2026-02-10 05:07:02,375 - INFO - Using existing project ['default-domain', 'k8s-default'](91d8509e-5b46-41e5-a31b-15e4017a3175) 2026-02-10 05:07:02,391 - DEBUG - Namespace ctest-new-default-11764349 not present 2026-02-10 05:07:02,402 - INFO - Created namespace ctest-new-default-11764349 2026-02-10 05:07:05,407 - DEBUG - Namespace ctest-non-default-57823570 not present 2026-02-10 05:07:05,422 - INFO - Created namespace ctest-non-default-57823570 2026-02-10 05:07:08,436 - DEBUG - Pod ctest-pod-88746805 not present 2026-02-10 05:07:08,437 - INFO - Creating Pod ctest-pod-88746805 2026-02-10 05:07:08,461 - DEBUG - Pod : ctest-pod-88746805 UUID is 45ab102a-ffa8-4f06-93a3-d40fc6d8699e 2026-02-10 05:07:08,466 - DEBUG - Pod ctest-pod-80932889 not present 2026-02-10 05:07:08,469 - INFO - Creating Pod ctest-pod-80932889 2026-02-10 05:07:08,496 - DEBUG - Pod : ctest-pod-80932889 UUID is 28842d70-19f8-4b44-80e1-58f0cd74273c 2026-02-10 05:07:08,497 - DEBUG - Pod ctest-pod-35251736 not present 2026-02-10 05:07:08,498 - INFO - Creating Pod ctest-pod-35251736 2026-02-10 05:07:08,545 - DEBUG - Pod : ctest-pod-35251736 UUID is ca090f07-8b68-44ab-97d7-159144afa643 2026-02-10 05:07:08,547 - DEBUG - Pod ctest-pod-33793348 not present 2026-02-10 05:07:08,547 - INFO - Creating Pod ctest-pod-33793348 2026-02-10 05:07:08,572 - DEBUG - Pod : ctest-pod-33793348 UUID is c13e5b77-2057-490b-a8b9-b168b5549b29 2026-02-10 05:07:08,574 - DEBUG - Pod ctest-pod-77966173 not present 2026-02-10 05:07:08,574 - INFO - Creating Pod ctest-pod-77966173 2026-02-10 05:07:08,588 - DEBUG - Pod : ctest-pod-77966173 UUID is 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 2026-02-10 05:07:08,594 - DEBUG - Pod ctest-pod-29976555 not present 2026-02-10 05:07:08,594 - INFO - Creating Pod ctest-pod-29976555 2026-02-10 05:07:08,616 - DEBUG - Pod : ctest-pod-29976555 UUID is fa3d9316-c6bc-4406-8dcc-890c8d52e50a 2026-02-10 05:07:08,617 - DEBUG - Pod ctest-pod-99482933 not present 2026-02-10 05:07:08,618 - INFO - Creating Pod ctest-pod-99482933 2026-02-10 05:07:08,636 - DEBUG - Pod : ctest-pod-99482933 UUID is 9aab6f3b-b2d6-417b-8e9b-704e106b798f 2026-02-10 05:07:08,637 - DEBUG - Pod ctest-pod-39240259 not present 2026-02-10 05:07:08,638 - INFO - Creating Pod ctest-pod-39240259 2026-02-10 05:07:08,657 - DEBUG - Pod : ctest-pod-39240259 UUID is ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e 2026-02-10 05:07:08,803 - INFO - Project default-domain:k8s-ctest-new-default-11764349 for Namespace ctest-new-default-11764349 is seen in contrail-api 2026-02-10 05:07:08,803 - DEBUG - Project uuid in Contrail is 26e8e691-9038-4a66-87bf-587b1a7889cb 2026-02-10 05:07:08,940 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=5b016224-9aa6-4ae7-8b9c-df7adf93db03 2026-02-10 05:07:08,947 - INFO - Namespace ctest-new-default-11764349 with uuid 5b016224-9aa6-4ae7-8b9c-df7adf93db03 found in kube manager 2026-02-10 05:07:08,947 - INFO - Namespace ctest-new-default-11764349 verification passed 2026-02-10 05:07:09,210 - INFO - Project default-domain:k8s-ctest-non-default-57823570 for Namespace ctest-non-default-57823570 is seen in contrail-api 2026-02-10 05:07:09,210 - DEBUG - Project uuid in Contrail is b2c4407e-1022-41b3-a3d5-14c31dc269e2 2026-02-10 05:07:09,210 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=d1fe39eb-1483-43c3-9104-a705259ffb22 2026-02-10 05:07:09,221 - INFO - Namespace ctest-non-default-57823570 with uuid d1fe39eb-1483-43c3-9104-a705259ffb22 found in kube manager 2026-02-10 05:07:09,221 - INFO - Namespace ctest-non-default-57823570 verification passed 2026-02-10 05:07:09,229 - DEBUG - Pod ctest-pod-88746805 not in running state.Currently in Pending 2026-02-10 05:07:14,267 - DEBUG - Pod ctest-pod-88746805 not in running state.Currently in Pending 2026-02-10 05:07:19,339 - DEBUG - Pod ctest-pod-88746805 not in running state.Currently in Pending 2026-02-10 05:07:24,346 - INFO - Pod ctest-pod-88746805 is in running state.Got IP 10.47.255.251 2026-02-10 05:07:24,358 - DEBUG - Pod ctest-pod-88746805 has vmi 5a7096e4-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:24,359 - INFO - Verified pod ctest-pod-88746805 in contrail-api 2026-02-10 05:07:24,377 - DEBUG - VMI 5a7096e4-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:24,377 - INFO - Verified Pod ctest-pod-88746805 in agent 10.0.0.41 2026-02-10 05:07:24,378 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=45ab102a-ffa8-4f06-93a3-d40fc6d8699e 2026-02-10 05:07:24,382 - INFO - Pod ctest-pod-88746805 with uuid 45ab102a-ffa8-4f06-93a3-d40fc6d8699e found in kube manager 2026-02-10 05:07:24,383 - INFO - Pod ctest-pod-88746805 verification passed 2026-02-10 05:07:24,392 - INFO - Pod ctest-pod-80932889 is in running state.Got IP 10.47.255.250 2026-02-10 05:07:24,448 - DEBUG - Pod ctest-pod-80932889 has vmi 5ae91510-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:24,449 - INFO - Verified pod ctest-pod-80932889 in contrail-api 2026-02-10 05:07:24,461 - DEBUG - VMI 5ae91510-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:24,461 - INFO - Verified Pod ctest-pod-80932889 in agent 10.0.0.41 2026-02-10 05:07:24,461 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=28842d70-19f8-4b44-80e1-58f0cd74273c 2026-02-10 05:07:24,465 - INFO - Pod ctest-pod-80932889 with uuid 28842d70-19f8-4b44-80e1-58f0cd74273c found in kube manager 2026-02-10 05:07:24,466 - INFO - Pod ctest-pod-80932889 verification passed 2026-02-10 05:07:24,471 - INFO - Pod ctest-pod-35251736 is in running state.Got IP 10.47.255.249 2026-02-10 05:07:24,481 - DEBUG - Pod ctest-pod-35251736 has vmi 5b7bc1ee-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:24,481 - INFO - Verified pod ctest-pod-35251736 in contrail-api 2026-02-10 05:07:24,493 - DEBUG - VMI 5b7bc1ee-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:24,493 - INFO - Verified Pod ctest-pod-35251736 in agent 10.0.0.41 2026-02-10 05:07:24,493 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ca090f07-8b68-44ab-97d7-159144afa643 2026-02-10 05:07:24,496 - INFO - Pod ctest-pod-35251736 with uuid ca090f07-8b68-44ab-97d7-159144afa643 found in kube manager 2026-02-10 05:07:24,496 - INFO - Pod ctest-pod-35251736 verification passed 2026-02-10 05:07:24,502 - INFO - Pod ctest-pod-33793348 is in running state.Got IP 10.47.255.248 2026-02-10 05:07:24,560 - DEBUG - Pod ctest-pod-33793348 has vmi 5befc954-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:24,560 - INFO - Verified pod ctest-pod-33793348 in contrail-api 2026-02-10 05:07:24,572 - DEBUG - VMI 5befc954-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:24,572 - INFO - Verified Pod ctest-pod-33793348 in agent 10.0.0.41 2026-02-10 05:07:24,572 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=c13e5b77-2057-490b-a8b9-b168b5549b29 2026-02-10 05:07:24,575 - INFO - Pod ctest-pod-33793348 with uuid c13e5b77-2057-490b-a8b9-b168b5549b29 found in kube manager 2026-02-10 05:07:24,575 - INFO - Pod ctest-pod-33793348 verification passed 2026-02-10 05:07:24,581 - DEBUG - Pod ctest-pod-77966173 not in running state.Currently in Pending 2026-02-10 05:07:29,588 - INFO - Pod ctest-pod-77966173 is in running state.Got IP 10.47.255.247 2026-02-10 05:07:29,599 - DEBUG - Pod ctest-pod-77966173 has vmi 5c89d9a4-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:29,599 - INFO - Verified pod ctest-pod-77966173 in contrail-api 2026-02-10 05:07:29,611 - DEBUG - VMI 5c89d9a4-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:29,611 - INFO - Verified Pod ctest-pod-77966173 in agent 10.0.0.41 2026-02-10 05:07:29,611 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 2026-02-10 05:07:29,615 - INFO - Pod ctest-pod-77966173 with uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 found in kube manager 2026-02-10 05:07:29,615 - INFO - Pod ctest-pod-77966173 verification passed 2026-02-10 05:07:29,621 - INFO - Pod ctest-pod-99482933 is in running state.Got IP 10.47.255.245 2026-02-10 05:07:29,676 - DEBUG - Pod ctest-pod-99482933 has vmi 5deec2a0-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:29,677 - INFO - Verified pod ctest-pod-99482933 in contrail-api 2026-02-10 05:07:29,688 - DEBUG - VMI 5deec2a0-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:29,688 - INFO - Verified Pod ctest-pod-99482933 in agent 10.0.0.41 2026-02-10 05:07:29,688 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=9aab6f3b-b2d6-417b-8e9b-704e106b798f 2026-02-10 05:07:29,691 - INFO - Pod ctest-pod-99482933 with uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f found in kube manager 2026-02-10 05:07:29,691 - INFO - Pod ctest-pod-99482933 verification passed 2026-02-10 05:07:29,697 - INFO - Pod ctest-pod-29976555 is in running state.Got IP 10.47.255.246 2026-02-10 05:07:29,709 - DEBUG - Pod ctest-pod-29976555 has vmi 5d46c73a-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:29,709 - INFO - Verified pod ctest-pod-29976555 in contrail-api 2026-02-10 05:07:29,720 - DEBUG - VMI 5d46c73a-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:29,720 - INFO - Verified Pod ctest-pod-29976555 in agent 10.0.0.41 2026-02-10 05:07:29,720 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=fa3d9316-c6bc-4406-8dcc-890c8d52e50a 2026-02-10 05:07:29,724 - INFO - Pod ctest-pod-29976555 with uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a found in kube manager 2026-02-10 05:07:29,724 - INFO - Pod ctest-pod-29976555 verification passed 2026-02-10 05:07:29,731 - INFO - Pod ctest-pod-39240259 is in running state.Got IP 10.47.255.244 2026-02-10 05:07:29,791 - DEBUG - Pod ctest-pod-39240259 has vmi 5e531444-063e-11f1-a60a-fa163edfe273 2026-02-10 05:07:29,791 - INFO - Verified pod ctest-pod-39240259 in contrail-api 2026-02-10 05:07:29,802 - DEBUG - VMI 5e531444-063e-11f1-a60a-fa163edfe273 is active in agent 10.0.0.41 2026-02-10 05:07:29,802 - INFO - Verified Pod ctest-pod-39240259 in agent 10.0.0.41 2026-02-10 05:07:29,802 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e 2026-02-10 05:07:29,806 - INFO - Pod ctest-pod-39240259 with uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e found in kube manager 2026-02-10 05:07:29,806 - INFO - Pod ctest-pod-39240259 verification passed 2026-02-10 05:07:29,806 - INFO - ================================================================================ 2026-02-10 05:07:29,806 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-02-10 05:07:29,806 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-02-10 05:07:30,033 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.33': '0'}} with 2026-02-10 05:07:30,033 - INFO - Initial checks done. Running the testcase now 2026-02-10 05:07:30,033 - INFO - 2026-02-10 05:07:30,094 - DEBUG - [Pod ctest-pod-88746805] Cmd: echo ctest-pod-88746805 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:07:30,145 - DEBUG - [Pod ctest-pod-80932889] Cmd: echo ctest-pod-80932889 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:07:30,197 - DEBUG - [Pod ctest-pod-35251736] Cmd: echo ctest-pod-35251736 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:07:30,253 - DEBUG - [Pod ctest-pod-33793348] Cmd: echo ctest-pod-33793348 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:07:30,256 - DEBUG - Service ctest-nginx-svc-27960042 not present 2026-02-10 05:07:30,256 - INFO - Creating service ctest-nginx-svc-27960042 2026-02-10 05:07:30,272 - INFO - Created Service ctest-nginx-svc-27960042 2026-02-10 05:07:30,279 - WARNING - Service UUID 3909e0ac-c8d4-4dce-b6be-466e90b74acb not yet found in contrail-api 2026-02-10 05:07:31,285 - INFO - Validated that Service ctest-nginx-svc-27960042 is seen in contrail-api 2026-02-10 05:07:31,285 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=3909e0ac-c8d4-4dce-b6be-466e90b74acb 2026-02-10 05:07:31,289 - INFO - Service ctest-nginx-svc-27960042 with uuid 3909e0ac-c8d4-4dce-b6be-466e90b74acb found in kube manager 2026-02-10 05:07:31,289 - INFO - Service ctest-nginx-svc-27960042 verification passed 2026-02-10 05:07:31,351 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,351 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:07:31,353 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,417 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-80932889 2026-02-10 05:07:31,417 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:07:31,417 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-80932889 2026-02-10 05:07:31,473 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,473 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:07:31,473 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,527 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-88746805 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,527 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:07:31,527 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: ctest-pod-88746805 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,527 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88746805': 1, 'ctest-pod-80932889': 3} 2026-02-10 05:07:31,571 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-88746805 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,571 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:07:31,571 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: ctest-pod-88746805 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,632 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,632 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:07:31,632 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:07:31,632 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88746805': 1, 'ctest-pod-80932889': 1} 2026-02-10 05:07:31,634 - DEBUG - Network policy ingress-on-service not present 2026-02-10 05:07:31,635 - INFO - Creating Network Policy ingress-on-service 2026-02-10 05:07:31,644 - INFO - Network policy found in k8s 2026-02-10 05:07:31,644 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=08b5a4fa-5b83-4399-b0dc-906ebc7c6ffb 2026-02-10 05:07:31,648 - INFO - Network Policy ingress-on-service with uuid 08b5a4fa-5b83-4399-b0dc-906ebc7c6ffb found in kube manager 2026-02-10 05:07:31,677 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-02-10 05:07:31,677 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-02-10 05:07:31,677 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=08b5a4fa-5b83-4399-b0dc-906ebc7c6ffb 2026-02-10 05:07:31,700 - WARNING - Network policy with name ingress-on-service not found in agent 2026-02-10 05:07:33,701 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=08b5a4fa-5b83-4399-b0dc-906ebc7c6ffb 2026-02-10 05:07:33,724 - INFO - Network policy with name ingress-on-service found in agent 2026-02-10 05:07:33,725 - INFO - Network Policy ingress-on-service verification passed 2026-02-10 05:07:38,775 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:38,775 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:38,775 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:43,826 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:43,826 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:43,826 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:48,883 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:48,883 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:48,883 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:53,946 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:53,946 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:53,946 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:58,998 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:58,998 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:07:58,998 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:04,050 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:04,050 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:04,050 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:09,103 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:09,103 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:09,103 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:14,163 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:14,163 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:14,163 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:19,210 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:19,210 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:19,210 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:24,261 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:24,261 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:24,261 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:24,261 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88746805': 0, 'ctest-pod-80932889': 0} 2026-02-10 05:08:24,327 - DEBUG - [Pod ctest-pod-29976555] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-88746805 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:08:24,327 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:08:24,327 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd output: ctest-pod-88746805 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:08:24,381 - DEBUG - [Pod ctest-pod-29976555] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:08:24,381 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 passed 2026-02-10 05:08:24,381 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd output: ctest-pod-80932889 Connecting to 10.106.113.79:80 (10.106.113.79:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:08:24,381 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88746805': 1, 'ctest-pod-80932889': 1} 2026-02-10 05:08:29,431 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:29,431 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:29,431 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:34,482 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:34,482 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:34,482 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:39,538 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:39,538 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:39,538 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:44,590 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:44,590 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:44,590 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:49,639 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:49,639 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:49,639 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:54,695 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:54,695 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:54,695 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:59,746 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:59,746 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:08:59,746 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:04,796 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:04,796 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:04,796 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:09,846 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:09,846 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:09,846 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:14,910 - DEBUG - [Pod ctest-pod-99482933] Cmd: wget http://10.106.113.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:14,910 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd wget http://10.106.113.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:14,910 - DEBUG - [Pod Pod ctest-pod-99482933] Cmd output: Connecting to 10.106.113.79:80 (10.106.113.79:80) wget: download timed out 2026-02-10 05:09:14,910 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88746805': 0, 'ctest-pod-80932889': 0} 2026-02-10 05:09:16,958 - DEBUG - [Pod ctest-pod-29976555] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.634 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.261/0.634 ms 2026-02-10 05:09:16,958 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29976555 with expectation True passed 2026-02-10 05:09:19,010 - DEBUG - [Pod ctest-pod-77966173] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.721 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.291/0.721 ms 2026-02-10 05:09:19,010 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77966173 with expectation True passed 2026-02-10 05:09:21,064 - DEBUG - [Pod ctest-pod-99482933] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.989 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.388/0.989 ms 2026-02-10 05:09:21,064 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99482933 with expectation True passed 2026-02-10 05:09:21,119 - DEBUG - [Pod ctest-pod-29976555] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:21,120 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:21,120 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:21,120 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29976555 passed 2026-02-10 05:09:21,171 - DEBUG - [Pod ctest-pod-29976555] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:21,171 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:21,171 - DEBUG - [Pod Pod ctest-pod-29976555] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:21,171 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29976555 passed 2026-02-10 05:09:21,229 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:21,229 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:21,229 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:21,229 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:23,285 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:23,285 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:23,285 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:23,285 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:25,342 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:25,342 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:25,342 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:25,342 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:27,400 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:27,400 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:27,400 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:27,400 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:29,455 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:29,456 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:29,456 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:29,456 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:31,519 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:31,519 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:31,519 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:31,519 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:33,567 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:33,568 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:33,568 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:33,568 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:35,631 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:35,631 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:35,631 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:35,631 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:37,683 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:37,683 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:37,683 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:37,683 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:39,732 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:39,732 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:39,732 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:39,732 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:41,782 - DEBUG - [Pod ctest-pod-77966173] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:41,783 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:09:41,783 - DEBUG - [Pod Pod ctest-pod-77966173] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:09:41,783 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-77966173 failed 2026-02-10 05:09:41,788 - INFO - Deleting Network Policy : ingress-on-service 2026-02-10 05:09:41,789 - INFO - Deleting service : ctest-nginx-svc-27960042 2026-02-10 05:09:42,036 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Tue Feb 10 05:09:41 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1) 2860 assert self.validate_wget(self.client2_pod_ns1, url2) 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False) 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7f1ae3e7caf0>> self.client1_pod_ns1 = url2 = 'http://10.47.255.250' expectation undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) AssertionError 2026-02-10 05:09:42,043 - DEBUG - No XMPP flaps were noticed during the test 2026-02-10 05:09:42,043 - INFO -
2026-02-10 05:09:42,043 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:13]
2026-02-10 05:09:42,043 - INFO - -------------------------------------------------------------------------------- 2026-02-10 05:09:42,047 - INFO - Deleting pod ctest-new-default-11764349:ctest-pod-88746805 2026-02-10 05:09:42,047 - INFO - Deleting pod ctest-new-default-11764349:ctest-pod-80932889 2026-02-10 05:09:42,047 - INFO - Deleting pod ctest-non-default-57823570:ctest-pod-35251736 2026-02-10 05:09:42,048 - INFO - Deleting pod ctest-non-default-57823570:ctest-pod-33793348 2026-02-10 05:09:42,049 - INFO - Deleting pod ctest-new-default-11764349:ctest-pod-77966173 2026-02-10 05:09:42,049 - INFO - Deleting pod ctest-new-default-11764349:ctest-pod-29976555 2026-02-10 05:09:42,049 - INFO - Deleting pod ctest-non-default-57823570:ctest-pod-99482933 2026-02-10 05:09:42,052 - INFO - Deleting pod ctest-non-default-57823570:ctest-pod-39240259 2026-02-10 05:09:42,198 - WARNING - Pod uuid 28842d70-19f8-4b44-80e1-58f0cd74273c is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,200 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,200 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,201 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,201 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,201 - WARNING - Pod uuid ca090f07-8b68-44ab-97d7-159144afa643 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,201 - WARNING - Pod uuid c13e5b77-2057-490b-a8b9-b168b5549b29 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:42,202 - WARNING - Pod uuid 45ab102a-ffa8-4f06-93a3-d40fc6d8699e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:47,227 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:47,228 - DEBUG - Pod c13e5b77-2057-490b-a8b9-b168b5549b29 is not in agent 10.0.0.41 VM list 2026-02-10 05:09:47,229 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:47,230 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:47,230 - DEBUG - Pod 45ab102a-ffa8-4f06-93a3-d40fc6d8699e is not in agent 10.0.0.41 VM list 2026-02-10 05:09:47,231 - DEBUG - Pod ca090f07-8b68-44ab-97d7-159144afa643 is not in agent 10.0.0.41 VM list 2026-02-10 05:09:47,232 - DEBUG - Pod 28842d70-19f8-4b44-80e1-58f0cd74273c is not in agent 10.0.0.41 VM list 2026-02-10 05:09:47,232 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:47,241 - DEBUG - VMI 5befc954-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:09:47,241 - INFO - Verified that pod ctest-pod-33793348 is removed in agent 2026-02-10 05:09:47,243 - DEBUG - VMI 5b7bc1ee-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:09:47,243 - INFO - Verified that pod ctest-pod-35251736 is removed in agent 2026-02-10 05:09:47,243 - DEBUG - VMI 5a7096e4-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:09:47,243 - INFO - Verified that pod ctest-pod-88746805 is removed in agent 2026-02-10 05:09:47,244 - DEBUG - VMI 5ae91510-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:09:47,244 - INFO - Verified that pod ctest-pod-80932889 is removed in agent 2026-02-10 05:09:52,247 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:52,248 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:52,248 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:52,249 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:57,261 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:57,263 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:57,263 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:09:57,263 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:02,278 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:02,278 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:02,279 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:02,279 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:07,296 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:07,296 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:07,297 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:07,297 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:12,314 - WARNING - Pod uuid fa3d9316-c6bc-4406-8dcc-890c8d52e50a is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:12,317 - WARNING - Pod uuid ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:12,319 - WARNING - Pod uuid 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:12,319 - WARNING - Pod uuid 9aab6f3b-b2d6-417b-8e9b-704e106b798f is still seen in agent 10.0.0.41 VM list 2026-02-10 05:10:17,323 - DEBUG - Pod fa3d9316-c6bc-4406-8dcc-890c8d52e50a is not in agent 10.0.0.41 VM list 2026-02-10 05:10:17,331 - DEBUG - Pod 9aab6f3b-b2d6-417b-8e9b-704e106b798f is not in agent 10.0.0.41 VM list 2026-02-10 05:10:17,333 - DEBUG - Pod 303dbbb5-e606-4cbd-81ef-fd3a4ec3be27 is not in agent 10.0.0.41 VM list 2026-02-10 05:10:17,334 - DEBUG - VMI 5d46c73a-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:10:17,334 - INFO - Verified that pod ctest-pod-29976555 is removed in agent 2026-02-10 05:10:17,335 - DEBUG - Pod ab8e0ff8-72b7-4ea3-b8f7-9c804bd6676e is not in agent 10.0.0.41 VM list 2026-02-10 05:10:17,342 - DEBUG - VMI 5deec2a0-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:10:17,342 - INFO - Verified that pod ctest-pod-99482933 is removed in agent 2026-02-10 05:10:17,344 - DEBUG - VMI 5c89d9a4-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:10:17,344 - INFO - Verified that pod ctest-pod-77966173 is removed in agent 2026-02-10 05:10:17,344 - DEBUG - VMI 5e531444-063e-11f1-a60a-fa163edfe273 is removed from agent 10.0.0.41 2026-02-10 05:10:17,344 - INFO - Verified that pod ctest-pod-39240259 is removed in agent 2026-02-10 05:10:17,344 - INFO - Deleting namespace ctest-non-default-57823570 2026-02-10 05:10:17,360 - DEBUG - Namespace ctest-non-default-57823570 still in k8s 2026-02-10 05:10:19,364 - DEBUG - Namespace ctest-non-default-57823570 still in k8s 2026-02-10 05:10:21,369 - DEBUG - Namespace ctest-non-default-57823570 still in k8s 2026-02-10 05:10:23,372 - DEBUG - Namespace ctest-non-default-57823570 is not in k8s 2026-02-10 05:10:23,372 - DEBUG - No need to check project deletion in contrail-api 2026-02-10 05:10:23,372 - INFO - Deleting namespace ctest-new-default-11764349 2026-02-10 05:10:23,390 - DEBUG - Namespace ctest-new-default-11764349 still in k8s 2026-02-10 05:10:25,395 - DEBUG - Namespace ctest-new-default-11764349 still in k8s 2026-02-10 05:10:27,399 - DEBUG - Namespace ctest-new-default-11764349 still in k8s 2026-02-10 05:10:29,403 - DEBUG - Namespace ctest-new-default-11764349 is not in k8s 2026-02-10 05:10:29,403 - DEBUG - No need to check project deletion in contrail-api