2026-02-09 21:43:05,668 - INFO - Using existing project ['default-domain', 'k8s-default'](f182fa60-7a17-47f4-b96f-84c0c7fd5f2f) 2026-02-09 21:43:05,684 - DEBUG - Namespace ctest-new-default-70943624 not present 2026-02-09 21:43:05,693 - INFO - Created namespace ctest-new-default-70943624 2026-02-09 21:43:08,697 - DEBUG - Namespace ctest-non-default-90533515 not present 2026-02-09 21:43:08,704 - INFO - Created namespace ctest-non-default-90533515 2026-02-09 21:43:11,729 - DEBUG - Pod ctest-pod-56715999 not present 2026-02-09 21:43:11,730 - INFO - Creating Pod ctest-pod-56715999 2026-02-09 21:43:11,772 - DEBUG - Pod : ctest-pod-56715999 UUID is e5cabbeb-cab9-4529-9ab4-9fb32eb6b359 2026-02-09 21:43:11,775 - DEBUG - Pod ctest-pod-74405744 not present 2026-02-09 21:43:11,775 - INFO - Creating Pod ctest-pod-74405744 2026-02-09 21:43:11,819 - DEBUG - Pod : ctest-pod-74405744 UUID is c8ba30d3-39a3-4dcb-9033-f93837d7d0d6 2026-02-09 21:43:11,821 - DEBUG - Pod ctest-pod-16805162 not present 2026-02-09 21:43:11,822 - INFO - Creating Pod ctest-pod-16805162 2026-02-09 21:43:11,840 - DEBUG - Pod : ctest-pod-16805162 UUID is 05e75fbd-a6cd-461c-a1e9-dadc76e19fe5 2026-02-09 21:43:11,846 - DEBUG - Pod ctest-pod-52068315 not present 2026-02-09 21:43:11,846 - INFO - Creating Pod ctest-pod-52068315 2026-02-09 21:43:11,877 - DEBUG - Pod : ctest-pod-52068315 UUID is 1dd5e15d-6ac8-4377-aab2-e8f7b98110dd 2026-02-09 21:43:11,880 - DEBUG - Pod ctest-pod-28886276 not present 2026-02-09 21:43:11,880 - INFO - Creating Pod ctest-pod-28886276 2026-02-09 21:43:11,915 - DEBUG - Pod : ctest-pod-28886276 UUID is 7411a96f-86d6-4fe4-b290-e3b800ecaa3c 2026-02-09 21:43:11,917 - DEBUG - Pod ctest-pod-90595740 not present 2026-02-09 21:43:11,918 - INFO - Creating Pod ctest-pod-90595740 2026-02-09 21:43:11,935 - DEBUG - Pod : ctest-pod-90595740 UUID is 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 2026-02-09 21:43:11,937 - DEBUG - Pod ctest-pod-17962590 not present 2026-02-09 21:43:11,937 - INFO - Creating Pod ctest-pod-17962590 2026-02-09 21:43:11,953 - DEBUG - Pod : ctest-pod-17962590 UUID is 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 2026-02-09 21:43:11,954 - DEBUG - Pod ctest-pod-77315388 not present 2026-02-09 21:43:11,955 - INFO - Creating Pod ctest-pod-77315388 2026-02-09 21:43:11,978 - DEBUG - Pod : ctest-pod-77315388 UUID is fd40796a-d38e-4d9f-bc3f-5ef415477b38 2026-02-09 21:43:12,208 - INFO - Project default-domain:k8s-ctest-new-default-70943624 for Namespace ctest-new-default-70943624 is seen in contrail-api 2026-02-09 21:43:12,208 - DEBUG - Project uuid in Contrail is b249985f-0efb-4288-a508-a0ede0cf3c6a 2026-02-09 21:43:12,362 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_NamespaceDatabaseList?namespace_uuid=37dfa1a8-8d76-4828-a396-51fba2909d45 2026-02-09 21:43:12,366 - INFO - Namespace ctest-new-default-70943624 with uuid 37dfa1a8-8d76-4828-a396-51fba2909d45 found in kube manager 2026-02-09 21:43:12,368 - INFO - Namespace ctest-new-default-70943624 verification passed 2026-02-09 21:43:12,599 - INFO - Project default-domain:k8s-ctest-non-default-90533515 for Namespace ctest-non-default-90533515 is seen in contrail-api 2026-02-09 21:43:12,599 - DEBUG - Project uuid in Contrail is 3357a7d8-7c9e-4d48-9538-7914856ca664 2026-02-09 21:43:12,600 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_NamespaceDatabaseList?namespace_uuid=c1427d6c-d706-4b74-afac-0e95bd5ccf2e 2026-02-09 21:43:12,603 - INFO - Namespace ctest-non-default-90533515 with uuid c1427d6c-d706-4b74-afac-0e95bd5ccf2e found in kube manager 2026-02-09 21:43:12,603 - INFO - Namespace ctest-non-default-90533515 verification passed 2026-02-09 21:43:12,609 - DEBUG - Pod ctest-pod-56715999 not in running state.Currently in Pending 2026-02-09 21:43:17,617 - DEBUG - Pod ctest-pod-56715999 not in running state.Currently in Pending 2026-02-09 21:43:22,624 - DEBUG - Pod ctest-pod-56715999 not in running state.Currently in Pending 2026-02-09 21:43:27,630 - INFO - Pod ctest-pod-56715999 is in running state.Got IP 10.47.255.251 2026-02-09 21:43:27,641 - DEBUG - Pod ctest-pod-56715999 has vmi 55aa139e-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:27,641 - INFO - Verified pod ctest-pod-56715999 in contrail-api 2026-02-09 21:43:27,654 - DEBUG - VMI 55aa139e-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:27,654 - INFO - Verified Pod ctest-pod-56715999 in agent 10.0.0.129 2026-02-09 21:43:27,654 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=e5cabbeb-cab9-4529-9ab4-9fb32eb6b359 2026-02-09 21:43:27,657 - INFO - Pod ctest-pod-56715999 with uuid e5cabbeb-cab9-4529-9ab4-9fb32eb6b359 found in kube manager 2026-02-09 21:43:27,657 - INFO - Pod ctest-pod-56715999 verification passed 2026-02-09 21:43:27,662 - INFO - Pod ctest-pod-74405744 is in running state.Got IP 10.47.255.250 2026-02-09 21:43:27,671 - DEBUG - Pod ctest-pod-74405744 has vmi 56121c28-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:27,671 - INFO - Verified pod ctest-pod-74405744 in contrail-api 2026-02-09 21:43:27,684 - DEBUG - VMI 56121c28-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:27,684 - INFO - Verified Pod ctest-pod-74405744 in agent 10.0.0.129 2026-02-09 21:43:27,684 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=c8ba30d3-39a3-4dcb-9033-f93837d7d0d6 2026-02-09 21:43:27,687 - INFO - Pod ctest-pod-74405744 with uuid c8ba30d3-39a3-4dcb-9033-f93837d7d0d6 found in kube manager 2026-02-09 21:43:27,687 - INFO - Pod ctest-pod-74405744 verification passed 2026-02-09 21:43:27,693 - INFO - Pod ctest-pod-16805162 is in running state.Got IP 10.47.255.249 2026-02-09 21:43:27,743 - DEBUG - Pod ctest-pod-16805162 has vmi 56a78452-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:27,743 - INFO - Verified pod ctest-pod-16805162 in contrail-api 2026-02-09 21:43:27,754 - DEBUG - VMI 56a78452-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:27,754 - INFO - Verified Pod ctest-pod-16805162 in agent 10.0.0.129 2026-02-09 21:43:27,754 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=05e75fbd-a6cd-461c-a1e9-dadc76e19fe5 2026-02-09 21:43:27,757 - INFO - Pod ctest-pod-16805162 with uuid 05e75fbd-a6cd-461c-a1e9-dadc76e19fe5 found in kube manager 2026-02-09 21:43:27,757 - INFO - Pod ctest-pod-16805162 verification passed 2026-02-09 21:43:27,763 - INFO - Pod ctest-pod-52068315 is in running state.Got IP 10.47.255.248 2026-02-09 21:43:27,772 - DEBUG - Pod ctest-pod-52068315 has vmi 57196ec8-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:27,773 - INFO - Verified pod ctest-pod-52068315 in contrail-api 2026-02-09 21:43:27,783 - DEBUG - VMI 57196ec8-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:27,783 - INFO - Verified Pod ctest-pod-52068315 in agent 10.0.0.129 2026-02-09 21:43:27,784 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=1dd5e15d-6ac8-4377-aab2-e8f7b98110dd 2026-02-09 21:43:27,786 - INFO - Pod ctest-pod-52068315 with uuid 1dd5e15d-6ac8-4377-aab2-e8f7b98110dd found in kube manager 2026-02-09 21:43:27,787 - INFO - Pod ctest-pod-52068315 verification passed 2026-02-09 21:43:27,792 - DEBUG - Pod ctest-pod-28886276 not in running state.Currently in Pending 2026-02-09 21:43:32,799 - INFO - Pod ctest-pod-28886276 is in running state.Got IP 10.47.255.247 2026-02-09 21:43:32,867 - DEBUG - Pod ctest-pod-28886276 has vmi 57953e68-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:32,868 - INFO - Verified pod ctest-pod-28886276 in contrail-api 2026-02-09 21:43:32,880 - DEBUG - VMI 57953e68-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:32,880 - INFO - Verified Pod ctest-pod-28886276 in agent 10.0.0.129 2026-02-09 21:43:32,880 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=7411a96f-86d6-4fe4-b290-e3b800ecaa3c 2026-02-09 21:43:32,884 - INFO - Pod ctest-pod-28886276 with uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c found in kube manager 2026-02-09 21:43:32,884 - INFO - Pod ctest-pod-28886276 verification passed 2026-02-09 21:43:32,891 - INFO - Pod ctest-pod-17962590 is in running state.Got IP 10.47.255.245 2026-02-09 21:43:32,927 - DEBUG - Pod ctest-pod-17962590 has vmi 589f9a10-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:32,927 - INFO - Verified pod ctest-pod-17962590 in contrail-api 2026-02-09 21:43:32,938 - DEBUG - VMI 589f9a10-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:32,939 - INFO - Verified Pod ctest-pod-17962590 in agent 10.0.0.129 2026-02-09 21:43:32,939 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 2026-02-09 21:43:32,948 - INFO - Pod ctest-pod-17962590 with uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 found in kube manager 2026-02-09 21:43:32,948 - INFO - Pod ctest-pod-17962590 verification passed 2026-02-09 21:43:32,959 - INFO - Pod ctest-pod-90595740 is in running state.Got IP 10.47.255.246 2026-02-09 21:43:33,015 - DEBUG - Pod ctest-pod-90595740 has vmi 580305ce-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:33,015 - INFO - Verified pod ctest-pod-90595740 in contrail-api 2026-02-09 21:43:33,026 - DEBUG - VMI 580305ce-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:33,027 - INFO - Verified Pod ctest-pod-90595740 in agent 10.0.0.129 2026-02-09 21:43:33,027 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=0c3a635b-1f4f-4e55-b4f4-0195adaf7794 2026-02-09 21:43:33,032 - INFO - Pod ctest-pod-90595740 with uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 found in kube manager 2026-02-09 21:43:33,033 - INFO - Pod ctest-pod-90595740 verification passed 2026-02-09 21:43:33,040 - INFO - Pod ctest-pod-77315388 is in running state.Got IP 10.47.255.244 2026-02-09 21:43:33,095 - DEBUG - Pod ctest-pod-77315388 has vmi 5907fff6-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:33,096 - INFO - Verified pod ctest-pod-77315388 in contrail-api 2026-02-09 21:43:33,106 - DEBUG - VMI 5907fff6-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:43:33,106 - INFO - Verified Pod ctest-pod-77315388 in agent 10.0.0.129 2026-02-09 21:43:33,106 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=fd40796a-d38e-4d9f-bc3f-5ef415477b38 2026-02-09 21:43:33,110 - INFO - Pod ctest-pod-77315388 with uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 found in kube manager 2026-02-09 21:43:33,110 - INFO - Pod ctest-pod-77315388 verification passed 2026-02-09 21:43:33,110 - INFO - ================================================================================ 2026-02-09 21:43:33,110 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-02-09 21:43:33,110 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-02-09 21:43:33,277 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.0.0.242': '0'}} with 2026-02-09 21:43:33,277 - INFO - Initial checks done. Running the testcase now 2026-02-09 21:43:33,277 - INFO - 2026-02-09 21:43:33,328 - DEBUG - [Pod ctest-pod-56715999] Cmd: echo ctest-pod-56715999 > /usr/share/nginx/html/index.html, Output: 2026-02-09 21:43:33,378 - DEBUG - [Pod ctest-pod-74405744] Cmd: echo ctest-pod-74405744 > /usr/share/nginx/html/index.html, Output: 2026-02-09 21:43:33,428 - DEBUG - [Pod ctest-pod-16805162] Cmd: echo ctest-pod-16805162 > /usr/share/nginx/html/index.html, Output: 2026-02-09 21:43:33,484 - DEBUG - [Pod ctest-pod-52068315] Cmd: echo ctest-pod-52068315 > /usr/share/nginx/html/index.html, Output: 2026-02-09 21:43:33,487 - DEBUG - Service ctest-nginx-svc-34687185 not present 2026-02-09 21:43:33,487 - INFO - Creating service ctest-nginx-svc-34687185 2026-02-09 21:43:33,512 - INFO - Created Service ctest-nginx-svc-34687185 2026-02-09 21:43:33,526 - WARNING - Service UUID d92befad-f65c-47a4-9ce7-3854e5973ca6 not yet found in contrail-api 2026-02-09 21:43:34,539 - INFO - Validated that Service ctest-nginx-svc-34687185 is seen in contrail-api 2026-02-09 21:43:34,540 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_LoadbalancerDatabaseList?x=d92befad-f65c-47a4-9ce7-3854e5973ca6 2026-02-09 21:43:34,549 - INFO - Service ctest-nginx-svc-34687185 with uuid d92befad-f65c-47a4-9ce7-3854e5973ca6 found in kube manager 2026-02-09 21:43:34,549 - INFO - Service ctest-nginx-svc-34687185 verification passed 2026-02-09 21:43:35,625 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56715999 2026-02-09 21:43:35,625 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:43:35,625 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56715999 2026-02-09 21:43:35,681 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-74405744 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:43:35,695 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:43:35,695 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: ctest-pod-74405744 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:43:35,695 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56715999': 1, 'ctest-pod-74405744': 1} 2026-02-09 21:43:35,751 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-74405744 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:43:35,752 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:43:35,753 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: ctest-pod-74405744 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:43:35,802 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56715999 2026-02-09 21:43:35,819 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:43:35,819 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56715999 2026-02-09 21:43:35,819 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56715999': 1, 'ctest-pod-74405744': 1} 2026-02-09 21:43:35,825 - DEBUG - Network policy ingress-on-service not present 2026-02-09 21:43:35,826 - INFO - Creating Network Policy ingress-on-service 2026-02-09 21:43:35,865 - INFO - Network policy found in k8s 2026-02-09 21:43:35,865 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1c0d0d11-1c57-44cb-bf23-4d00a659506c 2026-02-09 21:43:35,882 - INFO - Network Policy ingress-on-service with uuid 1c0d0d11-1c57-44cb-bf23-4d00a659506c found in kube manager 2026-02-09 21:43:35,922 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-02-09 21:43:35,922 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-02-09 21:43:35,922 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1c0d0d11-1c57-44cb-bf23-4d00a659506c 2026-02-09 21:43:35,951 - WARNING - Network policy with name ingress-on-service not found in agent 2026-02-09 21:43:37,952 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1c0d0d11-1c57-44cb-bf23-4d00a659506c 2026-02-09 21:43:37,975 - INFO - Network policy with name ingress-on-service found in agent 2026-02-09 21:43:37,976 - INFO - Network Policy ingress-on-service verification passed 2026-02-09 21:43:43,025 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:43,025 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:43,025 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:48,078 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:48,078 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:48,078 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:53,145 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:53,145 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:53,145 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:58,196 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:58,196 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:43:58,196 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:03,252 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:03,253 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:03,253 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:08,297 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:08,297 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:08,297 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:13,349 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:13,349 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:13,349 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:18,392 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:18,392 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:18,392 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:23,441 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:23,441 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:23,441 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:28,488 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:28,488 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:28,488 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:28,488 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56715999': 0, 'ctest-pod-74405744': 0} 2026-02-09 21:44:28,541 - DEBUG - [Pod ctest-pod-90595740] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-74405744 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:44:28,541 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:44:28,541 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd output: ctest-pod-74405744 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:44:28,587 - DEBUG - [Pod ctest-pod-90595740] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74405744 2026-02-09 21:44:28,587 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:44:28,587 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74405744 2026-02-09 21:44:28,639 - DEBUG - [Pod ctest-pod-90595740] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-56715999 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:44:28,639 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 passed 2026-02-09 21:44:28,639 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd output: ctest-pod-56715999 Connecting to 10.106.15.58:80 (10.106.15.58:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 21:44:28,639 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56715999': 1, 'ctest-pod-74405744': 2} 2026-02-09 21:44:33,686 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:33,686 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:33,686 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:38,732 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:38,732 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:38,732 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:43,788 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:43,788 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:43,788 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:48,836 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:48,836 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:48,837 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:53,889 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:53,889 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:53,889 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:58,937 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:58,937 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:44:58,937 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:03,988 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:03,989 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:03,989 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:09,040 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:09,040 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:09,040 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:14,097 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:14,097 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:14,097 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:19,149 - DEBUG - [Pod ctest-pod-17962590] Cmd: wget http://10.106.15.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:19,149 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd wget http://10.106.15.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:19,149 - DEBUG - [Pod Pod ctest-pod-17962590] Cmd output: Connecting to 10.106.15.58:80 (10.106.15.58:80) wget: download timed out 2026-02-09 21:45:19,149 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56715999': 0, 'ctest-pod-74405744': 0} 2026-02-09 21:45:21,205 - DEBUG - [Pod ctest-pod-90595740] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.999 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.389/0.999 ms 2026-02-09 21:45:21,205 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-90595740 with expectation True passed 2026-02-09 21:45:23,256 - DEBUG - [Pod ctest-pod-28886276] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.563 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.242/0.563 ms 2026-02-09 21:45:23,256 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28886276 with expectation True passed 2026-02-09 21:45:25,305 - DEBUG - [Pod ctest-pod-17962590] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.033 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.398/1.033 ms 2026-02-09 21:45:25,305 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17962590 with expectation True passed 2026-02-09 21:45:25,361 - DEBUG - [Pod ctest-pod-90595740] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:25,361 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:25,361 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:25,361 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90595740 passed 2026-02-09 21:45:25,394 - DEBUG - [Pod ctest-pod-90595740] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:25,394 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:25,394 - DEBUG - [Pod Pod ctest-pod-90595740] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:25,394 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90595740 passed 2026-02-09 21:45:25,448 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:25,448 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:25,448 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:25,448 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:27,507 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:27,507 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:27,507 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:27,508 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:29,562 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:29,562 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:29,562 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:29,562 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:31,618 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:31,618 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:31,618 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:31,618 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:33,669 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:33,669 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:33,669 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:33,669 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:35,723 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:35,723 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:35,723 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:35,723 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:37,793 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:37,793 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:37,793 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:37,793 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:39,853 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:39,853 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:39,853 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:39,853 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:41,919 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:41,919 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:41,919 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:41,919 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:43,975 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:43,975 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:43,975 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:43,975 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:46,024 - DEBUG - [Pod ctest-pod-28886276] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:46,024 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 21:45:46,024 - DEBUG - [Pod Pod ctest-pod-28886276] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 21:45:46,024 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-28886276 failed 2026-02-09 21:45:46,029 - INFO - Deleting Network Policy : ingress-on-service 2026-02-09 21:45:46,029 - INFO - Deleting service : ctest-nginx-svc-34687185 2026-02-09 21:45:46,215 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Feb 9 21:45:46 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1) 2860 assert self.validate_wget(self.client2_pod_ns1, url2) 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False) 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7ff91a83eaf0>> self.client1_pod_ns1 = url2 = 'http://10.47.255.250' expectation undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) AssertionError 2026-02-09 21:45:46,222 - DEBUG - No XMPP flaps were noticed during the test 2026-02-09 21:45:46,222 - INFO -
2026-02-09 21:45:46,222 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:13]
2026-02-09 21:45:46,222 - INFO - -------------------------------------------------------------------------------- 2026-02-09 21:45:46,226 - INFO - Deleting pod ctest-new-default-70943624:ctest-pod-56715999 2026-02-09 21:45:46,227 - INFO - Deleting pod ctest-new-default-70943624:ctest-pod-74405744 2026-02-09 21:45:46,227 - INFO - Deleting pod ctest-non-default-90533515:ctest-pod-16805162 2026-02-09 21:45:46,228 - INFO - Deleting pod ctest-non-default-90533515:ctest-pod-52068315 2026-02-09 21:45:46,228 - INFO - Deleting pod ctest-new-default-70943624:ctest-pod-28886276 2026-02-09 21:45:46,228 - INFO - Deleting pod ctest-new-default-70943624:ctest-pod-90595740 2026-02-09 21:45:46,229 - INFO - Deleting pod ctest-non-default-90533515:ctest-pod-17962590 2026-02-09 21:45:46,229 - INFO - Deleting pod ctest-non-default-90533515:ctest-pod-77315388 2026-02-09 21:45:46,258 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,316 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,334 - WARNING - Pod uuid e5cabbeb-cab9-4529-9ab4-9fb32eb6b359 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,335 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,337 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,337 - WARNING - Pod uuid 1dd5e15d-6ac8-4377-aab2-e8f7b98110dd is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,339 - WARNING - Pod uuid c8ba30d3-39a3-4dcb-9033-f93837d7d0d6 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:46,340 - WARNING - Pod uuid 05e75fbd-a6cd-461c-a1e9-dadc76e19fe5 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:51,267 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:51,323 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:51,353 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:51,353 - DEBUG - Pod e5cabbeb-cab9-4529-9ab4-9fb32eb6b359 is not in agent 10.0.0.129 VM list 2026-02-09 21:45:51,356 - DEBUG - Pod 1dd5e15d-6ac8-4377-aab2-e8f7b98110dd is not in agent 10.0.0.129 VM list 2026-02-09 21:45:51,357 - DEBUG - Pod 05e75fbd-a6cd-461c-a1e9-dadc76e19fe5 is not in agent 10.0.0.129 VM list 2026-02-09 21:45:51,358 - DEBUG - Pod c8ba30d3-39a3-4dcb-9033-f93837d7d0d6 is not in agent 10.0.0.129 VM list 2026-02-09 21:45:51,359 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:51,371 - DEBUG - VMI 57196ec8-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:45:51,371 - INFO - Verified that pod ctest-pod-52068315 is removed in agent 2026-02-09 21:45:51,371 - DEBUG - VMI 55aa139e-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:45:51,371 - INFO - Verified that pod ctest-pod-56715999 is removed in agent 2026-02-09 21:45:51,373 - DEBUG - VMI 56121c28-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:45:51,373 - INFO - Verified that pod ctest-pod-74405744 is removed in agent 2026-02-09 21:45:51,373 - DEBUG - VMI 56a78452-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:45:51,373 - INFO - Verified that pod ctest-pod-16805162 is removed in agent 2026-02-09 21:45:56,273 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:56,329 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:56,360 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:45:56,365 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:01,279 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:01,337 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:01,369 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:01,373 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:06,286 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:06,345 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:06,376 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:06,378 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:11,292 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:11,351 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:11,384 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:11,385 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:16,301 - WARNING - Pod uuid fd40796a-d38e-4d9f-bc3f-5ef415477b38 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:16,360 - WARNING - Pod uuid 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:16,397 - WARNING - Pod uuid 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:16,398 - WARNING - Pod uuid 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:46:21,356 - DEBUG - Pod fd40796a-d38e-4d9f-bc3f-5ef415477b38 is not in agent 10.0.0.129 VM list 2026-02-09 21:46:21,361 - DEBUG - VMI 5907fff6-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:46:21,361 - INFO - Verified that pod ctest-pod-77315388 is removed in agent 2026-02-09 21:46:21,365 - DEBUG - Pod 90c00cac-c8ee-4788-b6f1-f6c64c84c2e8 is not in agent 10.0.0.129 VM list 2026-02-09 21:46:21,370 - DEBUG - VMI 589f9a10-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:46:21,371 - INFO - Verified that pod ctest-pod-17962590 is removed in agent 2026-02-09 21:46:21,455 - DEBUG - Pod 0c3a635b-1f4f-4e55-b4f4-0195adaf7794 is not in agent 10.0.0.129 VM list 2026-02-09 21:46:21,457 - DEBUG - Pod 7411a96f-86d6-4fe4-b290-e3b800ecaa3c is not in agent 10.0.0.129 VM list 2026-02-09 21:46:21,464 - DEBUG - VMI 580305ce-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:46:21,464 - INFO - Verified that pod ctest-pod-90595740 is removed in agent 2026-02-09 21:46:21,464 - DEBUG - VMI 57953e68-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:46:21,465 - INFO - Verified that pod ctest-pod-28886276 is removed in agent 2026-02-09 21:46:21,465 - INFO - Deleting namespace ctest-non-default-90533515 2026-02-09 21:46:21,474 - DEBUG - Namespace ctest-non-default-90533515 still in k8s 2026-02-09 21:46:23,478 - DEBUG - Namespace ctest-non-default-90533515 still in k8s 2026-02-09 21:46:25,482 - DEBUG - Namespace ctest-non-default-90533515 still in k8s 2026-02-09 21:46:27,486 - DEBUG - Namespace ctest-non-default-90533515 is not in k8s 2026-02-09 21:46:27,486 - DEBUG - No need to check project deletion in contrail-api 2026-02-09 21:46:27,486 - INFO - Deleting namespace ctest-new-default-70943624 2026-02-09 21:46:27,496 - DEBUG - Namespace ctest-new-default-70943624 still in k8s 2026-02-09 21:46:29,501 - DEBUG - Namespace ctest-new-default-70943624 still in k8s 2026-02-09 21:46:31,505 - DEBUG - Namespace ctest-new-default-70943624 still in k8s 2026-02-09 21:46:33,508 - DEBUG - Namespace ctest-new-default-70943624 is not in k8s 2026-02-09 21:46:33,508 - DEBUG - No need to check project deletion in contrail-api