2026-03-03 11:33:59,134 - INFO - Using existing project ['default-domain', 'k8s-default'](23e641c3-b280-48b7-83d1-4e7b9e746cc9) 2026-03-03 11:33:59,157 - DEBUG - Namespace ctest-new-default-49188810 not present 2026-03-03 11:33:59,168 - INFO - Created namespace ctest-new-default-49188810 2026-03-03 11:34:02,173 - DEBUG - Namespace ctest-non-default-81374882 not present 2026-03-03 11:34:02,179 - INFO - Created namespace ctest-non-default-81374882 2026-03-03 11:34:05,200 - DEBUG - Pod ctest-pod-68717305 not present 2026-03-03 11:34:05,200 - INFO - Creating Pod ctest-pod-68717305 2026-03-03 11:34:05,240 - DEBUG - Pod : ctest-pod-68717305 UUID is ff0d8f13-4cd2-4d0c-9a1c-8a3c7f856dd3 2026-03-03 11:34:05,245 - DEBUG - Pod ctest-pod-34330611 not present 2026-03-03 11:34:05,246 - INFO - Creating Pod ctest-pod-34330611 2026-03-03 11:34:05,277 - DEBUG - Pod : ctest-pod-34330611 UUID is 2e904a71-9511-465e-bb37-239579bd3d29 2026-03-03 11:34:05,284 - DEBUG - Pod ctest-pod-36662846 not present 2026-03-03 11:34:05,285 - INFO - Creating Pod ctest-pod-36662846 2026-03-03 11:34:05,314 - DEBUG - Pod : ctest-pod-36662846 UUID is 14f41dc2-876c-4d59-8fcd-81f71178e938 2026-03-03 11:34:05,318 - DEBUG - Pod ctest-pod-98505277 not present 2026-03-03 11:34:05,319 - INFO - Creating Pod ctest-pod-98505277 2026-03-03 11:34:05,349 - DEBUG - Pod : ctest-pod-98505277 UUID is cc17a627-0751-4bcf-9d05-ef8873379f11 2026-03-03 11:34:05,359 - DEBUG - Pod ctest-pod-14035474 not present 2026-03-03 11:34:05,360 - INFO - Creating Pod ctest-pod-14035474 2026-03-03 11:34:05,381 - DEBUG - Pod : ctest-pod-14035474 UUID is f020d540-75c8-4354-88a2-df1d302f69db 2026-03-03 11:34:05,388 - DEBUG - Pod ctest-pod-08465132 not present 2026-03-03 11:34:05,388 - INFO - Creating Pod ctest-pod-08465132 2026-03-03 11:34:05,428 - DEBUG - Pod : ctest-pod-08465132 UUID is 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e 2026-03-03 11:34:05,431 - DEBUG - Pod ctest-pod-45341364 not present 2026-03-03 11:34:05,432 - INFO - Creating Pod ctest-pod-45341364 2026-03-03 11:34:05,463 - DEBUG - Pod : ctest-pod-45341364 UUID is 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 2026-03-03 11:34:05,466 - DEBUG - Pod ctest-pod-95814314 not present 2026-03-03 11:34:05,466 - INFO - Creating Pod ctest-pod-95814314 2026-03-03 11:34:05,499 - DEBUG - Pod : ctest-pod-95814314 UUID is df3789b7-0003-4674-af96-7686127ba825 2026-03-03 11:34:05,817 - INFO - Project default-domain:k8s-ctest-new-default-49188810 for Namespace ctest-new-default-49188810 is seen in contrail-api 2026-03-03 11:34:05,817 - DEBUG - Project uuid in Contrail is b153e087-7248-412c-ab01-da0bb3be56fc 2026-03-03 11:34:06,105 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=cf7ec5e0-956f-44c6-aace-b9ca855d2121 2026-03-03 11:34:06,111 - INFO - Namespace ctest-new-default-49188810 with uuid cf7ec5e0-956f-44c6-aace-b9ca855d2121 found in kube manager 2026-03-03 11:34:06,111 - INFO - Namespace ctest-new-default-49188810 verification passed 2026-03-03 11:34:06,361 - INFO - Project default-domain:k8s-ctest-non-default-81374882 for Namespace ctest-non-default-81374882 is seen in contrail-api 2026-03-03 11:34:06,361 - DEBUG - Project uuid in Contrail is 5d2ad29a-f500-4229-94ba-d816583f3452 2026-03-03 11:34:06,361 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=6067f111-f58a-4b01-9d98-9e433816faa4 2026-03-03 11:34:06,365 - INFO - Namespace ctest-non-default-81374882 with uuid 6067f111-f58a-4b01-9d98-9e433816faa4 found in kube manager 2026-03-03 11:34:06,365 - INFO - Namespace ctest-non-default-81374882 verification passed 2026-03-03 11:34:06,412 - DEBUG - Pod ctest-pod-68717305 not in running state.Currently in Pending 2026-03-03 11:34:11,420 - DEBUG - Pod ctest-pod-68717305 not in running state.Currently in Pending 2026-03-03 11:34:16,428 - DEBUG - Pod ctest-pod-68717305 not in running state.Currently in Pending 2026-03-03 11:34:21,438 - INFO - Pod ctest-pod-68717305 is in running state.Got IP 10.47.255.250 2026-03-03 11:34:21,490 - DEBUG - Pod ctest-pod-68717305 has vmi e4657312-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:21,491 - INFO - Verified pod ctest-pod-68717305 in contrail-api 2026-03-03 11:34:21,501 - DEBUG - VMI e4657312-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:21,501 - INFO - Verified Pod ctest-pod-68717305 in agent 10.0.0.50 2026-03-03 11:34:21,502 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ff0d8f13-4cd2-4d0c-9a1c-8a3c7f856dd3 2026-03-03 11:34:21,505 - INFO - Pod ctest-pod-68717305 with uuid ff0d8f13-4cd2-4d0c-9a1c-8a3c7f856dd3 found in kube manager 2026-03-03 11:34:21,505 - INFO - Pod ctest-pod-68717305 verification passed 2026-03-03 11:34:21,511 - INFO - Pod ctest-pod-34330611 is in running state.Got IP 10.47.255.249 2026-03-03 11:34:21,603 - DEBUG - Pod ctest-pod-34330611 has vmi e5143adc-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:21,603 - INFO - Verified pod ctest-pod-34330611 in contrail-api 2026-03-03 11:34:21,612 - DEBUG - VMI e5143adc-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:21,612 - INFO - Verified Pod ctest-pod-34330611 in agent 10.0.0.50 2026-03-03 11:34:21,613 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=2e904a71-9511-465e-bb37-239579bd3d29 2026-03-03 11:34:21,616 - INFO - Pod ctest-pod-34330611 with uuid 2e904a71-9511-465e-bb37-239579bd3d29 found in kube manager 2026-03-03 11:34:21,616 - INFO - Pod ctest-pod-34330611 verification passed 2026-03-03 11:34:21,623 - INFO - Pod ctest-pod-36662846 is in running state.Got IP 10.47.255.248 2026-03-03 11:34:21,715 - DEBUG - Pod ctest-pod-36662846 has vmi e60f2d5c-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:21,715 - INFO - Verified pod ctest-pod-36662846 in contrail-api 2026-03-03 11:34:21,723 - DEBUG - VMI e60f2d5c-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:21,724 - INFO - Verified Pod ctest-pod-36662846 in agent 10.0.0.50 2026-03-03 11:34:21,724 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=14f41dc2-876c-4d59-8fcd-81f71178e938 2026-03-03 11:34:21,727 - INFO - Pod ctest-pod-36662846 with uuid 14f41dc2-876c-4d59-8fcd-81f71178e938 found in kube manager 2026-03-03 11:34:21,727 - INFO - Pod ctest-pod-36662846 verification passed 2026-03-03 11:34:21,733 - DEBUG - Pod ctest-pod-98505277 not in running state.Currently in Pending 2026-03-03 11:34:26,743 - INFO - Pod ctest-pod-98505277 is in running state.Got IP 10.47.255.247 2026-03-03 11:34:26,795 - DEBUG - Pod ctest-pod-98505277 has vmi e6bb25da-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:26,795 - INFO - Verified pod ctest-pod-98505277 in contrail-api 2026-03-03 11:34:26,807 - DEBUG - VMI e6bb25da-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:26,808 - INFO - Verified Pod ctest-pod-98505277 in agent 10.0.0.50 2026-03-03 11:34:26,808 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=cc17a627-0751-4bcf-9d05-ef8873379f11 2026-03-03 11:34:26,812 - INFO - Pod ctest-pod-98505277 with uuid cc17a627-0751-4bcf-9d05-ef8873379f11 found in kube manager 2026-03-03 11:34:26,812 - INFO - Pod ctest-pod-98505277 verification passed 2026-03-03 11:34:26,818 - INFO - Pod ctest-pod-14035474 is in running state.Got IP 10.47.255.246 2026-03-03 11:34:26,913 - DEBUG - Pod ctest-pod-14035474 has vmi e7b25bfc-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:26,914 - INFO - Verified pod ctest-pod-14035474 in contrail-api 2026-03-03 11:34:26,923 - DEBUG - VMI e7b25bfc-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:26,923 - INFO - Verified Pod ctest-pod-14035474 in agent 10.0.0.50 2026-03-03 11:34:26,923 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f020d540-75c8-4354-88a2-df1d302f69db 2026-03-03 11:34:26,927 - INFO - Pod ctest-pod-14035474 with uuid f020d540-75c8-4354-88a2-df1d302f69db found in kube manager 2026-03-03 11:34:26,927 - INFO - Pod ctest-pod-14035474 verification passed 2026-03-03 11:34:26,934 - INFO - Pod ctest-pod-45341364 is in running state.Got IP 10.47.255.244 2026-03-03 11:34:27,027 - DEBUG - Pod ctest-pod-45341364 has vmi e941a270-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:27,028 - INFO - Verified pod ctest-pod-45341364 in contrail-api 2026-03-03 11:34:27,036 - DEBUG - VMI e941a270-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:27,037 - INFO - Verified Pod ctest-pod-45341364 in agent 10.0.0.50 2026-03-03 11:34:27,037 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=66e24509-0e8e-466e-aa1d-1d6236b6e8b7 2026-03-03 11:34:27,040 - INFO - Pod ctest-pod-45341364 with uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 found in kube manager 2026-03-03 11:34:27,040 - INFO - Pod ctest-pod-45341364 verification passed 2026-03-03 11:34:27,046 - INFO - Pod ctest-pod-08465132 is in running state.Got IP 10.47.255.245 2026-03-03 11:34:27,138 - DEBUG - Pod ctest-pod-08465132 has vmi e87a55d0-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:27,139 - INFO - Verified pod ctest-pod-08465132 in contrail-api 2026-03-03 11:34:27,148 - DEBUG - VMI e87a55d0-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:27,148 - INFO - Verified Pod ctest-pod-08465132 in agent 10.0.0.50 2026-03-03 11:34:27,148 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e 2026-03-03 11:34:27,152 - INFO - Pod ctest-pod-08465132 with uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e found in kube manager 2026-03-03 11:34:27,152 - INFO - Pod ctest-pod-08465132 verification passed 2026-03-03 11:34:27,158 - DEBUG - Pod ctest-pod-95814314 not in running state.Currently in Pending 2026-03-03 11:34:32,166 - INFO - Pod ctest-pod-95814314 is in running state.Got IP 10.47.255.243 2026-03-03 11:34:32,218 - DEBUG - Pod ctest-pod-95814314 has vmi ea516c04-16f4-11f1-909d-0242a49adb2f 2026-03-03 11:34:32,218 - INFO - Verified pod ctest-pod-95814314 in contrail-api 2026-03-03 11:34:32,227 - DEBUG - VMI ea516c04-16f4-11f1-909d-0242a49adb2f is active in agent 10.0.0.50 2026-03-03 11:34:32,228 - INFO - Verified Pod ctest-pod-95814314 in agent 10.0.0.50 2026-03-03 11:34:32,228 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=df3789b7-0003-4674-af96-7686127ba825 2026-03-03 11:34:32,231 - INFO - Pod ctest-pod-95814314 with uuid df3789b7-0003-4674-af96-7686127ba825 found in kube manager 2026-03-03 11:34:32,231 - INFO - Pod ctest-pod-95814314 verification passed 2026-03-03 11:34:32,232 - INFO - ================================================================================ 2026-03-03 11:34:32,232 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-03-03 11:34:32,232 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-03-03 11:34:32,531 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.50': '1'}} with 2026-03-03 11:34:32,531 - INFO - Initial checks done. Running the testcase now 2026-03-03 11:34:32,531 - INFO - 2026-03-03 11:34:32,618 - DEBUG - [Pod ctest-pod-68717305] Cmd: echo ctest-pod-68717305 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:34:32,696 - DEBUG - [Pod ctest-pod-34330611] Cmd: echo ctest-pod-34330611 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:34:32,781 - DEBUG - [Pod ctest-pod-36662846] Cmd: echo ctest-pod-36662846 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:34:32,850 - DEBUG - [Pod ctest-pod-98505277] Cmd: echo ctest-pod-98505277 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:34:32,854 - DEBUG - Service ctest-nginx-svc-23232241 not present 2026-03-03 11:34:32,854 - INFO - Creating service ctest-nginx-svc-23232241 2026-03-03 11:34:32,870 - INFO - Created Service ctest-nginx-svc-23232241 2026-03-03 11:34:32,876 - WARNING - Service UUID 12c28d07-6e9e-432a-8eb0-c407c65445f9 not yet found in contrail-api 2026-03-03 11:34:33,882 - INFO - Validated that Service ctest-nginx-svc-23232241 is seen in contrail-api 2026-03-03 11:34:33,882 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=12c28d07-6e9e-432a-8eb0-c407c65445f9 2026-03-03 11:34:33,885 - INFO - Service ctest-nginx-svc-23232241 with uuid 12c28d07-6e9e-432a-8eb0-c407c65445f9 found in kube manager 2026-03-03 11:34:33,885 - INFO - Service ctest-nginx-svc-23232241 verification passed 2026-03-03 11:34:35,025 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68717305 2026-03-03 11:34:35,025 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 passed 2026-03-03 11:34:35,025 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68717305 2026-03-03 11:34:35,112 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:34:35,112 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 passed 2026-03-03 11:34:35,112 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:34:35,112 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68717305': 1, 'ctest-pod-34330611': 1} 2026-03-03 11:34:35,198 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:34:35,198 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 passed 2026-03-03 11:34:35,198 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:34:35,270 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68717305 2026-03-03 11:34:35,270 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 passed 2026-03-03 11:34:35,270 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68717305 2026-03-03 11:34:35,270 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68717305': 1, 'ctest-pod-34330611': 1} 2026-03-03 11:34:35,274 - DEBUG - Network policy ingress-on-service not present 2026-03-03 11:34:35,274 - INFO - Creating Network Policy ingress-on-service 2026-03-03 11:34:35,292 - INFO - Network policy found in k8s 2026-03-03 11:34:35,293 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4333a446-c124-4afa-9bc7-eb64cf616a5b 2026-03-03 11:34:35,297 - INFO - Network Policy ingress-on-service with uuid 4333a446-c124-4afa-9bc7-eb64cf616a5b found in kube manager 2026-03-03 11:34:35,322 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-03-03 11:34:35,322 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-03-03 11:34:35,322 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4333a446-c124-4afa-9bc7-eb64cf616a5b 2026-03-03 11:34:35,348 - WARNING - Network policy with name ingress-on-service not found in agent 2026-03-03 11:34:37,349 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4333a446-c124-4afa-9bc7-eb64cf616a5b 2026-03-03 11:34:37,370 - WARNING - Network policy with name ingress-on-service not found in agent 2026-03-03 11:34:39,371 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4333a446-c124-4afa-9bc7-eb64cf616a5b 2026-03-03 11:34:39,393 - INFO - Network policy with name ingress-on-service found in agent 2026-03-03 11:34:39,394 - INFO - Network Policy ingress-on-service verification passed 2026-03-03 11:34:44,495 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:44,495 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:34:44,495 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:49,562 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:49,562 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:34:49,562 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:54,625 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:54,625 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:34:54,625 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:59,701 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:34:59,701 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:34:59,701 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:04,772 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:04,772 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:04,773 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:09,843 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:09,843 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:09,843 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:14,927 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:14,927 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:14,927 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:20,000 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:20,000 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:20,000 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:25,067 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:25,067 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:25,067 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:30,143 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:30,143 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:30,143 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:30,143 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68717305': 0, 'ctest-pod-34330611': 0} 2026-03-03 11:35:30,214 - DEBUG - [Pod ctest-pod-08465132] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-34330611 Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:35:30,214 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 passed 2026-03-03 11:35:30,214 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd output: ctest-pod-34330611 Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:35:30,283 - DEBUG - [Pod ctest-pod-08465132] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-68717305 Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:35:30,283 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 passed 2026-03-03 11:35:30,283 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd output: ctest-pod-68717305 Connecting to 10.96.210.106:80 (10.96.210.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:35:30,283 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68717305': 1, 'ctest-pod-34330611': 1} 2026-03-03 11:35:35,354 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:35,354 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:35,354 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:40,459 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:40,459 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:40,459 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:45,524 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:45,524 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:45,524 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:50,599 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:50,599 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:50,599 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:55,671 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:35:55,672 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:35:55,672 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:00,739 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:00,739 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:36:00,739 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:05,816 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:05,816 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:36:05,816 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:10,898 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:10,898 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:36:10,898 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:15,967 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:15,967 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:36:15,967 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:21,038 - DEBUG - [Pod ctest-pod-45341364] Cmd: wget http://10.96.210.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:21,038 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd wget http://10.96.210.106:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:36:21,038 - DEBUG - [Pod Pod ctest-pod-45341364] Cmd output: Connecting to 10.96.210.106:80 (10.96.210.106:80) wget: download timed out 2026-03-03 11:36:21,038 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68717305': 0, 'ctest-pod-34330611': 0} 2026-03-03 11:36:23,113 - DEBUG - [Pod ctest-pod-08465132] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.797 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.316/0.797 ms 2026-03-03 11:36:23,113 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08465132 with expectation True passed 2026-03-03 11:36:25,177 - DEBUG - [Pod ctest-pod-14035474] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.146 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.053 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.067 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.053/0.422/1.146 ms 2026-03-03 11:36:25,177 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-14035474 with expectation True passed 2026-03-03 11:36:27,243 - DEBUG - [Pod ctest-pod-45341364] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.764 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.072 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.299/0.764 ms 2026-03-03 11:36:27,243 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-45341364 with expectation True passed 2026-03-03 11:36:27,341 - DEBUG - [Pod ctest-pod-08465132] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) ctest-pod-68717305 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:27,341 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:36:27,341 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) ctest-pod-68717305 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:27,341 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08465132 passed 2026-03-03 11:36:27,429 - DEBUG - [Pod ctest-pod-08465132] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:36:27,429 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:27,429 - DEBUG - [Pod Pod ctest-pod-08465132] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:36:27,429 - INFO - wget check of of http://10.47.255.249 from ctest-pod-08465132 passed 2026-03-03 11:36:27,509 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: ctest-pod-34330611 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:27,509 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:27,509 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: ctest-pod-34330611 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:27,509 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:29,578 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:29,578 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:29,578 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:29,578 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:31,654 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:31,654 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:31,654 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:31,654 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:33,719 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:33,719 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:33,719 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:33,719 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:35,790 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:36:35,790 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:35,790 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:36:35,790 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:37,868 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:37,868 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:37,868 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:37,868 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:39,942 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:39,943 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:39,943 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:39,943 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:42,011 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout ctest-pod-34330611 - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:42,011 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:42,011 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout ctest-pod-34330611 - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:42,011 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:44,082 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:44,082 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:44,082 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:44,082 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:46,149 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:46,149 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:46,149 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-34330611 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:36:46,149 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:48,215 - DEBUG - [Pod ctest-pod-14035474] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:36:48,215 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-03 11:36:48,215 - DEBUG - [Pod Pod ctest-pod-14035474] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34330611 2026-03-03 11:36:48,216 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-14035474 failed 2026-03-03 11:36:48,220 - INFO - Deleting Network Policy : ingress-on-service 2026-03-03 11:36:48,222 - INFO - Deleting service : ctest-nginx-svc-23232241 2026-03-03 11:36:48,791 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Tue Mar 3 11:36:48 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1, output_file='-') 2860 assert self.validate_wget(self.client2_pod_ns1, url2, output_file='-') 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False, output_file='-') 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False, output_file='-') 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7f976b01e670>> self.client1_pod_ns1 = url2 = 'http://10.47.255.249' expectation undefined output_file undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False, output_file='-') AssertionError 2026-03-03 11:36:48,796 - DEBUG - No XMPP flaps were noticed during the test 2026-03-03 11:36:48,797 - INFO -
2026-03-03 11:36:48,797 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:16]
2026-03-03 11:36:48,797 - INFO - -------------------------------------------------------------------------------- 2026-03-03 11:36:48,801 - INFO - Deleting pod ctest-new-default-49188810:ctest-pod-68717305 2026-03-03 11:36:48,801 - INFO - Deleting pod ctest-new-default-49188810:ctest-pod-34330611 2026-03-03 11:36:48,802 - INFO - Deleting pod ctest-non-default-81374882:ctest-pod-36662846 2026-03-03 11:36:48,802 - INFO - Deleting pod ctest-non-default-81374882:ctest-pod-98505277 2026-03-03 11:36:48,802 - INFO - Deleting pod ctest-new-default-49188810:ctest-pod-14035474 2026-03-03 11:36:48,803 - INFO - Deleting pod ctest-new-default-49188810:ctest-pod-08465132 2026-03-03 11:36:48,806 - INFO - Deleting pod ctest-non-default-81374882:ctest-pod-45341364 2026-03-03 11:36:48,806 - INFO - Deleting pod ctest-non-default-81374882:ctest-pod-95814314 2026-03-03 11:36:48,994 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,995 - WARNING - Pod uuid 2e904a71-9511-465e-bb37-239579bd3d29 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,995 - WARNING - Pod uuid 14f41dc2-876c-4d59-8fcd-81f71178e938 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,995 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,996 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,996 - WARNING - Pod uuid ff0d8f13-4cd2-4d0c-9a1c-8a3c7f856dd3 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,996 - WARNING - Pod uuid cc17a627-0751-4bcf-9d05-ef8873379f11 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:48,997 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:54,014 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:54,019 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:54,019 - DEBUG - Pod 14f41dc2-876c-4d59-8fcd-81f71178e938 is not in agent 10.0.0.50 VM list 2026-03-03 11:36:54,020 - DEBUG - Pod 2e904a71-9511-465e-bb37-239579bd3d29 is not in agent 10.0.0.50 VM list 2026-03-03 11:36:54,024 - DEBUG - Pod cc17a627-0751-4bcf-9d05-ef8873379f11 is not in agent 10.0.0.50 VM list 2026-03-03 11:36:54,025 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:54,025 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:54,026 - DEBUG - Pod ff0d8f13-4cd2-4d0c-9a1c-8a3c7f856dd3 is not in agent 10.0.0.50 VM list 2026-03-03 11:36:54,033 - DEBUG - VMI e5143adc-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:36:54,033 - INFO - Verified that pod ctest-pod-34330611 is removed in agent 2026-03-03 11:36:54,034 - DEBUG - VMI e6bb25da-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:36:54,034 - INFO - Verified that pod ctest-pod-98505277 is removed in agent 2026-03-03 11:36:54,034 - DEBUG - VMI e4657312-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:36:54,035 - INFO - Verified that pod ctest-pod-68717305 is removed in agent 2026-03-03 11:36:54,035 - DEBUG - VMI e60f2d5c-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:36:54,035 - INFO - Verified that pod ctest-pod-36662846 is removed in agent 2026-03-03 11:36:59,020 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:59,024 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:59,032 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:36:59,033 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:04,026 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:04,029 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:04,041 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:04,042 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:09,037 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:09,038 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:09,048 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:09,049 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:14,046 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:14,047 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:14,056 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:14,057 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:19,054 - WARNING - Pod uuid 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:19,055 - WARNING - Pod uuid 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:19,064 - WARNING - Pod uuid df3789b7-0003-4674-af96-7686127ba825 is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:19,064 - WARNING - Pod uuid f020d540-75c8-4354-88a2-df1d302f69db is still seen in agent 10.0.0.50 VM list 2026-03-03 11:37:24,062 - DEBUG - Pod 66e24509-0e8e-466e-aa1d-1d6236b6e8b7 is not in agent 10.0.0.50 VM list 2026-03-03 11:37:24,064 - DEBUG - Pod 7c57c0f9-f4d9-4a10-8c44-c01f376b5d9e is not in agent 10.0.0.50 VM list 2026-03-03 11:37:24,074 - DEBUG - VMI e87a55d0-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:37:24,074 - INFO - Verified that pod ctest-pod-08465132 is removed in agent 2026-03-03 11:37:24,074 - DEBUG - VMI e941a270-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:37:24,074 - INFO - Verified that pod ctest-pod-45341364 is removed in agent 2026-03-03 11:37:24,075 - DEBUG - Pod df3789b7-0003-4674-af96-7686127ba825 is not in agent 10.0.0.50 VM list 2026-03-03 11:37:24,076 - DEBUG - Pod f020d540-75c8-4354-88a2-df1d302f69db is not in agent 10.0.0.50 VM list 2026-03-03 11:37:24,082 - DEBUG - VMI ea516c04-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:37:24,082 - INFO - Verified that pod ctest-pod-95814314 is removed in agent 2026-03-03 11:37:24,083 - DEBUG - VMI e7b25bfc-16f4-11f1-909d-0242a49adb2f is removed from agent 10.0.0.50 2026-03-03 11:37:24,083 - INFO - Verified that pod ctest-pod-14035474 is removed in agent 2026-03-03 11:37:24,083 - INFO - Deleting namespace ctest-non-default-81374882 2026-03-03 11:37:24,092 - DEBUG - Namespace ctest-non-default-81374882 still in k8s 2026-03-03 11:37:26,097 - DEBUG - Namespace ctest-non-default-81374882 still in k8s 2026-03-03 11:37:28,102 - DEBUG - Namespace ctest-non-default-81374882 still in k8s 2026-03-03 11:37:30,107 - DEBUG - Namespace ctest-non-default-81374882 is not in k8s 2026-03-03 11:37:30,107 - DEBUG - No need to check project deletion in contrail-api 2026-03-03 11:37:30,107 - INFO - Deleting namespace ctest-new-default-49188810 2026-03-03 11:37:30,124 - DEBUG - Namespace ctest-new-default-49188810 still in k8s 2026-03-03 11:37:32,128 - DEBUG - Namespace ctest-new-default-49188810 still in k8s 2026-03-03 11:37:34,132 - DEBUG - Namespace ctest-new-default-49188810 still in k8s 2026-03-03 11:37:36,136 - DEBUG - Namespace ctest-new-default-49188810 is not in k8s 2026-03-03 11:37:36,136 - DEBUG - No need to check project deletion in contrail-api