2026-03-11 11:02:38,670 - INFO - Using existing project ['default-domain', 'k8s-default'](68040acf-b4d4-4a31-bfb2-7efd65d260e0) 2026-03-11 11:02:38,694 - DEBUG - Namespace ctest-new-default-90325638 not present 2026-03-11 11:02:38,704 - INFO - Created namespace ctest-new-default-90325638 2026-03-11 11:02:41,709 - DEBUG - Namespace ctest-non-default-33517313 not present 2026-03-11 11:02:41,718 - INFO - Created namespace ctest-non-default-33517313 2026-03-11 11:02:44,735 - DEBUG - Pod ctest-pod-76753753 not present 2026-03-11 11:02:44,735 - INFO - Creating Pod ctest-pod-76753753 2026-03-11 11:02:44,766 - DEBUG - Pod : ctest-pod-76753753 UUID is b41481b3-2732-4ad7-a5ce-f9efe6107dfa 2026-03-11 11:02:44,770 - DEBUG - Pod ctest-pod-25062763 not present 2026-03-11 11:02:44,770 - INFO - Creating Pod ctest-pod-25062763 2026-03-11 11:02:44,795 - DEBUG - Pod : ctest-pod-25062763 UUID is 66f713a2-9ee5-481c-a332-ef9017474b88 2026-03-11 11:02:44,798 - DEBUG - Pod ctest-pod-62801441 not present 2026-03-11 11:02:44,799 - INFO - Creating Pod ctest-pod-62801441 2026-03-11 11:02:44,827 - DEBUG - Pod : ctest-pod-62801441 UUID is 1a69a9a2-2e60-4a22-9d43-3283603b0d6f 2026-03-11 11:02:44,836 - DEBUG - Pod ctest-pod-24283345 not present 2026-03-11 11:02:44,836 - INFO - Creating Pod ctest-pod-24283345 2026-03-11 11:02:44,875 - DEBUG - Pod : ctest-pod-24283345 UUID is b07db964-c24f-42bb-a0a0-3bc5fe183674 2026-03-11 11:02:44,880 - DEBUG - Pod ctest-pod-34696703 not present 2026-03-11 11:02:44,881 - INFO - Creating Pod ctest-pod-34696703 2026-03-11 11:02:44,907 - DEBUG - Pod : ctest-pod-34696703 UUID is 926238ca-e72f-438c-a073-99a3f1254b54 2026-03-11 11:02:44,913 - DEBUG - Pod ctest-pod-93915837 not present 2026-03-11 11:02:44,914 - INFO - Creating Pod ctest-pod-93915837 2026-03-11 11:02:44,938 - DEBUG - Pod : ctest-pod-93915837 UUID is 13d9d317-0d44-49f5-9dc7-1657fbe60f50 2026-03-11 11:02:44,941 - DEBUG - Pod ctest-pod-72082126 not present 2026-03-11 11:02:44,942 - INFO - Creating Pod ctest-pod-72082126 2026-03-11 11:02:44,966 - DEBUG - Pod : ctest-pod-72082126 UUID is 0a382211-a198-4229-9c69-725f6958fa88 2026-03-11 11:02:44,970 - DEBUG - Pod ctest-pod-05730249 not present 2026-03-11 11:02:44,971 - INFO - Creating Pod ctest-pod-05730249 2026-03-11 11:02:44,994 - DEBUG - Pod : ctest-pod-05730249 UUID is 2b896a97-968a-4757-a4cd-58d6e27b3467 2026-03-11 11:02:45,367 - INFO - Project default-domain:k8s-ctest-new-default-90325638 for Namespace ctest-new-default-90325638 is seen in contrail-api 2026-03-11 11:02:45,367 - DEBUG - Project uuid in Contrail is 52915fa9-9983-498a-95b1-40aea411b213 2026-03-11 11:02:45,546 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=589df9a7-27bc-4de4-9bdb-ee4d42a05713 2026-03-11 11:02:45,551 - INFO - Namespace ctest-new-default-90325638 with uuid 589df9a7-27bc-4de4-9bdb-ee4d42a05713 found in kube manager 2026-03-11 11:02:45,551 - INFO - Namespace ctest-new-default-90325638 verification passed 2026-03-11 11:02:45,803 - INFO - Project default-domain:k8s-ctest-non-default-33517313 for Namespace ctest-non-default-33517313 is seen in contrail-api 2026-03-11 11:02:45,803 - DEBUG - Project uuid in Contrail is 39e81952-0f4f-4d53-a092-3aee1b669c4a 2026-03-11 11:02:45,803 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=75df84d0-227f-4934-9af3-a2b6f9b570c4 2026-03-11 11:02:45,807 - INFO - Namespace ctest-non-default-33517313 with uuid 75df84d0-227f-4934-9af3-a2b6f9b570c4 found in kube manager 2026-03-11 11:02:45,807 - INFO - Namespace ctest-non-default-33517313 verification passed 2026-03-11 11:02:45,898 - DEBUG - Pod ctest-pod-76753753 not in running state.Currently in Pending 2026-03-11 11:02:50,905 - DEBUG - Pod ctest-pod-76753753 not in running state.Currently in Pending 2026-03-11 11:02:55,912 - DEBUG - Pod ctest-pod-76753753 not in running state.Currently in Pending 2026-03-11 11:03:00,920 - INFO - Pod ctest-pod-76753753 is in running state.Got IP 10.47.255.250 2026-03-11 11:03:00,974 - DEBUG - Pod ctest-pod-76753753 has vmi d6ed4ea8-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:00,975 - INFO - Verified pod ctest-pod-76753753 in contrail-api 2026-03-11 11:03:00,987 - DEBUG - VMI d6ed4ea8-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:00,988 - INFO - Verified Pod ctest-pod-76753753 in agent 10.0.0.38 2026-03-11 11:03:00,988 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b41481b3-2732-4ad7-a5ce-f9efe6107dfa 2026-03-11 11:03:00,992 - INFO - Pod ctest-pod-76753753 with uuid b41481b3-2732-4ad7-a5ce-f9efe6107dfa found in kube manager 2026-03-11 11:03:00,992 - INFO - Pod ctest-pod-76753753 verification passed 2026-03-11 11:03:01,000 - INFO - Pod ctest-pod-25062763 is in running state.Got IP 10.47.255.249 2026-03-11 11:03:01,094 - DEBUG - Pod ctest-pod-25062763 has vmi d79a477a-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:01,094 - INFO - Verified pod ctest-pod-25062763 in contrail-api 2026-03-11 11:03:01,105 - DEBUG - VMI d79a477a-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:01,105 - INFO - Verified Pod ctest-pod-25062763 in agent 10.0.0.38 2026-03-11 11:03:01,105 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=66f713a2-9ee5-481c-a332-ef9017474b88 2026-03-11 11:03:01,109 - INFO - Pod ctest-pod-25062763 with uuid 66f713a2-9ee5-481c-a332-ef9017474b88 found in kube manager 2026-03-11 11:03:01,109 - INFO - Pod ctest-pod-25062763 verification passed 2026-03-11 11:03:01,115 - INFO - Pod ctest-pod-62801441 is in running state.Got IP 10.47.255.248 2026-03-11 11:03:01,208 - DEBUG - Pod ctest-pod-62801441 has vmi d893b594-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:01,208 - INFO - Verified pod ctest-pod-62801441 in contrail-api 2026-03-11 11:03:01,219 - DEBUG - VMI d893b594-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:01,219 - INFO - Verified Pod ctest-pod-62801441 in agent 10.0.0.38 2026-03-11 11:03:01,219 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=1a69a9a2-2e60-4a22-9d43-3283603b0d6f 2026-03-11 11:03:01,222 - INFO - Pod ctest-pod-62801441 with uuid 1a69a9a2-2e60-4a22-9d43-3283603b0d6f found in kube manager 2026-03-11 11:03:01,223 - INFO - Pod ctest-pod-62801441 verification passed 2026-03-11 11:03:01,230 - DEBUG - Pod ctest-pod-24283345 not in running state.Currently in Pending 2026-03-11 11:03:06,239 - INFO - Pod ctest-pod-24283345 is in running state.Got IP 10.47.255.247 2026-03-11 11:03:06,293 - DEBUG - Pod ctest-pod-24283345 has vmi d9459dea-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:06,293 - INFO - Verified pod ctest-pod-24283345 in contrail-api 2026-03-11 11:03:06,303 - DEBUG - VMI d9459dea-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:06,304 - INFO - Verified Pod ctest-pod-24283345 in agent 10.0.0.38 2026-03-11 11:03:06,304 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b07db964-c24f-42bb-a0a0-3bc5fe183674 2026-03-11 11:03:06,307 - INFO - Pod ctest-pod-24283345 with uuid b07db964-c24f-42bb-a0a0-3bc5fe183674 found in kube manager 2026-03-11 11:03:06,308 - INFO - Pod ctest-pod-24283345 verification passed 2026-03-11 11:03:06,315 - INFO - Pod ctest-pod-34696703 is in running state.Got IP 10.47.255.246 2026-03-11 11:03:06,408 - DEBUG - Pod ctest-pod-34696703 has vmi da26516e-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:06,408 - INFO - Verified pod ctest-pod-34696703 in contrail-api 2026-03-11 11:03:06,417 - DEBUG - VMI da26516e-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:06,418 - INFO - Verified Pod ctest-pod-34696703 in agent 10.0.0.38 2026-03-11 11:03:06,418 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=926238ca-e72f-438c-a073-99a3f1254b54 2026-03-11 11:03:06,421 - INFO - Pod ctest-pod-34696703 with uuid 926238ca-e72f-438c-a073-99a3f1254b54 found in kube manager 2026-03-11 11:03:06,421 - INFO - Pod ctest-pod-34696703 verification passed 2026-03-11 11:03:06,428 - INFO - Pod ctest-pod-72082126 is in running state.Got IP 10.47.255.244 2026-03-11 11:03:06,521 - DEBUG - Pod ctest-pod-72082126 has vmi dbb75cb2-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:06,521 - INFO - Verified pod ctest-pod-72082126 in contrail-api 2026-03-11 11:03:06,531 - DEBUG - VMI dbb75cb2-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:06,531 - INFO - Verified Pod ctest-pod-72082126 in agent 10.0.0.38 2026-03-11 11:03:06,531 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=0a382211-a198-4229-9c69-725f6958fa88 2026-03-11 11:03:06,535 - INFO - Pod ctest-pod-72082126 with uuid 0a382211-a198-4229-9c69-725f6958fa88 found in kube manager 2026-03-11 11:03:06,535 - INFO - Pod ctest-pod-72082126 verification passed 2026-03-11 11:03:06,543 - INFO - Pod ctest-pod-93915837 is in running state.Got IP 10.47.255.245 2026-03-11 11:03:06,637 - DEBUG - Pod ctest-pod-93915837 has vmi daec4d38-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:06,637 - INFO - Verified pod ctest-pod-93915837 in contrail-api 2026-03-11 11:03:06,647 - DEBUG - VMI daec4d38-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:06,648 - INFO - Verified Pod ctest-pod-93915837 in agent 10.0.0.38 2026-03-11 11:03:06,648 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=13d9d317-0d44-49f5-9dc7-1657fbe60f50 2026-03-11 11:03:06,653 - INFO - Pod ctest-pod-93915837 with uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 found in kube manager 2026-03-11 11:03:06,653 - INFO - Pod ctest-pod-93915837 verification passed 2026-03-11 11:03:06,660 - DEBUG - Pod ctest-pod-05730249 not in running state.Currently in Pending 2026-03-11 11:03:11,668 - INFO - Pod ctest-pod-05730249 is in running state.Got IP 10.47.255.243 2026-03-11 11:03:11,721 - DEBUG - Pod ctest-pod-05730249 has vmi dc7963c0-1d39-11f1-908d-02424ac82e96 2026-03-11 11:03:11,721 - INFO - Verified pod ctest-pod-05730249 in contrail-api 2026-03-11 11:03:11,733 - DEBUG - VMI dc7963c0-1d39-11f1-908d-02424ac82e96 is active in agent 10.0.0.38 2026-03-11 11:03:11,733 - INFO - Verified Pod ctest-pod-05730249 in agent 10.0.0.38 2026-03-11 11:03:11,734 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=2b896a97-968a-4757-a4cd-58d6e27b3467 2026-03-11 11:03:11,739 - INFO - Pod ctest-pod-05730249 with uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 found in kube manager 2026-03-11 11:03:11,739 - INFO - Pod ctest-pod-05730249 verification passed 2026-03-11 11:03:11,739 - INFO - ================================================================================ 2026-03-11 11:03:11,739 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-03-11 11:03:11,739 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-03-11 11:03:12,040 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.38': '2'}} with 2026-03-11 11:03:12,040 - INFO - Initial checks done. Running the testcase now 2026-03-11 11:03:12,040 - INFO - 2026-03-11 11:03:12,140 - DEBUG - [Pod ctest-pod-76753753] Cmd: echo ctest-pod-76753753 > /usr/share/nginx/html/index.html, Output: 2026-03-11 11:03:12,236 - DEBUG - [Pod ctest-pod-25062763] Cmd: echo ctest-pod-25062763 > /usr/share/nginx/html/index.html, Output: 2026-03-11 11:03:12,312 - DEBUG - [Pod ctest-pod-62801441] Cmd: echo ctest-pod-62801441 > /usr/share/nginx/html/index.html, Output: 2026-03-11 11:03:12,391 - DEBUG - [Pod ctest-pod-24283345] Cmd: echo ctest-pod-24283345 > /usr/share/nginx/html/index.html, Output: 2026-03-11 11:03:12,395 - DEBUG - Service ctest-nginx-svc-53901472 not present 2026-03-11 11:03:12,396 - INFO - Creating service ctest-nginx-svc-53901472 2026-03-11 11:03:12,410 - INFO - Created Service ctest-nginx-svc-53901472 2026-03-11 11:03:12,419 - WARNING - Service UUID a0a783e7-b634-4ab2-8a10-b1d9001b5f5d not yet found in contrail-api 2026-03-11 11:03:13,426 - INFO - Validated that Service ctest-nginx-svc-53901472 is seen in contrail-api 2026-03-11 11:03:13,426 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=a0a783e7-b634-4ab2-8a10-b1d9001b5f5d 2026-03-11 11:03:13,435 - INFO - Service ctest-nginx-svc-53901472 with uuid a0a783e7-b634-4ab2-8a10-b1d9001b5f5d found in kube manager 2026-03-11 11:03:13,435 - INFO - Service ctest-nginx-svc-53901472 verification passed 2026-03-11 11:03:14,549 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout ctest-pod-76753753 - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:03:14,549 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:03:14,549 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout ctest-pod-76753753 - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:03:14,648 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76753753 2026-03-11 11:03:14,648 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:03:14,648 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76753753 2026-03-11 11:03:14,783 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76753753 2026-03-11 11:03:14,783 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:03:14,783 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76753753 2026-03-11 11:03:14,881 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:03:14,881 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:03:14,881 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:03:14,881 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76753753': 3, 'ctest-pod-25062763': 1} 2026-03-11 11:03:14,956 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-76753753 Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:03:14,956 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:03:14,956 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: ctest-pod-76753753 Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:03:15,044 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:03:15,044 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:03:15,044 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:03:15,044 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76753753': 1, 'ctest-pod-25062763': 1} 2026-03-11 11:03:15,047 - DEBUG - Network policy ingress-on-service not present 2026-03-11 11:03:15,048 - INFO - Creating Network Policy ingress-on-service 2026-03-11 11:03:15,073 - INFO - Network policy found in k8s 2026-03-11 11:03:15,074 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d6ed8c17-760d-459e-a034-38201d5a993b 2026-03-11 11:03:15,081 - INFO - Network Policy ingress-on-service with uuid d6ed8c17-760d-459e-a034-38201d5a993b found in kube manager 2026-03-11 11:03:15,105 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-03-11 11:03:15,106 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-03-11 11:03:15,106 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d6ed8c17-760d-459e-a034-38201d5a993b 2026-03-11 11:03:15,132 - WARNING - Network policy with name ingress-on-service not found in agent 2026-03-11 11:03:17,134 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d6ed8c17-760d-459e-a034-38201d5a993b 2026-03-11 11:03:17,153 - WARNING - Network policy with name ingress-on-service not found in agent 2026-03-11 11:03:19,154 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d6ed8c17-760d-459e-a034-38201d5a993b 2026-03-11 11:03:19,191 - INFO - Network policy with name ingress-on-service found in agent 2026-03-11 11:03:19,191 - INFO - Network Policy ingress-on-service verification passed 2026-03-11 11:03:24,269 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:24,269 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:24,269 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:29,351 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:29,351 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:29,351 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:34,437 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:34,438 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:34,438 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:39,515 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:39,515 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:39,515 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:44,593 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:44,593 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:44,593 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:49,681 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:49,681 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:49,681 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:54,750 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:54,750 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:54,750 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:59,811 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:03:59,811 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:03:59,811 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:04,877 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:04,877 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:04,877 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:09,960 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:09,960 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:09,960 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:09,960 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76753753': 0, 'ctest-pod-25062763': 0} 2026-03-11 11:04:10,033 - DEBUG - [Pod ctest-pod-93915837] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-76753753 Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:04:10,033 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:04:10,033 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd output: ctest-pod-76753753 Connecting to 10.97.230.140:80 (10.97.230.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:04:10,111 - DEBUG - [Pod ctest-pod-93915837] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:04:10,111 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 passed 2026-03-11 11:04:10,111 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:04:10,111 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76753753': 1, 'ctest-pod-25062763': 1} 2026-03-11 11:04:15,183 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:15,183 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:15,183 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:20,257 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:20,257 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:20,257 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:25,363 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:25,363 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:25,363 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:30,428 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:30,428 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:30,428 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:35,511 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:35,511 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:35,511 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:40,594 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:40,594 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:40,594 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:45,680 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:45,680 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:45,681 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:50,769 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:50,769 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:50,769 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:55,856 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:04:55,856 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:04:55,856 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:05:00,946 - DEBUG - [Pod ctest-pod-72082126] Cmd: wget http://10.97.230.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:05:00,946 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd wget http://10.97.230.140:80/ -O - -T 5 -t 1 failed. 2026-03-11 11:05:00,946 - DEBUG - [Pod Pod ctest-pod-72082126] Cmd output: Connecting to 10.97.230.140:80 (10.97.230.140:80) wget: download timed out 2026-03-11 11:05:00,946 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76753753': 0, 'ctest-pod-25062763': 0} 2026-03-11 11:05:03,013 - DEBUG - [Pod ctest-pod-93915837] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.193 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.459/1.193 ms 2026-03-11 11:05:03,013 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93915837 with expectation True passed 2026-03-11 11:05:05,082 - DEBUG - [Pod ctest-pod-34696703] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.694 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.088 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.618/1.694 ms 2026-03-11 11:05:05,083 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-34696703 with expectation True passed 2026-03-11 11:05:07,150 - DEBUG - [Pod ctest-pod-72082126] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.400 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.110 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.192/0.400 ms 2026-03-11 11:05:07,150 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-72082126 with expectation True passed 2026-03-11 11:05:07,223 - DEBUG - [Pod ctest-pod-93915837] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76753753 2026-03-11 11:05:07,223 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-11 11:05:07,223 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76753753 2026-03-11 11:05:07,224 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93915837 passed 2026-03-11 11:05:07,303 - DEBUG - [Pod ctest-pod-93915837] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:05:07,303 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:07,303 - DEBUG - [Pod Pod ctest-pod-93915837] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:05:07,303 - INFO - wget check of of http://10.47.255.249 from ctest-pod-93915837 passed 2026-03-11 11:05:07,392 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:05:07,392 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:07,392 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:05:07,392 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:09,484 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:09,484 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:09,484 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:09,484 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:11,572 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:11,573 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:11,573 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:11,573 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:13,662 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:13,662 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:13,662 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:13,662 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:15,751 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:15,751 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:15,752 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:15,752 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:17,823 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:05:17,823 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:17,823 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25062763 2026-03-11 11:05:17,823 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:19,952 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:19,953 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:19,953 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:19,953 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:22,068 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:22,068 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:22,069 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: ctest-pod-25062763 Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:22,069 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:24,143 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout ctest-pod-25062763 - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:24,143 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:24,143 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) writing to stdout ctest-pod-25062763 - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:24,143 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:26,214 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:26,214 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:26,214 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:26,214 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:28,323 - DEBUG - [Pod ctest-pod-34696703] Cmd: wget http://10.47.255.249 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:28,324 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd wget http://10.47.255.249 -O - -T 5 -t 1 passed 2026-03-11 11:05:28,324 - DEBUG - [Pod Pod ctest-pod-34696703] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) ctest-pod-25062763 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-11 11:05:28,324 - WARNING - wget check of of http://10.47.255.249 from ctest-pod-34696703 failed 2026-03-11 11:05:28,330 - INFO - Deleting Network Policy : ingress-on-service 2026-03-11 11:05:28,331 - INFO - Deleting service : ctest-nginx-svc-53901472 2026-03-11 11:05:28,930 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Wed Mar 11 11:05:28 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1, output_file='-') 2860 assert self.validate_wget(self.client2_pod_ns1, url2, output_file='-') 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False, output_file='-') 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False, output_file='-') 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7fbad837f6d0>> self.client1_pod_ns1 = url2 = 'http://10.47.255.249' expectation undefined output_file undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False, output_file='-') AssertionError 2026-03-11 11:05:28,939 - DEBUG - No XMPP flaps were noticed during the test 2026-03-11 11:05:28,939 - INFO -
2026-03-11 11:05:28,939 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:17]
2026-03-11 11:05:28,939 - INFO - -------------------------------------------------------------------------------- 2026-03-11 11:05:28,945 - INFO - Deleting pod ctest-new-default-90325638:ctest-pod-76753753 2026-03-11 11:05:28,946 - INFO - Deleting pod ctest-new-default-90325638:ctest-pod-25062763 2026-03-11 11:05:28,947 - INFO - Deleting pod ctest-non-default-33517313:ctest-pod-62801441 2026-03-11 11:05:28,947 - INFO - Deleting pod ctest-non-default-33517313:ctest-pod-24283345 2026-03-11 11:05:28,948 - INFO - Deleting pod ctest-new-default-90325638:ctest-pod-34696703 2026-03-11 11:05:28,948 - INFO - Deleting pod ctest-new-default-90325638:ctest-pod-93915837 2026-03-11 11:05:28,949 - INFO - Deleting pod ctest-non-default-33517313:ctest-pod-72082126 2026-03-11 11:05:28,949 - INFO - Deleting pod ctest-non-default-33517313:ctest-pod-05730249 2026-03-11 11:05:29,077 - WARNING - Pod uuid b41481b3-2732-4ad7-a5ce-f9efe6107dfa is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,089 - WARNING - Pod uuid b07db964-c24f-42bb-a0a0-3bc5fe183674 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,106 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,107 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,107 - WARNING - Pod uuid 66f713a2-9ee5-481c-a332-ef9017474b88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,109 - WARNING - Pod uuid 1a69a9a2-2e60-4a22-9d43-3283603b0d6f is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,111 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:29,111 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:34,083 - DEBUG - Pod b41481b3-2732-4ad7-a5ce-f9efe6107dfa is not in agent 10.0.0.38 VM list 2026-03-11 11:05:34,087 - DEBUG - VMI d6ed4ea8-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:05:34,087 - INFO - Verified that pod ctest-pod-76753753 is removed in agent 2026-03-11 11:05:34,093 - DEBUG - Pod b07db964-c24f-42bb-a0a0-3bc5fe183674 is not in agent 10.0.0.38 VM list 2026-03-11 11:05:34,097 - DEBUG - VMI d9459dea-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:05:34,097 - INFO - Verified that pod ctest-pod-24283345 is removed in agent 2026-03-11 11:05:34,127 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:34,128 - DEBUG - Pod 1a69a9a2-2e60-4a22-9d43-3283603b0d6f is not in agent 10.0.0.38 VM list 2026-03-11 11:05:34,129 - DEBUG - Pod 66f713a2-9ee5-481c-a332-ef9017474b88 is not in agent 10.0.0.38 VM list 2026-03-11 11:05:34,130 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:34,130 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:34,130 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:34,136 - DEBUG - VMI d893b594-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:05:34,136 - INFO - Verified that pod ctest-pod-62801441 is removed in agent 2026-03-11 11:05:34,136 - DEBUG - VMI d79a477a-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:05:34,136 - INFO - Verified that pod ctest-pod-25062763 is removed in agent 2026-03-11 11:05:39,135 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:39,142 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:39,143 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:39,145 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:44,141 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:44,154 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:44,155 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:44,155 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:49,147 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:49,165 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:49,167 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:49,167 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:54,154 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:54,184 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:54,184 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:54,185 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:59,160 - WARNING - Pod uuid 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:59,195 - WARNING - Pod uuid 2b896a97-968a-4757-a4cd-58d6e27b3467 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:59,196 - WARNING - Pod uuid 926238ca-e72f-438c-a073-99a3f1254b54 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:05:59,196 - WARNING - Pod uuid 0a382211-a198-4229-9c69-725f6958fa88 is still seen in agent 10.0.0.38 VM list 2026-03-11 11:06:04,166 - DEBUG - Pod 13d9d317-0d44-49f5-9dc7-1657fbe60f50 is not in agent 10.0.0.38 VM list 2026-03-11 11:06:04,170 - DEBUG - VMI daec4d38-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:06:04,171 - INFO - Verified that pod ctest-pod-93915837 is removed in agent 2026-03-11 11:06:04,206 - DEBUG - Pod 2b896a97-968a-4757-a4cd-58d6e27b3467 is not in agent 10.0.0.38 VM list 2026-03-11 11:06:04,210 - DEBUG - Pod 926238ca-e72f-438c-a073-99a3f1254b54 is not in agent 10.0.0.38 VM list 2026-03-11 11:06:04,211 - DEBUG - Pod 0a382211-a198-4229-9c69-725f6958fa88 is not in agent 10.0.0.38 VM list 2026-03-11 11:06:04,214 - DEBUG - VMI dc7963c0-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:06:04,214 - INFO - Verified that pod ctest-pod-05730249 is removed in agent 2026-03-11 11:06:04,219 - DEBUG - VMI dbb75cb2-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:06:04,219 - INFO - Verified that pod ctest-pod-72082126 is removed in agent 2026-03-11 11:06:04,220 - DEBUG - VMI da26516e-1d39-11f1-908d-02424ac82e96 is removed from agent 10.0.0.38 2026-03-11 11:06:04,220 - INFO - Verified that pod ctest-pod-34696703 is removed in agent 2026-03-11 11:06:04,220 - INFO - Deleting namespace ctest-non-default-33517313 2026-03-11 11:06:04,230 - DEBUG - Namespace ctest-non-default-33517313 still in k8s 2026-03-11 11:06:06,235 - DEBUG - Namespace ctest-non-default-33517313 still in k8s 2026-03-11 11:06:08,240 - DEBUG - Namespace ctest-non-default-33517313 still in k8s 2026-03-11 11:06:10,247 - DEBUG - Namespace ctest-non-default-33517313 is not in k8s 2026-03-11 11:06:10,247 - DEBUG - No need to check project deletion in contrail-api 2026-03-11 11:06:10,247 - INFO - Deleting namespace ctest-new-default-90325638 2026-03-11 11:06:10,256 - DEBUG - Namespace ctest-new-default-90325638 still in k8s 2026-03-11 11:06:12,261 - DEBUG - Namespace ctest-new-default-90325638 still in k8s 2026-03-11 11:06:14,267 - DEBUG - Namespace ctest-new-default-90325638 still in k8s 2026-03-11 11:06:16,271 - DEBUG - Namespace ctest-new-default-90325638 is not in k8s 2026-03-11 11:06:16,272 - DEBUG - No need to check project deletion in contrail-api