2026-03-03 11:50:47,473 - INFO - Using existing project ['default-domain', 'k8s-default'](cfa15c83-acb4-4d3b-b2a3-7e65c38efe6d) 2026-03-03 11:50:47,496 - DEBUG - Namespace ctest-new-default-67135373 not present 2026-03-03 11:50:47,625 - INFO - Created namespace ctest-new-default-67135373 2026-03-03 11:50:50,630 - DEBUG - Namespace ctest-non-default-10623013 not present 2026-03-03 11:50:50,646 - INFO - Created namespace ctest-non-default-10623013 2026-03-03 11:50:53,682 - DEBUG - Pod ctest-pod-14628913 not present 2026-03-03 11:50:53,683 - INFO - Creating Pod ctest-pod-14628913 2026-03-03 11:50:53,742 - DEBUG - Pod : ctest-pod-14628913 UUID is dec931d7-99c7-49c4-b596-710c5b69bb20 2026-03-03 11:50:53,748 - DEBUG - Pod ctest-pod-96812919 not present 2026-03-03 11:50:53,749 - INFO - Creating Pod ctest-pod-96812919 2026-03-03 11:50:53,800 - DEBUG - Pod : ctest-pod-96812919 UUID is 06383a7a-17ad-4686-b7c9-3f789d129efa 2026-03-03 11:50:53,806 - DEBUG - Pod ctest-pod-35511019 not present 2026-03-03 11:50:53,807 - INFO - Creating Pod ctest-pod-35511019 2026-03-03 11:50:53,861 - DEBUG - Pod : ctest-pod-35511019 UUID is 3ce3a53c-fab3-4d0e-b835-2addb2b6e750 2026-03-03 11:50:53,864 - DEBUG - Pod ctest-pod-70585404 not present 2026-03-03 11:50:53,865 - INFO - Creating Pod ctest-pod-70585404 2026-03-03 11:50:53,891 - DEBUG - Pod : ctest-pod-70585404 UUID is 51cf3a68-9fca-44a3-8180-ab3f83a50738 2026-03-03 11:50:53,897 - DEBUG - Pod ctest-pod-33161868 not present 2026-03-03 11:50:53,898 - INFO - Creating Pod ctest-pod-33161868 2026-03-03 11:50:53,928 - DEBUG - Pod : ctest-pod-33161868 UUID is 9422960f-3d7a-43ed-a470-c54389b64fd7 2026-03-03 11:50:53,935 - DEBUG - Pod ctest-pod-60415222 not present 2026-03-03 11:50:53,936 - INFO - Creating Pod ctest-pod-60415222 2026-03-03 11:50:53,975 - DEBUG - Pod : ctest-pod-60415222 UUID is 08d20563-cfd1-4e47-bd0c-a724e20bfa28 2026-03-03 11:50:53,980 - DEBUG - Pod ctest-pod-04945438 not present 2026-03-03 11:50:53,980 - INFO - Creating Pod ctest-pod-04945438 2026-03-03 11:50:54,010 - DEBUG - Pod : ctest-pod-04945438 UUID is 14857f66-2fee-4e35-903e-9f6e9d4fca8f 2026-03-03 11:50:54,013 - DEBUG - Pod ctest-pod-64191807 not present 2026-03-03 11:50:54,013 - INFO - Creating Pod ctest-pod-64191807 2026-03-03 11:50:54,045 - DEBUG - Pod : ctest-pod-64191807 UUID is f97310d7-118e-4eed-b8c0-239280c3464e 2026-03-03 11:50:54,316 - INFO - Project default-domain:k8s-ctest-new-default-67135373 for Namespace ctest-new-default-67135373 is seen in contrail-api 2026-03-03 11:50:54,316 - DEBUG - Project uuid in Contrail is 699b1392-0462-417c-b89d-0383e625e004 2026-03-03 11:50:54,545 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=599fe350-1f17-4900-8607-053e1d8164ed 2026-03-03 11:50:54,551 - INFO - Namespace ctest-new-default-67135373 with uuid 599fe350-1f17-4900-8607-053e1d8164ed found in kube manager 2026-03-03 11:50:54,552 - INFO - Namespace ctest-new-default-67135373 verification passed 2026-03-03 11:50:54,777 - INFO - Project default-domain:k8s-ctest-non-default-10623013 for Namespace ctest-non-default-10623013 is seen in contrail-api 2026-03-03 11:50:54,778 - DEBUG - Project uuid in Contrail is 64ee2ec5-bc85-424e-aead-9dc9e963fb9e 2026-03-03 11:50:54,778 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=258689af-3bf9-407d-8d5e-1fedb0a4f648 2026-03-03 11:50:54,784 - INFO - Namespace ctest-non-default-10623013 with uuid 258689af-3bf9-407d-8d5e-1fedb0a4f648 found in kube manager 2026-03-03 11:50:54,784 - INFO - Namespace ctest-non-default-10623013 verification passed 2026-03-03 11:50:54,791 - DEBUG - Pod ctest-pod-14628913 not in running state.Currently in Pending 2026-03-03 11:50:59,801 - DEBUG - Pod ctest-pod-14628913 not in running state.Currently in Pending 2026-03-03 11:51:04,810 - DEBUG - Pod ctest-pod-14628913 not in running state.Currently in Pending 2026-03-03 11:51:09,821 - INFO - Pod ctest-pod-14628913 is in running state.Got IP 10.47.255.251 2026-03-03 11:51:09,878 - DEBUG - Pod ctest-pod-14628913 has vmi 3caebbc6-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:09,878 - INFO - Verified pod ctest-pod-14628913 in contrail-api 2026-03-03 11:51:09,895 - DEBUG - VMI 3caebbc6-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:09,896 - INFO - Verified Pod ctest-pod-14628913 in agent 10.0.0.249 2026-03-03 11:51:09,896 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=dec931d7-99c7-49c4-b596-710c5b69bb20 2026-03-03 11:51:09,903 - INFO - Pod ctest-pod-14628913 with uuid dec931d7-99c7-49c4-b596-710c5b69bb20 found in kube manager 2026-03-03 11:51:09,903 - INFO - Pod ctest-pod-14628913 verification passed 2026-03-03 11:51:09,911 - INFO - Pod ctest-pod-96812919 is in running state.Got IP 10.47.255.250 2026-03-03 11:51:09,927 - DEBUG - Pod ctest-pod-96812919 has vmi 3d372650-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:09,927 - INFO - Verified pod ctest-pod-96812919 in contrail-api 2026-03-03 11:51:09,942 - DEBUG - VMI 3d372650-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:09,943 - INFO - Verified Pod ctest-pod-96812919 in agent 10.0.0.249 2026-03-03 11:51:09,943 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=06383a7a-17ad-4686-b7c9-3f789d129efa 2026-03-03 11:51:09,947 - INFO - Pod ctest-pod-96812919 with uuid 06383a7a-17ad-4686-b7c9-3f789d129efa found in kube manager 2026-03-03 11:51:09,947 - INFO - Pod ctest-pod-96812919 verification passed 2026-03-03 11:51:09,955 - INFO - Pod ctest-pod-35511019 is in running state.Got IP 10.47.255.249 2026-03-03 11:51:10,011 - DEBUG - Pod ctest-pod-35511019 has vmi 3de53998-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:10,011 - INFO - Verified pod ctest-pod-35511019 in contrail-api 2026-03-03 11:51:10,024 - DEBUG - VMI 3de53998-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:10,025 - INFO - Verified Pod ctest-pod-35511019 in agent 10.0.0.249 2026-03-03 11:51:10,025 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=3ce3a53c-fab3-4d0e-b835-2addb2b6e750 2026-03-03 11:51:10,029 - INFO - Pod ctest-pod-35511019 with uuid 3ce3a53c-fab3-4d0e-b835-2addb2b6e750 found in kube manager 2026-03-03 11:51:10,030 - INFO - Pod ctest-pod-35511019 verification passed 2026-03-03 11:51:10,038 - INFO - Pod ctest-pod-70585404 is in running state.Got IP 10.47.255.248 2026-03-03 11:51:10,094 - DEBUG - Pod ctest-pod-70585404 has vmi 3e6e57fa-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:10,095 - INFO - Verified pod ctest-pod-70585404 in contrail-api 2026-03-03 11:51:10,108 - DEBUG - VMI 3e6e57fa-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:10,108 - INFO - Verified Pod ctest-pod-70585404 in agent 10.0.0.249 2026-03-03 11:51:10,109 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=51cf3a68-9fca-44a3-8180-ab3f83a50738 2026-03-03 11:51:10,114 - INFO - Pod ctest-pod-70585404 with uuid 51cf3a68-9fca-44a3-8180-ab3f83a50738 found in kube manager 2026-03-03 11:51:10,114 - INFO - Pod ctest-pod-70585404 verification passed 2026-03-03 11:51:10,123 - INFO - Pod ctest-pod-33161868 is in running state.Got IP 10.47.255.247 2026-03-03 11:51:10,146 - DEBUG - Pod ctest-pod-33161868 has vmi 3eeffa26-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:10,146 - INFO - Verified pod ctest-pod-33161868 in contrail-api 2026-03-03 11:51:10,162 - DEBUG - VMI 3eeffa26-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:10,162 - INFO - Verified Pod ctest-pod-33161868 in agent 10.0.0.249 2026-03-03 11:51:10,162 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9422960f-3d7a-43ed-a470-c54389b64fd7 2026-03-03 11:51:10,167 - INFO - Pod ctest-pod-33161868 with uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 found in kube manager 2026-03-03 11:51:10,168 - INFO - Pod ctest-pod-33161868 verification passed 2026-03-03 11:51:10,175 - INFO - Pod ctest-pod-04945438 is in running state.Got IP 10.47.255.245 2026-03-03 11:51:10,236 - DEBUG - Pod ctest-pod-04945438 has vmi 40130010-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:10,236 - INFO - Verified pod ctest-pod-04945438 in contrail-api 2026-03-03 11:51:10,254 - DEBUG - VMI 40130010-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:10,254 - INFO - Verified Pod ctest-pod-04945438 in agent 10.0.0.249 2026-03-03 11:51:10,254 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=14857f66-2fee-4e35-903e-9f6e9d4fca8f 2026-03-03 11:51:10,259 - INFO - Pod ctest-pod-04945438 with uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f found in kube manager 2026-03-03 11:51:10,259 - INFO - Pod ctest-pod-04945438 verification passed 2026-03-03 11:51:10,267 - INFO - Pod ctest-pod-60415222 is in running state.Got IP 10.47.255.246 2026-03-03 11:51:10,322 - DEBUG - Pod ctest-pod-60415222 has vmi 3f88bc20-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:10,322 - INFO - Verified pod ctest-pod-60415222 in contrail-api 2026-03-03 11:51:10,335 - DEBUG - VMI 3f88bc20-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:10,336 - INFO - Verified Pod ctest-pod-60415222 in agent 10.0.0.249 2026-03-03 11:51:10,336 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=08d20563-cfd1-4e47-bd0c-a724e20bfa28 2026-03-03 11:51:10,341 - INFO - Pod ctest-pod-60415222 with uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 found in kube manager 2026-03-03 11:51:10,341 - INFO - Pod ctest-pod-60415222 verification passed 2026-03-03 11:51:10,347 - INFO - Pod ctest-pod-64191807 is in running state.Got IP 10.47.255.244 2026-03-03 11:51:10,362 - DEBUG - Pod ctest-pod-64191807 has vmi 4098a954-16f7-11f1-aae5-fa163e36d168 2026-03-03 11:51:10,363 - INFO - Verified pod ctest-pod-64191807 in contrail-api 2026-03-03 11:51:10,377 - DEBUG - VMI 4098a954-16f7-11f1-aae5-fa163e36d168 is active in agent 10.0.0.249 2026-03-03 11:51:10,378 - INFO - Verified Pod ctest-pod-64191807 in agent 10.0.0.249 2026-03-03 11:51:10,378 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f97310d7-118e-4eed-b8c0-239280c3464e 2026-03-03 11:51:10,383 - INFO - Pod ctest-pod-64191807 with uuid f97310d7-118e-4eed-b8c0-239280c3464e found in kube manager 2026-03-03 11:51:10,384 - INFO - Pod ctest-pod-64191807 verification passed 2026-03-03 11:51:10,384 - INFO - ================================================================================ 2026-03-03 11:51:10,384 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-03-03 11:51:10,384 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-03-03 11:51:10,654 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.0.0.22': '0'}} with 2026-03-03 11:51:10,654 - INFO - Initial checks done. Running the testcase now 2026-03-03 11:51:10,654 - INFO - 2026-03-03 11:51:10,714 - DEBUG - [Pod ctest-pod-14628913] Cmd: echo ctest-pod-14628913 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:51:10,781 - DEBUG - [Pod ctest-pod-96812919] Cmd: echo ctest-pod-96812919 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:51:10,846 - DEBUG - [Pod ctest-pod-35511019] Cmd: echo ctest-pod-35511019 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:51:10,901 - DEBUG - [Pod ctest-pod-70585404] Cmd: echo ctest-pod-70585404 > /usr/share/nginx/html/index.html, Output: 2026-03-03 11:51:10,905 - DEBUG - Service ctest-nginx-svc-86942694 not present 2026-03-03 11:51:10,905 - INFO - Creating service ctest-nginx-svc-86942694 2026-03-03 11:51:10,921 - INFO - Created Service ctest-nginx-svc-86942694 2026-03-03 11:51:10,935 - WARNING - Service UUID f27b6fd8-325f-4686-a868-b4beef13d528 not yet found in contrail-api 2026-03-03 11:51:11,943 - INFO - Validated that Service ctest-nginx-svc-86942694 is seen in contrail-api 2026-03-03 11:51:11,943 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=f27b6fd8-325f-4686-a868-b4beef13d528 2026-03-03 11:51:11,948 - INFO - Service ctest-nginx-svc-86942694 with uuid f27b6fd8-325f-4686-a868-b4beef13d528 found in kube manager 2026-03-03 11:51:11,948 - INFO - Service ctest-nginx-svc-86942694 verification passed 2026-03-03 11:51:13,027 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96812919 2026-03-03 11:51:13,027 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 passed 2026-03-03 11:51:13,027 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96812919 2026-03-03 11:51:13,085 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-14628913 Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:51:13,085 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 passed 2026-03-03 11:51:13,085 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-14628913 Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:51:13,085 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-14628913': 1, 'ctest-pod-96812919': 1} 2026-03-03 11:51:13,153 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96812919 2026-03-03 11:51:13,154 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 passed 2026-03-03 11:51:13,154 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96812919 2026-03-03 11:51:13,218 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-14628913 Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:51:13,220 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 passed 2026-03-03 11:51:13,220 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: ctest-pod-14628913 Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:51:13,220 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-14628913': 1, 'ctest-pod-96812919': 1} 2026-03-03 11:51:13,224 - DEBUG - Network policy ingress-on-service not present 2026-03-03 11:51:13,225 - INFO - Creating Network Policy ingress-on-service 2026-03-03 11:51:13,240 - INFO - Network policy found in k8s 2026-03-03 11:51:13,240 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=646da469-24c2-43e9-9cdd-248ae65d2eb8 2026-03-03 11:51:13,249 - INFO - Network Policy ingress-on-service with uuid 646da469-24c2-43e9-9cdd-248ae65d2eb8 found in kube manager 2026-03-03 11:51:13,304 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-03-03 11:51:13,304 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-03-03 11:51:13,309 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=646da469-24c2-43e9-9cdd-248ae65d2eb8 2026-03-03 11:51:13,385 - WARNING - Network policy with name ingress-on-service not found in agent 2026-03-03 11:51:15,386 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=646da469-24c2-43e9-9cdd-248ae65d2eb8 2026-03-03 11:51:15,415 - INFO - Network policy with name ingress-on-service found in agent 2026-03-03 11:51:15,415 - INFO - Network Policy ingress-on-service verification passed 2026-03-03 11:51:20,475 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:20,475 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:20,476 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:25,528 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:25,528 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:25,528 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:30,603 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:30,603 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:30,603 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:35,667 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:35,668 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:35,668 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:40,724 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:40,724 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:40,724 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:45,792 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:45,792 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:45,792 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:50,843 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:50,843 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:50,843 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:55,904 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:51:55,905 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:51:55,905 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:00,963 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:00,964 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:00,964 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:06,022 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:06,023 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:06,023 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:06,023 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-14628913': 0, 'ctest-pod-96812919': 0} 2026-03-03 11:52:06,084 - DEBUG - [Pod ctest-pod-60415222] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14628913 2026-03-03 11:52:06,084 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 passed 2026-03-03 11:52:06,084 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14628913 2026-03-03 11:52:06,144 - DEBUG - [Pod ctest-pod-60415222] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:52:06,144 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 passed 2026-03-03 11:52:06,144 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd output: ctest-pod-96812919 Connecting to 10.103.35.33:80 (10.103.35.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:52:06,144 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-14628913': 1, 'ctest-pod-96812919': 1} 2026-03-03 11:52:11,202 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:11,202 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:11,203 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:16,259 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:16,259 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:16,259 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:21,314 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:21,314 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:21,315 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:26,368 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:26,369 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:26,369 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:31,427 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:31,427 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:31,427 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:36,495 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:36,495 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:36,495 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:41,546 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:41,546 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:41,546 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:46,610 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:46,610 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:46,611 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:51,663 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:51,663 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:51,663 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:56,743 - DEBUG - [Pod ctest-pod-04945438] Cmd: wget http://10.103.35.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:56,743 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd wget http://10.103.35.33:80/ -O - -T 5 -t 1 failed. 2026-03-03 11:52:56,743 - DEBUG - [Pod Pod ctest-pod-04945438] Cmd output: Connecting to 10.103.35.33:80 (10.103.35.33:80) wget: download timed out 2026-03-03 11:52:56,743 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-14628913': 0, 'ctest-pod-96812919': 0} 2026-03-03 11:52:58,799 - DEBUG - [Pod ctest-pod-60415222] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.837 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.333/0.837 ms 2026-03-03 11:52:58,799 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-60415222 with expectation True passed 2026-03-03 11:53:00,852 - DEBUG - [Pod ctest-pod-33161868] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.086 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.130 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.430/1.086 ms 2026-03-03 11:53:00,852 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-33161868 with expectation True passed 2026-03-03 11:53:02,903 - DEBUG - [Pod ctest-pod-04945438] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.572 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.123 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.095/0.263/0.572 ms 2026-03-03 11:53:02,903 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04945438 with expectation True passed 2026-03-03 11:53:02,962 - DEBUG - [Pod ctest-pod-60415222] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-14628913 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:02,962 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-03-03 11:53:02,962 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd output: ctest-pod-14628913 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:02,962 - INFO - wget check of of http://10.47.255.251 from ctest-pod-60415222 passed 2026-03-03 11:53:03,022 - DEBUG - [Pod ctest-pod-60415222] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:03,022 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:03,022 - DEBUG - [Pod Pod ctest-pod-60415222] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:03,022 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60415222 passed 2026-03-03 11:53:03,083 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:03,083 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:03,083 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:03,084 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:05,141 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:05,141 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:05,141 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:05,142 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:07,218 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:07,218 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:07,218 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:07,218 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:09,277 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:09,277 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:09,277 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:09,277 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:11,337 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) ctest-pod-96812919 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:11,337 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:11,337 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) ctest-pod-96812919 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:11,337 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:13,388 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:13,388 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:13,388 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:13,388 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:15,452 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:15,452 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:15,452 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:15,452 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:17,518 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:17,519 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:17,519 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:17,519 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:19,582 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:19,582 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:19,582 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:19,582 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:21,646 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:21,646 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:21,647 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:21,647 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:23,704 - DEBUG - [Pod ctest-pod-33161868] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:23,705 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-03 11:53:23,705 - DEBUG - [Pod Pod ctest-pod-33161868] Cmd output: ctest-pod-96812919 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-03 11:53:23,705 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-33161868 failed 2026-03-03 11:53:23,713 - INFO - Deleting Network Policy : ingress-on-service 2026-03-03 11:53:23,714 - INFO - Deleting service : ctest-nginx-svc-86942694 2026-03-03 11:53:23,999 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Tue Mar 3 11:53:23 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1, output_file='-') 2860 assert self.validate_wget(self.client2_pod_ns1, url2, output_file='-') 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False, output_file='-') 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False, output_file='-') 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7f3e85378670>> self.client1_pod_ns1 = url2 = 'http://10.47.255.250' expectation undefined output_file undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False, output_file='-') AssertionError 2026-03-03 11:53:24,012 - DEBUG - No XMPP flaps were noticed during the test 2026-03-03 11:53:24,012 - INFO -
2026-03-03 11:53:24,012 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:14]
2026-03-03 11:53:24,012 - INFO - -------------------------------------------------------------------------------- 2026-03-03 11:53:24,017 - INFO - Deleting pod ctest-new-default-67135373:ctest-pod-14628913 2026-03-03 11:53:24,018 - INFO - Deleting pod ctest-new-default-67135373:ctest-pod-96812919 2026-03-03 11:53:24,019 - INFO - Deleting pod ctest-non-default-10623013:ctest-pod-35511019 2026-03-03 11:53:24,019 - INFO - Deleting pod ctest-non-default-10623013:ctest-pod-70585404 2026-03-03 11:53:24,020 - INFO - Deleting pod ctest-new-default-67135373:ctest-pod-33161868 2026-03-03 11:53:24,020 - INFO - Deleting pod ctest-new-default-67135373:ctest-pod-60415222 2026-03-03 11:53:24,021 - INFO - Deleting pod ctest-non-default-10623013:ctest-pod-04945438 2026-03-03 11:53:24,021 - INFO - Deleting pod ctest-non-default-10623013:ctest-pod-64191807 2026-03-03 11:53:24,205 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,207 - WARNING - Pod uuid 06383a7a-17ad-4686-b7c9-3f789d129efa is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,208 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,209 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,209 - WARNING - Pod uuid dec931d7-99c7-49c4-b596-710c5b69bb20 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,214 - WARNING - Pod uuid 51cf3a68-9fca-44a3-8180-ab3f83a50738 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,216 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:24,217 - WARNING - Pod uuid 3ce3a53c-fab3-4d0e-b835-2addb2b6e750 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:29,237 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:29,237 - DEBUG - Pod 3ce3a53c-fab3-4d0e-b835-2addb2b6e750 is not in agent 10.0.0.249 VM list 2026-03-03 11:53:29,239 - DEBUG - Pod 51cf3a68-9fca-44a3-8180-ab3f83a50738 is not in agent 10.0.0.249 VM list 2026-03-03 11:53:29,240 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:29,240 - DEBUG - Pod dec931d7-99c7-49c4-b596-710c5b69bb20 is not in agent 10.0.0.249 VM list 2026-03-03 11:53:29,244 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:29,245 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:29,245 - DEBUG - Pod 06383a7a-17ad-4686-b7c9-3f789d129efa is not in agent 10.0.0.249 VM list 2026-03-03 11:53:29,257 - DEBUG - VMI 3caebbc6-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:29,257 - INFO - Verified that pod ctest-pod-14628913 is removed in agent 2026-03-03 11:53:29,257 - DEBUG - VMI 3d372650-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:29,257 - INFO - Verified that pod ctest-pod-96812919 is removed in agent 2026-03-03 11:53:29,258 - DEBUG - VMI 3de53998-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:29,258 - INFO - Verified that pod ctest-pod-35511019 is removed in agent 2026-03-03 11:53:29,259 - DEBUG - VMI 3e6e57fa-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:29,259 - INFO - Verified that pod ctest-pod-70585404 is removed in agent 2026-03-03 11:53:34,251 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:34,251 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:34,255 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:34,257 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:39,260 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:39,265 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:39,267 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:39,267 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:44,273 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:44,280 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:44,282 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:44,282 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:49,280 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:49,294 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:49,295 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:49,296 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:54,290 - WARNING - Pod uuid 9422960f-3d7a-43ed-a470-c54389b64fd7 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:54,310 - WARNING - Pod uuid f97310d7-118e-4eed-b8c0-239280c3464e is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:54,312 - WARNING - Pod uuid 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:54,312 - WARNING - Pod uuid 14857f66-2fee-4e35-903e-9f6e9d4fca8f is still seen in agent 10.0.0.249 VM list 2026-03-03 11:53:59,298 - DEBUG - Pod 9422960f-3d7a-43ed-a470-c54389b64fd7 is not in agent 10.0.0.249 VM list 2026-03-03 11:53:59,305 - DEBUG - VMI 3eeffa26-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:59,305 - INFO - Verified that pod ctest-pod-33161868 is removed in agent 2026-03-03 11:53:59,324 - DEBUG - Pod f97310d7-118e-4eed-b8c0-239280c3464e is not in agent 10.0.0.249 VM list 2026-03-03 11:53:59,327 - DEBUG - Pod 14857f66-2fee-4e35-903e-9f6e9d4fca8f is not in agent 10.0.0.249 VM list 2026-03-03 11:53:59,329 - DEBUG - Pod 08d20563-cfd1-4e47-bd0c-a724e20bfa28 is not in agent 10.0.0.249 VM list 2026-03-03 11:53:59,339 - DEBUG - VMI 4098a954-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:59,339 - INFO - Verified that pod ctest-pod-64191807 is removed in agent 2026-03-03 11:53:59,341 - DEBUG - VMI 40130010-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:59,341 - INFO - Verified that pod ctest-pod-04945438 is removed in agent 2026-03-03 11:53:59,341 - DEBUG - VMI 3f88bc20-16f7-11f1-aae5-fa163e36d168 is removed from agent 10.0.0.249 2026-03-03 11:53:59,341 - INFO - Verified that pod ctest-pod-60415222 is removed in agent 2026-03-03 11:53:59,341 - INFO - Deleting namespace ctest-non-default-10623013 2026-03-03 11:53:59,361 - DEBUG - Namespace ctest-non-default-10623013 still in k8s 2026-03-03 11:54:01,367 - DEBUG - Namespace ctest-non-default-10623013 still in k8s 2026-03-03 11:54:03,373 - DEBUG - Namespace ctest-non-default-10623013 still in k8s 2026-03-03 11:54:05,377 - DEBUG - Namespace ctest-non-default-10623013 is not in k8s 2026-03-03 11:54:05,377 - DEBUG - No need to check project deletion in contrail-api 2026-03-03 11:54:05,378 - INFO - Deleting namespace ctest-new-default-67135373 2026-03-03 11:54:05,391 - DEBUG - Namespace ctest-new-default-67135373 still in k8s 2026-03-03 11:54:07,397 - DEBUG - Namespace ctest-new-default-67135373 still in k8s 2026-03-03 11:54:09,402 - DEBUG - Namespace ctest-new-default-67135373 still in k8s 2026-03-03 11:54:11,407 - DEBUG - Namespace ctest-new-default-67135373 is not in k8s 2026-03-03 11:54:11,407 - DEBUG - No need to check project deletion in contrail-api