2025-05-13 08:19:09,730 - INFO - Using existing project ['default-domain', 'k8s-default'](e9d4682f-c55b-47eb-8534-36b8c790c646) 2025-05-13 08:19:09,747 - DEBUG - Namespace ctest-new-default-06594768 not present 2025-05-13 08:19:09,755 - INFO - Created namespace ctest-new-default-06594768 2025-05-13 08:19:12,760 - DEBUG - Namespace ctest-non-default-04460084 not present 2025-05-13 08:19:12,772 - INFO - Created namespace ctest-non-default-04460084 2025-05-13 08:19:15,792 - DEBUG - Pod ctest-pod-23493436 not present 2025-05-13 08:19:15,792 - INFO - Creating Pod ctest-pod-23493436 2025-05-13 08:19:15,815 - DEBUG - Pod : ctest-pod-23493436 UUID is c72751e2-3777-47e5-8fee-e25b19974a0e 2025-05-13 08:19:15,817 - DEBUG - Pod ctest-pod-22162466 not present 2025-05-13 08:19:15,817 - INFO - Creating Pod ctest-pod-22162466 2025-05-13 08:19:15,863 - DEBUG - Pod : ctest-pod-22162466 UUID is 1e791845-bc2a-40d9-b31e-67dae45126f5 2025-05-13 08:19:15,869 - DEBUG - Pod ctest-pod-66377200 not present 2025-05-13 08:19:15,870 - INFO - Creating Pod ctest-pod-66377200 2025-05-13 08:19:15,902 - DEBUG - Pod : ctest-pod-66377200 UUID is 0c4fb16b-7206-4fbb-ad27-77069fd07359 2025-05-13 08:19:15,904 - DEBUG - Pod ctest-pod-59553404 not present 2025-05-13 08:19:15,905 - INFO - Creating Pod ctest-pod-59553404 2025-05-13 08:19:15,921 - DEBUG - Pod : ctest-pod-59553404 UUID is 984a3d8c-601a-423b-bf93-755c94d37737 2025-05-13 08:19:15,923 - DEBUG - Pod ctest-pod-18150441 not present 2025-05-13 08:19:15,923 - INFO - Creating Pod ctest-pod-18150441 2025-05-13 08:19:15,938 - DEBUG - Pod : ctest-pod-18150441 UUID is 67cbd6bb-719b-43b5-8c12-42dd1f92802c 2025-05-13 08:19:15,940 - DEBUG - Pod ctest-pod-40903471 not present 2025-05-13 08:19:15,940 - INFO - Creating Pod ctest-pod-40903471 2025-05-13 08:19:15,955 - DEBUG - Pod : ctest-pod-40903471 UUID is 1d3ed379-61b1-4361-9313-afa3f4366672 2025-05-13 08:19:15,957 - DEBUG - Pod ctest-pod-87632424 not present 2025-05-13 08:19:15,957 - INFO - Creating Pod ctest-pod-87632424 2025-05-13 08:19:15,976 - DEBUG - Pod : ctest-pod-87632424 UUID is 62ea060c-595f-4f53-ae9e-9d263a6fe6f6 2025-05-13 08:19:15,979 - DEBUG - Pod ctest-pod-51460028 not present 2025-05-13 08:19:15,979 - INFO - Creating Pod ctest-pod-51460028 2025-05-13 08:19:16,010 - DEBUG - Pod : ctest-pod-51460028 UUID is fc33ded6-53b4-4570-99e7-86ecea561385 2025-05-13 08:19:16,211 - INFO - Project default-domain:k8s-ctest-new-default-06594768 for Namespace ctest-new-default-06594768 is seen in contrail-api 2025-05-13 08:19:16,211 - DEBUG - Project uuid in Contrail is 32942211-8124-45c8-8218-f4c15a9e3e01 2025-05-13 08:19:16,358 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=79deaa86-325e-44eb-b397-98143e608d90 2025-05-13 08:19:16,362 - INFO - Namespace ctest-new-default-06594768 with uuid 79deaa86-325e-44eb-b397-98143e608d90 found in kube manager 2025-05-13 08:19:16,362 - INFO - Namespace ctest-new-default-06594768 verification passed 2025-05-13 08:19:16,586 - INFO - Project default-domain:k8s-ctest-non-default-04460084 for Namespace ctest-non-default-04460084 is seen in contrail-api 2025-05-13 08:19:16,586 - DEBUG - Project uuid in Contrail is 44553658-1b6e-4b33-bbc3-cf6d6a0d4edf 2025-05-13 08:19:16,586 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=7736cb34-0a12-466c-b0bb-920b69b0ee4c 2025-05-13 08:19:16,593 - INFO - Namespace ctest-non-default-04460084 with uuid 7736cb34-0a12-466c-b0bb-920b69b0ee4c found in kube manager 2025-05-13 08:19:16,593 - INFO - Namespace ctest-non-default-04460084 verification passed 2025-05-13 08:19:16,598 - DEBUG - Pod ctest-pod-23493436 not in running state.Currently in Pending 2025-05-13 08:19:21,604 - DEBUG - Pod ctest-pod-23493436 not in running state.Currently in Pending 2025-05-13 08:19:26,610 - INFO - Pod ctest-pod-23493436 is in running state.Got IP 10.47.255.251 2025-05-13 08:19:26,622 - DEBUG - Pod ctest-pod-23493436 has vmi f6905822-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:26,622 - INFO - Verified pod ctest-pod-23493436 in contrail-api 2025-05-13 08:19:26,634 - DEBUG - VMI f6905822-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:26,635 - INFO - Verified Pod ctest-pod-23493436 in agent 10.0.0.19 2025-05-13 08:19:26,635 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=c72751e2-3777-47e5-8fee-e25b19974a0e 2025-05-13 08:19:26,639 - INFO - Pod ctest-pod-23493436 with uuid c72751e2-3777-47e5-8fee-e25b19974a0e found in kube manager 2025-05-13 08:19:26,639 - INFO - Pod ctest-pod-23493436 verification passed 2025-05-13 08:19:26,644 - DEBUG - Pod ctest-pod-22162466 not in running state.Currently in Pending 2025-05-13 08:19:31,650 - INFO - Pod ctest-pod-22162466 is in running state.Got IP 10.47.255.250 2025-05-13 08:19:31,703 - DEBUG - Pod ctest-pod-22162466 has vmi f7053228-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:31,703 - INFO - Verified pod ctest-pod-22162466 in contrail-api 2025-05-13 08:19:31,715 - DEBUG - VMI f7053228-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:31,715 - INFO - Verified Pod ctest-pod-22162466 in agent 10.0.0.19 2025-05-13 08:19:31,716 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1e791845-bc2a-40d9-b31e-67dae45126f5 2025-05-13 08:19:31,719 - INFO - Pod ctest-pod-22162466 with uuid 1e791845-bc2a-40d9-b31e-67dae45126f5 found in kube manager 2025-05-13 08:19:31,719 - INFO - Pod ctest-pod-22162466 verification passed 2025-05-13 08:19:31,725 - INFO - Pod ctest-pod-66377200 is in running state.Got IP 10.47.255.249 2025-05-13 08:19:31,743 - DEBUG - Pod ctest-pod-66377200 has vmi f7a134fc-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:31,743 - INFO - Verified pod ctest-pod-66377200 in contrail-api 2025-05-13 08:19:31,756 - DEBUG - VMI f7a134fc-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:31,757 - INFO - Verified Pod ctest-pod-66377200 in agent 10.0.0.19 2025-05-13 08:19:31,757 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=0c4fb16b-7206-4fbb-ad27-77069fd07359 2025-05-13 08:19:31,761 - INFO - Pod ctest-pod-66377200 with uuid 0c4fb16b-7206-4fbb-ad27-77069fd07359 found in kube manager 2025-05-13 08:19:31,761 - INFO - Pod ctest-pod-66377200 verification passed 2025-05-13 08:19:31,767 - INFO - Pod ctest-pod-59553404 is in running state.Got IP 10.47.255.248 2025-05-13 08:19:31,823 - DEBUG - Pod ctest-pod-59553404 has vmi f81975b6-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:31,824 - INFO - Verified pod ctest-pod-59553404 in contrail-api 2025-05-13 08:19:31,843 - DEBUG - VMI f81975b6-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:31,843 - INFO - Verified Pod ctest-pod-59553404 in agent 10.0.0.19 2025-05-13 08:19:31,843 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=984a3d8c-601a-423b-bf93-755c94d37737 2025-05-13 08:19:31,848 - INFO - Pod ctest-pod-59553404 with uuid 984a3d8c-601a-423b-bf93-755c94d37737 found in kube manager 2025-05-13 08:19:31,848 - INFO - Pod ctest-pod-59553404 verification passed 2025-05-13 08:19:31,853 - DEBUG - Pod ctest-pod-18150441 not in running state.Currently in Pending 2025-05-13 08:19:36,866 - INFO - Pod ctest-pod-18150441 is in running state.Got IP 10.47.255.247 2025-05-13 08:19:36,885 - DEBUG - Pod ctest-pod-18150441 has vmi f89f758a-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:36,886 - INFO - Verified pod ctest-pod-18150441 in contrail-api 2025-05-13 08:19:36,899 - DEBUG - VMI f89f758a-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:36,899 - INFO - Verified Pod ctest-pod-18150441 in agent 10.0.0.19 2025-05-13 08:19:36,899 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=67cbd6bb-719b-43b5-8c12-42dd1f92802c 2025-05-13 08:19:36,910 - INFO - Pod ctest-pod-18150441 with uuid 67cbd6bb-719b-43b5-8c12-42dd1f92802c found in kube manager 2025-05-13 08:19:36,910 - INFO - Pod ctest-pod-18150441 verification passed 2025-05-13 08:19:36,920 - INFO - Pod ctest-pod-87632424 is in running state.Got IP 10.47.255.245 2025-05-13 08:19:36,984 - DEBUG - Pod ctest-pod-87632424 has vmi f97af43e-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:36,984 - INFO - Verified pod ctest-pod-87632424 in contrail-api 2025-05-13 08:19:37,005 - DEBUG - VMI f97af43e-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:37,005 - INFO - Verified Pod ctest-pod-87632424 in agent 10.0.0.19 2025-05-13 08:19:37,009 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=62ea060c-595f-4f53-ae9e-9d263a6fe6f6 2025-05-13 08:19:37,021 - INFO - Pod ctest-pod-87632424 with uuid 62ea060c-595f-4f53-ae9e-9d263a6fe6f6 found in kube manager 2025-05-13 08:19:37,021 - INFO - Pod ctest-pod-87632424 verification passed 2025-05-13 08:19:37,150 - INFO - Pod ctest-pod-40903471 is in running state.Got IP 10.47.255.246 2025-05-13 08:19:37,165 - DEBUG - Pod ctest-pod-40903471 has vmi f9100a34-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:37,165 - INFO - Verified pod ctest-pod-40903471 in contrail-api 2025-05-13 08:19:37,181 - DEBUG - VMI f9100a34-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:37,181 - INFO - Verified Pod ctest-pod-40903471 in agent 10.0.0.19 2025-05-13 08:19:37,185 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1d3ed379-61b1-4361-9313-afa3f4366672 2025-05-13 08:19:37,191 - INFO - Pod ctest-pod-40903471 with uuid 1d3ed379-61b1-4361-9313-afa3f4366672 found in kube manager 2025-05-13 08:19:37,191 - INFO - Pod ctest-pod-40903471 verification passed 2025-05-13 08:19:37,196 - INFO - Pod ctest-pod-51460028 is in running state.Got IP 10.47.255.244 2025-05-13 08:19:37,218 - DEBUG - Pod ctest-pod-51460028 has vmi f9e59dd4-2fd2-11f0-a637-fa163e2b49a7 2025-05-13 08:19:37,218 - INFO - Verified pod ctest-pod-51460028 in contrail-api 2025-05-13 08:19:37,234 - DEBUG - VMI f9e59dd4-2fd2-11f0-a637-fa163e2b49a7 is active in agent 10.0.0.19 2025-05-13 08:19:37,234 - INFO - Verified Pod ctest-pod-51460028 in agent 10.0.0.19 2025-05-13 08:19:37,234 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=fc33ded6-53b4-4570-99e7-86ecea561385 2025-05-13 08:19:37,241 - INFO - Pod ctest-pod-51460028 with uuid fc33ded6-53b4-4570-99e7-86ecea561385 found in kube manager 2025-05-13 08:19:37,242 - INFO - Pod ctest-pod-51460028 verification passed 2025-05-13 08:19:37,242 - INFO - ================================================================================ 2025-05-13 08:19:37,242 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-13 08:19:37,242 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-13 08:19:37,550 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.249': '0'}} with 2025-05-13 08:19:37,550 - INFO - Initial checks done. Running the testcase now 2025-05-13 08:19:37,550 - INFO - 2025-05-13 08:19:37,601 - DEBUG - [Pod ctest-pod-23493436] Cmd: echo ctest-pod-23493436 > /usr/share/nginx/html/index.html, Output: 2025-05-13 08:19:37,657 - DEBUG - [Pod ctest-pod-22162466] Cmd: echo ctest-pod-22162466 > /usr/share/nginx/html/index.html, Output: 2025-05-13 08:19:37,714 - DEBUG - [Pod ctest-pod-66377200] Cmd: echo ctest-pod-66377200 > /usr/share/nginx/html/index.html, Output: 2025-05-13 08:19:37,765 - DEBUG - [Pod ctest-pod-59553404] Cmd: echo ctest-pod-59553404 > /usr/share/nginx/html/index.html, Output: 2025-05-13 08:19:37,825 - DEBUG - Service ctest-nginx-svc-91153470 not present 2025-05-13 08:19:37,825 - INFO - Creating service ctest-nginx-svc-91153470 2025-05-13 08:19:37,838 - INFO - Created Service ctest-nginx-svc-91153470 2025-05-13 08:19:37,843 - WARNING - Service UUID 6d71f827-c612-4dfe-b7ea-399b4a04ae84 not yet found in contrail-api 2025-05-13 08:19:38,856 - INFO - Validated that Service ctest-nginx-svc-91153470 is seen in contrail-api 2025-05-13 08:19:38,856 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=6d71f827-c612-4dfe-b7ea-399b4a04ae84 2025-05-13 08:19:38,861 - INFO - Service ctest-nginx-svc-91153470 with uuid 6d71f827-c612-4dfe-b7ea-399b4a04ae84 found in kube manager 2025-05-13 08:19:38,861 - INFO - Service ctest-nginx-svc-91153470 verification passed 2025-05-13 08:19:39,923 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22162466 2025-05-13 08:19:39,923 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:19:39,924 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22162466 2025-05-13 08:19:39,979 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-23493436 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:19:39,979 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:19:39,979 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: ctest-pod-23493436 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:19:39,979 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23493436': 1, 'ctest-pod-22162466': 1} 2025-05-13 08:19:40,040 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22162466 2025-05-13 08:19:40,040 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:19:40,040 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22162466 2025-05-13 08:19:40,094 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-23493436 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:19:40,094 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:19:40,094 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: ctest-pod-23493436 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:19:40,095 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23493436': 1, 'ctest-pod-22162466': 1} 2025-05-13 08:19:40,097 - DEBUG - Network policy ingress-on-service not present 2025-05-13 08:19:40,098 - INFO - Creating Network Policy ingress-on-service 2025-05-13 08:19:40,151 - INFO - Network policy found in k8s 2025-05-13 08:19:40,151 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d519d97-8e9c-472b-9c21-1c545a17ddee 2025-05-13 08:19:40,156 - INFO - Network Policy ingress-on-service with uuid 6d519d97-8e9c-472b-9c21-1c545a17ddee found in kube manager 2025-05-13 08:19:40,191 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-13 08:19:40,191 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-13 08:19:40,192 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d519d97-8e9c-472b-9c21-1c545a17ddee 2025-05-13 08:19:40,227 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-13 08:19:42,229 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d519d97-8e9c-472b-9c21-1c545a17ddee 2025-05-13 08:19:42,260 - INFO - Network policy with name ingress-on-service found in agent 2025-05-13 08:19:42,260 - INFO - Network Policy ingress-on-service verification passed 2025-05-13 08:19:47,324 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:47,324 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:47,324 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:52,375 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:52,375 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:52,376 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:57,428 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:57,429 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:19:57,429 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:02,480 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:02,480 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:02,480 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:07,524 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:07,524 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:07,524 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:12,572 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:12,572 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:12,572 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:17,623 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:17,623 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:17,623 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:22,671 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:22,671 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:22,671 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:27,712 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:27,712 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:27,712 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:32,761 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:32,761 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:32,761 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:32,761 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23493436': 0, 'ctest-pod-22162466': 0} 2025-05-13 08:20:32,818 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:20:32,818 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:20:32,818 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:20:32,870 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23493436 2025-05-13 08:20:32,870 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:20:32,870 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23493436 2025-05-13 08:20:32,870 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23493436': 1, 'ctest-pod-22162466': 1} 2025-05-13 08:20:37,919 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:37,919 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:37,919 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:42,973 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:42,973 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:42,973 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:48,027 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:48,027 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:48,027 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:53,080 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:53,080 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:53,080 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:58,132 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:58,132 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:20:58,132 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:03,185 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:03,185 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:03,185 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:08,231 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:08,231 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:08,231 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:13,283 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:13,283 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:13,283 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:18,331 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:18,331 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:18,331 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:23,383 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:23,383 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:23,383 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:23,383 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23493436': 0, 'ctest-pod-22162466': 0} 2025-05-13 08:21:25,431 - DEBUG - [Pod ctest-pod-40903471] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.286 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.484/1.286 ms 2025-05-13 08:21:25,431 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-40903471 with expectation True passed 2025-05-13 08:21:27,479 - DEBUG - [Pod ctest-pod-18150441] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.384 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.112 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.100/0.198/0.384 ms 2025-05-13 08:21:27,479 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18150441 with expectation True passed 2025-05-13 08:21:29,532 - DEBUG - [Pod ctest-pod-87632424] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.876 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.124 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.356/0.876 ms 2025-05-13 08:21:29,532 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-87632424 with expectation True passed 2025-05-13 08:21:29,587 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:21:29,588 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-13 08:21:29,588 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:21:29,588 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40903471 passed 2025-05-13 08:21:29,642 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:21:29,642 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-13 08:21:29,642 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:21:29,642 - INFO - wget check of of http://10.47.255.250 from ctest-pod-40903471 passed 2025-05-13 08:21:34,696 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 08:21:34,696 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 08:21:34,696 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 08:21:34,696 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18150441 passed 2025-05-13 08:21:39,759 - DEBUG - [Pod ctest-pod-51460028] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-13 08:21:39,759 - DEBUG - [Pod Pod ctest-pod-51460028] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-13 08:21:39,759 - DEBUG - [Pod Pod ctest-pod-51460028] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-13 08:21:39,759 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51460028 passed 2025-05-13 08:21:39,766 - INFO - Updating Network Policy ingress-on-service 2025-05-13 08:21:44,815 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:44,815 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:44,815 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:49,872 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:49,872 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:49,872 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:54,915 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:54,916 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:54,916 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:59,972 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:59,972 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:21:59,972 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:02,661 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-05-13 08:22:13,012 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:13,012 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:13,012 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:18,077 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:18,077 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:18,077 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:23,128 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:23,128 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:23,128 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:28,180 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:28,180 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:28,180 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:33,227 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:33,227 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:33,227 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:38,275 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:38,275 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:38,275 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) wget: download timed out 2025-05-13 08:22:38,275 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23493436': 0, 'ctest-pod-22162466': 0} 2025-05-13 08:22:38,330 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,330 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,330 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,383 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,383 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,383 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,438 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) ctest-pod-23493436 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,438 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,438 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) ctest-pod-23493436 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,438 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23493436': 1, 'ctest-pod-22162466': 2} 2025-05-13 08:22:38,489 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,489 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,489 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,540 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,540 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,540 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,593 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,594 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,594 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: ctest-pod-22162466 Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 08:22:38,640 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22162466 2025-05-13 08:22:38,640 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,640 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22162466 2025-05-13 08:22:38,690 - DEBUG - [Pod ctest-pod-87632424] Cmd: wget http://10.96.228.210:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23493436 2025-05-13 08:22:38,690 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd wget http://10.96.228.210:80/ -O - -T 5 -t 1 passed 2025-05-13 08:22:38,690 - DEBUG - [Pod Pod ctest-pod-87632424] Cmd output: Connecting to 10.96.228.210:80 (10.96.228.210:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23493436 2025-05-13 08:22:38,690 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23493436': 1, 'ctest-pod-22162466': 4} 2025-05-13 08:22:40,739 - DEBUG - [Pod ctest-pod-40903471] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.763 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.309/0.763 ms 2025-05-13 08:22:40,739 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-40903471 with expectation True passed 2025-05-13 08:22:42,791 - DEBUG - [Pod ctest-pod-18150441] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.063 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.405/1.063 ms 2025-05-13 08:22:42,791 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18150441 with expectation True passed 2025-05-13 08:22:44,843 - DEBUG - [Pod ctest-pod-87632424] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.011 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.387/1.011 ms 2025-05-13 08:22:44,843 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-87632424 with expectation True passed 2025-05-13 08:22:44,893 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:22:44,894 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-13 08:22:44,894 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:22:44,894 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40903471 passed 2025-05-13 08:22:44,950 - DEBUG - [Pod ctest-pod-40903471] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:22:44,950 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-13 08:22:44,950 - DEBUG - [Pod Pod ctest-pod-40903471] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:22:44,950 - INFO - wget check of of http://10.47.255.250 from ctest-pod-40903471 passed 2025-05-13 08:22:49,989 - DEBUG - [Pod ctest-pod-18150441] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 08:22:49,989 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 08:22:49,989 - DEBUG - [Pod Pod ctest-pod-18150441] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 08:22:49,989 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18150441 passed 2025-05-13 08:22:50,050 - DEBUG - [Pod ctest-pod-51460028] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:22:50,051 - DEBUG - [Pod Pod ctest-pod-51460028] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-13 08:22:50,051 - DEBUG - [Pod Pod ctest-pod-51460028] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 08:22:50,051 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51460028 passed 2025-05-13 08:22:50,051 - INFO - Deleting Network Policy : ingress-on-service 2025-05-13 08:22:50,051 - INFO - Deleting service : ctest-nginx-svc-91153470 2025-05-13 08:22:50,291 - DEBUG - No XMPP flaps were noticed during the test