2025-05-13 11:02:28,942 - INFO - Using existing project ['default-domain', 'k8s-default'](aa18bfe5-9528-42e3-9663-4042d1aea5c7) 2025-05-13 11:02:28,960 - DEBUG - Namespace ctest-new-default-44329871 not present 2025-05-13 11:02:28,972 - INFO - Created namespace ctest-new-default-44329871 2025-05-13 11:02:31,976 - DEBUG - Namespace ctest-non-default-79381839 not present 2025-05-13 11:02:31,989 - INFO - Created namespace ctest-non-default-79381839 2025-05-13 11:02:35,017 - DEBUG - Pod ctest-pod-38644972 not present 2025-05-13 11:02:35,018 - INFO - Creating Pod ctest-pod-38644972 2025-05-13 11:02:35,040 - DEBUG - Pod : ctest-pod-38644972 UUID is e6025d6b-8cfe-428c-abc4-24fbbc9165b2 2025-05-13 11:02:35,044 - DEBUG - Pod ctest-pod-48641098 not present 2025-05-13 11:02:35,044 - INFO - Creating Pod ctest-pod-48641098 2025-05-13 11:02:35,064 - DEBUG - Pod : ctest-pod-48641098 UUID is 13a8f8fc-42a5-43a9-b79d-3016c257864b 2025-05-13 11:02:35,066 - DEBUG - Pod ctest-pod-54391504 not present 2025-05-13 11:02:35,066 - INFO - Creating Pod ctest-pod-54391504 2025-05-13 11:02:35,082 - DEBUG - Pod : ctest-pod-54391504 UUID is ba22f978-afb6-4055-8314-f0cdcf62f289 2025-05-13 11:02:35,085 - DEBUG - Pod ctest-pod-39395847 not present 2025-05-13 11:02:35,085 - INFO - Creating Pod ctest-pod-39395847 2025-05-13 11:02:35,102 - DEBUG - Pod : ctest-pod-39395847 UUID is f4bf1e9d-9d2b-4135-9c5b-bf3a6afac781 2025-05-13 11:02:35,106 - DEBUG - Pod ctest-pod-53532538 not present 2025-05-13 11:02:35,106 - INFO - Creating Pod ctest-pod-53532538 2025-05-13 11:02:35,122 - DEBUG - Pod : ctest-pod-53532538 UUID is 1d3d2980-2fe6-4274-9682-53aa504e65c1 2025-05-13 11:02:35,124 - DEBUG - Pod ctest-pod-81599732 not present 2025-05-13 11:02:35,124 - INFO - Creating Pod ctest-pod-81599732 2025-05-13 11:02:35,144 - DEBUG - Pod : ctest-pod-81599732 UUID is 129a0207-7a81-4266-b7aa-415674d23f20 2025-05-13 11:02:35,146 - DEBUG - Pod ctest-pod-15359245 not present 2025-05-13 11:02:35,146 - INFO - Creating Pod ctest-pod-15359245 2025-05-13 11:02:35,162 - DEBUG - Pod : ctest-pod-15359245 UUID is 79a17a55-2ac7-43d4-952c-0dad43b2be8d 2025-05-13 11:02:35,164 - DEBUG - Pod ctest-pod-66330189 not present 2025-05-13 11:02:35,164 - INFO - Creating Pod ctest-pod-66330189 2025-05-13 11:02:35,179 - DEBUG - Pod : ctest-pod-66330189 UUID is 74d0cbfe-8c98-4ff3-b201-5e3619282da9 2025-05-13 11:02:35,339 - INFO - Project default-domain:k8s-ctest-new-default-44329871 for Namespace ctest-new-default-44329871 is seen in contrail-api 2025-05-13 11:02:35,339 - DEBUG - Project uuid in Contrail is eebf78a8-666d-472f-a223-5f401549e870 2025-05-13 11:02:35,529 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=a9cbbe2f-138c-494d-b894-e5e6838f1376 2025-05-13 11:02:35,534 - INFO - Namespace ctest-new-default-44329871 with uuid a9cbbe2f-138c-494d-b894-e5e6838f1376 found in kube manager 2025-05-13 11:02:35,534 - INFO - Namespace ctest-new-default-44329871 verification passed 2025-05-13 11:02:35,777 - INFO - Project default-domain:k8s-ctest-non-default-79381839 for Namespace ctest-non-default-79381839 is seen in contrail-api 2025-05-13 11:02:35,777 - DEBUG - Project uuid in Contrail is e2aac2d9-a1d1-4ff5-a427-83e4ddc93e4d 2025-05-13 11:02:35,777 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=10625606-37c1-41a3-b2c0-0b0ff02bdb5d 2025-05-13 11:02:35,780 - INFO - Namespace ctest-non-default-79381839 with uuid 10625606-37c1-41a3-b2c0-0b0ff02bdb5d found in kube manager 2025-05-13 11:02:35,781 - INFO - Namespace ctest-non-default-79381839 verification passed 2025-05-13 11:02:35,785 - DEBUG - Pod ctest-pod-38644972 not in running state.Currently in Pending 2025-05-13 11:02:40,791 - DEBUG - Pod ctest-pod-38644972 not in running state.Currently in Pending 2025-05-13 11:02:45,798 - INFO - Pod ctest-pod-38644972 is in running state.Got IP 10.47.255.251 2025-05-13 11:02:45,811 - DEBUG - Pod ctest-pod-38644972 has vmi c74f0a1a-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:45,811 - INFO - Verified pod ctest-pod-38644972 in contrail-api 2025-05-13 11:02:45,823 - DEBUG - VMI c74f0a1a-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:45,823 - INFO - Verified Pod ctest-pod-38644972 in agent 10.0.0.27 2025-05-13 11:02:45,823 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=e6025d6b-8cfe-428c-abc4-24fbbc9165b2 2025-05-13 11:02:45,828 - INFO - Pod ctest-pod-38644972 with uuid e6025d6b-8cfe-428c-abc4-24fbbc9165b2 found in kube manager 2025-05-13 11:02:45,828 - INFO - Pod ctest-pod-38644972 verification passed 2025-05-13 11:02:45,834 - INFO - Pod ctest-pod-48641098 is in running state.Got IP 10.47.255.250 2025-05-13 11:02:45,893 - DEBUG - Pod ctest-pod-48641098 has vmi c7c1dcca-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:45,893 - INFO - Verified pod ctest-pod-48641098 in contrail-api 2025-05-13 11:02:45,906 - DEBUG - VMI c7c1dcca-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:45,906 - INFO - Verified Pod ctest-pod-48641098 in agent 10.0.0.27 2025-05-13 11:02:45,907 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=13a8f8fc-42a5-43a9-b79d-3016c257864b 2025-05-13 11:02:45,912 - INFO - Pod ctest-pod-48641098 with uuid 13a8f8fc-42a5-43a9-b79d-3016c257864b found in kube manager 2025-05-13 11:02:45,912 - INFO - Pod ctest-pod-48641098 verification passed 2025-05-13 11:02:45,926 - INFO - Pod ctest-pod-54391504 is in running state.Got IP 10.47.255.249 2025-05-13 11:02:45,939 - DEBUG - Pod ctest-pod-54391504 has vmi c85cb268-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:45,939 - INFO - Verified pod ctest-pod-54391504 in contrail-api 2025-05-13 11:02:45,952 - DEBUG - VMI c85cb268-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:45,952 - INFO - Verified Pod ctest-pod-54391504 in agent 10.0.0.27 2025-05-13 11:02:45,952 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=ba22f978-afb6-4055-8314-f0cdcf62f289 2025-05-13 11:02:45,957 - INFO - Pod ctest-pod-54391504 with uuid ba22f978-afb6-4055-8314-f0cdcf62f289 found in kube manager 2025-05-13 11:02:45,957 - INFO - Pod ctest-pod-54391504 verification passed 2025-05-13 11:02:45,962 - INFO - Pod ctest-pod-39395847 is in running state.Got IP 10.47.255.248 2025-05-13 11:02:46,017 - DEBUG - Pod ctest-pod-39395847 has vmi c8d92b18-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:46,017 - INFO - Verified pod ctest-pod-39395847 in contrail-api 2025-05-13 11:02:46,028 - DEBUG - VMI c8d92b18-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:46,028 - INFO - Verified Pod ctest-pod-39395847 in agent 10.0.0.27 2025-05-13 11:02:46,028 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=f4bf1e9d-9d2b-4135-9c5b-bf3a6afac781 2025-05-13 11:02:46,032 - INFO - Pod ctest-pod-39395847 with uuid f4bf1e9d-9d2b-4135-9c5b-bf3a6afac781 found in kube manager 2025-05-13 11:02:46,032 - INFO - Pod ctest-pod-39395847 verification passed 2025-05-13 11:02:46,037 - DEBUG - Pod ctest-pod-53532538 not in running state.Currently in Pending 2025-05-13 11:02:51,053 - INFO - Pod ctest-pod-53532538 is in running state.Got IP 10.47.255.247 2025-05-13 11:02:51,066 - DEBUG - Pod ctest-pod-53532538 has vmi c9594a64-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:51,066 - INFO - Verified pod ctest-pod-53532538 in contrail-api 2025-05-13 11:02:51,080 - DEBUG - VMI c9594a64-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:51,080 - INFO - Verified Pod ctest-pod-53532538 in agent 10.0.0.27 2025-05-13 11:02:51,080 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=1d3d2980-2fe6-4274-9682-53aa504e65c1 2025-05-13 11:02:51,084 - INFO - Pod ctest-pod-53532538 with uuid 1d3d2980-2fe6-4274-9682-53aa504e65c1 found in kube manager 2025-05-13 11:02:51,084 - INFO - Pod ctest-pod-53532538 verification passed 2025-05-13 11:02:51,090 - DEBUG - Pod ctest-pod-15359245 not in running state.Currently in Pending 2025-05-13 11:02:56,099 - INFO - Pod ctest-pod-15359245 is in running state.Got IP 10.47.255.245 2025-05-13 11:02:56,165 - DEBUG - Pod ctest-pod-15359245 has vmi ca30ed2a-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:56,165 - INFO - Verified pod ctest-pod-15359245 in contrail-api 2025-05-13 11:02:56,179 - DEBUG - VMI ca30ed2a-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:56,179 - INFO - Verified Pod ctest-pod-15359245 in agent 10.0.0.27 2025-05-13 11:02:56,179 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=79a17a55-2ac7-43d4-952c-0dad43b2be8d 2025-05-13 11:02:56,188 - INFO - Pod ctest-pod-15359245 with uuid 79a17a55-2ac7-43d4-952c-0dad43b2be8d found in kube manager 2025-05-13 11:02:56,189 - INFO - Pod ctest-pod-15359245 verification passed 2025-05-13 11:02:56,194 - INFO - Pod ctest-pod-81599732 is in running state.Got IP 10.47.255.246 2025-05-13 11:02:56,210 - DEBUG - Pod ctest-pod-81599732 has vmi c9c3d500-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:56,210 - INFO - Verified pod ctest-pod-81599732 in contrail-api 2025-05-13 11:02:56,225 - DEBUG - VMI c9c3d500-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:56,225 - INFO - Verified Pod ctest-pod-81599732 in agent 10.0.0.27 2025-05-13 11:02:56,226 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=129a0207-7a81-4266-b7aa-415674d23f20 2025-05-13 11:02:56,231 - INFO - Pod ctest-pod-81599732 with uuid 129a0207-7a81-4266-b7aa-415674d23f20 found in kube manager 2025-05-13 11:02:56,232 - INFO - Pod ctest-pod-81599732 verification passed 2025-05-13 11:02:56,241 - INFO - Pod ctest-pod-66330189 is in running state.Got IP 10.47.255.244 2025-05-13 11:02:56,305 - DEBUG - Pod ctest-pod-66330189 has vmi caa2e880-2fe9-11f0-a7cc-fa163e1c9a90 2025-05-13 11:02:56,305 - INFO - Verified pod ctest-pod-66330189 in contrail-api 2025-05-13 11:02:56,318 - DEBUG - VMI caa2e880-2fe9-11f0-a7cc-fa163e1c9a90 is active in agent 10.0.0.27 2025-05-13 11:02:56,318 - INFO - Verified Pod ctest-pod-66330189 in agent 10.0.0.27 2025-05-13 11:02:56,318 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=74d0cbfe-8c98-4ff3-b201-5e3619282da9 2025-05-13 11:02:56,323 - INFO - Pod ctest-pod-66330189 with uuid 74d0cbfe-8c98-4ff3-b201-5e3619282da9 found in kube manager 2025-05-13 11:02:56,323 - INFO - Pod ctest-pod-66330189 verification passed 2025-05-13 11:02:56,323 - INFO - ================================================================================ 2025-05-13 11:02:56,323 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-13 11:02:56,324 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-13 11:02:56,571 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.19': '0'}} with 2025-05-13 11:02:56,572 - INFO - Initial checks done. Running the testcase now 2025-05-13 11:02:56,572 - INFO - 2025-05-13 11:02:56,646 - DEBUG - [Pod ctest-pod-38644972] Cmd: echo ctest-pod-38644972 > /usr/share/nginx/html/index.html, Output: 2025-05-13 11:02:56,694 - DEBUG - [Pod ctest-pod-48641098] Cmd: echo ctest-pod-48641098 > /usr/share/nginx/html/index.html, Output: 2025-05-13 11:02:56,752 - DEBUG - [Pod ctest-pod-54391504] Cmd: echo ctest-pod-54391504 > /usr/share/nginx/html/index.html, Output: 2025-05-13 11:02:56,812 - DEBUG - [Pod ctest-pod-39395847] Cmd: echo ctest-pod-39395847 > /usr/share/nginx/html/index.html, Output: 2025-05-13 11:02:56,814 - DEBUG - Service ctest-nginx-svc-05718667 not present 2025-05-13 11:02:56,814 - INFO - Creating service ctest-nginx-svc-05718667 2025-05-13 11:02:56,827 - INFO - Created Service ctest-nginx-svc-05718667 2025-05-13 11:02:56,839 - WARNING - Service UUID 6336242c-9381-4e54-95b2-fc5700bd0b81 not yet found in contrail-api 2025-05-13 11:02:57,846 - INFO - Validated that Service ctest-nginx-svc-05718667 is seen in contrail-api 2025-05-13 11:02:57,846 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=6336242c-9381-4e54-95b2-fc5700bd0b81 2025-05-13 11:02:57,851 - INFO - Service ctest-nginx-svc-05718667 with uuid 6336242c-9381-4e54-95b2-fc5700bd0b81 found in kube manager 2025-05-13 11:02:57,851 - INFO - Service ctest-nginx-svc-05718667 verification passed 2025-05-13 11:02:58,919 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48641098 2025-05-13 11:02:58,919 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:02:58,919 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48641098 2025-05-13 11:02:58,979 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:58,979 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:02:58,980 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,032 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) ctest-pod-38644972 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,032 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:02:59,032 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) ctest-pod-38644972 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,032 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38644972': 1, 'ctest-pod-48641098': 2} 2025-05-13 11:02:59,092 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,092 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:02:59,092 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,145 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,145 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:02:59,145 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,237 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,237 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:02:59,238 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:02:59,238 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38644972': 2, 'ctest-pod-48641098': 1} 2025-05-13 11:02:59,241 - DEBUG - Network policy ingress-on-service not present 2025-05-13 11:02:59,241 - INFO - Creating Network Policy ingress-on-service 2025-05-13 11:02:59,252 - INFO - Network policy found in k8s 2025-05-13 11:02:59,252 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d70c9f9-1940-4acc-b138-16fce8fdb7b8 2025-05-13 11:02:59,279 - INFO - Network Policy ingress-on-service with uuid 6d70c9f9-1940-4acc-b138-16fce8fdb7b8 found in kube manager 2025-05-13 11:02:59,315 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-13 11:02:59,315 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-13 11:02:59,315 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d70c9f9-1940-4acc-b138-16fce8fdb7b8 2025-05-13 11:02:59,343 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-13 11:03:01,344 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d70c9f9-1940-4acc-b138-16fce8fdb7b8 2025-05-13 11:03:01,375 - INFO - Network policy with name ingress-on-service found in agent 2025-05-13 11:03:01,375 - INFO - Network Policy ingress-on-service verification passed 2025-05-13 11:03:06,430 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:06,431 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:06,431 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:11,482 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:11,482 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:11,482 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:16,543 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:16,543 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:16,543 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:21,591 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:21,591 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:21,591 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:26,646 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:26,646 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:26,646 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:31,694 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:31,694 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:31,694 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:36,752 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:36,752 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:36,752 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:41,819 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:41,819 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:41,819 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:46,872 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:46,872 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:46,872 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:51,923 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:51,923 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:51,923 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:51,923 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38644972': 0, 'ctest-pod-48641098': 0} 2025-05-13 11:03:51,984 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:03:51,984 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:03:51,984 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:03:52,040 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:03:52,040 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:03:52,040 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:03:52,040 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38644972': 1, 'ctest-pod-48641098': 1} 2025-05-13 11:03:57,103 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:57,103 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:03:57,103 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:02,163 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:02,163 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:02,163 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:07,211 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:07,211 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:07,211 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:12,265 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:12,265 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:12,265 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:17,323 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:17,323 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:17,323 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:22,385 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:22,385 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:22,385 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:27,439 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:27,439 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:27,439 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:32,495 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:32,495 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:32,495 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:37,544 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:37,544 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:37,544 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:42,603 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:42,604 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:42,604 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:04:42,604 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38644972': 0, 'ctest-pod-48641098': 0} 2025-05-13 11:04:44,655 - DEBUG - [Pod ctest-pod-81599732] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.987 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.096 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.719/1.987 ms 2025-05-13 11:04:44,655 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81599732 with expectation True passed 2025-05-13 11:04:46,708 - DEBUG - [Pod ctest-pod-53532538] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.545 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.569/1.545 ms 2025-05-13 11:04:46,708 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53532538 with expectation True passed 2025-05-13 11:04:48,768 - DEBUG - [Pod ctest-pod-15359245] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.058 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.401/1.058 ms 2025-05-13 11:04:48,768 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15359245 with expectation True passed 2025-05-13 11:04:48,835 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:04:48,835 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-13 11:04:48,835 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:04:48,835 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81599732 passed 2025-05-13 11:04:48,898 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:04:48,898 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-13 11:04:48,898 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:04:48,898 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81599732 passed 2025-05-13 11:04:53,957 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 11:04:53,963 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 11:04:53,963 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 11:04:53,963 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53532538 passed 2025-05-13 11:04:59,011 - DEBUG - [Pod ctest-pod-66330189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-13 11:04:59,012 - DEBUG - [Pod Pod ctest-pod-66330189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-13 11:04:59,012 - DEBUG - [Pod Pod ctest-pod-66330189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-13 11:04:59,012 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66330189 passed 2025-05-13 11:04:59,020 - INFO - Updating Network Policy ingress-on-service 2025-05-13 11:05:04,074 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:04,074 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:04,074 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:09,127 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:09,127 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:09,127 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:14,182 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:14,182 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:14,182 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:19,245 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:19,245 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:19,245 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:24,308 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:24,308 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:24,308 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:29,383 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:29,383 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:29,383 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:34,444 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:34,444 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:34,444 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:39,495 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:39,495 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:39,495 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:44,547 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:44,547 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:44,547 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:49,603 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:49,603 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:49,603 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) wget: download timed out 2025-05-13 11:05:49,603 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38644972': 0, 'ctest-pod-48641098': 0} 2025-05-13 11:05:49,657 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,657 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:49,657 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,714 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,714 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:49,714 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,775 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,775 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:49,775 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,830 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,830 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:49,830 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,878 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,878 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:49,878 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,942 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,942 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:49,942 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:49,942 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38644972': 1, 'ctest-pod-48641098': 5} 2025-05-13 11:05:50,004 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38644972 2025-05-13 11:05:50,005 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:50,005 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38644972 2025-05-13 11:05:50,057 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:50,057 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:50,057 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:50,109 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:50,109 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:50,109 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: ctest-pod-38644972 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:50,162 - DEBUG - [Pod ctest-pod-15359245] Cmd: wget http://10.101.230.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:50,164 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd wget http://10.101.230.137:80/ -O - -T 5 -t 1 passed 2025-05-13 11:05:50,164 - DEBUG - [Pod Pod ctest-pod-15359245] Cmd output: ctest-pod-48641098 Connecting to 10.101.230.137:80 (10.101.230.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-13 11:05:50,164 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38644972': 3, 'ctest-pod-48641098': 1} 2025-05-13 11:05:52,216 - DEBUG - [Pod ctest-pod-81599732] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.750 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.106 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.092/0.316/0.750 ms 2025-05-13 11:05:52,216 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81599732 with expectation True passed 2025-05-13 11:05:54,262 - DEBUG - [Pod ctest-pod-53532538] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.644 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.269/0.644 ms 2025-05-13 11:05:54,262 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53532538 with expectation True passed 2025-05-13 11:05:56,319 - DEBUG - [Pod ctest-pod-15359245] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.427 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.203/0.427 ms 2025-05-13 11:05:56,319 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15359245 with expectation True passed 2025-05-13 11:05:56,374 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:05:56,374 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-13 11:05:56,374 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:05:56,374 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81599732 passed 2025-05-13 11:05:56,434 - DEBUG - [Pod ctest-pod-81599732] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:05:56,434 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-13 11:05:56,434 - DEBUG - [Pod Pod ctest-pod-81599732] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:05:56,434 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81599732 passed 2025-05-13 11:06:01,487 - DEBUG - [Pod ctest-pod-53532538] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 11:06:01,487 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 11:06:01,487 - DEBUG - [Pod Pod ctest-pod-53532538] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-13 11:06:01,487 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53532538 passed 2025-05-13 11:06:01,540 - DEBUG - [Pod ctest-pod-66330189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:06:01,540 - DEBUG - [Pod Pod ctest-pod-66330189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-13 11:06:01,540 - DEBUG - [Pod Pod ctest-pod-66330189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-13 11:06:01,540 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66330189 passed 2025-05-13 11:06:01,540 - INFO - Deleting Network Policy : ingress-on-service 2025-05-13 11:06:01,541 - INFO - Deleting service : ctest-nginx-svc-05718667 2025-05-13 11:06:01,754 - DEBUG - No XMPP flaps were noticed during the test