2025-09-15 01:39:32,858 - INFO - Using existing project ['default-domain', 'k8s-default'](3d7496df-c7cd-4a92-9d35-aacccf9d5bb8) 2025-09-15 01:39:32,882 - DEBUG - Namespace ctest-new-default-04019147 not present 2025-09-15 01:39:32,896 - INFO - Created namespace ctest-new-default-04019147 2025-09-15 01:39:35,900 - DEBUG - Namespace ctest-non-default-28892205 not present 2025-09-15 01:39:35,907 - INFO - Created namespace ctest-non-default-28892205 2025-09-15 01:39:38,924 - DEBUG - Pod ctest-pod-33281031 not present 2025-09-15 01:39:38,925 - INFO - Creating Pod ctest-pod-33281031 2025-09-15 01:39:38,950 - DEBUG - Pod : ctest-pod-33281031 UUID is d10ce4e7-a597-42fb-b87c-6a34ef6329e8 2025-09-15 01:39:38,955 - DEBUG - Pod ctest-pod-48887832 not present 2025-09-15 01:39:38,956 - INFO - Creating Pod ctest-pod-48887832 2025-09-15 01:39:39,000 - DEBUG - Pod : ctest-pod-48887832 UUID is 83bcc730-c383-440b-8a5f-df3b1a84df5d 2025-09-15 01:39:39,007 - DEBUG - Pod ctest-pod-51721587 not present 2025-09-15 01:39:39,008 - INFO - Creating Pod ctest-pod-51721587 2025-09-15 01:39:39,045 - DEBUG - Pod : ctest-pod-51721587 UUID is ab5718ab-fa67-49f7-b39e-9eaffb8dca87 2025-09-15 01:39:39,048 - DEBUG - Pod ctest-pod-25908917 not present 2025-09-15 01:39:39,048 - INFO - Creating Pod ctest-pod-25908917 2025-09-15 01:39:39,069 - DEBUG - Pod : ctest-pod-25908917 UUID is a4429ff4-82ce-499d-b3ac-262c8a8ab368 2025-09-15 01:39:39,074 - DEBUG - Pod ctest-pod-44940198 not present 2025-09-15 01:39:39,074 - INFO - Creating Pod ctest-pod-44940198 2025-09-15 01:39:39,115 - DEBUG - Pod : ctest-pod-44940198 UUID is 9ff3f7d1-718a-4f2f-a7ce-9b54f2b0a975 2025-09-15 01:39:39,118 - DEBUG - Pod ctest-pod-38507393 not present 2025-09-15 01:39:39,119 - INFO - Creating Pod ctest-pod-38507393 2025-09-15 01:39:39,153 - DEBUG - Pod : ctest-pod-38507393 UUID is a608e92b-667d-47bd-ab09-96c1c12966ea 2025-09-15 01:39:39,156 - DEBUG - Pod ctest-pod-26562442 not present 2025-09-15 01:39:39,157 - INFO - Creating Pod ctest-pod-26562442 2025-09-15 01:39:39,181 - DEBUG - Pod : ctest-pod-26562442 UUID is e3c58274-e131-48a9-900b-8348878ec282 2025-09-15 01:39:39,189 - DEBUG - Pod ctest-pod-51225919 not present 2025-09-15 01:39:39,189 - INFO - Creating Pod ctest-pod-51225919 2025-09-15 01:39:39,217 - DEBUG - Pod : ctest-pod-51225919 UUID is 65d688b1-8b1b-44c9-b843-05bfb3ff16a7 2025-09-15 01:39:39,465 - INFO - Project default-domain:k8s-ctest-new-default-04019147 for Namespace ctest-new-default-04019147 is seen in contrail-api 2025-09-15 01:39:39,465 - DEBUG - Project uuid in Contrail is ddafa7ad-489f-4149-838a-9f438b1d8f2d 2025-09-15 01:39:39,613 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=92422216-91de-4bf3-ae9f-4eff4bf946dd 2025-09-15 01:39:39,623 - INFO - Namespace ctest-new-default-04019147 with uuid 92422216-91de-4bf3-ae9f-4eff4bf946dd found in kube manager 2025-09-15 01:39:39,623 - INFO - Namespace ctest-new-default-04019147 verification passed 2025-09-15 01:39:39,949 - INFO - Project default-domain:k8s-ctest-non-default-28892205 for Namespace ctest-non-default-28892205 is seen in contrail-api 2025-09-15 01:39:39,949 - DEBUG - Project uuid in Contrail is 2636cdd1-b38e-4932-81d1-dc0e8eb3ce55 2025-09-15 01:39:39,949 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=3bf0a606-008c-4040-a36a-1a3b8713fe7e 2025-09-15 01:39:39,953 - INFO - Namespace ctest-non-default-28892205 with uuid 3bf0a606-008c-4040-a36a-1a3b8713fe7e found in kube manager 2025-09-15 01:39:39,954 - INFO - Namespace ctest-non-default-28892205 verification passed 2025-09-15 01:39:39,961 - DEBUG - Pod ctest-pod-33281031 not in running state.Currently in Pending 2025-09-15 01:39:44,968 - DEBUG - Pod ctest-pod-33281031 not in running state.Currently in Pending 2025-09-15 01:39:49,976 - DEBUG - Pod ctest-pod-33281031 not in running state.Currently in Pending 2025-09-15 01:39:54,983 - INFO - Pod ctest-pod-33281031 is in running state.Got IP 10.47.255.250 2025-09-15 01:39:55,035 - DEBUG - Pod ctest-pod-33281031 has vmi d9ca90a4-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:39:55,035 - INFO - Verified pod ctest-pod-33281031 in contrail-api 2025-09-15 01:39:55,045 - DEBUG - VMI d9ca90a4-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:39:55,045 - INFO - Verified Pod ctest-pod-33281031 in agent 10.0.0.22 2025-09-15 01:39:55,045 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d10ce4e7-a597-42fb-b87c-6a34ef6329e8 2025-09-15 01:39:55,048 - INFO - Pod ctest-pod-33281031 with uuid d10ce4e7-a597-42fb-b87c-6a34ef6329e8 found in kube manager 2025-09-15 01:39:55,048 - INFO - Pod ctest-pod-33281031 verification passed 2025-09-15 01:39:55,055 - INFO - Pod ctest-pod-48887832 is in running state.Got IP 10.47.255.249 2025-09-15 01:39:55,147 - DEBUG - Pod ctest-pod-48887832 has vmi da7f28de-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:39:55,147 - INFO - Verified pod ctest-pod-48887832 in contrail-api 2025-09-15 01:39:55,155 - DEBUG - VMI da7f28de-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:39:55,156 - INFO - Verified Pod ctest-pod-48887832 in agent 10.0.0.22 2025-09-15 01:39:55,156 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=83bcc730-c383-440b-8a5f-df3b1a84df5d 2025-09-15 01:39:55,159 - INFO - Pod ctest-pod-48887832 with uuid 83bcc730-c383-440b-8a5f-df3b1a84df5d found in kube manager 2025-09-15 01:39:55,159 - INFO - Pod ctest-pod-48887832 verification passed 2025-09-15 01:39:55,165 - INFO - Pod ctest-pod-51721587 is in running state.Got IP 10.47.255.248 2025-09-15 01:39:55,258 - DEBUG - Pod ctest-pod-51721587 has vmi db71ca9e-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:39:55,258 - INFO - Verified pod ctest-pod-51721587 in contrail-api 2025-09-15 01:39:55,268 - DEBUG - VMI db71ca9e-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:39:55,268 - INFO - Verified Pod ctest-pod-51721587 in agent 10.0.0.22 2025-09-15 01:39:55,268 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ab5718ab-fa67-49f7-b39e-9eaffb8dca87 2025-09-15 01:39:55,272 - INFO - Pod ctest-pod-51721587 with uuid ab5718ab-fa67-49f7-b39e-9eaffb8dca87 found in kube manager 2025-09-15 01:39:55,272 - INFO - Pod ctest-pod-51721587 verification passed 2025-09-15 01:39:55,279 - DEBUG - Pod ctest-pod-25908917 not in running state.Currently in Pending 2025-09-15 01:40:00,288 - INFO - Pod ctest-pod-25908917 is in running state.Got IP 10.47.255.247 2025-09-15 01:40:00,342 - DEBUG - Pod ctest-pod-25908917 has vmi dc22a79c-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:40:00,342 - INFO - Verified pod ctest-pod-25908917 in contrail-api 2025-09-15 01:40:00,354 - DEBUG - VMI dc22a79c-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:40:00,354 - INFO - Verified Pod ctest-pod-25908917 in agent 10.0.0.22 2025-09-15 01:40:00,354 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a4429ff4-82ce-499d-b3ac-262c8a8ab368 2025-09-15 01:40:00,359 - INFO - Pod ctest-pod-25908917 with uuid a4429ff4-82ce-499d-b3ac-262c8a8ab368 found in kube manager 2025-09-15 01:40:00,359 - INFO - Pod ctest-pod-25908917 verification passed 2025-09-15 01:40:00,368 - INFO - Pod ctest-pod-44940198 is in running state.Got IP 10.47.255.246 2025-09-15 01:40:00,463 - DEBUG - Pod ctest-pod-44940198 has vmi dcf7d188-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:40:00,463 - INFO - Verified pod ctest-pod-44940198 in contrail-api 2025-09-15 01:40:00,472 - DEBUG - VMI dcf7d188-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:40:00,472 - INFO - Verified Pod ctest-pod-44940198 in agent 10.0.0.22 2025-09-15 01:40:00,473 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9ff3f7d1-718a-4f2f-a7ce-9b54f2b0a975 2025-09-15 01:40:00,476 - INFO - Pod ctest-pod-44940198 with uuid 9ff3f7d1-718a-4f2f-a7ce-9b54f2b0a975 found in kube manager 2025-09-15 01:40:00,476 - INFO - Pod ctest-pod-44940198 verification passed 2025-09-15 01:40:00,483 - INFO - Pod ctest-pod-26562442 is in running state.Got IP 10.47.255.244 2025-09-15 01:40:00,577 - DEBUG - Pod ctest-pod-26562442 has vmi de82bf7c-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:40:00,577 - INFO - Verified pod ctest-pod-26562442 in contrail-api 2025-09-15 01:40:00,586 - DEBUG - VMI de82bf7c-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:40:00,586 - INFO - Verified Pod ctest-pod-26562442 in agent 10.0.0.22 2025-09-15 01:40:00,586 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=e3c58274-e131-48a9-900b-8348878ec282 2025-09-15 01:40:00,590 - INFO - Pod ctest-pod-26562442 with uuid e3c58274-e131-48a9-900b-8348878ec282 found in kube manager 2025-09-15 01:40:00,590 - INFO - Pod ctest-pod-26562442 verification passed 2025-09-15 01:40:00,596 - INFO - Pod ctest-pod-38507393 is in running state.Got IP 10.47.255.245 2025-09-15 01:40:00,689 - DEBUG - Pod ctest-pod-38507393 has vmi ddc33512-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:40:00,689 - INFO - Verified pod ctest-pod-38507393 in contrail-api 2025-09-15 01:40:00,699 - DEBUG - VMI ddc33512-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:40:00,699 - INFO - Verified Pod ctest-pod-38507393 in agent 10.0.0.22 2025-09-15 01:40:00,699 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a608e92b-667d-47bd-ab09-96c1c12966ea 2025-09-15 01:40:00,703 - INFO - Pod ctest-pod-38507393 with uuid a608e92b-667d-47bd-ab09-96c1c12966ea found in kube manager 2025-09-15 01:40:00,703 - INFO - Pod ctest-pod-38507393 verification passed 2025-09-15 01:40:00,711 - DEBUG - Pod ctest-pod-51225919 not in running state.Currently in Pending 2025-09-15 01:40:05,720 - INFO - Pod ctest-pod-51225919 is in running state.Got IP 10.47.255.243 2025-09-15 01:40:05,772 - DEBUG - Pod ctest-pod-51225919 has vmi df5a642c-91d4-11f0-9cee-0242b9826d3b 2025-09-15 01:40:05,772 - INFO - Verified pod ctest-pod-51225919 in contrail-api 2025-09-15 01:40:05,783 - DEBUG - VMI df5a642c-91d4-11f0-9cee-0242b9826d3b is active in agent 10.0.0.22 2025-09-15 01:40:05,784 - INFO - Verified Pod ctest-pod-51225919 in agent 10.0.0.22 2025-09-15 01:40:05,784 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=65d688b1-8b1b-44c9-b843-05bfb3ff16a7 2025-09-15 01:40:05,789 - INFO - Pod ctest-pod-51225919 with uuid 65d688b1-8b1b-44c9-b843-05bfb3ff16a7 found in kube manager 2025-09-15 01:40:05,789 - INFO - Pod ctest-pod-51225919 verification passed 2025-09-15 01:40:05,789 - INFO - ================================================================================ 2025-09-15 01:40:05,789 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-09-15 01:40:05,789 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-09-15 01:40:06,058 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.22': '1'}} with 2025-09-15 01:40:06,058 - INFO - Initial checks done. Running the testcase now 2025-09-15 01:40:06,058 - INFO - 2025-09-15 01:40:06,133 - DEBUG - [Pod ctest-pod-33281031] Cmd: echo ctest-pod-33281031 > /usr/share/nginx/html/index.html, Output: 2025-09-15 01:40:06,201 - DEBUG - [Pod ctest-pod-48887832] Cmd: echo ctest-pod-48887832 > /usr/share/nginx/html/index.html, Output: 2025-09-15 01:40:06,268 - DEBUG - [Pod ctest-pod-51721587] Cmd: echo ctest-pod-51721587 > /usr/share/nginx/html/index.html, Output: 2025-09-15 01:40:06,338 - DEBUG - [Pod ctest-pod-25908917] Cmd: echo ctest-pod-25908917 > /usr/share/nginx/html/index.html, Output: 2025-09-15 01:40:06,341 - DEBUG - Service ctest-nginx-svc-04854887 not present 2025-09-15 01:40:06,342 - INFO - Creating service ctest-nginx-svc-04854887 2025-09-15 01:40:06,359 - INFO - Created Service ctest-nginx-svc-04854887 2025-09-15 01:40:06,365 - WARNING - Service UUID 8cdae506-d2b9-4c9b-89a9-a76c1b08f162 not yet found in contrail-api 2025-09-15 01:40:07,371 - INFO - Validated that Service ctest-nginx-svc-04854887 is seen in contrail-api 2025-09-15 01:40:07,371 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=8cdae506-d2b9-4c9b-89a9-a76c1b08f162 2025-09-15 01:40:07,377 - INFO - Service ctest-nginx-svc-04854887 with uuid 8cdae506-d2b9-4c9b-89a9-a76c1b08f162 found in kube manager 2025-09-15 01:40:07,377 - INFO - Service ctest-nginx-svc-04854887 verification passed 2025-09-15 01:40:08,514 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:40:08,514 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:40:08,514 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:40:08,597 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,598 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:40:08,598 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,667 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-48887832 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,667 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:40:08,667 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-48887832 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,667 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-33281031': 2, 'ctest-pod-48887832': 1} 2025-09-15 01:40:08,739 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,739 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:40:08,739 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,805 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:40:08,805 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:40:08,805 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:40:08,864 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-48887832 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,865 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:40:08,865 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-48887832 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:40:08,865 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-33281031': 2, 'ctest-pod-48887832': 1} 2025-09-15 01:40:08,868 - DEBUG - Network policy ingress-on-service not present 2025-09-15 01:40:08,869 - INFO - Creating Network Policy ingress-on-service 2025-09-15 01:40:08,880 - INFO - Network policy found in k8s 2025-09-15 01:40:08,880 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e906566-83f1-417b-864f-dff1e81dcb38 2025-09-15 01:40:08,886 - INFO - Network Policy ingress-on-service with uuid 8e906566-83f1-417b-864f-dff1e81dcb38 found in kube manager 2025-09-15 01:40:08,908 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-09-15 01:40:08,908 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-09-15 01:40:08,908 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e906566-83f1-417b-864f-dff1e81dcb38 2025-09-15 01:40:08,930 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-15 01:40:10,931 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e906566-83f1-417b-864f-dff1e81dcb38 2025-09-15 01:40:10,962 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-15 01:40:12,964 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e906566-83f1-417b-864f-dff1e81dcb38 2025-09-15 01:40:12,987 - INFO - Network policy with name ingress-on-service found in agent 2025-09-15 01:40:12,988 - INFO - Network Policy ingress-on-service verification passed 2025-09-15 01:40:18,058 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:18,058 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:18,058 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:23,123 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:23,123 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:23,123 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:28,205 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:28,205 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:28,205 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:33,277 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:33,277 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:33,277 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:38,341 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:38,341 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:38,341 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:43,411 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:43,411 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:43,411 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:48,495 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:48,495 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:48,495 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:53,567 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:53,567 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:53,567 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:58,640 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:58,640 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:40:58,640 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:03,715 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:03,715 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:03,715 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:03,715 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-33281031': 0, 'ctest-pod-48887832': 0} 2025-09-15 01:41:03,802 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48887832 2025-09-15 01:41:03,802 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:41:03,802 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48887832 2025-09-15 01:41:03,866 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: ctest-pod-48887832 Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:41:03,866 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:41:03,866 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: ctest-pod-48887832 Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:41:03,938 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-48887832 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:41:03,938 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:41:03,938 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-48887832 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:41:04,008 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:41:04,008 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:41:04,008 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:41:04,008 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-33281031': 1, 'ctest-pod-48887832': 3} 2025-09-15 01:41:09,071 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:09,071 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:09,071 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:14,318 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:14,318 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:14,318 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:19,393 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:19,393 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:19,393 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:24,471 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:24,471 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:24,471 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:29,536 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:29,536 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:29,536 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:34,623 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:34,623 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:34,623 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:39,698 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:39,698 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:39,698 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:44,764 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:44,764 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:44,765 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:49,845 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:49,845 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:49,845 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:54,915 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:54,915 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:54,916 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:41:54,916 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-33281031': 0, 'ctest-pod-48887832': 0} 2025-09-15 01:41:56,973 - DEBUG - [Pod ctest-pod-38507393] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.753 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.293/0.753 ms 2025-09-15 01:41:56,974 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-38507393 with expectation True passed 2025-09-15 01:41:59,056 - DEBUG - [Pod ctest-pod-44940198] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=5.469 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.059 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/1.865/5.469 ms 2025-09-15 01:41:59,056 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-44940198 with expectation True passed 2025-09-15 01:42:01,123 - DEBUG - [Pod ctest-pod-26562442] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.792 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.064 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.087 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.064/0.314/0.792 ms 2025-09-15 01:42:01,123 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-26562442 with expectation True passed 2025-09-15 01:42:01,201 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:42:01,201 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 01:42:01,201 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:42:01,201 - INFO - wget check of of http://10.47.255.250 from ctest-pod-38507393 passed 2025-09-15 01:42:01,271 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:42:01,271 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-09-15 01:42:01,271 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:42:01,271 - INFO - wget check of of http://10.47.255.249 from ctest-pod-38507393 passed 2025-09-15 01:42:06,351 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-15 01:42:06,351 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-15 01:42:06,351 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-15 01:42:06,351 - INFO - wget check of of http://10.47.255.249 from ctest-pod-44940198 passed 2025-09-15 01:42:11,415 - DEBUG - [Pod ctest-pod-51225919] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 01:42:11,415 - DEBUG - [Pod Pod ctest-pod-51225919] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 01:42:11,415 - DEBUG - [Pod Pod ctest-pod-51225919] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 01:42:11,415 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51225919 passed 2025-09-15 01:42:11,426 - INFO - Updating Network Policy ingress-on-service 2025-09-15 01:42:16,514 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:16,514 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:16,514 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:21,607 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:21,607 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:21,607 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:26,673 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:26,673 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:26,673 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:31,830 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:31,830 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:31,830 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:36,892 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:36,892 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:36,892 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:41,959 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:41,959 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:41,959 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:47,047 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:47,047 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:47,047 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:52,122 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:52,122 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:52,122 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:57,191 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:57,191 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:42:57,191 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:43:02,291 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:43:02,291 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:43:02,291 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) wget: download timed out 2025-09-15 01:43:02,291 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-33281031': 0, 'ctest-pod-48887832': 0} 2025-09-15 01:43:02,369 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout ctest-pod-33281031 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,369 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,369 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout ctest-pod-33281031 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,458 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout ctest-pod-33281031 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,458 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,458 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout ctest-pod-33281031 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,529 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout ctest-pod-33281031 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,529 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,529 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout ctest-pod-33281031 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,594 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:02,594 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,594 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:02,664 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,664 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,664 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,736 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: ctest-pod-48887832 Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,736 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,736 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: ctest-pod-48887832 Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,736 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-33281031': 5, 'ctest-pod-48887832': 1} 2025-09-15 01:43:02,809 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:02,809 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,809 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:02,894 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:02,894 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,894 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:02,972 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:02,972 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:02,972 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) ctest-pod-33281031 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:03,070 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:03,071 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:03,071 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-33281031 2025-09-15 01:43:03,154 - DEBUG - [Pod ctest-pod-26562442] Cmd: wget http://10.101.20.40:80/ -O - -T 5 -t 1 , Output: ctest-pod-48887832 Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:03,154 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd wget http://10.101.20.40:80/ -O - -T 5 -t 1 passed 2025-09-15 01:43:03,154 - DEBUG - [Pod Pod ctest-pod-26562442] Cmd output: ctest-pod-48887832 Connecting to 10.101.20.40:80 (10.101.20.40:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 01:43:03,155 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-33281031': 4, 'ctest-pod-48887832': 1} 2025-09-15 01:43:05,235 - DEBUG - [Pod ctest-pod-38507393] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.063 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.075/0.083 ms 2025-09-15 01:43:05,235 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-38507393 with expectation True passed 2025-09-15 01:43:07,304 - DEBUG - [Pod ctest-pod-44940198] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.736 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.089 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.297/0.736 ms 2025-09-15 01:43:07,304 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-44940198 with expectation True passed 2025-09-15 01:43:09,367 - DEBUG - [Pod ctest-pod-26562442] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.394 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.071 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.177/0.394 ms 2025-09-15 01:43:09,367 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-26562442 with expectation True passed 2025-09-15 01:43:09,444 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:43:09,445 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 01:43:09,445 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:43:09,445 - INFO - wget check of of http://10.47.255.250 from ctest-pod-38507393 passed 2025-09-15 01:43:09,509 - DEBUG - [Pod ctest-pod-38507393] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:43:09,509 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-09-15 01:43:09,509 - DEBUG - [Pod Pod ctest-pod-38507393] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:43:09,510 - INFO - wget check of of http://10.47.255.249 from ctest-pod-38507393 passed 2025-09-15 01:43:14,577 - DEBUG - [Pod ctest-pod-44940198] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-15 01:43:14,577 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-15 01:43:14,577 - DEBUG - [Pod Pod ctest-pod-44940198] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-15 01:43:14,577 - INFO - wget check of of http://10.47.255.249 from ctest-pod-44940198 passed 2025-09-15 01:43:14,647 - DEBUG - [Pod ctest-pod-51225919] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:43:14,647 - DEBUG - [Pod Pod ctest-pod-51225919] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 01:43:14,647 - DEBUG - [Pod Pod ctest-pod-51225919] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 01:43:14,647 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51225919 passed 2025-09-15 01:43:14,647 - INFO - Deleting Network Policy : ingress-on-service 2025-09-15 01:43:14,648 - INFO - Deleting service : ctest-nginx-svc-04854887 2025-09-15 01:43:15,207 - DEBUG - No XMPP flaps were noticed during the test