2025-10-27 03:27:02,898 - INFO - Using existing project ['default-domain', 'k8s-default'](ca5f09e5-fad0-4825-93a6-45a27ddc6afc) 2025-10-27 03:27:02,918 - DEBUG - Namespace ctest-new-default-49200110 not present 2025-10-27 03:27:02,931 - INFO - Created namespace ctest-new-default-49200110 2025-10-27 03:27:05,935 - DEBUG - Namespace ctest-non-default-29598618 not present 2025-10-27 03:27:05,946 - INFO - Created namespace ctest-non-default-29598618 2025-10-27 03:27:08,966 - DEBUG - Pod ctest-pod-61169911 not present 2025-10-27 03:27:08,969 - INFO - Creating Pod ctest-pod-61169911 2025-10-27 03:27:09,019 - DEBUG - Pod : ctest-pod-61169911 UUID is 1af90abd-3823-4f01-b777-e62ee7487b5f 2025-10-27 03:27:09,022 - DEBUG - Pod ctest-pod-93253516 not present 2025-10-27 03:27:09,022 - INFO - Creating Pod ctest-pod-93253516 2025-10-27 03:27:09,073 - DEBUG - Pod : ctest-pod-93253516 UUID is cebaee7f-34f1-4f14-bd72-34bdd90d7f1a 2025-10-27 03:27:09,079 - DEBUG - Pod ctest-pod-37809426 not present 2025-10-27 03:27:09,080 - INFO - Creating Pod ctest-pod-37809426 2025-10-27 03:27:09,123 - DEBUG - Pod : ctest-pod-37809426 UUID is 04f43d43-21c8-43a6-9977-22ecc9c89e3e 2025-10-27 03:27:09,125 - DEBUG - Pod ctest-pod-65816964 not present 2025-10-27 03:27:09,126 - INFO - Creating Pod ctest-pod-65816964 2025-10-27 03:27:09,150 - DEBUG - Pod : ctest-pod-65816964 UUID is aa742754-d60a-4ec0-bda6-e00bd4bdaa78 2025-10-27 03:27:09,153 - DEBUG - Pod ctest-pod-51302630 not present 2025-10-27 03:27:09,153 - INFO - Creating Pod ctest-pod-51302630 2025-10-27 03:27:09,173 - DEBUG - Pod : ctest-pod-51302630 UUID is 57c14190-7651-4d45-ba02-f7162d7ff091 2025-10-27 03:27:09,193 - DEBUG - Pod ctest-pod-25368022 not present 2025-10-27 03:27:09,194 - INFO - Creating Pod ctest-pod-25368022 2025-10-27 03:27:09,219 - DEBUG - Pod : ctest-pod-25368022 UUID is ad593e0e-39a3-4091-9478-2370d2ebc0ae 2025-10-27 03:27:09,221 - DEBUG - Pod ctest-pod-30530164 not present 2025-10-27 03:27:09,221 - INFO - Creating Pod ctest-pod-30530164 2025-10-27 03:27:09,240 - DEBUG - Pod : ctest-pod-30530164 UUID is 0c5acf8b-c740-4167-b41c-7ad61a5f5b68 2025-10-27 03:27:09,241 - DEBUG - Pod ctest-pod-01511415 not present 2025-10-27 03:27:09,242 - INFO - Creating Pod ctest-pod-01511415 2025-10-27 03:27:09,263 - DEBUG - Pod : ctest-pod-01511415 UUID is b8db5d56-e7b9-426c-befa-6d69ed9ca2b9 2025-10-27 03:27:09,471 - INFO - Project default-domain:k8s-ctest-new-default-49200110 for Namespace ctest-new-default-49200110 is seen in contrail-api 2025-10-27 03:27:09,471 - DEBUG - Project uuid in Contrail is c87ee4de-5e39-4df6-ad7b-cf7c6dc5298d 2025-10-27 03:27:09,627 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=cd41dbc7-bff5-43a4-a98f-1d74aaf534db 2025-10-27 03:27:09,631 - INFO - Namespace ctest-new-default-49200110 with uuid cd41dbc7-bff5-43a4-a98f-1d74aaf534db found in kube manager 2025-10-27 03:27:09,631 - INFO - Namespace ctest-new-default-49200110 verification passed 2025-10-27 03:27:09,857 - INFO - Project default-domain:k8s-ctest-non-default-29598618 for Namespace ctest-non-default-29598618 is seen in contrail-api 2025-10-27 03:27:09,857 - DEBUG - Project uuid in Contrail is 446e812b-7725-48fd-bfea-ff53a4356dbf 2025-10-27 03:27:09,858 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=9124de59-b49c-4127-8b2d-6d655b34cca8 2025-10-27 03:27:09,861 - INFO - Namespace ctest-non-default-29598618 with uuid 9124de59-b49c-4127-8b2d-6d655b34cca8 found in kube manager 2025-10-27 03:27:09,861 - INFO - Namespace ctest-non-default-29598618 verification passed 2025-10-27 03:27:09,867 - DEBUG - Pod ctest-pod-61169911 not in running state.Currently in Pending 2025-10-27 03:27:14,874 - DEBUG - Pod ctest-pod-61169911 not in running state.Currently in Pending 2025-10-27 03:27:19,880 - DEBUG - Pod ctest-pod-61169911 not in running state.Currently in Pending 2025-10-27 03:27:24,888 - INFO - Pod ctest-pod-61169911 is in running state.Got IP 10.47.255.251 2025-10-27 03:27:24,899 - DEBUG - Pod ctest-pod-61169911 has vmi d2b415e8-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:24,900 - INFO - Verified pod ctest-pod-61169911 in contrail-api 2025-10-27 03:27:24,912 - DEBUG - VMI d2b415e8-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:24,912 - INFO - Verified Pod ctest-pod-61169911 in agent 10.0.0.49 2025-10-27 03:27:24,912 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=1af90abd-3823-4f01-b777-e62ee7487b5f 2025-10-27 03:27:24,916 - INFO - Pod ctest-pod-61169911 with uuid 1af90abd-3823-4f01-b777-e62ee7487b5f found in kube manager 2025-10-27 03:27:24,916 - INFO - Pod ctest-pod-61169911 verification passed 2025-10-27 03:27:24,924 - INFO - Pod ctest-pod-93253516 is in running state.Got IP 10.47.255.250 2025-10-27 03:27:24,977 - DEBUG - Pod ctest-pod-93253516 has vmi d31abe4c-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:24,977 - INFO - Verified pod ctest-pod-93253516 in contrail-api 2025-10-27 03:27:24,989 - DEBUG - VMI d31abe4c-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:24,989 - INFO - Verified Pod ctest-pod-93253516 in agent 10.0.0.49 2025-10-27 03:27:24,990 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=cebaee7f-34f1-4f14-bd72-34bdd90d7f1a 2025-10-27 03:27:24,994 - INFO - Pod ctest-pod-93253516 with uuid cebaee7f-34f1-4f14-bd72-34bdd90d7f1a found in kube manager 2025-10-27 03:27:24,994 - INFO - Pod ctest-pod-93253516 verification passed 2025-10-27 03:27:25,002 - INFO - Pod ctest-pod-37809426 is in running state.Got IP 10.47.255.249 2025-10-27 03:27:25,016 - DEBUG - Pod ctest-pod-37809426 has vmi d3b5c90a-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:25,016 - INFO - Verified pod ctest-pod-37809426 in contrail-api 2025-10-27 03:27:25,027 - DEBUG - VMI d3b5c90a-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:25,027 - INFO - Verified Pod ctest-pod-37809426 in agent 10.0.0.49 2025-10-27 03:27:25,027 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=04f43d43-21c8-43a6-9977-22ecc9c89e3e 2025-10-27 03:27:25,031 - INFO - Pod ctest-pod-37809426 with uuid 04f43d43-21c8-43a6-9977-22ecc9c89e3e found in kube manager 2025-10-27 03:27:25,031 - INFO - Pod ctest-pod-37809426 verification passed 2025-10-27 03:27:25,037 - INFO - Pod ctest-pod-65816964 is in running state.Got IP 10.47.255.248 2025-10-27 03:27:25,097 - DEBUG - Pod ctest-pod-65816964 has vmi d41f196e-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:25,097 - INFO - Verified pod ctest-pod-65816964 in contrail-api 2025-10-27 03:27:25,108 - DEBUG - VMI d41f196e-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:25,108 - INFO - Verified Pod ctest-pod-65816964 in agent 10.0.0.49 2025-10-27 03:27:25,109 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=aa742754-d60a-4ec0-bda6-e00bd4bdaa78 2025-10-27 03:27:25,113 - INFO - Pod ctest-pod-65816964 with uuid aa742754-d60a-4ec0-bda6-e00bd4bdaa78 found in kube manager 2025-10-27 03:27:25,113 - INFO - Pod ctest-pod-65816964 verification passed 2025-10-27 03:27:25,120 - DEBUG - Pod ctest-pod-51302630 not in running state.Currently in Pending 2025-10-27 03:27:30,127 - INFO - Pod ctest-pod-51302630 is in running state.Got IP 10.47.255.247 2025-10-27 03:27:30,139 - DEBUG - Pod ctest-pod-51302630 has vmi d49ac744-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:30,139 - INFO - Verified pod ctest-pod-51302630 in contrail-api 2025-10-27 03:27:30,151 - DEBUG - VMI d49ac744-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:30,151 - INFO - Verified Pod ctest-pod-51302630 in agent 10.0.0.49 2025-10-27 03:27:30,151 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=57c14190-7651-4d45-ba02-f7162d7ff091 2025-10-27 03:27:30,155 - INFO - Pod ctest-pod-51302630 with uuid 57c14190-7651-4d45-ba02-f7162d7ff091 found in kube manager 2025-10-27 03:27:30,155 - INFO - Pod ctest-pod-51302630 verification passed 2025-10-27 03:27:30,161 - INFO - Pod ctest-pod-30530164 is in running state.Got IP 10.47.255.245 2025-10-27 03:27:30,216 - DEBUG - Pod ctest-pod-30530164 has vmi d5709086-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:30,216 - INFO - Verified pod ctest-pod-30530164 in contrail-api 2025-10-27 03:27:30,228 - DEBUG - VMI d5709086-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:30,228 - INFO - Verified Pod ctest-pod-30530164 in agent 10.0.0.49 2025-10-27 03:27:30,228 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=0c5acf8b-c740-4167-b41c-7ad61a5f5b68 2025-10-27 03:27:30,232 - INFO - Pod ctest-pod-30530164 with uuid 0c5acf8b-c740-4167-b41c-7ad61a5f5b68 found in kube manager 2025-10-27 03:27:30,232 - INFO - Pod ctest-pod-30530164 verification passed 2025-10-27 03:27:30,239 - INFO - Pod ctest-pod-25368022 is in running state.Got IP 10.47.255.246 2025-10-27 03:27:30,293 - DEBUG - Pod ctest-pod-25368022 has vmi d50a0d84-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:30,293 - INFO - Verified pod ctest-pod-25368022 in contrail-api 2025-10-27 03:27:30,307 - DEBUG - VMI d50a0d84-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:30,307 - INFO - Verified Pod ctest-pod-25368022 in agent 10.0.0.49 2025-10-27 03:27:30,307 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=ad593e0e-39a3-4091-9478-2370d2ebc0ae 2025-10-27 03:27:30,311 - INFO - Pod ctest-pod-25368022 with uuid ad593e0e-39a3-4091-9478-2370d2ebc0ae found in kube manager 2025-10-27 03:27:30,311 - INFO - Pod ctest-pod-25368022 verification passed 2025-10-27 03:27:30,318 - INFO - Pod ctest-pod-01511415 is in running state.Got IP 10.47.255.244 2025-10-27 03:27:30,337 - DEBUG - Pod ctest-pod-01511415 has vmi d5d2b1f8-b2e4-11f0-a423-fa163e60c983 2025-10-27 03:27:30,337 - INFO - Verified pod ctest-pod-01511415 in contrail-api 2025-10-27 03:27:30,349 - DEBUG - VMI d5d2b1f8-b2e4-11f0-a423-fa163e60c983 is active in agent 10.0.0.49 2025-10-27 03:27:30,349 - INFO - Verified Pod ctest-pod-01511415 in agent 10.0.0.49 2025-10-27 03:27:30,349 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b8db5d56-e7b9-426c-befa-6d69ed9ca2b9 2025-10-27 03:27:30,352 - INFO - Pod ctest-pod-01511415 with uuid b8db5d56-e7b9-426c-befa-6d69ed9ca2b9 found in kube manager 2025-10-27 03:27:30,352 - INFO - Pod ctest-pod-01511415 verification passed 2025-10-27 03:27:30,353 - INFO - ================================================================================ 2025-10-27 03:27:30,353 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-10-27 03:27:30,353 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-10-27 03:27:30,549 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.38': '0'}} with 2025-10-27 03:27:30,549 - INFO - Initial checks done. Running the testcase now 2025-10-27 03:27:30,549 - INFO - 2025-10-27 03:27:30,604 - DEBUG - [Pod ctest-pod-61169911] Cmd: echo ctest-pod-61169911 > /usr/share/nginx/html/index.html, Output: 2025-10-27 03:27:30,663 - DEBUG - [Pod ctest-pod-93253516] Cmd: echo ctest-pod-93253516 > /usr/share/nginx/html/index.html, Output: 2025-10-27 03:27:30,721 - DEBUG - [Pod ctest-pod-37809426] Cmd: echo ctest-pod-37809426 > /usr/share/nginx/html/index.html, Output: 2025-10-27 03:27:30,779 - DEBUG - [Pod ctest-pod-65816964] Cmd: echo ctest-pod-65816964 > /usr/share/nginx/html/index.html, Output: 2025-10-27 03:27:30,782 - DEBUG - Service ctest-nginx-svc-89581492 not present 2025-10-27 03:27:30,782 - INFO - Creating service ctest-nginx-svc-89581492 2025-10-27 03:27:30,798 - INFO - Created Service ctest-nginx-svc-89581492 2025-10-27 03:27:30,803 - WARNING - Service UUID c32efd72-7216-40de-bf52-9431f0876888 not yet found in contrail-api 2025-10-27 03:27:31,821 - INFO - Validated that Service ctest-nginx-svc-89581492 is seen in contrail-api 2025-10-27 03:27:31,821 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=c32efd72-7216-40de-bf52-9431f0876888 2025-10-27 03:27:31,826 - INFO - Service ctest-nginx-svc-89581492 with uuid c32efd72-7216-40de-bf52-9431f0876888 found in kube manager 2025-10-27 03:27:31,826 - INFO - Service ctest-nginx-svc-89581492 verification passed 2025-10-27 03:27:32,896 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61169911 2025-10-27 03:27:32,896 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:32,896 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61169911 2025-10-27 03:27:32,948 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:32,949 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:32,949 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,008 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,008 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:33,008 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,058 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,058 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:33,058 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,116 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,116 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:33,116 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,116 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61169911': 4, 'ctest-pod-93253516': 1} 2025-10-27 03:27:33,175 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,175 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:33,175 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,233 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,233 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:33,233 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,288 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,288 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:27:33,288 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:27:33,288 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61169911': 1, 'ctest-pod-93253516': 2} 2025-10-27 03:27:33,292 - DEBUG - Network policy ingress-on-service not present 2025-10-27 03:27:33,293 - INFO - Creating Network Policy ingress-on-service 2025-10-27 03:27:33,305 - INFO - Network policy found in k8s 2025-10-27 03:27:33,305 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b05137c-87ce-44f4-ac90-9dce655e54e9 2025-10-27 03:27:33,309 - INFO - Network Policy ingress-on-service with uuid 0b05137c-87ce-44f4-ac90-9dce655e54e9 found in kube manager 2025-10-27 03:27:33,340 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-10-27 03:27:33,340 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-10-27 03:27:33,341 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b05137c-87ce-44f4-ac90-9dce655e54e9 2025-10-27 03:27:33,363 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-27 03:27:35,364 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b05137c-87ce-44f4-ac90-9dce655e54e9 2025-10-27 03:27:35,391 - INFO - Network policy with name ingress-on-service found in agent 2025-10-27 03:27:35,392 - INFO - Network Policy ingress-on-service verification passed 2025-10-27 03:27:40,445 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:40,445 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:40,445 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:45,500 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:45,500 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:45,500 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:50,548 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:50,548 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:50,548 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:55,602 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:55,602 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:27:55,602 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:00,652 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:00,652 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:00,652 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:05,705 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:05,705 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:05,705 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:10,766 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:10,766 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:10,766 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:15,824 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:15,824 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:15,824 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:20,877 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:20,877 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:20,877 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:25,933 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:25,933 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:25,933 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:25,933 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-61169911': 0, 'ctest-pod-93253516': 0} 2025-10-27 03:28:25,986 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:28:25,986 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:28:25,986 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:28:26,043 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93253516 2025-10-27 03:28:26,043 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:28:26,043 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93253516 2025-10-27 03:28:26,098 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:28:26,098 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:28:26,098 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:28:26,098 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61169911': 1, 'ctest-pod-93253516': 2} 2025-10-27 03:28:31,152 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:31,152 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:31,152 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:36,204 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:36,204 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:36,204 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:41,251 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:41,252 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:41,252 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:46,306 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:46,306 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:46,306 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:51,356 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:51,356 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:51,356 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:56,412 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:56,412 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:28:56,412 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:01,468 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:01,468 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:01,468 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:06,519 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:06,519 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:06,519 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:11,581 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:11,581 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:11,581 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:16,637 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:16,637 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:16,637 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:16,637 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-61169911': 0, 'ctest-pod-93253516': 0} 2025-10-27 03:29:18,692 - DEBUG - [Pod ctest-pod-25368022] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.186 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.454/1.186 ms 2025-10-27 03:29:18,692 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-25368022 with expectation True passed 2025-10-27 03:29:20,745 - DEBUG - [Pod ctest-pod-51302630] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.518 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.227/0.518 ms 2025-10-27 03:29:20,745 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51302630 with expectation True passed 2025-10-27 03:29:22,801 - DEBUG - [Pod ctest-pod-30530164] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.275 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.479/1.275 ms 2025-10-27 03:29:22,801 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30530164 with expectation True passed 2025-10-27 03:29:22,855 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:29:22,856 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-27 03:29:22,856 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:29:22,856 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25368022 passed 2025-10-27 03:29:22,910 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:29:22,910 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-27 03:29:22,910 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:29:22,910 - INFO - wget check of of http://10.47.255.250 from ctest-pod-25368022 passed 2025-10-27 03:29:27,961 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-27 03:29:27,961 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-27 03:29:27,961 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-27 03:29:27,961 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51302630 passed 2025-10-27 03:29:33,015 - DEBUG - [Pod ctest-pod-01511415] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-27 03:29:33,015 - DEBUG - [Pod Pod ctest-pod-01511415] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-27 03:29:33,015 - DEBUG - [Pod Pod ctest-pod-01511415] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-27 03:29:33,015 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01511415 passed 2025-10-27 03:29:33,023 - INFO - Updating Network Policy ingress-on-service 2025-10-27 03:29:38,081 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:38,082 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:38,082 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:43,137 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:43,137 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:43,137 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:48,193 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:48,193 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:48,193 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:53,256 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:53,257 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:53,257 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:58,312 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:58,313 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:29:58,313 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:03,379 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:03,379 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:03,379 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:08,434 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:08,434 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:08,434 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:13,497 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:13,498 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:13,498 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:18,545 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:18,545 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:18,545 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:23,596 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:23,596 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:23,596 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.104.97.157:80 (10.104.97.157:80) wget: download timed out 2025-10-27 03:30:23,596 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-61169911': 0, 'ctest-pod-93253516': 0} 2025-10-27 03:30:23,655 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,655 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:30:23,655 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,702 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,702 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:30:23,702 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,703 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61169911': 1, 'ctest-pod-93253516': 1} 2025-10-27 03:30:23,760 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,761 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:30:23,761 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: ctest-pod-93253516 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,819 - DEBUG - [Pod ctest-pod-30530164] Cmd: wget http://10.104.97.157:80/ -O - -T 5 -t 1 , Output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,819 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd wget http://10.104.97.157:80/ -O - -T 5 -t 1 passed 2025-10-27 03:30:23,819 - DEBUG - [Pod Pod ctest-pod-30530164] Cmd output: ctest-pod-61169911 Connecting to 10.104.97.157:80 (10.104.97.157:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-27 03:30:23,819 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61169911': 1, 'ctest-pod-93253516': 1} 2025-10-27 03:30:25,873 - DEBUG - [Pod ctest-pod-25368022] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.388 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.182/0.388 ms 2025-10-27 03:30:25,873 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-25368022 with expectation True passed 2025-10-27 03:30:27,928 - DEBUG - [Pod ctest-pod-51302630] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.890 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.346/0.890 ms 2025-10-27 03:30:27,928 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51302630 with expectation True passed 2025-10-27 03:30:29,985 - DEBUG - [Pod ctest-pod-30530164] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.480 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.218/0.480 ms 2025-10-27 03:30:29,985 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30530164 with expectation True passed 2025-10-27 03:30:30,041 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:30:30,041 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-27 03:30:30,041 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:30:30,041 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25368022 passed 2025-10-27 03:30:30,087 - DEBUG - [Pod ctest-pod-25368022] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:30:30,087 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-27 03:30:30,087 - DEBUG - [Pod Pod ctest-pod-25368022] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:30:30,087 - INFO - wget check of of http://10.47.255.250 from ctest-pod-25368022 passed 2025-10-27 03:30:35,137 - DEBUG - [Pod ctest-pod-51302630] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-27 03:30:35,137 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-27 03:30:35,137 - DEBUG - [Pod Pod ctest-pod-51302630] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-27 03:30:35,137 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51302630 passed 2025-10-27 03:30:35,194 - DEBUG - [Pod ctest-pod-01511415] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:30:35,194 - DEBUG - [Pod Pod ctest-pod-01511415] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-27 03:30:35,194 - DEBUG - [Pod Pod ctest-pod-01511415] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-27 03:30:35,194 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01511415 passed 2025-10-27 03:30:35,194 - INFO - Deleting Network Policy : ingress-on-service 2025-10-27 03:30:35,195 - INFO - Deleting service : ctest-nginx-svc-89581492 2025-10-27 03:30:35,401 - DEBUG - No XMPP flaps were noticed during the test