2025-09-18 23:40:08,773 - INFO - Using existing project ['default-domain', 'k8s-default'](567fb4a4-ff10-44f6-bce3-d139b8a1ac90) 2025-09-18 23:40:08,794 - DEBUG - Namespace ctest-new-default-15846283 not present 2025-09-18 23:40:08,802 - INFO - Created namespace ctest-new-default-15846283 2025-09-18 23:40:11,807 - DEBUG - Namespace ctest-non-default-41610618 not present 2025-09-18 23:40:11,837 - INFO - Created namespace ctest-non-default-41610618 2025-09-18 23:40:14,854 - DEBUG - Pod ctest-pod-37167863 not present 2025-09-18 23:40:14,854 - INFO - Creating Pod ctest-pod-37167863 2025-09-18 23:40:14,910 - DEBUG - Pod : ctest-pod-37167863 UUID is cf3bb258-c531-4974-9174-c8a74fa2ae37 2025-09-18 23:40:14,913 - DEBUG - Pod ctest-pod-14421265 not present 2025-09-18 23:40:14,913 - INFO - Creating Pod ctest-pod-14421265 2025-09-18 23:40:14,936 - DEBUG - Pod : ctest-pod-14421265 UUID is 8bdc0ebf-e06f-401a-a745-cfef857a31b0 2025-09-18 23:40:14,939 - DEBUG - Pod ctest-pod-23808705 not present 2025-09-18 23:40:14,940 - INFO - Creating Pod ctest-pod-23808705 2025-09-18 23:40:14,969 - DEBUG - Pod : ctest-pod-23808705 UUID is 5c716fcf-9e4e-4adf-bdfa-ac591e0a461a 2025-09-18 23:40:14,973 - DEBUG - Pod ctest-pod-64906100 not present 2025-09-18 23:40:14,973 - INFO - Creating Pod ctest-pod-64906100 2025-09-18 23:40:15,002 - DEBUG - Pod : ctest-pod-64906100 UUID is efb63381-f03c-48c9-aad7-282dcbd9681d 2025-09-18 23:40:15,004 - DEBUG - Pod ctest-pod-70079147 not present 2025-09-18 23:40:15,005 - INFO - Creating Pod ctest-pod-70079147 2025-09-18 23:40:15,024 - DEBUG - Pod : ctest-pod-70079147 UUID is 918ec32f-cd07-47ff-a5eb-d3d3ed33c127 2025-09-18 23:40:15,026 - DEBUG - Pod ctest-pod-94483655 not present 2025-09-18 23:40:15,027 - INFO - Creating Pod ctest-pod-94483655 2025-09-18 23:40:15,060 - DEBUG - Pod : ctest-pod-94483655 UUID is 553d1eb3-51a7-4bdc-b5d6-efc264090f8d 2025-09-18 23:40:15,063 - DEBUG - Pod ctest-pod-05911135 not present 2025-09-18 23:40:15,063 - INFO - Creating Pod ctest-pod-05911135 2025-09-18 23:40:15,106 - DEBUG - Pod : ctest-pod-05911135 UUID is 7735c41c-41a1-49f7-934a-f47543b68663 2025-09-18 23:40:15,109 - DEBUG - Pod ctest-pod-95755510 not present 2025-09-18 23:40:15,110 - INFO - Creating Pod ctest-pod-95755510 2025-09-18 23:40:15,132 - DEBUG - Pod : ctest-pod-95755510 UUID is c209132b-5d7c-4ac5-ac2d-63218a9531d7 2025-09-18 23:40:15,432 - INFO - Project default-domain:k8s-ctest-new-default-15846283 for Namespace ctest-new-default-15846283 is seen in contrail-api 2025-09-18 23:40:15,432 - DEBUG - Project uuid in Contrail is 09fe2150-0620-45d4-9e45-e6c48f6614f4 2025-09-18 23:40:15,584 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=2edcea57-592d-4d20-9011-f71b0250a3f0 2025-09-18 23:40:15,590 - INFO - Namespace ctest-new-default-15846283 with uuid 2edcea57-592d-4d20-9011-f71b0250a3f0 found in kube manager 2025-09-18 23:40:15,590 - INFO - Namespace ctest-new-default-15846283 verification passed 2025-09-18 23:40:15,775 - INFO - Project default-domain:k8s-ctest-non-default-41610618 for Namespace ctest-non-default-41610618 is seen in contrail-api 2025-09-18 23:40:15,775 - DEBUG - Project uuid in Contrail is fb4b9f3c-badf-4ff2-b271-80e86bcd9cc0 2025-09-18 23:40:15,775 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=fe15d66c-7614-4d35-8d82-ce8468c69842 2025-09-18 23:40:15,781 - INFO - Namespace ctest-non-default-41610618 with uuid fe15d66c-7614-4d35-8d82-ce8468c69842 found in kube manager 2025-09-18 23:40:15,781 - INFO - Namespace ctest-non-default-41610618 verification passed 2025-09-18 23:40:15,789 - DEBUG - Pod ctest-pod-37167863 not in running state.Currently in Pending 2025-09-18 23:40:20,800 - DEBUG - Pod ctest-pod-37167863 not in running state.Currently in Pending 2025-09-18 23:40:25,808 - DEBUG - Pod ctest-pod-37167863 not in running state.Currently in Pending 2025-09-18 23:40:30,823 - INFO - Pod ctest-pod-37167863 is in running state.Got IP 10.47.255.251 2025-09-18 23:40:30,836 - DEBUG - Pod ctest-pod-37167863 has vmi d4744b24-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:30,836 - INFO - Verified pod ctest-pod-37167863 in contrail-api 2025-09-18 23:40:30,848 - DEBUG - VMI d4744b24-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:30,848 - INFO - Verified Pod ctest-pod-37167863 in agent 10.0.0.56 2025-09-18 23:40:30,848 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=cf3bb258-c531-4974-9174-c8a74fa2ae37 2025-09-18 23:40:30,852 - INFO - Pod ctest-pod-37167863 with uuid cf3bb258-c531-4974-9174-c8a74fa2ae37 found in kube manager 2025-09-18 23:40:30,852 - INFO - Pod ctest-pod-37167863 verification passed 2025-09-18 23:40:30,858 - INFO - Pod ctest-pod-14421265 is in running state.Got IP 10.47.255.250 2025-09-18 23:40:30,918 - DEBUG - Pod ctest-pod-14421265 has vmi d4ed84f8-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:30,918 - INFO - Verified pod ctest-pod-14421265 in contrail-api 2025-09-18 23:40:30,928 - DEBUG - VMI d4ed84f8-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:30,928 - INFO - Verified Pod ctest-pod-14421265 in agent 10.0.0.56 2025-09-18 23:40:30,928 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=8bdc0ebf-e06f-401a-a745-cfef857a31b0 2025-09-18 23:40:30,933 - INFO - Pod ctest-pod-14421265 with uuid 8bdc0ebf-e06f-401a-a745-cfef857a31b0 found in kube manager 2025-09-18 23:40:30,933 - INFO - Pod ctest-pod-14421265 verification passed 2025-09-18 23:40:30,940 - INFO - Pod ctest-pod-23808705 is in running state.Got IP 10.47.255.249 2025-09-18 23:40:30,992 - DEBUG - Pod ctest-pod-23808705 has vmi d59125f4-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:30,992 - INFO - Verified pod ctest-pod-23808705 in contrail-api 2025-09-18 23:40:31,007 - DEBUG - VMI d59125f4-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:31,007 - INFO - Verified Pod ctest-pod-23808705 in agent 10.0.0.56 2025-09-18 23:40:31,008 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5c716fcf-9e4e-4adf-bdfa-ac591e0a461a 2025-09-18 23:40:31,012 - INFO - Pod ctest-pod-23808705 with uuid 5c716fcf-9e4e-4adf-bdfa-ac591e0a461a found in kube manager 2025-09-18 23:40:31,012 - INFO - Pod ctest-pod-23808705 verification passed 2025-09-18 23:40:31,019 - INFO - Pod ctest-pod-64906100 is in running state.Got IP 10.47.255.248 2025-09-18 23:40:31,032 - DEBUG - Pod ctest-pod-64906100 has vmi d5ff8fd0-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:31,032 - INFO - Verified pod ctest-pod-64906100 in contrail-api 2025-09-18 23:40:31,049 - DEBUG - VMI d5ff8fd0-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:31,049 - INFO - Verified Pod ctest-pod-64906100 in agent 10.0.0.56 2025-09-18 23:40:31,049 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=efb63381-f03c-48c9-aad7-282dcbd9681d 2025-09-18 23:40:31,054 - INFO - Pod ctest-pod-64906100 with uuid efb63381-f03c-48c9-aad7-282dcbd9681d found in kube manager 2025-09-18 23:40:31,054 - INFO - Pod ctest-pod-64906100 verification passed 2025-09-18 23:40:31,062 - DEBUG - Pod ctest-pod-70079147 not in running state.Currently in Pending 2025-09-18 23:40:36,075 - INFO - Pod ctest-pod-70079147 is in running state.Got IP 10.47.255.247 2025-09-18 23:40:36,128 - DEBUG - Pod ctest-pod-70079147 has vmi d676feda-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:36,128 - INFO - Verified pod ctest-pod-70079147 in contrail-api 2025-09-18 23:40:36,139 - DEBUG - VMI d676feda-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:36,140 - INFO - Verified Pod ctest-pod-70079147 in agent 10.0.0.56 2025-09-18 23:40:36,140 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=918ec32f-cd07-47ff-a5eb-d3d3ed33c127 2025-09-18 23:40:36,143 - INFO - Pod ctest-pod-70079147 with uuid 918ec32f-cd07-47ff-a5eb-d3d3ed33c127 found in kube manager 2025-09-18 23:40:36,144 - INFO - Pod ctest-pod-70079147 verification passed 2025-09-18 23:40:36,150 - INFO - Pod ctest-pod-05911135 is in running state.Got IP 10.47.255.245 2025-09-18 23:40:36,162 - DEBUG - Pod ctest-pod-05911135 has vmi d756d960-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:36,163 - INFO - Verified pod ctest-pod-05911135 in contrail-api 2025-09-18 23:40:36,176 - DEBUG - VMI d756d960-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:36,176 - INFO - Verified Pod ctest-pod-05911135 in agent 10.0.0.56 2025-09-18 23:40:36,176 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=7735c41c-41a1-49f7-934a-f47543b68663 2025-09-18 23:40:36,180 - INFO - Pod ctest-pod-05911135 with uuid 7735c41c-41a1-49f7-934a-f47543b68663 found in kube manager 2025-09-18 23:40:36,180 - INFO - Pod ctest-pod-05911135 verification passed 2025-09-18 23:40:36,187 - INFO - Pod ctest-pod-94483655 is in running state.Got IP 10.47.255.246 2025-09-18 23:40:36,243 - DEBUG - Pod ctest-pod-94483655 has vmi d6e0bd48-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:36,243 - INFO - Verified pod ctest-pod-94483655 in contrail-api 2025-09-18 23:40:36,255 - DEBUG - VMI d6e0bd48-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:36,256 - INFO - Verified Pod ctest-pod-94483655 in agent 10.0.0.56 2025-09-18 23:40:36,256 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=553d1eb3-51a7-4bdc-b5d6-efc264090f8d 2025-09-18 23:40:36,261 - INFO - Pod ctest-pod-94483655 with uuid 553d1eb3-51a7-4bdc-b5d6-efc264090f8d found in kube manager 2025-09-18 23:40:36,261 - INFO - Pod ctest-pod-94483655 verification passed 2025-09-18 23:40:36,267 - INFO - Pod ctest-pod-95755510 is in running state.Got IP 10.47.255.244 2025-09-18 23:40:36,324 - DEBUG - Pod ctest-pod-95755510 has vmi d7c10132-94e8-11f0-a6ba-fa163ec2b82c 2025-09-18 23:40:36,324 - INFO - Verified pod ctest-pod-95755510 in contrail-api 2025-09-18 23:40:36,335 - DEBUG - VMI d7c10132-94e8-11f0-a6ba-fa163ec2b82c is active in agent 10.0.0.56 2025-09-18 23:40:36,335 - INFO - Verified Pod ctest-pod-95755510 in agent 10.0.0.56 2025-09-18 23:40:36,335 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=c209132b-5d7c-4ac5-ac2d-63218a9531d7 2025-09-18 23:40:36,339 - INFO - Pod ctest-pod-95755510 with uuid c209132b-5d7c-4ac5-ac2d-63218a9531d7 found in kube manager 2025-09-18 23:40:36,339 - INFO - Pod ctest-pod-95755510 verification passed 2025-09-18 23:40:36,339 - INFO - ================================================================================ 2025-09-18 23:40:36,340 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-09-18 23:40:36,340 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-09-18 23:40:36,560 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.33': '0'}} with 2025-09-18 23:40:36,560 - INFO - Initial checks done. Running the testcase now 2025-09-18 23:40:36,560 - INFO - 2025-09-18 23:40:36,614 - DEBUG - [Pod ctest-pod-37167863] Cmd: echo ctest-pod-37167863 > /usr/share/nginx/html/index.html, Output: 2025-09-18 23:40:36,672 - DEBUG - [Pod ctest-pod-14421265] Cmd: echo ctest-pod-14421265 > /usr/share/nginx/html/index.html, Output: 2025-09-18 23:40:36,724 - DEBUG - [Pod ctest-pod-23808705] Cmd: echo ctest-pod-23808705 > /usr/share/nginx/html/index.html, Output: 2025-09-18 23:40:36,780 - DEBUG - [Pod ctest-pod-64906100] Cmd: echo ctest-pod-64906100 > /usr/share/nginx/html/index.html, Output: 2025-09-18 23:40:36,783 - DEBUG - Service ctest-nginx-svc-79080223 not present 2025-09-18 23:40:36,784 - INFO - Creating service ctest-nginx-svc-79080223 2025-09-18 23:40:36,797 - INFO - Created Service ctest-nginx-svc-79080223 2025-09-18 23:40:36,803 - WARNING - Service UUID 3748afb1-84ac-4cba-8c91-42e5bce0b1f1 not yet found in contrail-api 2025-09-18 23:40:37,829 - INFO - Validated that Service ctest-nginx-svc-79080223 is seen in contrail-api 2025-09-18 23:40:37,830 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=3748afb1-84ac-4cba-8c91-42e5bce0b1f1 2025-09-18 23:40:37,838 - INFO - Service ctest-nginx-svc-79080223 with uuid 3748afb1-84ac-4cba-8c91-42e5bce0b1f1 found in kube manager 2025-09-18 23:40:37,838 - INFO - Service ctest-nginx-svc-79080223 verification passed 2025-09-18 23:40:38,894 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) ctest-pod-14421265 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:38,895 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:38,895 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) ctest-pod-14421265 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:38,953 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:38,953 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:38,953 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:38,953 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37167863': 1, 'ctest-pod-14421265': 1} 2025-09-18 23:40:39,030 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,030 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:39,030 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,089 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37167863 2025-09-18 23:40:39,090 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:39,090 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37167863 2025-09-18 23:40:39,140 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) ctest-pod-37167863 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,140 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:39,140 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) ctest-pod-37167863 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,188 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,189 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:39,189 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,242 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,243 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:40:39,243 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:40:39,243 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37167863': 4, 'ctest-pod-14421265': 1} 2025-09-18 23:40:39,261 - DEBUG - Network policy ingress-on-service not present 2025-09-18 23:40:39,295 - INFO - Creating Network Policy ingress-on-service 2025-09-18 23:40:39,312 - INFO - Network policy found in k8s 2025-09-18 23:40:39,329 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c31a7ec6-d093-41f9-a22b-e605c15e1ce5 2025-09-18 23:40:39,335 - INFO - Network Policy ingress-on-service with uuid c31a7ec6-d093-41f9-a22b-e605c15e1ce5 found in kube manager 2025-09-18 23:40:39,368 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-09-18 23:40:39,368 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-09-18 23:40:39,368 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c31a7ec6-d093-41f9-a22b-e605c15e1ce5 2025-09-18 23:40:39,402 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-18 23:40:41,406 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c31a7ec6-d093-41f9-a22b-e605c15e1ce5 2025-09-18 23:40:41,440 - INFO - Network policy with name ingress-on-service found in agent 2025-09-18 23:40:41,441 - INFO - Network Policy ingress-on-service verification passed 2025-09-18 23:40:46,499 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:46,499 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:46,499 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:51,550 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:51,550 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:51,550 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:56,601 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:56,602 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:40:56,602 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:01,654 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:01,654 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:01,654 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:06,707 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:06,707 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:06,707 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:11,757 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:11,757 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:11,758 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:16,809 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:16,809 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:16,809 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:21,860 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:21,860 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:21,860 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:26,907 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:26,907 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:26,907 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:31,951 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:31,951 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:31,951 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:31,951 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-37167863': 0, 'ctest-pod-14421265': 0} 2025-09-18 23:41:32,016 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:41:32,016 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:41:32,016 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:41:32,076 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:41:32,076 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:41:32,076 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:41:32,076 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37167863': 1, 'ctest-pod-14421265': 1} 2025-09-18 23:41:37,126 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:37,126 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:37,126 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:42,174 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:42,175 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:42,175 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:47,226 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:47,227 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:47,227 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:52,278 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:52,278 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:52,278 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:57,327 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:57,327 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:41:57,327 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:02,400 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:02,400 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:02,400 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:07,450 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:07,451 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:07,451 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:12,501 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:12,501 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:12,501 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:17,554 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:17,554 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:17,554 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:21,319 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-09-18 23:42:31,378 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:31,378 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:31,378 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:31,378 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-37167863': 0, 'ctest-pod-14421265': 0} 2025-09-18 23:42:33,431 - DEBUG - [Pod ctest-pod-94483655] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.992 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.053 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.053/0.372/0.992 ms 2025-09-18 23:42:33,431 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-94483655 with expectation True passed 2025-09-18 23:42:35,475 - DEBUG - [Pod ctest-pod-70079147] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.820 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.112 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.341/0.820 ms 2025-09-18 23:42:35,475 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70079147 with expectation True passed 2025-09-18 23:42:37,536 - DEBUG - [Pod ctest-pod-05911135] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.170 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.440/1.170 ms 2025-09-18 23:42:37,536 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05911135 with expectation True passed 2025-09-18 23:42:37,592 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:42:37,593 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-18 23:42:37,593 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:42:37,593 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94483655 passed 2025-09-18 23:42:37,652 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:42:37,652 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-18 23:42:37,652 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:42:37,652 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94483655 passed 2025-09-18 23:42:42,688 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-18 23:42:42,688 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-18 23:42:42,688 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-18 23:42:42,688 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70079147 passed 2025-09-18 23:42:47,738 - DEBUG - [Pod ctest-pod-95755510] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-18 23:42:47,738 - DEBUG - [Pod Pod ctest-pod-95755510] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-18 23:42:47,738 - DEBUG - [Pod Pod ctest-pod-95755510] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-18 23:42:47,738 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95755510 passed 2025-09-18 23:42:47,746 - INFO - Updating Network Policy ingress-on-service 2025-09-18 23:42:52,811 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:52,811 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:52,811 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:57,863 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:57,864 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:42:57,864 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:02,914 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:02,914 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:02,914 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:07,968 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:07,968 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:07,968 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:13,021 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:13,021 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:13,021 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:18,096 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:18,096 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:18,096 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:23,142 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:23,143 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:23,143 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:28,194 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:28,194 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:28,194 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:33,247 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:33,247 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:33,247 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:38,302 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:38,302 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:38,303 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) wget: download timed out 2025-09-18 23:43:38,303 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-37167863': 0, 'ctest-pod-14421265': 0} 2025-09-18 23:43:38,355 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,355 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,355 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,412 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) ctest-pod-14421265 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,412 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,412 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) ctest-pod-14421265 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,457 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,457 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,457 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,511 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,512 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,512 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,512 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37167863': 1, 'ctest-pod-14421265': 3} 2025-09-18 23:43:38,569 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,569 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,569 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,612 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,613 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,613 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,667 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,668 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,668 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,718 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14421265 2025-09-18 23:43:38,718 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,718 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14421265 2025-09-18 23:43:38,774 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,774 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,774 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,829 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,830 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,830 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-14421265 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,889 - DEBUG - [Pod ctest-pod-05911135] Cmd: wget http://10.96.60.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,889 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd wget http://10.96.60.81:80/ -O - -T 5 -t 1 passed 2025-09-18 23:43:38,889 - DEBUG - [Pod Pod ctest-pod-05911135] Cmd output: ctest-pod-37167863 Connecting to 10.96.60.81:80 (10.96.60.81:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-18 23:43:38,889 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37167863': 1, 'ctest-pod-14421265': 6} 2025-09-18 23:43:40,943 - DEBUG - [Pod ctest-pod-94483655] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.737 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.296/0.737 ms 2025-09-18 23:43:40,943 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-94483655 with expectation True passed 2025-09-18 23:43:42,995 - DEBUG - [Pod ctest-pod-70079147] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.428 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.195/0.428 ms 2025-09-18 23:43:42,995 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70079147 with expectation True passed 2025-09-18 23:43:45,046 - DEBUG - [Pod ctest-pod-05911135] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.704 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.286/0.704 ms 2025-09-18 23:43:45,046 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05911135 with expectation True passed 2025-09-18 23:43:45,098 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:43:45,098 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-18 23:43:45,098 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:43:45,098 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94483655 passed 2025-09-18 23:43:45,160 - DEBUG - [Pod ctest-pod-94483655] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:43:45,160 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-18 23:43:45,160 - DEBUG - [Pod Pod ctest-pod-94483655] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:43:45,160 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94483655 passed 2025-09-18 23:43:50,214 - DEBUG - [Pod ctest-pod-70079147] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-18 23:43:50,214 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-18 23:43:50,214 - DEBUG - [Pod Pod ctest-pod-70079147] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-18 23:43:50,214 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70079147 passed 2025-09-18 23:43:50,269 - DEBUG - [Pod ctest-pod-95755510] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:43:50,270 - DEBUG - [Pod Pod ctest-pod-95755510] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-18 23:43:50,270 - DEBUG - [Pod Pod ctest-pod-95755510] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-18 23:43:50,270 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95755510 passed 2025-09-18 23:43:50,270 - INFO - Deleting Network Policy : ingress-on-service 2025-09-18 23:43:50,271 - INFO - Deleting service : ctest-nginx-svc-79080223 2025-09-18 23:43:50,477 - DEBUG - No XMPP flaps were noticed during the test