2025-10-31 02:54:04,133 - INFO - Using existing project ['default-domain', 'k8s-default'](f55337c6-2e52-4932-9b4f-46749d428bbf) 2025-10-31 02:54:04,153 - DEBUG - Namespace ctest-new-default-72840852 not present 2025-10-31 02:54:04,170 - INFO - Created namespace ctest-new-default-72840852 2025-10-31 02:54:07,174 - DEBUG - Namespace ctest-non-default-12901266 not present 2025-10-31 02:54:07,184 - INFO - Created namespace ctest-non-default-12901266 2025-10-31 02:54:10,215 - DEBUG - Pod ctest-pod-56499999 not present 2025-10-31 02:54:10,216 - INFO - Creating Pod ctest-pod-56499999 2025-10-31 02:54:10,312 - DEBUG - Pod : ctest-pod-56499999 UUID is 8c944b69-434c-49ac-acc9-455f425a69b8 2025-10-31 02:54:10,340 - DEBUG - Pod ctest-pod-89216172 not present 2025-10-31 02:54:10,341 - INFO - Creating Pod ctest-pod-89216172 2025-10-31 02:54:10,383 - DEBUG - Pod : ctest-pod-89216172 UUID is 3a9d319e-3ffc-459e-a255-51877cc75fba 2025-10-31 02:54:10,394 - DEBUG - Pod ctest-pod-98915490 not present 2025-10-31 02:54:10,405 - INFO - Creating Pod ctest-pod-98915490 2025-10-31 02:54:10,541 - DEBUG - Pod : ctest-pod-98915490 UUID is c35ea460-ccdf-4895-87c2-47436129d764 2025-10-31 02:54:10,552 - DEBUG - Pod ctest-pod-24431512 not present 2025-10-31 02:54:10,553 - INFO - Creating Pod ctest-pod-24431512 2025-10-31 02:54:10,611 - DEBUG - Pod : ctest-pod-24431512 UUID is 27bb6e73-b972-4c8d-b663-317557dfe978 2025-10-31 02:54:10,617 - DEBUG - Pod ctest-pod-51315782 not present 2025-10-31 02:54:10,617 - INFO - Creating Pod ctest-pod-51315782 2025-10-31 02:54:10,714 - DEBUG - Pod : ctest-pod-51315782 UUID is a05c0d26-bd8c-41d1-912e-0bed47382b1a 2025-10-31 02:54:10,727 - DEBUG - Pod ctest-pod-21974606 not present 2025-10-31 02:54:10,730 - INFO - Creating Pod ctest-pod-21974606 2025-10-31 02:54:10,775 - DEBUG - Pod : ctest-pod-21974606 UUID is 067b22d6-3660-480a-8491-8d720eb7d0d6 2025-10-31 02:54:10,780 - DEBUG - Pod ctest-pod-30660612 not present 2025-10-31 02:54:10,781 - INFO - Creating Pod ctest-pod-30660612 2025-10-31 02:54:10,836 - DEBUG - Pod : ctest-pod-30660612 UUID is aea19ec7-e706-4ab6-9012-f74049922d5a 2025-10-31 02:54:10,841 - DEBUG - Pod ctest-pod-20732252 not present 2025-10-31 02:54:10,841 - INFO - Creating Pod ctest-pod-20732252 2025-10-31 02:54:10,867 - DEBUG - Pod : ctest-pod-20732252 UUID is 83bb01e8-a132-43cf-9978-cdc5b3e5b2de 2025-10-31 02:54:11,052 - INFO - Project default-domain:k8s-ctest-new-default-72840852 for Namespace ctest-new-default-72840852 is seen in contrail-api 2025-10-31 02:54:11,052 - DEBUG - Project uuid in Contrail is 8bf18d9b-fb94-46b7-8b38-b24bfc4ba507 2025-10-31 02:54:11,214 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=e6ec6d5c-5907-4cf0-a4fd-7df730625ba4 2025-10-31 02:54:11,219 - INFO - Namespace ctest-new-default-72840852 with uuid e6ec6d5c-5907-4cf0-a4fd-7df730625ba4 found in kube manager 2025-10-31 02:54:11,219 - INFO - Namespace ctest-new-default-72840852 verification passed 2025-10-31 02:54:11,423 - INFO - Project default-domain:k8s-ctest-non-default-12901266 for Namespace ctest-non-default-12901266 is seen in contrail-api 2025-10-31 02:54:11,423 - DEBUG - Project uuid in Contrail is 7315dd38-5d4c-4dc7-89fe-e731634b69a9 2025-10-31 02:54:11,423 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=7c311bf4-97a4-4b79-930f-aec55132d556 2025-10-31 02:54:11,427 - INFO - Namespace ctest-non-default-12901266 with uuid 7c311bf4-97a4-4b79-930f-aec55132d556 found in kube manager 2025-10-31 02:54:11,428 - INFO - Namespace ctest-non-default-12901266 verification passed 2025-10-31 02:54:11,434 - DEBUG - Pod ctest-pod-56499999 not in running state.Currently in Pending 2025-10-31 02:54:16,442 - DEBUG - Pod ctest-pod-56499999 not in running state.Currently in Pending 2025-10-31 02:54:21,449 - DEBUG - Pod ctest-pod-56499999 not in running state.Currently in Pending 2025-10-31 02:54:26,470 - INFO - Pod ctest-pod-56499999 is in running state.Got IP 10.47.255.251 2025-10-31 02:54:26,526 - DEBUG - Pod ctest-pod-56499999 has vmi e104eda2-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:26,526 - INFO - Verified pod ctest-pod-56499999 in contrail-api 2025-10-31 02:54:26,543 - DEBUG - VMI e104eda2-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:26,543 - INFO - Verified Pod ctest-pod-56499999 in agent 10.0.0.65 2025-10-31 02:54:26,543 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=8c944b69-434c-49ac-acc9-455f425a69b8 2025-10-31 02:54:26,549 - INFO - Pod ctest-pod-56499999 with uuid 8c944b69-434c-49ac-acc9-455f425a69b8 found in kube manager 2025-10-31 02:54:26,549 - INFO - Pod ctest-pod-56499999 verification passed 2025-10-31 02:54:26,559 - INFO - Pod ctest-pod-89216172 is in running state.Got IP 10.47.255.250 2025-10-31 02:54:26,574 - DEBUG - Pod ctest-pod-89216172 has vmi e1731d0e-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:26,574 - INFO - Verified pod ctest-pod-89216172 in contrail-api 2025-10-31 02:54:26,587 - DEBUG - VMI e1731d0e-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:26,587 - INFO - Verified Pod ctest-pod-89216172 in agent 10.0.0.65 2025-10-31 02:54:26,587 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=3a9d319e-3ffc-459e-a255-51877cc75fba 2025-10-31 02:54:26,592 - INFO - Pod ctest-pod-89216172 with uuid 3a9d319e-3ffc-459e-a255-51877cc75fba found in kube manager 2025-10-31 02:54:26,592 - INFO - Pod ctest-pod-89216172 verification passed 2025-10-31 02:54:26,599 - INFO - Pod ctest-pod-98915490 is in running state.Got IP 10.47.255.249 2025-10-31 02:54:26,653 - DEBUG - Pod ctest-pod-98915490 has vmi e2099a2c-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:26,653 - INFO - Verified pod ctest-pod-98915490 in contrail-api 2025-10-31 02:54:26,668 - DEBUG - VMI e2099a2c-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:26,669 - INFO - Verified Pod ctest-pod-98915490 in agent 10.0.0.65 2025-10-31 02:54:26,669 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=c35ea460-ccdf-4895-87c2-47436129d764 2025-10-31 02:54:26,674 - INFO - Pod ctest-pod-98915490 with uuid c35ea460-ccdf-4895-87c2-47436129d764 found in kube manager 2025-10-31 02:54:26,674 - INFO - Pod ctest-pod-98915490 verification passed 2025-10-31 02:54:26,681 - INFO - Pod ctest-pod-24431512 is in running state.Got IP 10.47.255.248 2025-10-31 02:54:26,741 - DEBUG - Pod ctest-pod-24431512 has vmi e29464ae-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:26,741 - INFO - Verified pod ctest-pod-24431512 in contrail-api 2025-10-31 02:54:26,754 - DEBUG - VMI e29464ae-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:26,755 - INFO - Verified Pod ctest-pod-24431512 in agent 10.0.0.65 2025-10-31 02:54:26,755 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=27bb6e73-b972-4c8d-b663-317557dfe978 2025-10-31 02:54:26,759 - INFO - Pod ctest-pod-24431512 with uuid 27bb6e73-b972-4c8d-b663-317557dfe978 found in kube manager 2025-10-31 02:54:26,759 - INFO - Pod ctest-pod-24431512 verification passed 2025-10-31 02:54:26,765 - DEBUG - Pod ctest-pod-51315782 not in running state.Currently in Pending 2025-10-31 02:54:31,772 - INFO - Pod ctest-pod-51315782 is in running state.Got IP 10.47.255.247 2025-10-31 02:54:31,787 - DEBUG - Pod ctest-pod-51315782 has vmi e3152fbc-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:31,787 - INFO - Verified pod ctest-pod-51315782 in contrail-api 2025-10-31 02:54:31,799 - DEBUG - VMI e3152fbc-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:31,799 - INFO - Verified Pod ctest-pod-51315782 in agent 10.0.0.65 2025-10-31 02:54:31,799 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=a05c0d26-bd8c-41d1-912e-0bed47382b1a 2025-10-31 02:54:31,803 - INFO - Pod ctest-pod-51315782 with uuid a05c0d26-bd8c-41d1-912e-0bed47382b1a found in kube manager 2025-10-31 02:54:31,804 - INFO - Pod ctest-pod-51315782 verification passed 2025-10-31 02:54:31,810 - INFO - Pod ctest-pod-30660612 is in running state.Got IP 10.47.255.245 2025-10-31 02:54:31,865 - DEBUG - Pod ctest-pod-30660612 has vmi e427727a-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:31,865 - INFO - Verified pod ctest-pod-30660612 in contrail-api 2025-10-31 02:54:31,878 - DEBUG - VMI e427727a-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:31,878 - INFO - Verified Pod ctest-pod-30660612 in agent 10.0.0.65 2025-10-31 02:54:31,878 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=aea19ec7-e706-4ab6-9012-f74049922d5a 2025-10-31 02:54:31,882 - INFO - Pod ctest-pod-30660612 with uuid aea19ec7-e706-4ab6-9012-f74049922d5a found in kube manager 2025-10-31 02:54:31,882 - INFO - Pod ctest-pod-30660612 verification passed 2025-10-31 02:54:31,890 - INFO - Pod ctest-pod-21974606 is in running state.Got IP 10.47.255.246 2025-10-31 02:54:31,902 - DEBUG - Pod ctest-pod-21974606 has vmi e3a2fbc6-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:31,902 - INFO - Verified pod ctest-pod-21974606 in contrail-api 2025-10-31 02:54:31,914 - DEBUG - VMI e3a2fbc6-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:31,914 - INFO - Verified Pod ctest-pod-21974606 in agent 10.0.0.65 2025-10-31 02:54:31,914 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=067b22d6-3660-480a-8491-8d720eb7d0d6 2025-10-31 02:54:31,918 - INFO - Pod ctest-pod-21974606 with uuid 067b22d6-3660-480a-8491-8d720eb7d0d6 found in kube manager 2025-10-31 02:54:31,918 - INFO - Pod ctest-pod-21974606 verification passed 2025-10-31 02:54:31,924 - INFO - Pod ctest-pod-20732252 is in running state.Got IP 10.47.255.244 2025-10-31 02:54:31,982 - DEBUG - Pod ctest-pod-20732252 has vmi e4a085f2-b604-11f0-8e3e-fa163ed8a0a4 2025-10-31 02:54:31,982 - INFO - Verified pod ctest-pod-20732252 in contrail-api 2025-10-31 02:54:31,993 - DEBUG - VMI e4a085f2-b604-11f0-8e3e-fa163ed8a0a4 is active in agent 10.0.0.65 2025-10-31 02:54:31,994 - INFO - Verified Pod ctest-pod-20732252 in agent 10.0.0.65 2025-10-31 02:54:31,994 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=83bb01e8-a132-43cf-9978-cdc5b3e5b2de 2025-10-31 02:54:31,998 - INFO - Pod ctest-pod-20732252 with uuid 83bb01e8-a132-43cf-9978-cdc5b3e5b2de found in kube manager 2025-10-31 02:54:31,998 - INFO - Pod ctest-pod-20732252 verification passed 2025-10-31 02:54:31,998 - INFO - ================================================================================ 2025-10-31 02:54:31,998 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-10-31 02:54:31,998 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-10-31 02:54:32,205 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.38': '0'}} with 2025-10-31 02:54:32,205 - INFO - Initial checks done. Running the testcase now 2025-10-31 02:54:32,205 - INFO - 2025-10-31 02:54:32,257 - DEBUG - [Pod ctest-pod-56499999] Cmd: echo ctest-pod-56499999 > /usr/share/nginx/html/index.html, Output: 2025-10-31 02:54:32,312 - DEBUG - [Pod ctest-pod-89216172] Cmd: echo ctest-pod-89216172 > /usr/share/nginx/html/index.html, Output: 2025-10-31 02:54:32,368 - DEBUG - [Pod ctest-pod-98915490] Cmd: echo ctest-pod-98915490 > /usr/share/nginx/html/index.html, Output: 2025-10-31 02:54:32,406 - DEBUG - [Pod ctest-pod-24431512] Cmd: echo ctest-pod-24431512 > /usr/share/nginx/html/index.html, Output: 2025-10-31 02:54:32,409 - DEBUG - Service ctest-nginx-svc-09099009 not present 2025-10-31 02:54:32,409 - INFO - Creating service ctest-nginx-svc-09099009 2025-10-31 02:54:32,430 - INFO - Created Service ctest-nginx-svc-09099009 2025-10-31 02:54:32,443 - WARNING - Service UUID a1832cf7-ec7d-4804-95f8-2d85d48144b1 not yet found in contrail-api 2025-10-31 02:54:33,450 - INFO - Validated that Service ctest-nginx-svc-09099009 is seen in contrail-api 2025-10-31 02:54:33,451 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=a1832cf7-ec7d-4804-95f8-2d85d48144b1 2025-10-31 02:54:33,454 - INFO - Service ctest-nginx-svc-09099009 with uuid a1832cf7-ec7d-4804-95f8-2d85d48144b1 found in kube manager 2025-10-31 02:54:33,454 - INFO - Service ctest-nginx-svc-09099009 verification passed 2025-10-31 02:54:34,539 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89216172 2025-10-31 02:54:34,540 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,540 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89216172 2025-10-31 02:54:34,601 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89216172 2025-10-31 02:54:34,601 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,602 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89216172 2025-10-31 02:54:34,651 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,652 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,652 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,713 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,713 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,713 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,767 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,767 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,767 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,767 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56499999': 1, 'ctest-pod-89216172': 4} 2025-10-31 02:54:34,823 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,823 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,824 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:54:34,883 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56499999 2025-10-31 02:54:34,883 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:54:34,883 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56499999 2025-10-31 02:54:34,883 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56499999': 1, 'ctest-pod-89216172': 1} 2025-10-31 02:54:34,886 - DEBUG - Network policy ingress-on-service not present 2025-10-31 02:54:34,888 - INFO - Creating Network Policy ingress-on-service 2025-10-31 02:54:34,911 - INFO - Network policy found in k8s 2025-10-31 02:54:34,911 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1c23503-14cb-4bce-99e2-803a245d3dea 2025-10-31 02:54:34,918 - INFO - Network Policy ingress-on-service with uuid c1c23503-14cb-4bce-99e2-803a245d3dea found in kube manager 2025-10-31 02:54:34,948 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-10-31 02:54:34,948 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-10-31 02:54:34,949 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1c23503-14cb-4bce-99e2-803a245d3dea 2025-10-31 02:54:34,983 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-31 02:54:36,985 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1c23503-14cb-4bce-99e2-803a245d3dea 2025-10-31 02:54:37,011 - INFO - Network policy with name ingress-on-service found in agent 2025-10-31 02:54:37,011 - INFO - Network Policy ingress-on-service verification passed 2025-10-31 02:54:42,058 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:42,059 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:42,059 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:47,115 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:47,116 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:47,116 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:52,166 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:52,167 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:52,167 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:57,224 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:57,225 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:54:57,225 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:02,281 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:02,282 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:02,282 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:07,340 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:07,340 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:07,340 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:12,393 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:12,393 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:12,393 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:14,270 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-10-31 02:55:24,327 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:24,328 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:24,328 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:29,381 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:29,382 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:29,382 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:34,445 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:34,446 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:34,446 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:34,446 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56499999': 0, 'ctest-pod-89216172': 0} 2025-10-31 02:55:34,506 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:55:34,506 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:55:34,506 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:55:34,566 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:55:34,566 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:55:34,566 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:55:34,566 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56499999': 1, 'ctest-pod-89216172': 1} 2025-10-31 02:55:39,614 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:39,614 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:39,614 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:44,668 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:44,668 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:44,668 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:49,721 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:49,722 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:49,722 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:54,774 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:54,774 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:54,774 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:59,826 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:59,826 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:55:59,826 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:04,874 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:04,874 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:04,874 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:09,922 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:09,922 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:09,922 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:14,978 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:14,978 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:14,978 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:20,041 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:20,041 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:20,041 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:25,105 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:25,105 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:25,105 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:25,105 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56499999': 0, 'ctest-pod-89216172': 0} 2025-10-31 02:56:27,159 - DEBUG - [Pod ctest-pod-21974606] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.562 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.121 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.254/0.562 ms 2025-10-31 02:56:27,159 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-21974606 with expectation True passed 2025-10-31 02:56:29,206 - DEBUG - [Pod ctest-pod-51315782] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.936 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.369/0.936 ms 2025-10-31 02:56:29,206 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51315782 with expectation True passed 2025-10-31 02:56:31,258 - DEBUG - [Pod ctest-pod-30660612] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.980 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.118 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.393/0.980 ms 2025-10-31 02:56:31,258 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30660612 with expectation True passed 2025-10-31 02:56:31,325 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:56:31,325 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-31 02:56:31,325 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:56:31,325 - INFO - wget check of of http://10.47.255.251 from ctest-pod-21974606 passed 2025-10-31 02:56:31,371 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:56:31,371 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-31 02:56:31,371 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:56:31,371 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21974606 passed 2025-10-31 02:56:36,421 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 02:56:36,422 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 02:56:36,422 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 02:56:36,422 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51315782 passed 2025-10-31 02:56:41,483 - DEBUG - [Pod ctest-pod-20732252] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-31 02:56:41,483 - DEBUG - [Pod Pod ctest-pod-20732252] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-31 02:56:41,483 - DEBUG - [Pod Pod ctest-pod-20732252] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-31 02:56:41,483 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20732252 passed 2025-10-31 02:56:41,492 - INFO - Updating Network Policy ingress-on-service 2025-10-31 02:56:46,562 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:46,562 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:46,562 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:51,610 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:51,610 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:51,610 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:56,662 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:56,662 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:56:56,662 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:01,727 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:01,727 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:01,727 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:06,782 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:06,782 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:06,782 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:11,835 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:11,835 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:11,835 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:16,890 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:16,890 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:16,890 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:21,942 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:21,943 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:21,943 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:26,990 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:26,990 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:26,990 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:32,042 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:32,042 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:32,042 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) wget: download timed out 2025-10-31 02:57:32,042 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56499999': 0, 'ctest-pod-89216172': 0} 2025-10-31 02:57:32,101 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,101 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:57:32,101 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,151 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,151 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:57:32,151 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,208 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56499999 2025-10-31 02:57:32,209 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:57:32,209 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56499999 2025-10-31 02:57:32,265 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,265 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:57:32,265 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,265 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56499999': 3, 'ctest-pod-89216172': 1} 2025-10-31 02:57:32,320 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,320 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:57:32,320 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: ctest-pod-56499999 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,376 - DEBUG - [Pod ctest-pod-30660612] Cmd: wget http://10.104.225.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,376 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd wget http://10.104.225.49:80/ -O - -T 5 -t 1 passed 2025-10-31 02:57:32,376 - DEBUG - [Pod Pod ctest-pod-30660612] Cmd output: ctest-pod-89216172 Connecting to 10.104.225.49:80 (10.104.225.49:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 02:57:32,376 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56499999': 1, 'ctest-pod-89216172': 1} 2025-10-31 02:57:34,430 - DEBUG - [Pod ctest-pod-21974606] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.446 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.104 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.210/0.446 ms 2025-10-31 02:57:34,431 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-21974606 with expectation True passed 2025-10-31 02:57:36,481 - DEBUG - [Pod ctest-pod-51315782] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.440 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.203/0.440 ms 2025-10-31 02:57:36,482 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51315782 with expectation True passed 2025-10-31 02:57:38,534 - DEBUG - [Pod ctest-pod-30660612] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.404 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.196/0.404 ms 2025-10-31 02:57:38,534 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30660612 with expectation True passed 2025-10-31 02:57:38,585 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:57:38,585 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-31 02:57:38,585 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:57:38,585 - INFO - wget check of of http://10.47.255.251 from ctest-pod-21974606 passed 2025-10-31 02:57:38,641 - DEBUG - [Pod ctest-pod-21974606] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:57:38,641 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-31 02:57:38,641 - DEBUG - [Pod Pod ctest-pod-21974606] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:57:38,641 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21974606 passed 2025-10-31 02:57:43,691 - DEBUG - [Pod ctest-pod-51315782] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 02:57:43,691 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 02:57:43,691 - DEBUG - [Pod Pod ctest-pod-51315782] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 02:57:43,691 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51315782 passed 2025-10-31 02:57:43,749 - DEBUG - [Pod ctest-pod-20732252] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:57:43,749 - DEBUG - [Pod Pod ctest-pod-20732252] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-31 02:57:43,749 - DEBUG - [Pod Pod ctest-pod-20732252] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 02:57:43,749 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20732252 passed 2025-10-31 02:57:43,750 - INFO - Deleting Network Policy : ingress-on-service 2025-10-31 02:57:43,750 - INFO - Deleting service : ctest-nginx-svc-09099009 2025-10-31 02:57:43,946 - DEBUG - No XMPP flaps were noticed during the test