2025-12-29 01:52:40,855 - INFO - Using existing project ['default-domain', 'k8s-default'](633812f7-e2c4-4d2f-9f77-b40d84db3e69) 2025-12-29 01:52:40,877 - DEBUG - Namespace ctest-new-default-85063703 not present 2025-12-29 01:52:40,888 - INFO - Created namespace ctest-new-default-85063703 2025-12-29 01:52:43,906 - DEBUG - Namespace ctest-non-default-17924109 not present 2025-12-29 01:52:43,918 - INFO - Created namespace ctest-non-default-17924109 2025-12-29 01:52:46,941 - DEBUG - Pod ctest-pod-13047141 not present 2025-12-29 01:52:46,942 - INFO - Creating Pod ctest-pod-13047141 2025-12-29 01:52:46,979 - DEBUG - Pod : ctest-pod-13047141 UUID is f4cfaee2-9eec-4679-984b-91da33c41de0 2025-12-29 01:52:46,981 - DEBUG - Pod ctest-pod-25179413 not present 2025-12-29 01:52:46,981 - INFO - Creating Pod ctest-pod-25179413 2025-12-29 01:52:47,016 - DEBUG - Pod : ctest-pod-25179413 UUID is d94cb488-a342-4515-9e2c-6e9c47ec6c4f 2025-12-29 01:52:47,019 - DEBUG - Pod ctest-pod-54424332 not present 2025-12-29 01:52:47,019 - INFO - Creating Pod ctest-pod-54424332 2025-12-29 01:52:47,053 - DEBUG - Pod : ctest-pod-54424332 UUID is 82564c6a-e085-48db-96da-8c3d2553a666 2025-12-29 01:52:47,055 - DEBUG - Pod ctest-pod-98149075 not present 2025-12-29 01:52:47,055 - INFO - Creating Pod ctest-pod-98149075 2025-12-29 01:52:47,085 - DEBUG - Pod : ctest-pod-98149075 UUID is 5786d577-a07d-4058-8197-9571c9b87ef6 2025-12-29 01:52:47,087 - DEBUG - Pod ctest-pod-99770389 not present 2025-12-29 01:52:47,087 - INFO - Creating Pod ctest-pod-99770389 2025-12-29 01:52:47,113 - DEBUG - Pod : ctest-pod-99770389 UUID is b1f4b6bb-0484-42bc-a183-1a8a3deb1ed7 2025-12-29 01:52:47,115 - DEBUG - Pod ctest-pod-74037305 not present 2025-12-29 01:52:47,115 - INFO - Creating Pod ctest-pod-74037305 2025-12-29 01:52:47,134 - DEBUG - Pod : ctest-pod-74037305 UUID is 668517ce-c702-405f-8380-9dd7865643ed 2025-12-29 01:52:47,136 - DEBUG - Pod ctest-pod-37982398 not present 2025-12-29 01:52:47,137 - INFO - Creating Pod ctest-pod-37982398 2025-12-29 01:52:47,161 - DEBUG - Pod : ctest-pod-37982398 UUID is 4664611a-3856-4736-aa1a-a2cd7561b20d 2025-12-29 01:52:47,166 - DEBUG - Pod ctest-pod-40378898 not present 2025-12-29 01:52:47,166 - INFO - Creating Pod ctest-pod-40378898 2025-12-29 01:52:47,216 - DEBUG - Pod : ctest-pod-40378898 UUID is 5ff89435-dd9f-4251-9286-0dfad1b857a8 2025-12-29 01:52:47,391 - INFO - Project default-domain:k8s-ctest-new-default-85063703 for Namespace ctest-new-default-85063703 is seen in contrail-api 2025-12-29 01:52:47,392 - DEBUG - Project uuid in Contrail is 90c87407-1da7-420e-acf5-b6bec069990a 2025-12-29 01:52:47,553 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=34edec4e-64de-4598-8e17-fd6846ff1e02 2025-12-29 01:52:47,560 - INFO - Namespace ctest-new-default-85063703 with uuid 34edec4e-64de-4598-8e17-fd6846ff1e02 found in kube manager 2025-12-29 01:52:47,560 - INFO - Namespace ctest-new-default-85063703 verification passed 2025-12-29 01:52:47,755 - INFO - Project default-domain:k8s-ctest-non-default-17924109 for Namespace ctest-non-default-17924109 is seen in contrail-api 2025-12-29 01:52:47,756 - DEBUG - Project uuid in Contrail is 205f538a-82a6-4388-808d-a5d4eda60a48 2025-12-29 01:52:47,756 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=26ca6deb-423e-4582-94b3-5e47e6c8b76e 2025-12-29 01:52:47,763 - INFO - Namespace ctest-non-default-17924109 with uuid 26ca6deb-423e-4582-94b3-5e47e6c8b76e found in kube manager 2025-12-29 01:52:47,763 - INFO - Namespace ctest-non-default-17924109 verification passed 2025-12-29 01:52:47,776 - DEBUG - Pod ctest-pod-13047141 not in running state.Currently in Pending 2025-12-29 01:52:52,783 - DEBUG - Pod ctest-pod-13047141 not in running state.Currently in Pending 2025-12-29 01:52:57,790 - DEBUG - Pod ctest-pod-13047141 not in running state.Currently in Pending 2025-12-29 01:53:02,797 - INFO - Pod ctest-pod-13047141 is in running state.Got IP 10.47.255.251 2025-12-29 01:53:02,809 - DEBUG - Pod ctest-pod-13047141 has vmi 13f5a18e-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:02,809 - INFO - Verified pod ctest-pod-13047141 in contrail-api 2025-12-29 01:53:02,824 - DEBUG - VMI 13f5a18e-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:02,824 - INFO - Verified Pod ctest-pod-13047141 in agent 10.0.0.41 2025-12-29 01:53:02,824 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=f4cfaee2-9eec-4679-984b-91da33c41de0 2025-12-29 01:53:02,830 - INFO - Pod ctest-pod-13047141 with uuid f4cfaee2-9eec-4679-984b-91da33c41de0 found in kube manager 2025-12-29 01:53:02,830 - INFO - Pod ctest-pod-13047141 verification passed 2025-12-29 01:53:02,836 - INFO - Pod ctest-pod-25179413 is in running state.Got IP 10.47.255.250 2025-12-29 01:53:02,889 - DEBUG - Pod ctest-pod-25179413 has vmi 148295c6-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:02,889 - INFO - Verified pod ctest-pod-25179413 in contrail-api 2025-12-29 01:53:02,900 - DEBUG - VMI 148295c6-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:02,900 - INFO - Verified Pod ctest-pod-25179413 in agent 10.0.0.41 2025-12-29 01:53:02,901 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=d94cb488-a342-4515-9e2c-6e9c47ec6c4f 2025-12-29 01:53:02,905 - INFO - Pod ctest-pod-25179413 with uuid d94cb488-a342-4515-9e2c-6e9c47ec6c4f found in kube manager 2025-12-29 01:53:02,905 - INFO - Pod ctest-pod-25179413 verification passed 2025-12-29 01:53:02,911 - INFO - Pod ctest-pod-54424332 is in running state.Got IP 10.47.255.249 2025-12-29 01:53:02,966 - DEBUG - Pod ctest-pod-54424332 has vmi 150da486-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:02,966 - INFO - Verified pod ctest-pod-54424332 in contrail-api 2025-12-29 01:53:02,977 - DEBUG - VMI 150da486-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:02,977 - INFO - Verified Pod ctest-pod-54424332 in agent 10.0.0.41 2025-12-29 01:53:02,978 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=82564c6a-e085-48db-96da-8c3d2553a666 2025-12-29 01:53:02,981 - INFO - Pod ctest-pod-54424332 with uuid 82564c6a-e085-48db-96da-8c3d2553a666 found in kube manager 2025-12-29 01:53:02,981 - INFO - Pod ctest-pod-54424332 verification passed 2025-12-29 01:53:02,988 - INFO - Pod ctest-pod-98149075 is in running state.Got IP 10.47.255.248 2025-12-29 01:53:02,998 - DEBUG - Pod ctest-pod-98149075 has vmi 157c8298-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:02,998 - INFO - Verified pod ctest-pod-98149075 in contrail-api 2025-12-29 01:53:03,012 - DEBUG - VMI 157c8298-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:03,013 - INFO - Verified Pod ctest-pod-98149075 in agent 10.0.0.41 2025-12-29 01:53:03,013 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=5786d577-a07d-4058-8197-9571c9b87ef6 2025-12-29 01:53:03,022 - INFO - Pod ctest-pod-98149075 with uuid 5786d577-a07d-4058-8197-9571c9b87ef6 found in kube manager 2025-12-29 01:53:03,023 - INFO - Pod ctest-pod-98149075 verification passed 2025-12-29 01:53:03,029 - DEBUG - Pod ctest-pod-99770389 not in running state.Currently in Pending 2025-12-29 01:53:08,037 - INFO - Pod ctest-pod-99770389 is in running state.Got IP 10.47.255.247 2025-12-29 01:53:08,094 - DEBUG - Pod ctest-pod-99770389 has vmi 15fe9a12-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:08,095 - INFO - Verified pod ctest-pod-99770389 in contrail-api 2025-12-29 01:53:08,109 - DEBUG - VMI 15fe9a12-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:08,110 - INFO - Verified Pod ctest-pod-99770389 in agent 10.0.0.41 2025-12-29 01:53:08,110 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=b1f4b6bb-0484-42bc-a183-1a8a3deb1ed7 2025-12-29 01:53:08,115 - INFO - Pod ctest-pod-99770389 with uuid b1f4b6bb-0484-42bc-a183-1a8a3deb1ed7 found in kube manager 2025-12-29 01:53:08,115 - INFO - Pod ctest-pod-99770389 verification passed 2025-12-29 01:53:08,124 - INFO - Pod ctest-pod-37982398 is in running state.Got IP 10.47.255.245 2025-12-29 01:53:08,140 - DEBUG - Pod ctest-pod-37982398 has vmi 16d48474-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:08,140 - INFO - Verified pod ctest-pod-37982398 in contrail-api 2025-12-29 01:53:08,156 - DEBUG - VMI 16d48474-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:08,156 - INFO - Verified Pod ctest-pod-37982398 in agent 10.0.0.41 2025-12-29 01:53:08,156 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=4664611a-3856-4736-aa1a-a2cd7561b20d 2025-12-29 01:53:08,162 - INFO - Pod ctest-pod-37982398 with uuid 4664611a-3856-4736-aa1a-a2cd7561b20d found in kube manager 2025-12-29 01:53:08,162 - INFO - Pod ctest-pod-37982398 verification passed 2025-12-29 01:53:08,171 - INFO - Pod ctest-pod-74037305 is in running state.Got IP 10.47.255.246 2025-12-29 01:53:08,225 - DEBUG - Pod ctest-pod-74037305 has vmi 166a0cf2-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:08,225 - INFO - Verified pod ctest-pod-74037305 in contrail-api 2025-12-29 01:53:08,237 - DEBUG - VMI 166a0cf2-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:08,237 - INFO - Verified Pod ctest-pod-74037305 in agent 10.0.0.41 2025-12-29 01:53:08,238 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=668517ce-c702-405f-8380-9dd7865643ed 2025-12-29 01:53:08,242 - INFO - Pod ctest-pod-74037305 with uuid 668517ce-c702-405f-8380-9dd7865643ed found in kube manager 2025-12-29 01:53:08,242 - INFO - Pod ctest-pod-74037305 verification passed 2025-12-29 01:53:08,248 - INFO - Pod ctest-pod-40378898 is in running state.Got IP 10.47.255.244 2025-12-29 01:53:08,306 - DEBUG - Pod ctest-pod-40378898 has vmi 173e0246-e459-11f0-b28e-fa163eb8edf4 2025-12-29 01:53:08,307 - INFO - Verified pod ctest-pod-40378898 in contrail-api 2025-12-29 01:53:08,319 - DEBUG - VMI 173e0246-e459-11f0-b28e-fa163eb8edf4 is active in agent 10.0.0.41 2025-12-29 01:53:08,319 - INFO - Verified Pod ctest-pod-40378898 in agent 10.0.0.41 2025-12-29 01:53:08,319 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=5ff89435-dd9f-4251-9286-0dfad1b857a8 2025-12-29 01:53:08,324 - INFO - Pod ctest-pod-40378898 with uuid 5ff89435-dd9f-4251-9286-0dfad1b857a8 found in kube manager 2025-12-29 01:53:08,324 - INFO - Pod ctest-pod-40378898 verification passed 2025-12-29 01:53:08,324 - INFO - ================================================================================ 2025-12-29 01:53:08,324 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-12-29 01:53:08,324 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-12-29 01:53:08,570 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.241': '0'}} with 2025-12-29 01:53:08,570 - INFO - Initial checks done. Running the testcase now 2025-12-29 01:53:08,570 - INFO - 2025-12-29 01:53:08,631 - DEBUG - [Pod ctest-pod-13047141] Cmd: echo ctest-pod-13047141 > /usr/share/nginx/html/index.html, Output: 2025-12-29 01:53:08,685 - DEBUG - [Pod ctest-pod-25179413] Cmd: echo ctest-pod-25179413 > /usr/share/nginx/html/index.html, Output: 2025-12-29 01:53:08,753 - DEBUG - [Pod ctest-pod-54424332] Cmd: echo ctest-pod-54424332 > /usr/share/nginx/html/index.html, Output: 2025-12-29 01:53:08,812 - DEBUG - [Pod ctest-pod-98149075] Cmd: echo ctest-pod-98149075 > /usr/share/nginx/html/index.html, Output: 2025-12-29 01:53:08,815 - DEBUG - Service ctest-nginx-svc-72420625 not present 2025-12-29 01:53:08,816 - INFO - Creating service ctest-nginx-svc-72420625 2025-12-29 01:53:08,831 - INFO - Created Service ctest-nginx-svc-72420625 2025-12-29 01:53:08,838 - WARNING - Service UUID 6d615913-b1df-4170-b764-9fb153aa9dc2 not yet found in contrail-api 2025-12-29 01:53:09,847 - INFO - Validated that Service ctest-nginx-svc-72420625 is seen in contrail-api 2025-12-29 01:53:09,847 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_LoadbalancerDatabaseList?x=6d615913-b1df-4170-b764-9fb153aa9dc2 2025-12-29 01:53:09,851 - INFO - Service ctest-nginx-svc-72420625 with uuid 6d615913-b1df-4170-b764-9fb153aa9dc2 found in kube manager 2025-12-29 01:53:09,851 - INFO - Service ctest-nginx-svc-72420625 verification passed 2025-12-29 01:53:10,927 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:53:10,927 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:53:10,927 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:53:10,981 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) ctest-pod-13047141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:10,981 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:53:10,981 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) ctest-pod-13047141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,037 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,037 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:53:11,037 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,037 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-13047141': 2, 'ctest-pod-25179413': 1} 2025-12-29 01:53:11,091 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-13047141 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,092 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:53:11,092 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: ctest-pod-13047141 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,149 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,149 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:53:11,149 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:53:11,150 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-13047141': 1, 'ctest-pod-25179413': 1} 2025-12-29 01:53:11,152 - DEBUG - Network policy ingress-on-service not present 2025-12-29 01:53:11,153 - INFO - Creating Network Policy ingress-on-service 2025-12-29 01:53:11,169 - INFO - Network policy found in k8s 2025-12-29 01:53:11,169 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2032fa11-2699-4011-8565-6206b6d06d51 2025-12-29 01:53:11,173 - INFO - Network Policy ingress-on-service with uuid 2032fa11-2699-4011-8565-6206b6d06d51 found in kube manager 2025-12-29 01:53:11,202 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-12-29 01:53:11,203 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-12-29 01:53:11,203 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2032fa11-2699-4011-8565-6206b6d06d51 2025-12-29 01:53:11,226 - WARNING - Network policy with name ingress-on-service not found in agent 2025-12-29 01:53:13,227 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2032fa11-2699-4011-8565-6206b6d06d51 2025-12-29 01:53:13,252 - INFO - Network policy with name ingress-on-service found in agent 2025-12-29 01:53:13,253 - INFO - Network Policy ingress-on-service verification passed 2025-12-29 01:53:18,311 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:18,311 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:18,311 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:23,362 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:23,362 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:23,362 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:28,414 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:28,414 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:28,414 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:33,454 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:33,454 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:33,454 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:38,507 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:38,507 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:38,507 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:43,563 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:43,563 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:43,563 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:48,615 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:48,615 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:48,616 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:53,666 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:53,666 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:53,666 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:58,712 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:58,712 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:53:58,712 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:03,767 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:03,767 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:03,767 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:03,767 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-13047141': 0, 'ctest-pod-25179413': 0} 2025-12-29 01:54:03,825 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:54:03,826 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:54:03,826 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:54:03,881 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:54:03,881 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:54:03,881 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:54:03,882 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-13047141': 1, 'ctest-pod-25179413': 1} 2025-12-29 01:54:08,935 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:08,935 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:08,935 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:13,987 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:13,987 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:13,987 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:15,160 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-12-29 01:54:25,226 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:25,226 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:25,226 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:30,292 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:30,292 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:30,292 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:35,338 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:35,338 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:35,338 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:40,392 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:40,392 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:40,392 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:45,449 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:45,449 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:45,449 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:50,522 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:50,522 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:50,522 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:55,583 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:55,583 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:54:55,583 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:00,631 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:00,631 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:00,632 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:00,632 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-13047141': 0, 'ctest-pod-25179413': 0} 2025-12-29 01:55:02,683 - DEBUG - [Pod ctest-pod-74037305] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.881 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.343/0.881 ms 2025-12-29 01:55:02,684 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-74037305 with expectation True passed 2025-12-29 01:55:04,735 - DEBUG - [Pod ctest-pod-99770389] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.433 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.200/0.433 ms 2025-12-29 01:55:04,735 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99770389 with expectation True passed 2025-12-29 01:55:06,796 - DEBUG - [Pod ctest-pod-37982398] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.152 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.443/1.152 ms 2025-12-29 01:55:06,796 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37982398 with expectation True passed 2025-12-29 01:55:06,849 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:55:06,849 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-12-29 01:55:06,849 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:55:06,849 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74037305 passed 2025-12-29 01:55:06,905 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:55:06,905 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-12-29 01:55:06,905 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:55:06,905 - INFO - wget check of of http://10.47.255.250 from ctest-pod-74037305 passed 2025-12-29 01:55:11,951 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-29 01:55:11,951 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-29 01:55:11,951 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-29 01:55:11,951 - INFO - wget check of of http://10.47.255.250 from ctest-pod-99770389 passed 2025-12-29 01:55:17,004 - DEBUG - [Pod ctest-pod-40378898] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-12-29 01:55:17,004 - DEBUG - [Pod Pod ctest-pod-40378898] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-12-29 01:55:17,004 - DEBUG - [Pod Pod ctest-pod-40378898] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-12-29 01:55:17,004 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40378898 passed 2025-12-29 01:55:17,021 - INFO - Updating Network Policy ingress-on-service 2025-12-29 01:55:22,079 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:22,079 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:22,079 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:27,126 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:27,126 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:27,126 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:32,179 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:32,180 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:32,180 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:37,232 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:37,232 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:37,232 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:42,282 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:42,283 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:42,283 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:47,331 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:47,331 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:47,331 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:52,382 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:52,382 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:52,382 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:57,428 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:57,428 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:55:57,428 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:02,484 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:02,484 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:02,484 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:07,530 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:07,530 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:07,530 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) wget: download timed out 2025-12-29 01:56:07,530 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-13047141': 0, 'ctest-pod-25179413': 0} 2025-12-29 01:56:07,585 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:56:07,585 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,585 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:56:07,637 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,637 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,637 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,638 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-13047141': 1, 'ctest-pod-25179413': 1} 2025-12-29 01:56:07,692 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,692 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,692 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,752 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25179413 2025-12-29 01:56:07,752 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,753 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25179413 2025-12-29 01:56:07,788 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,788 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,788 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,840 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,840 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,840 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,893 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,893 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,893 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: ctest-pod-25179413 Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-29 01:56:07,947 - DEBUG - [Pod ctest-pod-37982398] Cmd: wget http://10.100.161.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:56:07,947 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd wget http://10.100.161.140:80/ -O - -T 5 -t 1 passed 2025-12-29 01:56:07,947 - DEBUG - [Pod Pod ctest-pod-37982398] Cmd output: Connecting to 10.100.161.140:80 (10.100.161.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-13047141 2025-12-29 01:56:07,947 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-13047141': 1, 'ctest-pod-25179413': 5} 2025-12-29 01:56:10,000 - DEBUG - [Pod ctest-pod-74037305] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.841 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.327/0.841 ms 2025-12-29 01:56:10,000 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-74037305 with expectation True passed 2025-12-29 01:56:12,047 - DEBUG - [Pod ctest-pod-99770389] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.969 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.381/0.969 ms 2025-12-29 01:56:12,048 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99770389 with expectation True passed 2025-12-29 01:56:14,102 - DEBUG - [Pod ctest-pod-37982398] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.481 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.216/0.481 ms 2025-12-29 01:56:14,102 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37982398 with expectation True passed 2025-12-29 01:56:14,164 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:56:14,164 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-12-29 01:56:14,164 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:56:14,164 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74037305 passed 2025-12-29 01:56:14,222 - DEBUG - [Pod ctest-pod-74037305] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:56:14,222 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-12-29 01:56:14,223 - DEBUG - [Pod Pod ctest-pod-74037305] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:56:14,223 - INFO - wget check of of http://10.47.255.250 from ctest-pod-74037305 passed 2025-12-29 01:56:19,282 - DEBUG - [Pod ctest-pod-99770389] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-29 01:56:19,282 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-29 01:56:19,282 - DEBUG - [Pod Pod ctest-pod-99770389] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-29 01:56:19,282 - INFO - wget check of of http://10.47.255.250 from ctest-pod-99770389 passed 2025-12-29 01:56:19,362 - DEBUG - [Pod ctest-pod-40378898] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:56:19,362 - DEBUG - [Pod Pod ctest-pod-40378898] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-12-29 01:56:19,362 - DEBUG - [Pod Pod ctest-pod-40378898] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-29 01:56:19,362 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40378898 passed 2025-12-29 01:56:19,362 - INFO - Deleting Network Policy : ingress-on-service 2025-12-29 01:56:19,363 - INFO - Deleting service : ctest-nginx-svc-72420625 2025-12-29 01:56:19,611 - DEBUG - No XMPP flaps were noticed during the test