2025-04-27 10:24:35,968 - INFO - Using existing project ['default-domain', 'k8s-default'](fb081d19-65e5-4c3b-ad57-d0e7f75b2274) 2025-04-27 10:24:35,994 - DEBUG - Namespace ctest-new-default-16733185 not present 2025-04-27 10:24:36,010 - INFO - Created namespace ctest-new-default-16733185 2025-04-27 10:24:39,014 - DEBUG - Namespace ctest-non-default-96899556 not present 2025-04-27 10:24:39,027 - INFO - Created namespace ctest-non-default-96899556 2025-04-27 10:24:42,055 - DEBUG - Pod ctest-pod-57156143 not present 2025-04-27 10:24:42,056 - INFO - Creating Pod ctest-pod-57156143 2025-04-27 10:24:42,093 - DEBUG - Pod : ctest-pod-57156143 UUID is 663771ab-7886-462c-b47a-94aaeeec5b6e 2025-04-27 10:24:42,109 - DEBUG - Pod ctest-pod-93660614 not present 2025-04-27 10:24:42,109 - INFO - Creating Pod ctest-pod-93660614 2025-04-27 10:24:42,131 - DEBUG - Pod : ctest-pod-93660614 UUID is 82c0c36a-73b4-4ac1-8668-be2ca02bc01a 2025-04-27 10:24:42,134 - DEBUG - Pod ctest-pod-03792096 not present 2025-04-27 10:24:42,135 - INFO - Creating Pod ctest-pod-03792096 2025-04-27 10:24:42,163 - DEBUG - Pod : ctest-pod-03792096 UUID is 804a3f6a-dd85-4ba6-95b8-5376db107fc9 2025-04-27 10:24:42,168 - DEBUG - Pod ctest-pod-47558435 not present 2025-04-27 10:24:42,168 - INFO - Creating Pod ctest-pod-47558435 2025-04-27 10:24:42,197 - DEBUG - Pod : ctest-pod-47558435 UUID is b6a75f70-5f2b-4851-bc7e-24ca41d90584 2025-04-27 10:24:42,204 - DEBUG - Pod ctest-pod-36106138 not present 2025-04-27 10:24:42,204 - INFO - Creating Pod ctest-pod-36106138 2025-04-27 10:24:42,234 - DEBUG - Pod : ctest-pod-36106138 UUID is 785affc5-1ca7-4b54-a2de-890357b06296 2025-04-27 10:24:42,235 - DEBUG - Pod ctest-pod-58568842 not present 2025-04-27 10:24:42,236 - INFO - Creating Pod ctest-pod-58568842 2025-04-27 10:24:42,255 - DEBUG - Pod : ctest-pod-58568842 UUID is 048e010d-169b-43fc-a4c7-18dbdc92cae2 2025-04-27 10:24:42,257 - DEBUG - Pod ctest-pod-37642739 not present 2025-04-27 10:24:42,257 - INFO - Creating Pod ctest-pod-37642739 2025-04-27 10:24:42,272 - DEBUG - Pod : ctest-pod-37642739 UUID is 4410d6a5-aaaa-4c03-a350-ea9dab049db9 2025-04-27 10:24:42,274 - DEBUG - Pod ctest-pod-35643596 not present 2025-04-27 10:24:42,274 - INFO - Creating Pod ctest-pod-35643596 2025-04-27 10:24:42,290 - DEBUG - Pod : ctest-pod-35643596 UUID is 1c0a7188-79a1-4c94-b534-a91e704e733b 2025-04-27 10:24:42,473 - INFO - Project default-domain:k8s-ctest-new-default-16733185 for Namespace ctest-new-default-16733185 is seen in contrail-api 2025-04-27 10:24:42,476 - DEBUG - Project uuid in Contrail is 8c418e85-4cc2-4c91-9090-10886a9dbe00 2025-04-27 10:24:42,693 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=7c006b72-282d-4085-834c-eaf08e678456 2025-04-27 10:24:42,698 - INFO - Namespace ctest-new-default-16733185 with uuid 7c006b72-282d-4085-834c-eaf08e678456 found in kube manager 2025-04-27 10:24:42,699 - INFO - Namespace ctest-new-default-16733185 verification passed 2025-04-27 10:24:42,895 - INFO - Project default-domain:k8s-ctest-non-default-96899556 for Namespace ctest-non-default-96899556 is seen in contrail-api 2025-04-27 10:24:42,895 - DEBUG - Project uuid in Contrail is b169e8f2-039e-4051-b705-0f89c0747aa7 2025-04-27 10:24:42,895 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=b525b154-f483-4e58-8295-d4db3e3731fd 2025-04-27 10:24:42,901 - INFO - Namespace ctest-non-default-96899556 with uuid b525b154-f483-4e58-8295-d4db3e3731fd found in kube manager 2025-04-27 10:24:42,901 - INFO - Namespace ctest-non-default-96899556 verification passed 2025-04-27 10:24:42,914 - DEBUG - Pod ctest-pod-57156143 not in running state.Currently in Pending 2025-04-27 10:24:47,923 - DEBUG - Pod ctest-pod-57156143 not in running state.Currently in Pending 2025-04-27 10:24:52,931 - DEBUG - Pod ctest-pod-57156143 not in running state.Currently in Pending 2025-04-27 10:24:57,945 - INFO - Pod ctest-pod-57156143 is in running state.Got IP 10.47.255.251 2025-04-27 10:24:57,958 - DEBUG - Pod ctest-pod-57156143 has vmi d60690fe-2351-11f0-b564-fa163eea387a 2025-04-27 10:24:57,958 - INFO - Verified pod ctest-pod-57156143 in contrail-api 2025-04-27 10:24:57,971 - DEBUG - VMI d60690fe-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:24:57,971 - INFO - Verified Pod ctest-pod-57156143 in agent 10.0.0.22 2025-04-27 10:24:57,972 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=663771ab-7886-462c-b47a-94aaeeec5b6e 2025-04-27 10:24:57,976 - INFO - Pod ctest-pod-57156143 with uuid 663771ab-7886-462c-b47a-94aaeeec5b6e found in kube manager 2025-04-27 10:24:57,976 - INFO - Pod ctest-pod-57156143 verification passed 2025-04-27 10:24:57,980 - INFO - Pod ctest-pod-93660614 is in running state.Got IP 10.47.255.250 2025-04-27 10:24:58,039 - DEBUG - Pod ctest-pod-93660614 has vmi d6738088-2351-11f0-b564-fa163eea387a 2025-04-27 10:24:58,039 - INFO - Verified pod ctest-pod-93660614 in contrail-api 2025-04-27 10:24:58,051 - DEBUG - VMI d6738088-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:24:58,052 - INFO - Verified Pod ctest-pod-93660614 in agent 10.0.0.22 2025-04-27 10:24:58,052 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=82c0c36a-73b4-4ac1-8668-be2ca02bc01a 2025-04-27 10:24:58,056 - INFO - Pod ctest-pod-93660614 with uuid 82c0c36a-73b4-4ac1-8668-be2ca02bc01a found in kube manager 2025-04-27 10:24:58,056 - INFO - Pod ctest-pod-93660614 verification passed 2025-04-27 10:24:58,062 - INFO - Pod ctest-pod-03792096 is in running state.Got IP 10.47.255.249 2025-04-27 10:24:58,116 - DEBUG - Pod ctest-pod-03792096 has vmi d7082904-2351-11f0-b564-fa163eea387a 2025-04-27 10:24:58,117 - INFO - Verified pod ctest-pod-03792096 in contrail-api 2025-04-27 10:24:58,129 - DEBUG - VMI d7082904-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:24:58,129 - INFO - Verified Pod ctest-pod-03792096 in agent 10.0.0.22 2025-04-27 10:24:58,129 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=804a3f6a-dd85-4ba6-95b8-5376db107fc9 2025-04-27 10:24:58,133 - INFO - Pod ctest-pod-03792096 with uuid 804a3f6a-dd85-4ba6-95b8-5376db107fc9 found in kube manager 2025-04-27 10:24:58,134 - INFO - Pod ctest-pod-03792096 verification passed 2025-04-27 10:24:58,139 - INFO - Pod ctest-pod-47558435 is in running state.Got IP 10.47.255.248 2025-04-27 10:24:58,151 - DEBUG - Pod ctest-pod-47558435 has vmi d77e435a-2351-11f0-b564-fa163eea387a 2025-04-27 10:24:58,151 - INFO - Verified pod ctest-pod-47558435 in contrail-api 2025-04-27 10:24:58,162 - DEBUG - VMI d77e435a-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:24:58,163 - INFO - Verified Pod ctest-pod-47558435 in agent 10.0.0.22 2025-04-27 10:24:58,163 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b6a75f70-5f2b-4851-bc7e-24ca41d90584 2025-04-27 10:24:58,167 - INFO - Pod ctest-pod-47558435 with uuid b6a75f70-5f2b-4851-bc7e-24ca41d90584 found in kube manager 2025-04-27 10:24:58,167 - INFO - Pod ctest-pod-47558435 verification passed 2025-04-27 10:24:58,172 - DEBUG - Pod ctest-pod-36106138 not in running state.Currently in Pending 2025-04-27 10:25:03,179 - INFO - Pod ctest-pod-36106138 is in running state.Got IP 10.47.255.247 2025-04-27 10:25:03,192 - DEBUG - Pod ctest-pod-36106138 has vmi d80064a2-2351-11f0-b564-fa163eea387a 2025-04-27 10:25:03,192 - INFO - Verified pod ctest-pod-36106138 in contrail-api 2025-04-27 10:25:03,205 - DEBUG - VMI d80064a2-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:25:03,206 - INFO - Verified Pod ctest-pod-36106138 in agent 10.0.0.22 2025-04-27 10:25:03,206 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=785affc5-1ca7-4b54-a2de-890357b06296 2025-04-27 10:25:03,211 - INFO - Pod ctest-pod-36106138 with uuid 785affc5-1ca7-4b54-a2de-890357b06296 found in kube manager 2025-04-27 10:25:03,211 - INFO - Pod ctest-pod-36106138 verification passed 2025-04-27 10:25:03,272 - INFO - Pod ctest-pod-37642739 is in running state.Got IP 10.47.255.245 2025-04-27 10:25:03,324 - DEBUG - Pod ctest-pod-37642739 has vmi d92042b2-2351-11f0-b564-fa163eea387a 2025-04-27 10:25:03,324 - INFO - Verified pod ctest-pod-37642739 in contrail-api 2025-04-27 10:25:03,337 - DEBUG - VMI d92042b2-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:25:03,337 - INFO - Verified Pod ctest-pod-37642739 in agent 10.0.0.22 2025-04-27 10:25:03,338 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4410d6a5-aaaa-4c03-a350-ea9dab049db9 2025-04-27 10:25:03,341 - INFO - Pod ctest-pod-37642739 with uuid 4410d6a5-aaaa-4c03-a350-ea9dab049db9 found in kube manager 2025-04-27 10:25:03,342 - INFO - Pod ctest-pod-37642739 verification passed 2025-04-27 10:25:03,346 - INFO - Pod ctest-pod-58568842 is in running state.Got IP 10.47.255.246 2025-04-27 10:25:03,358 - DEBUG - Pod ctest-pod-58568842 has vmi d886bc46-2351-11f0-b564-fa163eea387a 2025-04-27 10:25:03,358 - INFO - Verified pod ctest-pod-58568842 in contrail-api 2025-04-27 10:25:03,370 - DEBUG - VMI d886bc46-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:25:03,370 - INFO - Verified Pod ctest-pod-58568842 in agent 10.0.0.22 2025-04-27 10:25:03,370 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=048e010d-169b-43fc-a4c7-18dbdc92cae2 2025-04-27 10:25:03,374 - INFO - Pod ctest-pod-58568842 with uuid 048e010d-169b-43fc-a4c7-18dbdc92cae2 found in kube manager 2025-04-27 10:25:03,374 - INFO - Pod ctest-pod-58568842 verification passed 2025-04-27 10:25:03,379 - INFO - Pod ctest-pod-35643596 is in running state.Got IP 10.47.255.244 2025-04-27 10:25:03,432 - DEBUG - Pod ctest-pod-35643596 has vmi d9bae7cc-2351-11f0-b564-fa163eea387a 2025-04-27 10:25:03,432 - INFO - Verified pod ctest-pod-35643596 in contrail-api 2025-04-27 10:25:03,444 - DEBUG - VMI d9bae7cc-2351-11f0-b564-fa163eea387a is active in agent 10.0.0.22 2025-04-27 10:25:03,444 - INFO - Verified Pod ctest-pod-35643596 in agent 10.0.0.22 2025-04-27 10:25:03,444 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1c0a7188-79a1-4c94-b534-a91e704e733b 2025-04-27 10:25:03,448 - INFO - Pod ctest-pod-35643596 with uuid 1c0a7188-79a1-4c94-b534-a91e704e733b found in kube manager 2025-04-27 10:25:03,448 - INFO - Pod ctest-pod-35643596 verification passed 2025-04-27 10:25:03,448 - INFO - ================================================================================ 2025-04-27 10:25:03,449 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-27 10:25:03,449 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-27 10:25:03,676 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with 2025-04-27 10:25:03,676 - INFO - Initial checks done. Running the testcase now 2025-04-27 10:25:03,676 - INFO - 2025-04-27 10:25:03,738 - DEBUG - [Pod ctest-pod-57156143] Cmd: echo ctest-pod-57156143 > /usr/share/nginx/html/index.html, Output: 2025-04-27 10:25:03,798 - DEBUG - [Pod ctest-pod-93660614] Cmd: echo ctest-pod-93660614 > /usr/share/nginx/html/index.html, Output: 2025-04-27 10:25:03,850 - DEBUG - [Pod ctest-pod-03792096] Cmd: echo ctest-pod-03792096 > /usr/share/nginx/html/index.html, Output: 2025-04-27 10:25:03,906 - DEBUG - [Pod ctest-pod-47558435] Cmd: echo ctest-pod-47558435 > /usr/share/nginx/html/index.html, Output: 2025-04-27 10:25:03,909 - DEBUG - Service ctest-nginx-svc-79829292 not present 2025-04-27 10:25:03,909 - INFO - Creating service ctest-nginx-svc-79829292 2025-04-27 10:25:03,937 - INFO - Created Service ctest-nginx-svc-79829292 2025-04-27 10:25:03,943 - WARNING - Service UUID 2d52752a-20ec-45fb-bcf2-c8561d40e733 not yet found in contrail-api 2025-04-27 10:25:04,949 - INFO - Validated that Service ctest-nginx-svc-79829292 is seen in contrail-api 2025-04-27 10:25:04,949 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=2d52752a-20ec-45fb-bcf2-c8561d40e733 2025-04-27 10:25:04,954 - INFO - Service ctest-nginx-svc-79829292 with uuid 2d52752a-20ec-45fb-bcf2-c8561d40e733 found in kube manager 2025-04-27 10:25:04,954 - INFO - Service ctest-nginx-svc-79829292 verification passed 2025-04-27 10:25:06,012 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93660614 2025-04-27 10:25:06,012 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:25:06,012 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93660614 2025-04-27 10:25:06,066 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:25:06,066 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:25:06,066 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:25:06,119 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57156143 2025-04-27 10:25:06,119 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:25:06,119 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57156143 2025-04-27 10:25:06,119 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57156143': 1, 'ctest-pod-93660614': 2} 2025-04-27 10:25:06,173 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:25:06,173 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:25:06,173 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:25:06,230 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:25:06,230 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:25:06,230 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:25:06,230 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57156143': 1, 'ctest-pod-93660614': 1} 2025-04-27 10:25:06,232 - DEBUG - Network policy ingress-on-service not present 2025-04-27 10:25:06,233 - INFO - Creating Network Policy ingress-on-service 2025-04-27 10:25:06,249 - INFO - Network policy found in k8s 2025-04-27 10:25:06,250 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=55da5353-4adf-40dc-a55b-944c977af2ab 2025-04-27 10:25:06,257 - INFO - Network Policy ingress-on-service with uuid 55da5353-4adf-40dc-a55b-944c977af2ab found in kube manager 2025-04-27 10:25:06,296 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-27 10:25:06,296 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-27 10:25:06,297 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=55da5353-4adf-40dc-a55b-944c977af2ab 2025-04-27 10:25:06,333 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-27 10:25:08,334 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=55da5353-4adf-40dc-a55b-944c977af2ab 2025-04-27 10:25:08,364 - INFO - Network policy with name ingress-on-service found in agent 2025-04-27 10:25:08,365 - INFO - Network Policy ingress-on-service verification passed 2025-04-27 10:25:13,416 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:13,416 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:13,416 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:18,464 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:18,465 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:18,465 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:23,523 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:23,524 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:23,524 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:28,572 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:28,572 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:28,572 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:33,344 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-04-27 10:25:43,711 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:43,711 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:43,712 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:48,760 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:48,760 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:48,760 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:53,816 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:53,817 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:53,817 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:58,867 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:58,867 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:25:58,867 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:03,915 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:03,915 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:03,915 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:08,972 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:08,972 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:08,972 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:08,972 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57156143': 0, 'ctest-pod-93660614': 0} 2025-04-27 10:26:09,028 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,028 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:26:09,028 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,077 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,077 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:26:09,077 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,129 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,129 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:26:09,129 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,179 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,179 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:26:09,179 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:26:09,179 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57156143': 3, 'ctest-pod-93660614': 1} 2025-04-27 10:26:14,227 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:14,227 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:14,227 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:19,285 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:19,285 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:19,285 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:24,336 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:24,336 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:24,336 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:29,389 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:29,389 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:29,389 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:34,440 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:34,440 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:34,440 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:39,489 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:39,489 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:39,489 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:44,540 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:44,540 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:44,540 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:49,590 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:49,591 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:49,591 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:54,635 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:54,635 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:54,635 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:59,687 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:59,687 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:59,688 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:26:59,688 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57156143': 0, 'ctest-pod-93660614': 0} 2025-04-27 10:27:01,735 - DEBUG - [Pod ctest-pod-58568842] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.458 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.071 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.205/0.458 ms 2025-04-27 10:27:01,736 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-58568842 with expectation True passed 2025-04-27 10:27:03,788 - DEBUG - [Pod ctest-pod-36106138] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.531 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.224/0.531 ms 2025-04-27 10:27:03,788 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36106138 with expectation True passed 2025-04-27 10:27:05,844 - DEBUG - [Pod ctest-pod-37642739] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.756 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.308/0.756 ms 2025-04-27 10:27:05,844 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37642739 with expectation True passed 2025-04-27 10:27:05,915 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:27:05,915 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-27 10:27:05,915 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:27:05,915 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58568842 passed 2025-04-27 10:27:05,958 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:27:05,958 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-27 10:27:05,958 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:27:05,958 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58568842 passed 2025-04-27 10:27:11,012 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 10:27:11,012 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 10:27:11,012 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 10:27:11,012 - INFO - wget check of of http://10.47.255.250 from ctest-pod-36106138 passed 2025-04-27 10:27:16,065 - DEBUG - [Pod ctest-pod-35643596] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-27 10:27:16,065 - DEBUG - [Pod Pod ctest-pod-35643596] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-27 10:27:16,065 - DEBUG - [Pod Pod ctest-pod-35643596] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-27 10:27:16,065 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35643596 passed 2025-04-27 10:27:16,073 - INFO - Updating Network Policy ingress-on-service 2025-04-27 10:27:21,152 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:21,152 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:21,152 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:26,203 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:26,203 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:26,203 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:31,332 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:31,332 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:31,332 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:36,376 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:36,376 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:36,376 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:41,427 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:41,427 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:41,427 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:46,479 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:46,479 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:46,479 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:51,532 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:51,532 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:51,532 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:56,584 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:56,584 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:27:56,584 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:01,637 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:01,637 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:01,637 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:06,692 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:06,692 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:06,692 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.104.206.252:80 (10.104.206.252:80) wget: download timed out 2025-04-27 10:28:06,692 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57156143': 0, 'ctest-pod-93660614': 0} 2025-04-27 10:28:06,750 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,751 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:28:06,751 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,802 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,803 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:28:06,803 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,803 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57156143': 1, 'ctest-pod-93660614': 1} 2025-04-27 10:28:06,861 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,861 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:28:06,861 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,910 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,910 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:28:06,910 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,965 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:06,965 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:28:06,965 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: ctest-pod-93660614 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:07,017 - DEBUG - [Pod ctest-pod-37642739] Cmd: wget http://10.104.206.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:07,017 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd wget http://10.104.206.252:80/ -O - -T 5 -t 1 passed 2025-04-27 10:28:07,017 - DEBUG - [Pod Pod ctest-pod-37642739] Cmd output: ctest-pod-57156143 Connecting to 10.104.206.252:80 (10.104.206.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 10:28:07,017 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57156143': 1, 'ctest-pod-93660614': 3} 2025-04-27 10:28:09,069 - DEBUG - [Pod ctest-pod-58568842] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.412 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.187/0.412 ms 2025-04-27 10:28:09,069 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-58568842 with expectation True passed 2025-04-27 10:28:11,116 - DEBUG - [Pod ctest-pod-36106138] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.471 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.544/1.471 ms 2025-04-27 10:28:11,116 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36106138 with expectation True passed 2025-04-27 10:28:13,175 - DEBUG - [Pod ctest-pod-37642739] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.504 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.216/0.504 ms 2025-04-27 10:28:13,175 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37642739 with expectation True passed 2025-04-27 10:28:13,235 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:28:13,235 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-27 10:28:13,235 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:28:13,235 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58568842 passed 2025-04-27 10:28:13,309 - DEBUG - [Pod ctest-pod-58568842] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:28:13,309 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-27 10:28:13,309 - DEBUG - [Pod Pod ctest-pod-58568842] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:28:13,310 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58568842 passed 2025-04-27 10:28:18,360 - DEBUG - [Pod ctest-pod-36106138] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 10:28:18,360 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 10:28:18,360 - DEBUG - [Pod Pod ctest-pod-36106138] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 10:28:18,360 - INFO - wget check of of http://10.47.255.250 from ctest-pod-36106138 passed 2025-04-27 10:28:18,413 - DEBUG - [Pod ctest-pod-35643596] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:28:18,413 - DEBUG - [Pod Pod ctest-pod-35643596] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-27 10:28:18,413 - DEBUG - [Pod Pod ctest-pod-35643596] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 10:28:18,413 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35643596 passed 2025-04-27 10:28:18,413 - INFO - Deleting Network Policy : ingress-on-service 2025-04-27 10:28:18,414 - INFO - Deleting service : ctest-nginx-svc-79829292 2025-04-27 10:28:18,651 - DEBUG - No XMPP flaps were noticed during the test