2025-01-08 21:58:42,042 - INFO - Using existing project ['default-domain', 'k8s-default'](a0b8511d-b228-410d-9008-d6b837657a16) 2025-01-08 21:58:42,063 - DEBUG - Namespace ctest-new-default-00682650 not present 2025-01-08 21:58:42,073 - INFO - Created namespace ctest-new-default-00682650 2025-01-08 21:58:45,077 - DEBUG - Namespace ctest-non-default-83713295 not present 2025-01-08 21:58:45,087 - INFO - Created namespace ctest-non-default-83713295 2025-01-08 21:58:48,158 - DEBUG - Pod ctest-pod-89144976 not present 2025-01-08 21:58:48,159 - INFO - Creating Pod ctest-pod-89144976 2025-01-08 21:58:48,195 - DEBUG - Node for Pod ctest-pod-89144976 not yet populated 2025-01-08 21:58:51,220 - DEBUG - Pod : ctest-pod-89144976 UUID is bacc2c45-41cb-441d-9bbc-ae8e8848546a 2025-01-08 21:58:51,228 - DEBUG - Pod ctest-pod-35803940 not present 2025-01-08 21:58:51,229 - INFO - Creating Pod ctest-pod-35803940 2025-01-08 21:58:51,298 - DEBUG - Pod : ctest-pod-35803940 UUID is 03f30aab-633a-4da1-a897-fdfa6a2a742b 2025-01-08 21:58:51,308 - DEBUG - Pod ctest-pod-43909102 not present 2025-01-08 21:58:51,309 - INFO - Creating Pod ctest-pod-43909102 2025-01-08 21:58:51,352 - DEBUG - Pod : ctest-pod-43909102 UUID is 945f289e-9c85-4a2d-a158-5cbd67181f14 2025-01-08 21:58:51,357 - DEBUG - Pod ctest-pod-49979350 not present 2025-01-08 21:58:51,358 - INFO - Creating Pod ctest-pod-49979350 2025-01-08 21:58:51,396 - DEBUG - Pod : ctest-pod-49979350 UUID is 698b8e5d-faf5-486b-95e3-b980059cf3e7 2025-01-08 21:58:51,401 - DEBUG - Pod ctest-pod-69961196 not present 2025-01-08 21:58:51,401 - INFO - Creating Pod ctest-pod-69961196 2025-01-08 21:58:51,451 - DEBUG - Pod : ctest-pod-69961196 UUID is d63a4163-4b4f-43e6-93d4-cd15e817ea3f 2025-01-08 21:58:51,457 - DEBUG - Pod ctest-pod-29186950 not present 2025-01-08 21:58:51,457 - INFO - Creating Pod ctest-pod-29186950 2025-01-08 21:58:51,487 - DEBUG - Pod : ctest-pod-29186950 UUID is a60bb52e-8897-4d8b-9489-2b841b3e4974 2025-01-08 21:58:51,489 - DEBUG - Pod ctest-pod-93350329 not present 2025-01-08 21:58:51,489 - INFO - Creating Pod ctest-pod-93350329 2025-01-08 21:58:51,530 - DEBUG - Pod : ctest-pod-93350329 UUID is 7003cd4e-348a-4b94-917c-0315c3b90f80 2025-01-08 21:58:51,533 - DEBUG - Pod ctest-pod-52397657 not present 2025-01-08 21:58:51,533 - INFO - Creating Pod ctest-pod-52397657 2025-01-08 21:58:51,559 - DEBUG - Pod : ctest-pod-52397657 UUID is fc48ecfe-034a-48cf-8d3a-b89046d52174 2025-01-08 21:58:51,828 - INFO - Project default-domain:k8s-ctest-new-default-00682650 for Namespace ctest-new-default-00682650 is seen in contrail-api 2025-01-08 21:58:51,828 - DEBUG - Project uuid in Contrail is 8ab9e303-573f-4423-8e95-c3df1e59be64 2025-01-08 21:58:52,027 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NamespaceDatabaseList?namespace_uuid=438daada-c690-4967-82c6-9494997ab04e 2025-01-08 21:58:52,031 - INFO - Namespace ctest-new-default-00682650 with uuid 438daada-c690-4967-82c6-9494997ab04e found in kube manager 2025-01-08 21:58:52,031 - INFO - Namespace ctest-new-default-00682650 verification passed 2025-01-08 21:58:52,230 - INFO - Project default-domain:k8s-ctest-non-default-83713295 for Namespace ctest-non-default-83713295 is seen in contrail-api 2025-01-08 21:58:52,230 - DEBUG - Project uuid in Contrail is 4d1eba05-8628-4e4e-8452-531e1ea60c89 2025-01-08 21:58:52,231 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NamespaceDatabaseList?namespace_uuid=ffebfcdf-4f4b-467d-ac4b-576fef905de5 2025-01-08 21:58:52,238 - INFO - Namespace ctest-non-default-83713295 with uuid ffebfcdf-4f4b-467d-ac4b-576fef905de5 found in kube manager 2025-01-08 21:58:52,238 - INFO - Namespace ctest-non-default-83713295 verification passed 2025-01-08 21:58:52,247 - DEBUG - Pod ctest-pod-89144976 not in running state.Currently in Pending 2025-01-08 21:58:57,255 - INFO - Pod ctest-pod-89144976 is in running state.Got IP 10.47.255.251 2025-01-08 21:58:57,281 - DEBUG - Pod ctest-pod-89144976 has vmi be1be50c-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:58:57,281 - INFO - Verified pod ctest-pod-89144976 in contrail-api 2025-01-08 21:58:57,295 - DEBUG - VMI be1be50c-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:58:57,295 - INFO - Verified Pod ctest-pod-89144976 in agent 10.0.0.31 2025-01-08 21:58:57,295 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=bacc2c45-41cb-441d-9bbc-ae8e8848546a 2025-01-08 21:58:57,310 - INFO - Pod ctest-pod-89144976 with uuid bacc2c45-41cb-441d-9bbc-ae8e8848546a found in kube manager 2025-01-08 21:58:57,311 - INFO - Pod ctest-pod-89144976 verification passed 2025-01-08 21:58:57,317 - DEBUG - Pod ctest-pod-35803940 not in running state.Currently in Pending 2025-01-08 21:59:02,338 - INFO - Pod ctest-pod-35803940 is in running state.Got IP 10.47.255.250 2025-01-08 21:59:02,410 - DEBUG - Pod ctest-pod-35803940 has vmi bef8a532-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:02,411 - INFO - Verified pod ctest-pod-35803940 in contrail-api 2025-01-08 21:59:02,441 - DEBUG - VMI bef8a532-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:02,441 - INFO - Verified Pod ctest-pod-35803940 in agent 10.0.0.31 2025-01-08 21:59:02,442 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=03f30aab-633a-4da1-a897-fdfa6a2a742b 2025-01-08 21:59:02,454 - INFO - Pod ctest-pod-35803940 with uuid 03f30aab-633a-4da1-a897-fdfa6a2a742b found in kube manager 2025-01-08 21:59:02,454 - INFO - Pod ctest-pod-35803940 verification passed 2025-01-08 21:59:02,469 - DEBUG - Pod ctest-pod-43909102 not in running state.Currently in Pending 2025-01-08 21:59:07,486 - INFO - Pod ctest-pod-43909102 is in running state.Got IP 10.47.255.249 2025-01-08 21:59:07,521 - DEBUG - Pod ctest-pod-43909102 has vmi bfba1f5a-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:07,522 - INFO - Verified pod ctest-pod-43909102 in contrail-api 2025-01-08 21:59:07,545 - DEBUG - VMI bfba1f5a-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:07,546 - INFO - Verified Pod ctest-pod-43909102 in agent 10.0.0.31 2025-01-08 21:59:07,546 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=945f289e-9c85-4a2d-a158-5cbd67181f14 2025-01-08 21:59:07,554 - INFO - Pod ctest-pod-43909102 with uuid 945f289e-9c85-4a2d-a158-5cbd67181f14 found in kube manager 2025-01-08 21:59:07,555 - INFO - Pod ctest-pod-43909102 verification passed 2025-01-08 21:59:07,564 - INFO - Pod ctest-pod-49979350 is in running state.Got IP 10.47.255.248 2025-01-08 21:59:07,593 - DEBUG - Pod ctest-pod-49979350 has vmi c03d4e48-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:07,593 - INFO - Verified pod ctest-pod-49979350 in contrail-api 2025-01-08 21:59:07,616 - DEBUG - VMI c03d4e48-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:07,616 - INFO - Verified Pod ctest-pod-49979350 in agent 10.0.0.31 2025-01-08 21:59:07,616 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=698b8e5d-faf5-486b-95e3-b980059cf3e7 2025-01-08 21:59:07,625 - INFO - Pod ctest-pod-49979350 with uuid 698b8e5d-faf5-486b-95e3-b980059cf3e7 found in kube manager 2025-01-08 21:59:07,625 - INFO - Pod ctest-pod-49979350 verification passed 2025-01-08 21:59:07,632 - INFO - Pod ctest-pod-69961196 is in running state.Got IP 10.47.255.247 2025-01-08 21:59:07,702 - DEBUG - Pod ctest-pod-69961196 has vmi c0d41594-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:07,702 - INFO - Verified pod ctest-pod-69961196 in contrail-api 2025-01-08 21:59:07,716 - DEBUG - VMI c0d41594-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:07,716 - INFO - Verified Pod ctest-pod-69961196 in agent 10.0.0.31 2025-01-08 21:59:07,718 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=d63a4163-4b4f-43e6-93d4-cd15e817ea3f 2025-01-08 21:59:07,723 - INFO - Pod ctest-pod-69961196 with uuid d63a4163-4b4f-43e6-93d4-cd15e817ea3f found in kube manager 2025-01-08 21:59:07,723 - INFO - Pod ctest-pod-69961196 verification passed 2025-01-08 21:59:07,728 - INFO - Pod ctest-pod-93350329 is in running state.Got IP 10.47.255.245 2025-01-08 21:59:07,744 - DEBUG - Pod ctest-pod-93350329 has vmi c1dcb7a2-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:07,744 - INFO - Verified pod ctest-pod-93350329 in contrail-api 2025-01-08 21:59:07,757 - DEBUG - VMI c1dcb7a2-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:07,757 - INFO - Verified Pod ctest-pod-93350329 in agent 10.0.0.31 2025-01-08 21:59:07,758 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=7003cd4e-348a-4b94-917c-0315c3b90f80 2025-01-08 21:59:07,762 - INFO - Pod ctest-pod-93350329 with uuid 7003cd4e-348a-4b94-917c-0315c3b90f80 found in kube manager 2025-01-08 21:59:07,762 - INFO - Pod ctest-pod-93350329 verification passed 2025-01-08 21:59:07,829 - INFO - Pod ctest-pod-29186950 is in running state.Got IP 10.47.255.246 2025-01-08 21:59:07,890 - DEBUG - Pod ctest-pod-29186950 has vmi c167da54-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:07,890 - INFO - Verified pod ctest-pod-29186950 in contrail-api 2025-01-08 21:59:07,909 - DEBUG - VMI c167da54-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:07,909 - INFO - Verified Pod ctest-pod-29186950 in agent 10.0.0.31 2025-01-08 21:59:07,909 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=a60bb52e-8897-4d8b-9489-2b841b3e4974 2025-01-08 21:59:07,917 - INFO - Pod ctest-pod-29186950 with uuid a60bb52e-8897-4d8b-9489-2b841b3e4974 found in kube manager 2025-01-08 21:59:07,917 - INFO - Pod ctest-pod-29186950 verification passed 2025-01-08 21:59:07,926 - INFO - Pod ctest-pod-52397657 is in running state.Got IP 10.47.255.244 2025-01-08 21:59:07,948 - DEBUG - Pod ctest-pod-52397657 has vmi c262024a-ce0b-11ef-a7d2-fa163eaff87c 2025-01-08 21:59:07,949 - INFO - Verified pod ctest-pod-52397657 in contrail-api 2025-01-08 21:59:07,979 - DEBUG - VMI c262024a-ce0b-11ef-a7d2-fa163eaff87c is active in agent 10.0.0.31 2025-01-08 21:59:07,980 - INFO - Verified Pod ctest-pod-52397657 in agent 10.0.0.31 2025-01-08 21:59:07,980 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=fc48ecfe-034a-48cf-8d3a-b89046d52174 2025-01-08 21:59:07,989 - INFO - Pod ctest-pod-52397657 with uuid fc48ecfe-034a-48cf-8d3a-b89046d52174 found in kube manager 2025-01-08 21:59:07,989 - INFO - Pod ctest-pod-52397657 verification passed 2025-01-08 21:59:07,989 - INFO - ================================================================================ 2025-01-08 21:59:07,989 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-08 21:59:07,989 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-08 21:59:08,270 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.0.0.44': '0'}} with 2025-01-08 21:59:08,270 - INFO - Initial checks done. Running the testcase now 2025-01-08 21:59:08,270 - INFO - 2025-01-08 21:59:08,362 - DEBUG - [Pod ctest-pod-89144976] Cmd: echo ctest-pod-89144976 > /usr/share/nginx/html/index.html, Output: 2025-01-08 21:59:08,435 - DEBUG - [Pod ctest-pod-35803940] Cmd: echo ctest-pod-35803940 > /usr/share/nginx/html/index.html, Output: 2025-01-08 21:59:08,519 - DEBUG - [Pod ctest-pod-43909102] Cmd: echo ctest-pod-43909102 > /usr/share/nginx/html/index.html, Output: 2025-01-08 21:59:08,586 - DEBUG - [Pod ctest-pod-49979350] Cmd: echo ctest-pod-49979350 > /usr/share/nginx/html/index.html, Output: 2025-01-08 21:59:08,593 - DEBUG - Service ctest-nginx-svc-40308458 not present 2025-01-08 21:59:08,593 - INFO - Creating service ctest-nginx-svc-40308458 2025-01-08 21:59:08,629 - INFO - Created Service ctest-nginx-svc-40308458 2025-01-08 21:59:08,639 - WARNING - Service UUID ec7a3c17-8827-43de-80f0-184aecd5c202 not yet found in contrail-api 2025-01-08 21:59:09,648 - INFO - Validated that Service ctest-nginx-svc-40308458 is seen in contrail-api 2025-01-08 21:59:09,649 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_LoadbalancerDatabaseList?x=ec7a3c17-8827-43de-80f0-184aecd5c202 2025-01-08 21:59:09,654 - INFO - Service ctest-nginx-svc-40308458 with uuid ec7a3c17-8827-43de-80f0-184aecd5c202 found in kube manager 2025-01-08 21:59:09,654 - INFO - Service ctest-nginx-svc-40308458 verification passed 2025-01-08 21:59:10,736 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89144976 2025-01-08 21:59:10,737 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 21:59:10,737 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89144976 2025-01-08 21:59:10,797 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35803940 2025-01-08 21:59:10,797 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 21:59:10,797 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35803940 2025-01-08 21:59:10,797 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89144976': 1, 'ctest-pod-35803940': 1} 2025-01-08 21:59:10,876 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 21:59:10,876 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 21:59:10,877 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 21:59:10,956 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 21:59:10,956 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 21:59:10,956 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 21:59:10,957 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89144976': 1, 'ctest-pod-35803940': 1} 2025-01-08 21:59:10,963 - DEBUG - Network policy ingress-on-service not present 2025-01-08 21:59:10,964 - INFO - Creating Network Policy ingress-on-service 2025-01-08 21:59:10,991 - INFO - Network policy found in k8s 2025-01-08 21:59:10,991 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c848e69a-4303-470f-8a03-a27dea9a01d9 2025-01-08 21:59:11,011 - INFO - Network Policy ingress-on-service with uuid c848e69a-4303-470f-8a03-a27dea9a01d9 found in kube manager 2025-01-08 21:59:11,063 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-08 21:59:11,063 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-08 21:59:11,063 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c848e69a-4303-470f-8a03-a27dea9a01d9 2025-01-08 21:59:11,097 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-08 21:59:13,098 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c848e69a-4303-470f-8a03-a27dea9a01d9 2025-01-08 21:59:13,158 - INFO - Network policy with name ingress-on-service found in agent 2025-01-08 21:59:13,159 - INFO - Network Policy ingress-on-service verification passed 2025-01-08 21:59:18,254 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:18,254 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:18,254 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:23,331 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:23,331 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:23,331 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:28,406 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:28,406 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:28,406 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:33,469 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:33,469 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:33,469 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:38,545 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:38,545 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:38,545 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:43,619 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:43,619 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:43,619 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:48,684 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:48,684 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:48,685 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:53,780 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:53,780 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:53,780 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:58,857 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:58,857 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 21:59:58,857 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:03,932 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:03,933 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:03,933 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:03,933 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89144976': 0, 'ctest-pod-35803940': 0} 2025-01-08 22:00:04,020 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:00:04,021 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:00:04,021 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:00:04,113 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:00:04,114 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:00:04,114 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:00:04,192 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:00:04,193 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:00:04,193 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:00:04,193 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89144976': 2, 'ctest-pod-35803940': 1} 2025-01-08 22:00:09,275 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:09,275 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:09,275 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:14,363 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:14,363 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:14,364 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:19,439 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:19,440 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:19,440 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:24,511 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:24,511 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:24,511 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:29,571 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:29,571 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:29,571 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:34,624 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:34,624 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:34,624 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:39,703 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:39,703 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:39,703 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:44,776 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:44,776 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:44,776 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:44,888 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-08 22:00:55,218 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:55,218 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:00:55,218 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:00,283 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:00,283 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:00,283 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:00,284 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89144976': 0, 'ctest-pod-35803940': 0} 2025-01-08 22:01:02,340 - DEBUG - [Pod ctest-pod-29186950] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.153 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.096 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.442/1.153 ms 2025-01-08 22:01:02,341 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29186950 with expectation True passed 2025-01-08 22:01:04,403 - DEBUG - [Pod ctest-pod-69961196] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.083 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.064 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.064/0.407/1.083 ms 2025-01-08 22:01:04,403 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69961196 with expectation True passed 2025-01-08 22:01:06,471 - DEBUG - [Pod ctest-pod-93350329] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.230 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.146 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.486/1.230 ms 2025-01-08 22:01:06,471 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93350329 with expectation True passed 2025-01-08 22:01:06,542 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:01:06,542 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 22:01:06,542 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:01:06,542 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29186950 passed 2025-01-08 22:01:06,627 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:01:06,627 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-08 22:01:06,627 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:01:06,627 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29186950 passed 2025-01-08 22:01:11,688 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 22:01:11,689 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 22:01:11,689 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 22:01:11,689 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69961196 passed 2025-01-08 22:01:16,768 - DEBUG - [Pod ctest-pod-52397657] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 22:01:16,768 - DEBUG - [Pod Pod ctest-pod-52397657] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 22:01:16,768 - DEBUG - [Pod Pod ctest-pod-52397657] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 22:01:16,768 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52397657 passed 2025-01-08 22:01:16,794 - INFO - Updating Network Policy ingress-on-service 2025-01-08 22:01:21,916 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:21,916 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:21,916 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:26,986 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:26,986 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:26,986 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:32,045 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:32,045 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:32,045 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:37,117 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:37,117 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:37,118 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:42,199 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:42,199 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:42,199 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:47,272 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:47,272 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:47,272 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:52,354 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:52,354 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:52,354 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:57,424 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:57,425 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:01:57,425 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:02,502 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:02,502 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:02,502 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:07,578 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:07,578 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:07,578 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) wget: download timed out 2025-01-08 22:02:07,578 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89144976': 0, 'ctest-pod-35803940': 0} 2025-01-08 22:02:07,651 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:07,652 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:07,652 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:07,712 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89144976 2025-01-08 22:02:07,712 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:07,712 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89144976 2025-01-08 22:02:07,771 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:07,771 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:07,771 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:07,771 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89144976': 2, 'ctest-pod-35803940': 1} 2025-01-08 22:02:07,844 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:07,844 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:07,844 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:07,900 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35803940 2025-01-08 22:02:07,900 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:07,901 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35803940 2025-01-08 22:02:07,961 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35803940 2025-01-08 22:02:07,962 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:07,962 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35803940 2025-01-08 22:02:08,031 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.170.100:80 (10.97.170.100:80) ctest-pod-35803940 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:08,032 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:08,032 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: Connecting to 10.97.170.100:80 (10.97.170.100:80) ctest-pod-35803940 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:08,098 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:08,098 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:08,098 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: ctest-pod-35803940 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:08,182 - DEBUG - [Pod ctest-pod-93350329] Cmd: wget http://10.97.170.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:08,182 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd wget http://10.97.170.100:80/ -O - -T 5 -t 1 passed 2025-01-08 22:02:08,182 - DEBUG - [Pod Pod ctest-pod-93350329] Cmd output: ctest-pod-89144976 Connecting to 10.97.170.100:80 (10.97.170.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 22:02:08,182 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89144976': 1, 'ctest-pod-35803940': 5} 2025-01-08 22:02:10,254 - DEBUG - [Pod ctest-pod-29186950] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.948 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.069 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.364/0.948 ms 2025-01-08 22:02:10,255 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29186950 with expectation True passed 2025-01-08 22:02:12,320 - DEBUG - [Pod ctest-pod-69961196] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.565 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.235/0.565 ms 2025-01-08 22:02:12,320 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69961196 with expectation True passed 2025-01-08 22:02:14,407 - DEBUG - [Pod ctest-pod-93350329] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.437 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.200/0.437 ms 2025-01-08 22:02:14,408 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93350329 with expectation True passed 2025-01-08 22:02:14,495 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:02:14,495 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 22:02:14,495 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:02:14,495 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29186950 passed 2025-01-08 22:02:14,578 - DEBUG - [Pod ctest-pod-29186950] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:02:14,579 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-08 22:02:14,579 - DEBUG - [Pod Pod ctest-pod-29186950] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:02:14,579 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29186950 passed 2025-01-08 22:02:19,657 - DEBUG - [Pod ctest-pod-69961196] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 22:02:19,657 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 22:02:19,657 - DEBUG - [Pod Pod ctest-pod-69961196] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 22:02:19,657 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69961196 passed 2025-01-08 22:02:19,769 - DEBUG - [Pod ctest-pod-52397657] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:02:19,770 - DEBUG - [Pod Pod ctest-pod-52397657] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 22:02:19,770 - DEBUG - [Pod Pod ctest-pod-52397657] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 22:02:19,770 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52397657 passed 2025-01-08 22:02:19,770 - INFO - Deleting Network Policy : ingress-on-service 2025-01-08 22:02:19,772 - INFO - Deleting service : ctest-nginx-svc-40308458 2025-01-08 22:02:20,165 - DEBUG - No XMPP flaps were noticed during the test