2025-04-22 11:22:30,755 - INFO - Using existing project ['default-domain', 'k8s-default'](9c1329d5-29c7-4e7a-aa74-1d9e493228d6) 2025-04-22 11:22:30,773 - DEBUG - Namespace ctest-new-default-83701751 not present 2025-04-22 11:22:30,784 - INFO - Created namespace ctest-new-default-83701751 2025-04-22 11:22:33,788 - DEBUG - Namespace ctest-non-default-50754526 not present 2025-04-22 11:22:33,794 - INFO - Created namespace ctest-non-default-50754526 2025-04-22 11:22:36,818 - DEBUG - Pod ctest-pod-54256729 not present 2025-04-22 11:22:36,819 - INFO - Creating Pod ctest-pod-54256729 2025-04-22 11:22:36,871 - DEBUG - Pod : ctest-pod-54256729 UUID is 73945e3d-552e-4de7-b1e2-dba8c77fde29 2025-04-22 11:22:36,884 - DEBUG - Pod ctest-pod-31131122 not present 2025-04-22 11:22:36,884 - INFO - Creating Pod ctest-pod-31131122 2025-04-22 11:22:36,924 - DEBUG - Pod : ctest-pod-31131122 UUID is d55c3a01-c859-4e5f-a6e3-3fa824953e9f 2025-04-22 11:22:36,939 - DEBUG - Pod ctest-pod-35182556 not present 2025-04-22 11:22:36,940 - INFO - Creating Pod ctest-pod-35182556 2025-04-22 11:22:36,965 - DEBUG - Pod : ctest-pod-35182556 UUID is 58eed27b-2bad-4706-8163-27e9cff943c2 2025-04-22 11:22:36,969 - DEBUG - Pod ctest-pod-49283038 not present 2025-04-22 11:22:36,969 - INFO - Creating Pod ctest-pod-49283038 2025-04-22 11:22:36,998 - DEBUG - Pod : ctest-pod-49283038 UUID is 0447509d-758d-46d0-a654-52b7a2d37ca1 2025-04-22 11:22:37,001 - DEBUG - Pod ctest-pod-00931280 not present 2025-04-22 11:22:37,001 - INFO - Creating Pod ctest-pod-00931280 2025-04-22 11:22:37,018 - DEBUG - Pod : ctest-pod-00931280 UUID is 326c5994-5d30-496d-8b63-ab8df26b5ffb 2025-04-22 11:22:37,021 - DEBUG - Pod ctest-pod-76343869 not present 2025-04-22 11:22:37,021 - INFO - Creating Pod ctest-pod-76343869 2025-04-22 11:22:37,044 - DEBUG - Pod : ctest-pod-76343869 UUID is 47b736f7-3de8-4c8a-a42f-8d6c8bb83863 2025-04-22 11:22:37,046 - DEBUG - Pod ctest-pod-53091563 not present 2025-04-22 11:22:37,046 - INFO - Creating Pod ctest-pod-53091563 2025-04-22 11:22:37,083 - DEBUG - Pod : ctest-pod-53091563 UUID is 462e021e-2d09-4024-b7b6-65f5c222c0ae 2025-04-22 11:22:37,086 - DEBUG - Pod ctest-pod-98424189 not present 2025-04-22 11:22:37,086 - INFO - Creating Pod ctest-pod-98424189 2025-04-22 11:22:37,108 - DEBUG - Pod : ctest-pod-98424189 UUID is da554e3f-b2f7-4bd3-a1b9-8ae2ba132e16 2025-04-22 11:22:37,266 - INFO - Project default-domain:k8s-ctest-new-default-83701751 for Namespace ctest-new-default-83701751 is seen in contrail-api 2025-04-22 11:22:37,266 - DEBUG - Project uuid in Contrail is 94f80d7b-3f7f-4a00-8c82-e7414b6430f1 2025-04-22 11:22:37,439 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=5145caa2-65ee-4939-ac03-f5a1c7c02d2d 2025-04-22 11:22:37,447 - INFO - Namespace ctest-new-default-83701751 with uuid 5145caa2-65ee-4939-ac03-f5a1c7c02d2d found in kube manager 2025-04-22 11:22:37,447 - INFO - Namespace ctest-new-default-83701751 verification passed 2025-04-22 11:22:37,648 - INFO - Project default-domain:k8s-ctest-non-default-50754526 for Namespace ctest-non-default-50754526 is seen in contrail-api 2025-04-22 11:22:37,648 - DEBUG - Project uuid in Contrail is ee878ff1-e2bc-4157-8e44-c98f386da7b1 2025-04-22 11:22:37,648 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=1d63ad3a-47a5-44a5-a691-7b4851ecee8f 2025-04-22 11:22:37,656 - INFO - Namespace ctest-non-default-50754526 with uuid 1d63ad3a-47a5-44a5-a691-7b4851ecee8f found in kube manager 2025-04-22 11:22:37,656 - INFO - Namespace ctest-non-default-50754526 verification passed 2025-04-22 11:22:37,661 - DEBUG - Pod ctest-pod-54256729 not in running state.Currently in Pending 2025-04-22 11:22:42,667 - DEBUG - Pod ctest-pod-54256729 not in running state.Currently in Pending 2025-04-22 11:22:47,673 - INFO - Pod ctest-pod-54256729 is in running state.Got IP 10.47.255.251 2025-04-22 11:22:47,688 - DEBUG - Pod ctest-pod-54256729 has vmi 1917440e-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:47,688 - INFO - Verified pod ctest-pod-54256729 in contrail-api 2025-04-22 11:22:47,701 - DEBUG - VMI 1917440e-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:47,701 - INFO - Verified Pod ctest-pod-54256729 in agent 10.0.0.50 2025-04-22 11:22:47,701 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=73945e3d-552e-4de7-b1e2-dba8c77fde29 2025-04-22 11:22:47,706 - INFO - Pod ctest-pod-54256729 with uuid 73945e3d-552e-4de7-b1e2-dba8c77fde29 found in kube manager 2025-04-22 11:22:47,706 - INFO - Pod ctest-pod-54256729 verification passed 2025-04-22 11:22:47,715 - INFO - Pod ctest-pod-31131122 is in running state.Got IP 10.47.255.250 2025-04-22 11:22:47,775 - DEBUG - Pod ctest-pod-31131122 has vmi 19b0b864-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:47,775 - INFO - Verified pod ctest-pod-31131122 in contrail-api 2025-04-22 11:22:47,788 - DEBUG - VMI 19b0b864-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:47,789 - INFO - Verified Pod ctest-pod-31131122 in agent 10.0.0.50 2025-04-22 11:22:47,789 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=d55c3a01-c859-4e5f-a6e3-3fa824953e9f 2025-04-22 11:22:47,793 - INFO - Pod ctest-pod-31131122 with uuid d55c3a01-c859-4e5f-a6e3-3fa824953e9f found in kube manager 2025-04-22 11:22:47,793 - INFO - Pod ctest-pod-31131122 verification passed 2025-04-22 11:22:47,799 - INFO - Pod ctest-pod-35182556 is in running state.Got IP 10.47.255.249 2025-04-22 11:22:47,855 - DEBUG - Pod ctest-pod-35182556 has vmi 1a552354-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:47,856 - INFO - Verified pod ctest-pod-35182556 in contrail-api 2025-04-22 11:22:47,867 - DEBUG - VMI 1a552354-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:47,867 - INFO - Verified Pod ctest-pod-35182556 in agent 10.0.0.50 2025-04-22 11:22:47,867 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=58eed27b-2bad-4706-8163-27e9cff943c2 2025-04-22 11:22:47,872 - INFO - Pod ctest-pod-35182556 with uuid 58eed27b-2bad-4706-8163-27e9cff943c2 found in kube manager 2025-04-22 11:22:47,872 - INFO - Pod ctest-pod-35182556 verification passed 2025-04-22 11:22:47,878 - DEBUG - Pod ctest-pod-49283038 not in running state.Currently in Pending 2025-04-22 11:22:52,885 - INFO - Pod ctest-pod-49283038 is in running state.Got IP 10.47.255.248 2025-04-22 11:22:52,900 - DEBUG - Pod ctest-pod-49283038 has vmi 1ad0b46a-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:52,900 - INFO - Verified pod ctest-pod-49283038 in contrail-api 2025-04-22 11:22:52,914 - DEBUG - VMI 1ad0b46a-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:52,914 - INFO - Verified Pod ctest-pod-49283038 in agent 10.0.0.50 2025-04-22 11:22:52,914 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=0447509d-758d-46d0-a654-52b7a2d37ca1 2025-04-22 11:22:52,919 - INFO - Pod ctest-pod-49283038 with uuid 0447509d-758d-46d0-a654-52b7a2d37ca1 found in kube manager 2025-04-22 11:22:52,919 - INFO - Pod ctest-pod-49283038 verification passed 2025-04-22 11:22:52,924 - DEBUG - Pod ctest-pod-00931280 not in running state.Currently in Pending 2025-04-22 11:22:57,934 - INFO - Pod ctest-pod-00931280 is in running state.Got IP 10.47.255.247 2025-04-22 11:22:57,947 - DEBUG - Pod ctest-pod-00931280 has vmi 1b5bfb9c-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:57,947 - INFO - Verified pod ctest-pod-00931280 in contrail-api 2025-04-22 11:22:57,959 - DEBUG - VMI 1b5bfb9c-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:57,960 - INFO - Verified Pod ctest-pod-00931280 in agent 10.0.0.50 2025-04-22 11:22:57,960 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=326c5994-5d30-496d-8b63-ab8df26b5ffb 2025-04-22 11:22:57,964 - INFO - Pod ctest-pod-00931280 with uuid 326c5994-5d30-496d-8b63-ab8df26b5ffb found in kube manager 2025-04-22 11:22:57,964 - INFO - Pod ctest-pod-00931280 verification passed 2025-04-22 11:22:57,969 - INFO - Pod ctest-pod-53091563 is in running state.Got IP 10.47.255.245 2025-04-22 11:22:58,023 - DEBUG - Pod ctest-pod-53091563 has vmi 1c4a64c6-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:58,023 - INFO - Verified pod ctest-pod-53091563 in contrail-api 2025-04-22 11:22:58,039 - DEBUG - VMI 1c4a64c6-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:58,039 - INFO - Verified Pod ctest-pod-53091563 in agent 10.0.0.50 2025-04-22 11:22:58,039 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=462e021e-2d09-4024-b7b6-65f5c222c0ae 2025-04-22 11:22:58,044 - INFO - Pod ctest-pod-53091563 with uuid 462e021e-2d09-4024-b7b6-65f5c222c0ae found in kube manager 2025-04-22 11:22:58,044 - INFO - Pod ctest-pod-53091563 verification passed 2025-04-22 11:22:58,122 - INFO - Pod ctest-pod-76343869 is in running state.Got IP 10.47.255.246 2025-04-22 11:22:58,136 - DEBUG - Pod ctest-pod-76343869 has vmi 1bd41fb4-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:58,136 - INFO - Verified pod ctest-pod-76343869 in contrail-api 2025-04-22 11:22:58,149 - DEBUG - VMI 1bd41fb4-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:58,150 - INFO - Verified Pod ctest-pod-76343869 in agent 10.0.0.50 2025-04-22 11:22:58,150 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=47b736f7-3de8-4c8a-a42f-8d6c8bb83863 2025-04-22 11:22:58,154 - INFO - Pod ctest-pod-76343869 with uuid 47b736f7-3de8-4c8a-a42f-8d6c8bb83863 found in kube manager 2025-04-22 11:22:58,154 - INFO - Pod ctest-pod-76343869 verification passed 2025-04-22 11:22:58,159 - INFO - Pod ctest-pod-98424189 is in running state.Got IP 10.47.255.244 2025-04-22 11:22:58,216 - DEBUG - Pod ctest-pod-98424189 has vmi 1cb90732-1f6c-11f0-849e-fa163ee68643 2025-04-22 11:22:58,216 - INFO - Verified pod ctest-pod-98424189 in contrail-api 2025-04-22 11:22:58,229 - DEBUG - VMI 1cb90732-1f6c-11f0-849e-fa163ee68643 is active in agent 10.0.0.50 2025-04-22 11:22:58,229 - INFO - Verified Pod ctest-pod-98424189 in agent 10.0.0.50 2025-04-22 11:22:58,230 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=da554e3f-b2f7-4bd3-a1b9-8ae2ba132e16 2025-04-22 11:22:58,234 - INFO - Pod ctest-pod-98424189 with uuid da554e3f-b2f7-4bd3-a1b9-8ae2ba132e16 found in kube manager 2025-04-22 11:22:58,234 - INFO - Pod ctest-pod-98424189 verification passed 2025-04-22 11:22:58,235 - INFO - ================================================================================ 2025-04-22 11:22:58,235 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-22 11:22:58,235 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-22 11:22:58,475 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.49': '0'}} with 2025-04-22 11:22:58,475 - INFO - Initial checks done. Running the testcase now 2025-04-22 11:22:58,475 - INFO - 2025-04-22 11:22:58,525 - DEBUG - [Pod ctest-pod-54256729] Cmd: echo ctest-pod-54256729 > /usr/share/nginx/html/index.html, Output: 2025-04-22 11:22:58,583 - DEBUG - [Pod ctest-pod-31131122] Cmd: echo ctest-pod-31131122 > /usr/share/nginx/html/index.html, Output: 2025-04-22 11:22:58,619 - DEBUG - [Pod ctest-pod-35182556] Cmd: echo ctest-pod-35182556 > /usr/share/nginx/html/index.html, Output: 2025-04-22 11:22:58,670 - DEBUG - [Pod ctest-pod-49283038] Cmd: echo ctest-pod-49283038 > /usr/share/nginx/html/index.html, Output: 2025-04-22 11:22:58,673 - DEBUG - Service ctest-nginx-svc-95151667 not present 2025-04-22 11:22:58,673 - INFO - Creating service ctest-nginx-svc-95151667 2025-04-22 11:22:58,690 - INFO - Created Service ctest-nginx-svc-95151667 2025-04-22 11:22:58,699 - WARNING - Service UUID e663de6b-7339-4a24-b00e-41bd9c8e79b6 not yet found in contrail-api 2025-04-22 11:22:59,705 - INFO - Validated that Service ctest-nginx-svc-95151667 is seen in contrail-api 2025-04-22 11:22:59,705 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=e663de6b-7339-4a24-b00e-41bd9c8e79b6 2025-04-22 11:22:59,710 - INFO - Service ctest-nginx-svc-95151667 with uuid e663de6b-7339-4a24-b00e-41bd9c8e79b6 found in kube manager 2025-04-22 11:22:59,710 - INFO - Service ctest-nginx-svc-95151667 verification passed 2025-04-22 11:23:00,920 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) ctest-pod-31131122 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:00,920 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:00,920 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) ctest-pod-31131122 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:00,975 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:00,975 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:00,975 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:00,975 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54256729': 1, 'ctest-pod-31131122': 1} 2025-04-22 11:23:01,044 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:01,045 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:01,045 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:01,087 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54256729 2025-04-22 11:23:01,087 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:01,087 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54256729 2025-04-22 11:23:01,145 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) ctest-pod-31131122 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:01,145 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:01,145 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) ctest-pod-31131122 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:01,145 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54256729': 2, 'ctest-pod-31131122': 1} 2025-04-22 11:23:01,149 - DEBUG - Network policy ingress-on-service not present 2025-04-22 11:23:01,150 - INFO - Creating Network Policy ingress-on-service 2025-04-22 11:23:01,162 - INFO - Network policy found in k8s 2025-04-22 11:23:01,162 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8827583a-0c7f-4447-8747-1c3b6d039639 2025-04-22 11:23:01,169 - INFO - Network Policy ingress-on-service with uuid 8827583a-0c7f-4447-8747-1c3b6d039639 found in kube manager 2025-04-22 11:23:01,230 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-22 11:23:01,230 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-22 11:23:01,230 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8827583a-0c7f-4447-8747-1c3b6d039639 2025-04-22 11:23:01,269 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-22 11:23:03,270 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8827583a-0c7f-4447-8747-1c3b6d039639 2025-04-22 11:23:03,298 - INFO - Network policy with name ingress-on-service found in agent 2025-04-22 11:23:03,298 - INFO - Network Policy ingress-on-service verification passed 2025-04-22 11:23:08,350 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:08,350 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:08,350 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:13,401 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:13,402 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:13,402 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:18,450 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:18,450 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:18,450 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:23,503 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:23,503 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:23,503 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:28,574 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:28,574 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:28,574 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:33,627 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:33,627 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:33,627 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:38,682 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:38,682 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:38,682 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:43,734 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:43,734 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:43,734 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:48,785 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:48,786 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:48,786 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:53,837 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:53,837 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:53,837 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:53,837 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54256729': 0, 'ctest-pod-31131122': 0} 2025-04-22 11:23:53,888 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:53,888 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:53,888 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:23:53,941 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54256729 2025-04-22 11:23:53,941 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:23:53,941 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54256729 2025-04-22 11:23:53,941 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54256729': 1, 'ctest-pod-31131122': 1} 2025-04-22 11:23:58,994 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:58,995 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:23:58,995 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:04,035 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:04,035 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:04,035 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:09,087 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:09,087 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:09,087 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:14,143 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:14,143 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:14,143 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:19,194 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:19,194 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:19,194 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:24,246 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:24,246 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:24,246 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:29,307 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:29,313 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:29,313 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:34,382 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:34,382 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:34,382 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:39,434 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:39,434 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:39,434 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:44,477 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:44,478 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:44,478 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:24:44,478 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54256729': 0, 'ctest-pod-31131122': 0} 2025-04-22 11:24:46,530 - DEBUG - [Pod ctest-pod-76343869] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.764 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.316/0.764 ms 2025-04-22 11:24:46,531 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76343869 with expectation True passed 2025-04-22 11:24:48,581 - DEBUG - [Pod ctest-pod-00931280] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.701 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.281/0.701 ms 2025-04-22 11:24:48,581 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00931280 with expectation True passed 2025-04-22 11:24:50,629 - DEBUG - [Pod ctest-pod-53091563] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.211 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.461/1.211 ms 2025-04-22 11:24:50,629 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53091563 with expectation True passed 2025-04-22 11:24:50,679 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:24:50,679 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-22 11:24:50,680 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:24:50,680 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76343869 passed 2025-04-22 11:24:50,732 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:24:50,732 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-22 11:24:50,732 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:24:50,732 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76343869 passed 2025-04-22 11:24:55,785 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-22 11:24:55,785 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-22 11:24:55,785 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-22 11:24:55,785 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00931280 passed 2025-04-22 11:25:00,840 - DEBUG - [Pod ctest-pod-98424189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-22 11:25:00,840 - DEBUG - [Pod Pod ctest-pod-98424189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-22 11:25:00,840 - DEBUG - [Pod Pod ctest-pod-98424189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-22 11:25:00,840 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98424189 passed 2025-04-22 11:25:00,848 - INFO - Updating Network Policy ingress-on-service 2025-04-22 11:25:05,910 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:05,910 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:05,910 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:10,962 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:10,962 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:10,962 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:16,023 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:16,023 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:16,023 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:21,073 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:21,074 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:21,074 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:26,122 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:26,122 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:26,122 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:31,173 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:31,173 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:31,173 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:36,218 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:36,218 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:36,218 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:41,265 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:41,265 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:41,266 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:46,314 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:46,314 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:46,314 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:51,381 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:51,381 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:51,381 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) wget: download timed out 2025-04-22 11:25:51,381 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54256729': 0, 'ctest-pod-31131122': 0} 2025-04-22 11:25:51,423 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,423 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:25:51,423 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,475 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,475 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:25:51,475 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,475 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54256729': 1, 'ctest-pod-31131122': 1} 2025-04-22 11:25:51,556 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,556 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:25:51,556 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,606 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,606 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:25:51,606 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: ctest-pod-31131122 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,661 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31131122 2025-04-22 11:25:51,661 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:25:51,661 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31131122 2025-04-22 11:25:51,712 - DEBUG - [Pod ctest-pod-53091563] Cmd: wget http://10.110.109.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,712 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd wget http://10.110.109.140:80/ -O - -T 5 -t 1 passed 2025-04-22 11:25:51,712 - DEBUG - [Pod Pod ctest-pod-53091563] Cmd output: ctest-pod-54256729 Connecting to 10.110.109.140:80 (10.110.109.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-22 11:25:51,712 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54256729': 1, 'ctest-pod-31131122': 3} 2025-04-22 11:25:53,758 - DEBUG - [Pod ctest-pod-76343869] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.375 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.178/0.375 ms 2025-04-22 11:25:53,758 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76343869 with expectation True passed 2025-04-22 11:25:55,805 - DEBUG - [Pod ctest-pod-00931280] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.326 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.101 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.095/0.507/1.326 ms 2025-04-22 11:25:55,806 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00931280 with expectation True passed 2025-04-22 11:25:57,862 - DEBUG - [Pod ctest-pod-53091563] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.564 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.576/1.564 ms 2025-04-22 11:25:57,862 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53091563 with expectation True passed 2025-04-22 11:25:57,915 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:25:57,915 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-22 11:25:57,915 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:25:57,915 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76343869 passed 2025-04-22 11:25:57,976 - DEBUG - [Pod ctest-pod-76343869] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:25:57,977 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-22 11:25:57,977 - DEBUG - [Pod Pod ctest-pod-76343869] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:25:57,977 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76343869 passed 2025-04-22 11:26:03,025 - DEBUG - [Pod ctest-pod-00931280] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-22 11:26:03,025 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-22 11:26:03,025 - DEBUG - [Pod Pod ctest-pod-00931280] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-22 11:26:03,025 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00931280 passed 2025-04-22 11:26:03,084 - DEBUG - [Pod ctest-pod-98424189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:26:03,084 - DEBUG - [Pod Pod ctest-pod-98424189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-22 11:26:03,084 - DEBUG - [Pod Pod ctest-pod-98424189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-22 11:26:03,084 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98424189 passed 2025-04-22 11:26:03,085 - INFO - Deleting Network Policy : ingress-on-service 2025-04-22 11:26:03,085 - INFO - Deleting service : ctest-nginx-svc-95151667 2025-04-22 11:26:03,318 - DEBUG - No XMPP flaps were noticed during the test