2024-11-03 19:50:36,596 - INFO - Using existing project ['default-domain', 'k8s-default'](3c4963a0-3034-40fb-94ec-d2eda3513a80) 2024-11-03 19:50:36,614 - DEBUG - Namespace ctest-new-default-43751174 not present 2024-11-03 19:50:36,643 - INFO - Created namespace ctest-new-default-43751174 2024-11-03 19:50:39,647 - DEBUG - Namespace ctest-non-default-62627884 not present 2024-11-03 19:50:39,662 - INFO - Created namespace ctest-non-default-62627884 2024-11-03 19:50:42,697 - DEBUG - Pod ctest-pod-10701380 not present 2024-11-03 19:50:42,698 - INFO - Creating Pod ctest-pod-10701380 2024-11-03 19:50:42,742 - DEBUG - Pod : ctest-pod-10701380 UUID is a4db491b-bcef-4606-b7cd-6772938a6f73 2024-11-03 19:50:42,746 - DEBUG - Pod ctest-pod-19874083 not present 2024-11-03 19:50:42,747 - INFO - Creating Pod ctest-pod-19874083 2024-11-03 19:50:42,790 - DEBUG - Pod : ctest-pod-19874083 UUID is f8b25141-b265-4f10-bfe1-371c3a75d5b8 2024-11-03 19:50:42,802 - DEBUG - Pod ctest-pod-23238197 not present 2024-11-03 19:50:42,803 - INFO - Creating Pod ctest-pod-23238197 2024-11-03 19:50:42,841 - DEBUG - Pod : ctest-pod-23238197 UUID is 262e9c4b-98d8-4def-a486-5ebb257df280 2024-11-03 19:50:42,843 - DEBUG - Pod ctest-pod-95794499 not present 2024-11-03 19:50:42,844 - INFO - Creating Pod ctest-pod-95794499 2024-11-03 19:50:42,878 - DEBUG - Pod : ctest-pod-95794499 UUID is f9e515fe-d184-4eef-8f7a-87119f525cf2 2024-11-03 19:50:42,882 - DEBUG - Pod ctest-pod-92771230 not present 2024-11-03 19:50:42,882 - INFO - Creating Pod ctest-pod-92771230 2024-11-03 19:50:42,904 - DEBUG - Pod : ctest-pod-92771230 UUID is 482882c4-eb09-4329-b782-98fdca14ed3c 2024-11-03 19:50:42,908 - DEBUG - Pod ctest-pod-65961139 not present 2024-11-03 19:50:42,908 - INFO - Creating Pod ctest-pod-65961139 2024-11-03 19:50:42,929 - DEBUG - Pod : ctest-pod-65961139 UUID is 0b022624-339a-4275-b1e7-fe3c7dab964e 2024-11-03 19:50:42,931 - DEBUG - Pod ctest-pod-20346072 not present 2024-11-03 19:50:42,932 - INFO - Creating Pod ctest-pod-20346072 2024-11-03 19:50:42,954 - DEBUG - Pod : ctest-pod-20346072 UUID is 88d86438-0f41-4726-a050-e58b312493e3 2024-11-03 19:50:42,956 - DEBUG - Pod ctest-pod-88039091 not present 2024-11-03 19:50:42,957 - INFO - Creating Pod ctest-pod-88039091 2024-11-03 19:50:42,995 - DEBUG - Pod : ctest-pod-88039091 UUID is 2a51eb4a-2230-4fa1-9d4e-2a81fb3faa08 2024-11-03 19:50:43,230 - INFO - Project default-domain:k8s-ctest-new-default-43751174 for Namespace ctest-new-default-43751174 is seen in contrail-api 2024-11-03 19:50:43,231 - DEBUG - Project uuid in Contrail is f11552ca-9158-4d90-a534-72812fde6473 2024-11-03 19:50:43,465 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=bdb5b0b5-7960-42b0-a688-63f5f5a53ef9 2024-11-03 19:50:43,469 - INFO - Namespace ctest-new-default-43751174 with uuid bdb5b0b5-7960-42b0-a688-63f5f5a53ef9 found in kube manager 2024-11-03 19:50:43,470 - INFO - Namespace ctest-new-default-43751174 verification passed 2024-11-03 19:50:43,724 - INFO - Project default-domain:k8s-ctest-non-default-62627884 for Namespace ctest-non-default-62627884 is seen in contrail-api 2024-11-03 19:50:43,724 - DEBUG - Project uuid in Contrail is 8e16b4ef-82c2-49ae-94ee-b6fdf9a349e7 2024-11-03 19:50:43,724 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=c2a3981b-33fd-44f7-af8e-41871f39a685 2024-11-03 19:50:43,728 - INFO - Namespace ctest-non-default-62627884 with uuid c2a3981b-33fd-44f7-af8e-41871f39a685 found in kube manager 2024-11-03 19:50:43,728 - INFO - Namespace ctest-non-default-62627884 verification passed 2024-11-03 19:50:43,735 - DEBUG - Pod ctest-pod-10701380 not in running state.Currently in Pending 2024-11-03 19:50:48,745 - DEBUG - Pod ctest-pod-10701380 not in running state.Currently in Pending 2024-11-03 19:50:53,752 - INFO - Pod ctest-pod-10701380 is in running state.Got IP 10.47.255.251 2024-11-03 19:50:53,812 - DEBUG - Pod ctest-pod-10701380 has vmi ea1c74be-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:50:53,812 - INFO - Verified pod ctest-pod-10701380 in contrail-api 2024-11-03 19:50:53,832 - DEBUG - VMI ea1c74be-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:50:53,832 - INFO - Verified Pod ctest-pod-10701380 in agent 10.0.0.33 2024-11-03 19:50:53,832 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a4db491b-bcef-4606-b7cd-6772938a6f73 2024-11-03 19:50:53,837 - INFO - Pod ctest-pod-10701380 with uuid a4db491b-bcef-4606-b7cd-6772938a6f73 found in kube manager 2024-11-03 19:50:53,837 - INFO - Pod ctest-pod-10701380 verification passed 2024-11-03 19:50:53,842 - INFO - Pod ctest-pod-19874083 is in running state.Got IP 10.47.255.250 2024-11-03 19:50:53,862 - DEBUG - Pod ctest-pod-19874083 has vmi eaaba13e-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:50:53,862 - INFO - Verified pod ctest-pod-19874083 in contrail-api 2024-11-03 19:50:53,903 - DEBUG - VMI eaaba13e-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:50:53,903 - INFO - Verified Pod ctest-pod-19874083 in agent 10.0.0.33 2024-11-03 19:50:53,903 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f8b25141-b265-4f10-bfe1-371c3a75d5b8 2024-11-03 19:50:53,908 - INFO - Pod ctest-pod-19874083 with uuid f8b25141-b265-4f10-bfe1-371c3a75d5b8 found in kube manager 2024-11-03 19:50:53,908 - INFO - Pod ctest-pod-19874083 verification passed 2024-11-03 19:50:53,915 - INFO - Pod ctest-pod-23238197 is in running state.Got IP 10.47.255.249 2024-11-03 19:50:53,976 - DEBUG - Pod ctest-pod-23238197 has vmi eb70c446-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:50:53,976 - INFO - Verified pod ctest-pod-23238197 in contrail-api 2024-11-03 19:50:53,988 - DEBUG - VMI eb70c446-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:50:53,988 - INFO - Verified Pod ctest-pod-23238197 in agent 10.0.0.33 2024-11-03 19:50:53,988 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=262e9c4b-98d8-4def-a486-5ebb257df280 2024-11-03 19:50:53,993 - INFO - Pod ctest-pod-23238197 with uuid 262e9c4b-98d8-4def-a486-5ebb257df280 found in kube manager 2024-11-03 19:50:53,993 - INFO - Pod ctest-pod-23238197 verification passed 2024-11-03 19:50:53,998 - DEBUG - Pod ctest-pod-95794499 not in running state.Currently in Pending 2024-11-03 19:50:59,023 - INFO - Pod ctest-pod-95794499 is in running state.Got IP 10.47.255.248 2024-11-03 19:50:59,041 - DEBUG - Pod ctest-pod-95794499 has vmi ec1b141e-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:50:59,041 - INFO - Verified pod ctest-pod-95794499 in contrail-api 2024-11-03 19:50:59,054 - DEBUG - VMI ec1b141e-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:50:59,054 - INFO - Verified Pod ctest-pod-95794499 in agent 10.0.0.33 2024-11-03 19:50:59,054 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f9e515fe-d184-4eef-8f7a-87119f525cf2 2024-11-03 19:50:59,058 - INFO - Pod ctest-pod-95794499 with uuid f9e515fe-d184-4eef-8f7a-87119f525cf2 found in kube manager 2024-11-03 19:50:59,058 - INFO - Pod ctest-pod-95794499 verification passed 2024-11-03 19:50:59,063 - DEBUG - Pod ctest-pod-92771230 not in running state.Currently in Pending 2024-11-03 19:51:04,069 - INFO - Pod ctest-pod-92771230 is in running state.Got IP 10.47.255.247 2024-11-03 19:51:04,087 - DEBUG - Pod ctest-pod-92771230 has vmi ecbe3ae0-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:51:04,087 - INFO - Verified pod ctest-pod-92771230 in contrail-api 2024-11-03 19:51:04,101 - DEBUG - VMI ecbe3ae0-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:51:04,101 - INFO - Verified Pod ctest-pod-92771230 in agent 10.0.0.33 2024-11-03 19:51:04,101 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=482882c4-eb09-4329-b782-98fdca14ed3c 2024-11-03 19:51:04,106 - INFO - Pod ctest-pod-92771230 with uuid 482882c4-eb09-4329-b782-98fdca14ed3c found in kube manager 2024-11-03 19:51:04,106 - INFO - Pod ctest-pod-92771230 verification passed 2024-11-03 19:51:04,111 - INFO - Pod ctest-pod-20346072 is in running state.Got IP 10.47.255.245 2024-11-03 19:51:04,171 - DEBUG - Pod ctest-pod-20346072 has vmi edb6dc7c-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:51:04,172 - INFO - Verified pod ctest-pod-20346072 in contrail-api 2024-11-03 19:51:04,185 - DEBUG - VMI edb6dc7c-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:51:04,185 - INFO - Verified Pod ctest-pod-20346072 in agent 10.0.0.33 2024-11-03 19:51:04,185 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=88d86438-0f41-4726-a050-e58b312493e3 2024-11-03 19:51:04,189 - INFO - Pod ctest-pod-20346072 with uuid 88d86438-0f41-4726-a050-e58b312493e3 found in kube manager 2024-11-03 19:51:04,190 - INFO - Pod ctest-pod-20346072 verification passed 2024-11-03 19:51:04,195 - INFO - Pod ctest-pod-65961139 is in running state.Got IP 10.47.255.246 2024-11-03 19:51:04,256 - DEBUG - Pod ctest-pod-65961139 has vmi ed3e6e04-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:51:04,256 - INFO - Verified pod ctest-pod-65961139 in contrail-api 2024-11-03 19:51:04,269 - DEBUG - VMI ed3e6e04-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:51:04,270 - INFO - Verified Pod ctest-pod-65961139 in agent 10.0.0.33 2024-11-03 19:51:04,270 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0b022624-339a-4275-b1e7-fe3c7dab964e 2024-11-03 19:51:04,275 - INFO - Pod ctest-pod-65961139 with uuid 0b022624-339a-4275-b1e7-fe3c7dab964e found in kube manager 2024-11-03 19:51:04,275 - INFO - Pod ctest-pod-65961139 verification passed 2024-11-03 19:51:04,280 - INFO - Pod ctest-pod-88039091 is in running state.Got IP 10.47.255.244 2024-11-03 19:51:04,300 - DEBUG - Pod ctest-pod-88039091 has vmi ee3bf880-9a1c-11ef-8047-fa163ea8a5f3 2024-11-03 19:51:04,301 - INFO - Verified pod ctest-pod-88039091 in contrail-api 2024-11-03 19:51:04,314 - DEBUG - VMI ee3bf880-9a1c-11ef-8047-fa163ea8a5f3 is active in agent 10.0.0.33 2024-11-03 19:51:04,314 - INFO - Verified Pod ctest-pod-88039091 in agent 10.0.0.33 2024-11-03 19:51:04,314 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2a51eb4a-2230-4fa1-9d4e-2a81fb3faa08 2024-11-03 19:51:04,318 - INFO - Pod ctest-pod-88039091 with uuid 2a51eb4a-2230-4fa1-9d4e-2a81fb3faa08 found in kube manager 2024-11-03 19:51:04,318 - INFO - Pod ctest-pod-88039091 verification passed 2024-11-03 19:51:04,319 - INFO - ================================================================================ 2024-11-03 19:51:04,319 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-03 19:51:04,319 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-03 19:51:04,578 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.22': '0'}} with 2024-11-03 19:51:04,578 - INFO - Initial checks done. Running the testcase now 2024-11-03 19:51:04,578 - INFO - 2024-11-03 19:51:04,653 - DEBUG - [Pod ctest-pod-10701380] Cmd: echo ctest-pod-10701380 > /usr/share/nginx/html/index.html, Output: 2024-11-03 19:51:04,722 - DEBUG - [Pod ctest-pod-19874083] Cmd: echo ctest-pod-19874083 > /usr/share/nginx/html/index.html, Output: 2024-11-03 19:51:04,786 - DEBUG - [Pod ctest-pod-23238197] Cmd: echo ctest-pod-23238197 > /usr/share/nginx/html/index.html, Output: 2024-11-03 19:51:04,860 - DEBUG - [Pod ctest-pod-95794499] Cmd: echo ctest-pod-95794499 > /usr/share/nginx/html/index.html, Output: 2024-11-03 19:51:04,863 - DEBUG - Service ctest-nginx-svc-49695747 not present 2024-11-03 19:51:04,863 - INFO - Creating service ctest-nginx-svc-49695747 2024-11-03 19:51:04,878 - INFO - Created Service ctest-nginx-svc-49695747 2024-11-03 19:51:04,899 - WARNING - Service UUID 9ad43ccc-8d43-488f-8181-565e2a5cea26 not yet found in contrail-api 2024-11-03 19:51:05,911 - INFO - Validated that Service ctest-nginx-svc-49695747 is seen in contrail-api 2024-11-03 19:51:05,911 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=9ad43ccc-8d43-488f-8181-565e2a5cea26 2024-11-03 19:51:05,916 - INFO - Service ctest-nginx-svc-49695747 with uuid 9ad43ccc-8d43-488f-8181-565e2a5cea26 found in kube manager 2024-11-03 19:51:05,916 - INFO - Service ctest-nginx-svc-49695747 verification passed 2024-11-03 19:51:07,004 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19874083 2024-11-03 19:51:07,004 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:51:07,004 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19874083 2024-11-03 19:51:07,066 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,066 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:51:07,066 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,066 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10701380': 1, 'ctest-pod-19874083': 1} 2024-11-03 19:51:07,129 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,129 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:51:07,129 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,193 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,193 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:51:07,193 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,260 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,260 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:51:07,260 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,310 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,310 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:51:07,310 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:51:07,310 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10701380': 1, 'ctest-pod-19874083': 3} 2024-11-03 19:51:07,314 - DEBUG - Network policy ingress-on-service not present 2024-11-03 19:51:07,314 - INFO - Creating Network Policy ingress-on-service 2024-11-03 19:51:07,327 - INFO - Network policy found in k8s 2024-11-03 19:51:07,327 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=270e1309-2c0c-4bbf-ae7e-8d2d895aa657 2024-11-03 19:51:07,338 - INFO - Network Policy ingress-on-service with uuid 270e1309-2c0c-4bbf-ae7e-8d2d895aa657 found in kube manager 2024-11-03 19:51:07,377 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-03 19:51:07,377 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-03 19:51:07,377 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=270e1309-2c0c-4bbf-ae7e-8d2d895aa657 2024-11-03 19:51:07,407 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-03 19:51:09,408 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=270e1309-2c0c-4bbf-ae7e-8d2d895aa657 2024-11-03 19:51:09,451 - INFO - Network policy with name ingress-on-service found in agent 2024-11-03 19:51:09,452 - INFO - Network Policy ingress-on-service verification passed 2024-11-03 19:51:14,540 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:14,540 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:14,540 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:19,602 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:19,602 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:19,602 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:24,656 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:24,656 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:24,656 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:29,708 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:29,708 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:29,708 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:34,769 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:34,769 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:34,769 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:39,826 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:39,826 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:39,826 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:44,882 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:44,882 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:44,882 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:49,943 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:49,943 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:49,943 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:54,995 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:54,995 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:51:54,995 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:00,067 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:00,067 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:00,067 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:00,067 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10701380': 0, 'ctest-pod-19874083': 0} 2024-11-03 19:52:00,148 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:52:00,149 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:52:00,149 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:52:00,211 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10701380 2024-11-03 19:52:00,212 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:52:00,212 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10701380 2024-11-03 19:52:00,278 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:52:00,279 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:52:00,279 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:52:00,279 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10701380': 2, 'ctest-pod-19874083': 1} 2024-11-03 19:52:05,340 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:05,340 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:05,340 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:10,390 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:10,390 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:10,391 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:15,455 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:15,455 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:15,455 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:20,511 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:20,511 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:20,511 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:25,565 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:25,565 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:25,565 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:30,640 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:30,640 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:30,640 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:35,698 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:35,698 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:35,698 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:40,749 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:40,749 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:40,749 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:45,799 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:45,799 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:45,799 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:50,861 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:50,861 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:50,861 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:52:50,861 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10701380': 0, 'ctest-pod-19874083': 0} 2024-11-03 19:52:52,925 - DEBUG - [Pod ctest-pod-65961139] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.989 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.057 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.057/0.372/0.989 ms 2024-11-03 19:52:52,925 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-65961139 with expectation True passed 2024-11-03 19:52:54,997 - DEBUG - [Pod ctest-pod-92771230] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.443 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.531/1.443 ms 2024-11-03 19:52:54,998 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92771230 with expectation True passed 2024-11-03 19:52:57,058 - DEBUG - [Pod ctest-pod-20346072] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.651 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.270/0.651 ms 2024-11-03 19:52:57,058 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20346072 with expectation True passed 2024-11-03 19:52:57,108 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:52:57,108 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-03 19:52:57,108 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:52:57,108 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65961139 passed 2024-11-03 19:52:57,171 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:52:57,171 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-03 19:52:57,171 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:52:57,171 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65961139 passed 2024-11-03 19:53:02,224 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-03 19:53:02,224 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-03 19:53:02,224 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-03 19:53:02,224 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92771230 passed 2024-11-03 19:53:07,302 - DEBUG - [Pod ctest-pod-88039091] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-03 19:53:07,302 - DEBUG - [Pod Pod ctest-pod-88039091] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-03 19:53:07,302 - DEBUG - [Pod Pod ctest-pod-88039091] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-03 19:53:07,302 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88039091 passed 2024-11-03 19:53:07,314 - INFO - Updating Network Policy ingress-on-service 2024-11-03 19:53:12,406 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:12,406 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:12,407 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:17,472 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:17,472 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:17,472 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:22,539 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:22,539 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:22,539 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:27,602 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:27,602 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:27,602 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:32,656 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:32,656 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:32,657 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:37,713 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:37,713 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:37,713 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:42,784 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:42,784 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:42,784 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:47,835 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:47,835 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:47,835 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:52,899 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:52,900 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:52,900 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:57,974 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:57,974 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:57,974 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) wget: download timed out 2024-11-03 19:53:57,974 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10701380': 0, 'ctest-pod-19874083': 0} 2024-11-03 19:53:58,028 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.114.169:80 (10.98.114.169:80) ctest-pod-19874083 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,029 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:53:58,029 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: Connecting to 10.98.114.169:80 (10.98.114.169:80) ctest-pod-19874083 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,088 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,088 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:53:58,088 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,088 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10701380': 1, 'ctest-pod-19874083': 1} 2024-11-03 19:53:58,144 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,144 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:53:58,144 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: ctest-pod-10701380 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,208 - DEBUG - [Pod ctest-pod-20346072] Cmd: wget http://10.98.114.169:80/ -O - -T 5 -t 1 , Output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,208 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd wget http://10.98.114.169:80/ -O - -T 5 -t 1 passed 2024-11-03 19:53:58,208 - DEBUG - [Pod Pod ctest-pod-20346072] Cmd output: ctest-pod-19874083 Connecting to 10.98.114.169:80 (10.98.114.169:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-03 19:53:58,208 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10701380': 1, 'ctest-pod-19874083': 1} 2024-11-03 19:54:00,274 - DEBUG - [Pod ctest-pod-65961139] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.514 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.221/0.514 ms 2024-11-03 19:54:00,274 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-65961139 with expectation True passed 2024-11-03 19:54:02,343 - DEBUG - [Pod ctest-pod-92771230] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.508 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.223/0.508 ms 2024-11-03 19:54:02,343 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92771230 with expectation True passed 2024-11-03 19:54:04,406 - DEBUG - [Pod ctest-pod-20346072] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.021 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.406/1.021 ms 2024-11-03 19:54:04,406 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20346072 with expectation True passed 2024-11-03 19:54:04,486 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:54:04,486 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-03 19:54:04,486 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:54:04,487 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65961139 passed 2024-11-03 19:54:04,569 - DEBUG - [Pod ctest-pod-65961139] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:54:04,569 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-03 19:54:04,569 - DEBUG - [Pod Pod ctest-pod-65961139] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:54:04,569 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65961139 passed 2024-11-03 19:54:09,640 - DEBUG - [Pod ctest-pod-92771230] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-03 19:54:09,640 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-03 19:54:09,640 - DEBUG - [Pod Pod ctest-pod-92771230] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-03 19:54:09,640 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92771230 passed 2024-11-03 19:54:09,714 - DEBUG - [Pod ctest-pod-88039091] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:54:09,714 - DEBUG - [Pod Pod ctest-pod-88039091] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-03 19:54:09,714 - DEBUG - [Pod Pod ctest-pod-88039091] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-03 19:54:09,714 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88039091 passed 2024-11-03 19:54:09,714 - INFO - Deleting Network Policy : ingress-on-service 2024-11-03 19:54:09,715 - INFO - Deleting service : ctest-nginx-svc-49695747 2024-11-03 19:54:09,908 - DEBUG - No XMPP flaps were noticed during the test