2024-09-17 08:54:41,125 - INFO - Using existing project ['default-domain', 'k8s-default'](35aad031-6623-4064-b0a9-e17e066b73a7) 2024-09-17 08:54:41,152 - DEBUG - Namespace ctest-new-default-37875047 not present 2024-09-17 08:54:41,165 - INFO - Created namespace ctest-new-default-37875047 2024-09-17 08:54:44,170 - DEBUG - Namespace ctest-non-default-50809476 not present 2024-09-17 08:54:44,183 - INFO - Created namespace ctest-non-default-50809476 2024-09-17 08:54:47,202 - DEBUG - Pod ctest-pod-41843337 not present 2024-09-17 08:54:47,202 - INFO - Creating Pod ctest-pod-41843337 2024-09-17 08:54:47,224 - DEBUG - Pod : ctest-pod-41843337 UUID is 089dd7d1-1550-456d-b474-1c8aee010b27 2024-09-17 08:54:47,229 - DEBUG - Pod ctest-pod-22673875 not present 2024-09-17 08:54:47,229 - INFO - Creating Pod ctest-pod-22673875 2024-09-17 08:54:47,261 - DEBUG - Pod : ctest-pod-22673875 UUID is 2a86ce89-ff60-4ff1-98d1-50f9c849af14 2024-09-17 08:54:47,268 - DEBUG - Pod ctest-pod-36665229 not present 2024-09-17 08:54:47,268 - INFO - Creating Pod ctest-pod-36665229 2024-09-17 08:54:47,302 - DEBUG - Pod : ctest-pod-36665229 UUID is 72d65873-d6ec-4acf-88f2-6a9d17a5286b 2024-09-17 08:54:47,306 - DEBUG - Pod ctest-pod-65463358 not present 2024-09-17 08:54:47,306 - INFO - Creating Pod ctest-pod-65463358 2024-09-17 08:54:47,331 - DEBUG - Pod : ctest-pod-65463358 UUID is 9a23d5f5-d2d5-43cd-ae0a-a3aee43e33b7 2024-09-17 08:54:47,339 - DEBUG - Pod ctest-pod-46811083 not present 2024-09-17 08:54:47,339 - INFO - Creating Pod ctest-pod-46811083 2024-09-17 08:54:48,128 - DEBUG - Pod : ctest-pod-46811083 UUID is 5ef6d5ac-928f-41b3-831c-0379f22c4105 2024-09-17 08:54:48,131 - DEBUG - Pod ctest-pod-47162072 not present 2024-09-17 08:54:48,131 - INFO - Creating Pod ctest-pod-47162072 2024-09-17 08:54:48,158 - DEBUG - Pod : ctest-pod-47162072 UUID is 69903f80-3a40-493b-96ea-8b2104bf769c 2024-09-17 08:54:48,162 - DEBUG - Pod ctest-pod-59605251 not present 2024-09-17 08:54:48,163 - INFO - Creating Pod ctest-pod-59605251 2024-09-17 08:54:48,185 - DEBUG - Pod : ctest-pod-59605251 UUID is 7fd35151-ade3-4936-a9c1-42a02f1dc218 2024-09-17 08:54:48,189 - DEBUG - Pod ctest-pod-65342993 not present 2024-09-17 08:54:48,189 - INFO - Creating Pod ctest-pod-65342993 2024-09-17 08:54:48,211 - DEBUG - Pod : ctest-pod-65342993 UUID is 4277e832-fe80-457c-8805-245b691e2a1f 2024-09-17 08:54:48,419 - INFO - Project default-domain:k8s-ctest-new-default-37875047 for Namespace ctest-new-default-37875047 is seen in contrail-api 2024-09-17 08:54:48,425 - DEBUG - Project uuid in Contrail is 18c82ce9-9ee7-4b1e-a5d5-2a8100011238 2024-09-17 08:54:48,564 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NamespaceDatabaseList?namespace_uuid=764c9910-4450-4e60-8be5-a6a724dac379 2024-09-17 08:54:48,570 - INFO - Namespace ctest-new-default-37875047 with uuid 764c9910-4450-4e60-8be5-a6a724dac379 found in kube manager 2024-09-17 08:54:48,571 - INFO - Namespace ctest-new-default-37875047 verification passed 2024-09-17 08:54:48,797 - INFO - Project default-domain:k8s-ctest-non-default-50809476 for Namespace ctest-non-default-50809476 is seen in contrail-api 2024-09-17 08:54:48,797 - DEBUG - Project uuid in Contrail is 405d2a38-42fb-46e6-837c-c076b64a72cd 2024-09-17 08:54:48,797 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NamespaceDatabaseList?namespace_uuid=095c060b-5cf8-47a2-965e-2d76bdfbc19c 2024-09-17 08:54:48,802 - INFO - Namespace ctest-non-default-50809476 with uuid 095c060b-5cf8-47a2-965e-2d76bdfbc19c found in kube manager 2024-09-17 08:54:48,802 - INFO - Namespace ctest-non-default-50809476 verification passed 2024-09-17 08:54:48,808 - DEBUG - Pod ctest-pod-41843337 not in running state.Currently in Pending 2024-09-17 08:54:53,823 - DEBUG - Pod ctest-pod-41843337 not in running state.Currently in Pending 2024-09-17 08:54:58,831 - DEBUG - Pod ctest-pod-41843337 not in running state.Currently in Pending 2024-09-17 08:55:03,839 - INFO - Pod ctest-pod-41843337 is in running state.Got IP 10.47.255.251 2024-09-17 08:55:03,902 - DEBUG - Pod ctest-pod-41843337 has vmi 7f0fdd38-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:03,903 - INFO - Verified pod ctest-pod-41843337 in contrail-api 2024-09-17 08:55:03,921 - DEBUG - VMI 7f0fdd38-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:03,922 - INFO - Verified Pod ctest-pod-41843337 in agent 10.0.0.32 2024-09-17 08:55:03,923 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=089dd7d1-1550-456d-b474-1c8aee010b27 2024-09-17 08:55:03,930 - INFO - Pod ctest-pod-41843337 with uuid 089dd7d1-1550-456d-b474-1c8aee010b27 found in kube manager 2024-09-17 08:55:03,930 - INFO - Pod ctest-pod-41843337 verification passed 2024-09-17 08:55:03,941 - INFO - Pod ctest-pod-22673875 is in running state.Got IP 10.47.255.250 2024-09-17 08:55:03,978 - DEBUG - Pod ctest-pod-22673875 has vmi 7f8a9a5a-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:03,978 - INFO - Verified pod ctest-pod-22673875 in contrail-api 2024-09-17 08:55:03,998 - DEBUG - VMI 7f8a9a5a-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:03,999 - INFO - Verified Pod ctest-pod-22673875 in agent 10.0.0.32 2024-09-17 08:55:04,000 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=2a86ce89-ff60-4ff1-98d1-50f9c849af14 2024-09-17 08:55:04,014 - INFO - Pod ctest-pod-22673875 with uuid 2a86ce89-ff60-4ff1-98d1-50f9c849af14 found in kube manager 2024-09-17 08:55:04,014 - INFO - Pod ctest-pod-22673875 verification passed 2024-09-17 08:55:04,022 - INFO - Pod ctest-pod-36665229 is in running state.Got IP 10.47.255.249 2024-09-17 08:55:04,049 - DEBUG - Pod ctest-pod-36665229 has vmi 80b147ee-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:04,049 - INFO - Verified pod ctest-pod-36665229 in contrail-api 2024-09-17 08:55:04,071 - DEBUG - VMI 80b147ee-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:04,071 - INFO - Verified Pod ctest-pod-36665229 in agent 10.0.0.32 2024-09-17 08:55:04,072 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=72d65873-d6ec-4acf-88f2-6a9d17a5286b 2024-09-17 08:55:04,081 - INFO - Pod ctest-pod-36665229 with uuid 72d65873-d6ec-4acf-88f2-6a9d17a5286b found in kube manager 2024-09-17 08:55:04,081 - INFO - Pod ctest-pod-36665229 verification passed 2024-09-17 08:55:04,092 - DEBUG - Pod ctest-pod-65463358 not in running state.Currently in Pending 2024-09-17 08:55:09,099 - INFO - Pod ctest-pod-65463358 is in running state.Got IP 10.47.255.248 2024-09-17 08:55:09,158 - DEBUG - Pod ctest-pod-65463358 has vmi 81a7bbce-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:09,159 - INFO - Verified pod ctest-pod-65463358 in contrail-api 2024-09-17 08:55:09,172 - DEBUG - VMI 81a7bbce-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:09,173 - INFO - Verified Pod ctest-pod-65463358 in agent 10.0.0.32 2024-09-17 08:55:09,173 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=9a23d5f5-d2d5-43cd-ae0a-a3aee43e33b7 2024-09-17 08:55:09,178 - INFO - Pod ctest-pod-65463358 with uuid 9a23d5f5-d2d5-43cd-ae0a-a3aee43e33b7 found in kube manager 2024-09-17 08:55:09,178 - INFO - Pod ctest-pod-65463358 verification passed 2024-09-17 08:55:09,185 - INFO - Pod ctest-pod-46811083 is in running state.Got IP 10.47.255.247 2024-09-17 08:55:09,209 - DEBUG - Pod ctest-pod-46811083 has vmi 824361e6-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:09,209 - INFO - Verified pod ctest-pod-46811083 in contrail-api 2024-09-17 08:55:09,222 - DEBUG - VMI 824361e6-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:09,223 - INFO - Verified Pod ctest-pod-46811083 in agent 10.0.0.32 2024-09-17 08:55:09,223 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=5ef6d5ac-928f-41b3-831c-0379f22c4105 2024-09-17 08:55:09,228 - INFO - Pod ctest-pod-46811083 with uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 found in kube manager 2024-09-17 08:55:09,228 - INFO - Pod ctest-pod-46811083 verification passed 2024-09-17 08:55:09,233 - INFO - Pod ctest-pod-59605251 is in running state.Got IP 10.47.255.245 2024-09-17 08:55:09,294 - DEBUG - Pod ctest-pod-59605251 has vmi 835d146e-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:09,294 - INFO - Verified pod ctest-pod-59605251 in contrail-api 2024-09-17 08:55:09,308 - DEBUG - VMI 835d146e-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:09,308 - INFO - Verified Pod ctest-pod-59605251 in agent 10.0.0.32 2024-09-17 08:55:09,308 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=7fd35151-ade3-4936-a9c1-42a02f1dc218 2024-09-17 08:55:09,312 - INFO - Pod ctest-pod-59605251 with uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 found in kube manager 2024-09-17 08:55:09,312 - INFO - Pod ctest-pod-59605251 verification passed 2024-09-17 08:55:09,837 - INFO - Pod ctest-pod-47162072 is in running state.Got IP 10.47.255.246 2024-09-17 08:55:09,855 - DEBUG - Pod ctest-pod-47162072 has vmi 82d85260-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:09,855 - INFO - Verified pod ctest-pod-47162072 in contrail-api 2024-09-17 08:55:09,868 - DEBUG - VMI 82d85260-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:09,869 - INFO - Verified Pod ctest-pod-47162072 in agent 10.0.0.32 2024-09-17 08:55:09,869 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=69903f80-3a40-493b-96ea-8b2104bf769c 2024-09-17 08:55:09,874 - INFO - Pod ctest-pod-47162072 with uuid 69903f80-3a40-493b-96ea-8b2104bf769c found in kube manager 2024-09-17 08:55:09,874 - INFO - Pod ctest-pod-47162072 verification passed 2024-09-17 08:55:09,879 - DEBUG - Pod ctest-pod-65342993 not in running state.Currently in Pending 2024-09-17 08:55:14,886 - INFO - Pod ctest-pod-65342993 is in running state.Got IP 10.47.255.244 2024-09-17 08:55:14,950 - DEBUG - Pod ctest-pod-65342993 has vmi 83e91fea-74d2-11ef-b38c-fa163ea49b28 2024-09-17 08:55:14,951 - INFO - Verified pod ctest-pod-65342993 in contrail-api 2024-09-17 08:55:14,967 - DEBUG - VMI 83e91fea-74d2-11ef-b38c-fa163ea49b28 is active in agent 10.0.0.32 2024-09-17 08:55:14,967 - INFO - Verified Pod ctest-pod-65342993 in agent 10.0.0.32 2024-09-17 08:55:14,967 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=4277e832-fe80-457c-8805-245b691e2a1f 2024-09-17 08:55:14,972 - INFO - Pod ctest-pod-65342993 with uuid 4277e832-fe80-457c-8805-245b691e2a1f found in kube manager 2024-09-17 08:55:14,972 - INFO - Pod ctest-pod-65342993 verification passed 2024-09-17 08:55:14,972 - INFO - ================================================================================ 2024-09-17 08:55:14,972 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-17 08:55:14,973 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-17 08:55:15,219 - DEBUG - Nothing to compare xmpp stats {'10.0.0.32': {'10.0.0.36': '0'}} with 2024-09-17 08:55:15,219 - INFO - Initial checks done. Running the testcase now 2024-09-17 08:55:15,219 - INFO - 2024-09-17 08:55:15,279 - DEBUG - [Pod ctest-pod-41843337] Cmd: echo ctest-pod-41843337 > /usr/share/nginx/html/index.html, Output: 2024-09-17 08:55:15,340 - DEBUG - [Pod ctest-pod-22673875] Cmd: echo ctest-pod-22673875 > /usr/share/nginx/html/index.html, Output: 2024-09-17 08:55:15,412 - DEBUG - [Pod ctest-pod-36665229] Cmd: echo ctest-pod-36665229 > /usr/share/nginx/html/index.html, Output: 2024-09-17 08:55:15,488 - DEBUG - [Pod ctest-pod-65463358] Cmd: echo ctest-pod-65463358 > /usr/share/nginx/html/index.html, Output: 2024-09-17 08:55:15,492 - DEBUG - Service ctest-nginx-svc-25255871 not present 2024-09-17 08:55:15,493 - INFO - Creating service ctest-nginx-svc-25255871 2024-09-17 08:55:15,528 - INFO - Created Service ctest-nginx-svc-25255871 2024-09-17 08:55:15,545 - WARNING - Service UUID c235c12e-84f2-4da5-b27a-2273855c8a2d not yet found in contrail-api 2024-09-17 08:55:16,561 - INFO - Validated that Service ctest-nginx-svc-25255871 is seen in contrail-api 2024-09-17 08:55:16,562 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_LoadbalancerDatabaseList?x=c235c12e-84f2-4da5-b27a-2273855c8a2d 2024-09-17 08:55:16,568 - INFO - Service ctest-nginx-svc-25255871 with uuid c235c12e-84f2-4da5-b27a-2273855c8a2d found in kube manager 2024-09-17 08:55:16,570 - INFO - Service ctest-nginx-svc-25255871 verification passed 2024-09-17 08:55:17,680 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22673875 2024-09-17 08:55:17,680 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:55:17,680 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22673875 2024-09-17 08:55:17,744 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) ctest-pod-22673875 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:55:17,745 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:55:17,745 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) ctest-pod-22673875 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:55:17,806 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41843337 2024-09-17 08:55:17,806 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:55:17,806 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41843337 2024-09-17 08:55:17,806 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41843337': 1, 'ctest-pod-22673875': 2} 2024-09-17 08:55:17,887 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22673875 2024-09-17 08:55:17,887 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:55:17,887 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22673875 2024-09-17 08:55:17,947 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) ctest-pod-41843337 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:55:17,947 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:55:17,947 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) ctest-pod-41843337 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:55:17,947 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41843337': 1, 'ctest-pod-22673875': 1} 2024-09-17 08:55:17,951 - DEBUG - Network policy ingress-on-service not present 2024-09-17 08:55:17,952 - INFO - Creating Network Policy ingress-on-service 2024-09-17 08:55:17,970 - INFO - Network policy found in k8s 2024-09-17 08:55:17,970 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=caf968ba-523e-4bee-8a84-a791194ccfdc 2024-09-17 08:55:18,002 - INFO - Network Policy ingress-on-service with uuid caf968ba-523e-4bee-8a84-a791194ccfdc found in kube manager 2024-09-17 08:55:18,696 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-17 08:55:18,696 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-17 08:55:18,696 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=caf968ba-523e-4bee-8a84-a791194ccfdc 2024-09-17 08:55:18,726 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-17 08:55:20,727 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=caf968ba-523e-4bee-8a84-a791194ccfdc 2024-09-17 08:55:20,761 - INFO - Network policy with name ingress-on-service found in agent 2024-09-17 08:55:20,761 - INFO - Network Policy ingress-on-service verification passed 2024-09-17 08:55:25,820 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:25,820 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:25,820 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:30,890 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:30,890 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:30,890 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:35,964 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:35,964 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:35,965 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:41,034 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:41,034 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:41,034 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:46,096 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:46,096 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:46,096 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:51,168 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:51,168 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:51,168 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:56,222 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:56,222 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:55:56,222 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:01,282 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:01,282 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:01,282 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:06,342 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:06,342 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:06,342 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:11,406 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:11,406 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:11,406 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:11,406 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41843337': 0, 'ctest-pod-22673875': 0} 2024-09-17 08:56:11,470 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:56:11,470 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:56:11,470 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:56:11,530 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) ctest-pod-22673875 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:56:11,531 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:56:11,531 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) ctest-pod-22673875 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:56:11,594 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41843337 2024-09-17 08:56:11,594 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:56:11,594 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41843337 2024-09-17 08:56:11,594 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41843337': 1, 'ctest-pod-22673875': 2} 2024-09-17 08:56:16,661 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:16,661 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:16,661 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:21,715 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:21,715 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:21,715 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:26,773 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:26,773 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:26,773 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:31,830 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:31,830 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:31,830 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:36,893 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:36,893 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:36,893 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:41,963 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:41,963 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:41,963 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:47,463 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:47,464 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:47,464 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:52,518 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:52,519 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:52,519 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:57,583 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:57,583 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:56:57,583 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:02,648 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:02,648 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:02,648 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:02,648 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41843337': 0, 'ctest-pod-22673875': 0} 2024-09-17 08:57:04,702 - DEBUG - [Pod ctest-pod-47162072] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.869 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.337/0.869 ms 2024-09-17 08:57:04,703 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-47162072 with expectation True passed 2024-09-17 08:57:06,750 - DEBUG - [Pod ctest-pod-46811083] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.199 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.447/1.199 ms 2024-09-17 08:57:06,750 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-46811083 with expectation True passed 2024-09-17 08:57:08,823 - DEBUG - [Pod ctest-pod-59605251] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.736 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.298/0.736 ms 2024-09-17 08:57:08,823 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59605251 with expectation True passed 2024-09-17 08:57:08,878 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:57:08,878 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-17 08:57:08,878 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:57:08,878 - INFO - wget check of of http://10.47.255.251 from ctest-pod-47162072 passed 2024-09-17 08:57:08,935 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:57:08,935 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-17 08:57:08,935 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:57:08,935 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47162072 passed 2024-09-17 08:57:13,986 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 08:57:13,986 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 08:57:13,986 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 08:57:13,986 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46811083 passed 2024-09-17 08:57:19,054 - DEBUG - [Pod ctest-pod-65342993] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-17 08:57:19,054 - DEBUG - [Pod Pod ctest-pod-65342993] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-17 08:57:19,054 - DEBUG - [Pod Pod ctest-pod-65342993] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-17 08:57:19,054 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65342993 passed 2024-09-17 08:57:19,063 - INFO - Updating Network Policy ingress-on-service 2024-09-17 08:57:24,122 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:24,123 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:24,123 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:29,170 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:29,171 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:29,171 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:34,224 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:34,224 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:34,224 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:39,290 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:39,290 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:39,290 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:44,346 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:44,347 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:44,347 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:49,624 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:49,624 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:49,624 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:54,691 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:54,691 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:54,691 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:59,735 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:59,735 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:57:59,735 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:04,798 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:04,798 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:04,798 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:10,199 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:10,199 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:10,200 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.109.212.232:80 (10.109.212.232:80) wget: download timed out 2024-09-17 08:58:10,200 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41843337': 0, 'ctest-pod-22673875': 0} 2024-09-17 08:58:10,265 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,265 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,265 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,331 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,331 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,331 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,395 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,395 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,395 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,444 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,444 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,444 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,507 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-41843337 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,508 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,508 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: ctest-pod-41843337 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,508 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41843337': 1, 'ctest-pod-22673875': 4} 2024-09-17 08:58:10,578 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-41843337 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,579 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,579 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: ctest-pod-41843337 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,644 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-41843337 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,645 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,645 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: ctest-pod-41843337 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,722 - DEBUG - [Pod ctest-pod-59605251] Cmd: wget http://10.109.212.232:80/ -O - -T 5 -t 1 , Output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,723 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd wget http://10.109.212.232:80/ -O - -T 5 -t 1 passed 2024-09-17 08:58:10,723 - DEBUG - [Pod Pod ctest-pod-59605251] Cmd output: ctest-pod-22673875 Connecting to 10.109.212.232:80 (10.109.212.232:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 08:58:10,723 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41843337': 2, 'ctest-pod-22673875': 1} 2024-09-17 08:58:12,803 - DEBUG - [Pod ctest-pod-47162072] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.617 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.260/0.617 ms 2024-09-17 08:58:12,804 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-47162072 with expectation True passed 2024-09-17 08:58:14,852 - DEBUG - [Pod ctest-pod-46811083] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.685 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.274/0.685 ms 2024-09-17 08:58:14,852 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-46811083 with expectation True passed 2024-09-17 08:58:16,918 - DEBUG - [Pod ctest-pod-59605251] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.553 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.048 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.048/0.227/0.553 ms 2024-09-17 08:58:16,918 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59605251 with expectation True passed 2024-09-17 08:58:16,982 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:58:16,983 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-17 08:58:16,983 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:58:16,983 - INFO - wget check of of http://10.47.255.251 from ctest-pod-47162072 passed 2024-09-17 08:58:17,049 - DEBUG - [Pod ctest-pod-47162072] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:58:17,049 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-17 08:58:17,049 - DEBUG - [Pod Pod ctest-pod-47162072] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:58:17,049 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47162072 passed 2024-09-17 08:58:22,099 - DEBUG - [Pod ctest-pod-46811083] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 08:58:22,099 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 08:58:22,100 - DEBUG - [Pod Pod ctest-pod-46811083] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 08:58:22,100 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46811083 passed 2024-09-17 08:58:23,095 - DEBUG - [Pod ctest-pod-65342993] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:58:23,095 - DEBUG - [Pod Pod ctest-pod-65342993] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-17 08:58:23,095 - DEBUG - [Pod Pod ctest-pod-65342993] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 08:58:23,096 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65342993 passed 2024-09-17 08:58:23,096 - INFO - Deleting Network Policy : ingress-on-service 2024-09-17 08:58:23,096 - INFO - Deleting service : ctest-nginx-svc-25255871 2024-09-17 08:58:24,178 - DEBUG - No XMPP flaps were noticed during the test 2024-09-17 08:58:24,178 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2024-09-17 08:58:24,178 - INFO - -------------------------------------------------------------------------------- 2024-09-17 08:58:24,184 - INFO - Deleting pod ctest-new-default-37875047:ctest-pod-41843337 2024-09-17 08:58:24,185 - INFO - Deleting pod ctest-new-default-37875047:ctest-pod-22673875 2024-09-17 08:58:24,185 - INFO - Deleting pod ctest-non-default-50809476:ctest-pod-36665229 2024-09-17 08:58:24,185 - INFO - Deleting pod ctest-non-default-50809476:ctest-pod-65463358 2024-09-17 08:58:24,186 - INFO - Deleting pod ctest-new-default-37875047:ctest-pod-46811083 2024-09-17 08:58:24,186 - INFO - Deleting pod ctest-new-default-37875047:ctest-pod-47162072 2024-09-17 08:58:24,186 - INFO - Deleting pod ctest-non-default-50809476:ctest-pod-59605251 2024-09-17 08:58:24,187 - INFO - Deleting pod ctest-non-default-50809476:ctest-pod-65342993 2024-09-17 08:58:24,325 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,326 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,327 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,327 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,328 - WARNING - Pod uuid 089dd7d1-1550-456d-b474-1c8aee010b27 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,328 - WARNING - Pod uuid 9a23d5f5-d2d5-43cd-ae0a-a3aee43e33b7 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,330 - WARNING - Pod uuid 2a86ce89-ff60-4ff1-98d1-50f9c849af14 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:24,330 - WARNING - Pod uuid 72d65873-d6ec-4acf-88f2-6a9d17a5286b is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:29,359 - DEBUG - Pod 72d65873-d6ec-4acf-88f2-6a9d17a5286b is not in agent 10.0.0.32 VM list 2024-09-17 08:58:29,361 - DEBUG - Pod 2a86ce89-ff60-4ff1-98d1-50f9c849af14 is not in agent 10.0.0.32 VM list 2024-09-17 08:58:29,363 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:29,363 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:29,364 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:29,366 - DEBUG - Pod 9a23d5f5-d2d5-43cd-ae0a-a3aee43e33b7 is not in agent 10.0.0.32 VM list 2024-09-17 08:58:29,368 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:29,377 - DEBUG - VMI 80b147ee-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:29,377 - INFO - Verified that pod ctest-pod-36665229 is removed in agent 2024-09-17 08:58:29,378 - DEBUG - VMI 7f8a9a5a-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:29,378 - INFO - Verified that pod ctest-pod-22673875 is removed in agent 2024-09-17 08:58:29,379 - DEBUG - VMI 81a7bbce-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:29,379 - INFO - Verified that pod ctest-pod-65463358 is removed in agent 2024-09-17 08:58:30,081 - WARNING - Pod uuid 089dd7d1-1550-456d-b474-1c8aee010b27 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:34,388 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:34,388 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:34,389 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:34,390 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:35,699 - WARNING - Pod uuid 089dd7d1-1550-456d-b474-1c8aee010b27 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:39,415 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:39,415 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:39,416 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:39,417 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:40,714 - WARNING - Pod uuid 089dd7d1-1550-456d-b474-1c8aee010b27 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:44,436 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:44,437 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:44,439 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:44,439 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:45,721 - WARNING - Pod uuid 089dd7d1-1550-456d-b474-1c8aee010b27 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:49,454 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:49,454 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:49,456 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:49,456 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:50,730 - WARNING - Pod uuid 089dd7d1-1550-456d-b474-1c8aee010b27 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:54,473 - WARNING - Pod uuid 7fd35151-ade3-4936-a9c1-42a02f1dc218 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:54,475 - WARNING - Pod uuid 69903f80-3a40-493b-96ea-8b2104bf769c is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:54,476 - WARNING - Pod uuid 4277e832-fe80-457c-8805-245b691e2a1f is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:54,476 - WARNING - Pod uuid 5ef6d5ac-928f-41b3-831c-0379f22c4105 is still seen in agent 10.0.0.32 VM list 2024-09-17 08:58:55,746 - DEBUG - Pod 089dd7d1-1550-456d-b474-1c8aee010b27 is not in agent 10.0.0.32 VM list 2024-09-17 08:58:55,752 - DEBUG - VMI 7f0fdd38-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:55,752 - INFO - Verified that pod ctest-pod-41843337 is removed in agent 2024-09-17 08:58:59,501 - DEBUG - Pod 7fd35151-ade3-4936-a9c1-42a02f1dc218 is not in agent 10.0.0.32 VM list 2024-09-17 08:58:59,506 - DEBUG - Pod 5ef6d5ac-928f-41b3-831c-0379f22c4105 is not in agent 10.0.0.32 VM list 2024-09-17 08:58:59,508 - DEBUG - Pod 4277e832-fe80-457c-8805-245b691e2a1f is not in agent 10.0.0.32 VM list 2024-09-17 08:58:59,510 - DEBUG - Pod 69903f80-3a40-493b-96ea-8b2104bf769c is not in agent 10.0.0.32 VM list 2024-09-17 08:58:59,525 - DEBUG - VMI 835d146e-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:59,525 - INFO - Verified that pod ctest-pod-59605251 is removed in agent 2024-09-17 08:58:59,534 - DEBUG - VMI 83e91fea-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:59,534 - INFO - Verified that pod ctest-pod-65342993 is removed in agent 2024-09-17 08:58:59,536 - DEBUG - VMI 824361e6-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:59,536 - INFO - Verified that pod ctest-pod-46811083 is removed in agent 2024-09-17 08:58:59,537 - DEBUG - VMI 82d85260-74d2-11ef-b38c-fa163ea49b28 is removed from agent 10.0.0.32 2024-09-17 08:58:59,537 - INFO - Verified that pod ctest-pod-47162072 is removed in agent 2024-09-17 08:58:59,537 - INFO - Deleting namespace ctest-non-default-50809476 2024-09-17 08:58:59,548 - DEBUG - Namespace ctest-non-default-50809476 still in k8s 2024-09-17 08:59:01,552 - DEBUG - Namespace ctest-non-default-50809476 still in k8s 2024-09-17 08:59:03,795 - DEBUG - Namespace ctest-non-default-50809476 still in k8s 2024-09-17 08:59:05,799 - DEBUG - Namespace ctest-non-default-50809476 is not in k8s 2024-09-17 08:59:05,800 - DEBUG - No need to check project deletion in contrail-api 2024-09-17 08:59:05,800 - INFO - Deleting namespace ctest-new-default-37875047 2024-09-17 08:59:06,531 - DEBUG - Namespace ctest-new-default-37875047 still in k8s 2024-09-17 08:59:08,535 - DEBUG - Namespace ctest-new-default-37875047 still in k8s 2024-09-17 08:59:10,552 - DEBUG - Namespace ctest-new-default-37875047 still in k8s 2024-09-17 08:59:12,556 - DEBUG - Namespace ctest-new-default-37875047 is not in k8s 2024-09-17 08:59:12,556 - DEBUG - No need to check project deletion in contrail-api