2024-10-19 17:45:10,664 - INFO - Using existing project ['default-domain', 'k8s-default'](063700e9-e1cd-4288-8123-14613a0f31df) 2024-10-19 17:45:10,685 - DEBUG - Namespace ctest-new-default-60332994 not present 2024-10-19 17:45:10,694 - INFO - Created namespace ctest-new-default-60332994 2024-10-19 17:45:13,698 - DEBUG - Namespace ctest-non-default-64796336 not present 2024-10-19 17:45:13,709 - INFO - Created namespace ctest-non-default-64796336 2024-10-19 17:45:16,730 - DEBUG - Pod ctest-pod-62429560 not present 2024-10-19 17:45:16,731 - INFO - Creating Pod ctest-pod-62429560 2024-10-19 17:45:16,764 - DEBUG - Pod : ctest-pod-62429560 UUID is 3c836726-fa62-449d-a091-df0aa3e7dd32 2024-10-19 17:45:16,768 - DEBUG - Pod ctest-pod-57184717 not present 2024-10-19 17:45:16,769 - INFO - Creating Pod ctest-pod-57184717 2024-10-19 17:45:16,804 - DEBUG - Pod : ctest-pod-57184717 UUID is c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d 2024-10-19 17:45:16,807 - DEBUG - Pod ctest-pod-01638984 not present 2024-10-19 17:45:16,807 - INFO - Creating Pod ctest-pod-01638984 2024-10-19 17:45:16,832 - DEBUG - Pod : ctest-pod-01638984 UUID is fc0d6b2b-a844-409f-83ac-279df42a194b 2024-10-19 17:45:16,836 - DEBUG - Pod ctest-pod-13400935 not present 2024-10-19 17:45:16,837 - INFO - Creating Pod ctest-pod-13400935 2024-10-19 17:45:16,876 - DEBUG - Pod : ctest-pod-13400935 UUID is 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c 2024-10-19 17:45:16,879 - DEBUG - Pod ctest-pod-83177514 not present 2024-10-19 17:45:16,879 - INFO - Creating Pod ctest-pod-83177514 2024-10-19 17:45:16,897 - DEBUG - Pod : ctest-pod-83177514 UUID is 95695d9f-4f03-470b-836c-e8f55b097150 2024-10-19 17:45:16,899 - DEBUG - Pod ctest-pod-27399550 not present 2024-10-19 17:45:16,899 - INFO - Creating Pod ctest-pod-27399550 2024-10-19 17:45:16,918 - DEBUG - Pod : ctest-pod-27399550 UUID is dafc9cf3-0785-464c-b29e-a1cc779f71db 2024-10-19 17:45:16,920 - DEBUG - Pod ctest-pod-67973534 not present 2024-10-19 17:45:16,920 - INFO - Creating Pod ctest-pod-67973534 2024-10-19 17:45:16,938 - DEBUG - Pod : ctest-pod-67973534 UUID is 897bbe83-56f3-4702-a487-8004c641f15f 2024-10-19 17:45:16,940 - DEBUG - Pod ctest-pod-61678341 not present 2024-10-19 17:45:16,940 - INFO - Creating Pod ctest-pod-61678341 2024-10-19 17:45:16,957 - DEBUG - Pod : ctest-pod-61678341 UUID is 8eb38753-9d19-47b9-880a-31259b521f96 2024-10-19 17:45:17,182 - INFO - Project default-domain:k8s-ctest-new-default-60332994 for Namespace ctest-new-default-60332994 is seen in contrail-api 2024-10-19 17:45:17,182 - DEBUG - Project uuid in Contrail is 12b4cc53-3b89-4f89-8e80-044e74aecb9b 2024-10-19 17:45:17,376 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=42037d91-3c38-4255-8b2b-2f9738dd3d92 2024-10-19 17:45:17,398 - INFO - Namespace ctest-new-default-60332994 with uuid 42037d91-3c38-4255-8b2b-2f9738dd3d92 found in kube manager 2024-10-19 17:45:17,398 - INFO - Namespace ctest-new-default-60332994 verification passed 2024-10-19 17:45:17,614 - INFO - Project default-domain:k8s-ctest-non-default-64796336 for Namespace ctest-non-default-64796336 is seen in contrail-api 2024-10-19 17:45:17,615 - DEBUG - Project uuid in Contrail is c8e2f6cf-ca4f-49c9-9aa0-7bd8786fe80c 2024-10-19 17:45:17,615 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=32277304-320a-4480-a6c3-2092b71c91f3 2024-10-19 17:45:17,620 - INFO - Namespace ctest-non-default-64796336 with uuid 32277304-320a-4480-a6c3-2092b71c91f3 found in kube manager 2024-10-19 17:45:17,620 - INFO - Namespace ctest-non-default-64796336 verification passed 2024-10-19 17:45:17,626 - DEBUG - Pod ctest-pod-62429560 not in running state.Currently in Pending 2024-10-19 17:45:22,634 - DEBUG - Pod ctest-pod-62429560 not in running state.Currently in Pending 2024-10-19 17:45:27,641 - INFO - Pod ctest-pod-62429560 is in running state.Got IP 10.47.255.251 2024-10-19 17:45:27,712 - DEBUG - Pod ctest-pod-62429560 has vmi e7fb4a52-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:27,712 - INFO - Verified pod ctest-pod-62429560 in contrail-api 2024-10-19 17:45:27,725 - DEBUG - VMI e7fb4a52-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:27,726 - INFO - Verified Pod ctest-pod-62429560 in agent 10.0.0.29 2024-10-19 17:45:27,726 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=3c836726-fa62-449d-a091-df0aa3e7dd32 2024-10-19 17:45:27,732 - INFO - Pod ctest-pod-62429560 with uuid 3c836726-fa62-449d-a091-df0aa3e7dd32 found in kube manager 2024-10-19 17:45:27,732 - INFO - Pod ctest-pod-62429560 verification passed 2024-10-19 17:45:27,745 - DEBUG - Pod ctest-pod-57184717 not in running state.Currently in Pending 2024-10-19 17:45:32,754 - INFO - Pod ctest-pod-57184717 is in running state.Got IP 10.47.255.250 2024-10-19 17:45:32,781 - DEBUG - Pod ctest-pod-57184717 has vmi e892d124-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:32,781 - INFO - Verified pod ctest-pod-57184717 in contrail-api 2024-10-19 17:45:32,795 - DEBUG - VMI e892d124-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:32,796 - INFO - Verified Pod ctest-pod-57184717 in agent 10.0.0.29 2024-10-19 17:45:32,796 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d 2024-10-19 17:45:32,804 - INFO - Pod ctest-pod-57184717 with uuid c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d found in kube manager 2024-10-19 17:45:32,804 - INFO - Pod ctest-pod-57184717 verification passed 2024-10-19 17:45:32,813 - DEBUG - Pod ctest-pod-01638984 not in running state.Currently in Pending 2024-10-19 17:45:37,819 - INFO - Pod ctest-pod-01638984 is in running state.Got IP 10.47.255.249 2024-10-19 17:45:37,841 - DEBUG - Pod ctest-pod-01638984 has vmi e9581b0a-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:37,841 - INFO - Verified pod ctest-pod-01638984 in contrail-api 2024-10-19 17:45:37,855 - DEBUG - VMI e9581b0a-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:37,855 - INFO - Verified Pod ctest-pod-01638984 in agent 10.0.0.29 2024-10-19 17:45:37,855 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=fc0d6b2b-a844-409f-83ac-279df42a194b 2024-10-19 17:45:37,861 - INFO - Pod ctest-pod-01638984 with uuid fc0d6b2b-a844-409f-83ac-279df42a194b found in kube manager 2024-10-19 17:45:37,861 - INFO - Pod ctest-pod-01638984 verification passed 2024-10-19 17:45:37,866 - INFO - Pod ctest-pod-13400935 is in running state.Got IP 10.47.255.248 2024-10-19 17:45:37,929 - DEBUG - Pod ctest-pod-13400935 has vmi e9e7f5e0-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:37,929 - INFO - Verified pod ctest-pod-13400935 in contrail-api 2024-10-19 17:45:37,944 - DEBUG - VMI e9e7f5e0-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:37,944 - INFO - Verified Pod ctest-pod-13400935 in agent 10.0.0.29 2024-10-19 17:45:37,944 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c 2024-10-19 17:45:37,950 - INFO - Pod ctest-pod-13400935 with uuid 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c found in kube manager 2024-10-19 17:45:37,950 - INFO - Pod ctest-pod-13400935 verification passed 2024-10-19 17:45:37,956 - INFO - Pod ctest-pod-83177514 is in running state.Got IP 10.47.255.247 2024-10-19 17:45:38,020 - DEBUG - Pod ctest-pod-83177514 has vmi ea86be1e-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:38,020 - INFO - Verified pod ctest-pod-83177514 in contrail-api 2024-10-19 17:45:38,036 - DEBUG - VMI ea86be1e-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:38,037 - INFO - Verified Pod ctest-pod-83177514 in agent 10.0.0.29 2024-10-19 17:45:38,037 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=95695d9f-4f03-470b-836c-e8f55b097150 2024-10-19 17:45:38,042 - INFO - Pod ctest-pod-83177514 with uuid 95695d9f-4f03-470b-836c-e8f55b097150 found in kube manager 2024-10-19 17:45:38,042 - INFO - Pod ctest-pod-83177514 verification passed 2024-10-19 17:45:38,048 - INFO - Pod ctest-pod-67973534 is in running state.Got IP 10.47.255.245 2024-10-19 17:45:38,082 - DEBUG - Pod ctest-pod-67973534 has vmi eb91216e-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:38,082 - INFO - Verified pod ctest-pod-67973534 in contrail-api 2024-10-19 17:45:38,098 - DEBUG - VMI eb91216e-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:38,099 - INFO - Verified Pod ctest-pod-67973534 in agent 10.0.0.29 2024-10-19 17:45:38,099 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=897bbe83-56f3-4702-a487-8004c641f15f 2024-10-19 17:45:38,106 - INFO - Pod ctest-pod-67973534 with uuid 897bbe83-56f3-4702-a487-8004c641f15f found in kube manager 2024-10-19 17:45:38,107 - INFO - Pod ctest-pod-67973534 verification passed 2024-10-19 17:45:38,114 - INFO - Pod ctest-pod-27399550 is in running state.Got IP 10.47.255.246 2024-10-19 17:45:38,178 - DEBUG - Pod ctest-pod-27399550 has vmi eb0a7aec-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:38,178 - INFO - Verified pod ctest-pod-27399550 in contrail-api 2024-10-19 17:45:38,193 - DEBUG - VMI eb0a7aec-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:38,193 - INFO - Verified Pod ctest-pod-27399550 in agent 10.0.0.29 2024-10-19 17:45:38,193 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=dafc9cf3-0785-464c-b29e-a1cc779f71db 2024-10-19 17:45:38,198 - INFO - Pod ctest-pod-27399550 with uuid dafc9cf3-0785-464c-b29e-a1cc779f71db found in kube manager 2024-10-19 17:45:38,199 - INFO - Pod ctest-pod-27399550 verification passed 2024-10-19 17:45:38,205 - INFO - Pod ctest-pod-61678341 is in running state.Got IP 10.47.255.244 2024-10-19 17:45:38,268 - DEBUG - Pod ctest-pod-61678341 has vmi ec119c2c-8e41-11ef-8d05-fa163e118063 2024-10-19 17:45:38,268 - INFO - Verified pod ctest-pod-61678341 in contrail-api 2024-10-19 17:45:38,283 - DEBUG - VMI ec119c2c-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29 2024-10-19 17:45:38,283 - INFO - Verified Pod ctest-pod-61678341 in agent 10.0.0.29 2024-10-19 17:45:38,283 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=8eb38753-9d19-47b9-880a-31259b521f96 2024-10-19 17:45:38,288 - INFO - Pod ctest-pod-61678341 with uuid 8eb38753-9d19-47b9-880a-31259b521f96 found in kube manager 2024-10-19 17:45:38,288 - INFO - Pod ctest-pod-61678341 verification passed 2024-10-19 17:45:38,289 - INFO - ================================================================================ 2024-10-19 17:45:38,289 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-19 17:45:38,289 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-19 17:45:38,507 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.0.0.49': '0'}} with 2024-10-19 17:45:38,507 - INFO - Initial checks done. Running the testcase now 2024-10-19 17:45:38,507 - INFO - 2024-10-19 17:45:38,561 - DEBUG - [Pod ctest-pod-62429560] Cmd: echo ctest-pod-62429560 > /usr/share/nginx/html/index.html, Output: 2024-10-19 17:45:38,637 - DEBUG - [Pod ctest-pod-57184717] Cmd: echo ctest-pod-57184717 > /usr/share/nginx/html/index.html, Output: 2024-10-19 17:45:38,699 - DEBUG - [Pod ctest-pod-01638984] Cmd: echo ctest-pod-01638984 > /usr/share/nginx/html/index.html, Output: 2024-10-19 17:45:38,774 - DEBUG - [Pod ctest-pod-13400935] Cmd: echo ctest-pod-13400935 > /usr/share/nginx/html/index.html, Output: 2024-10-19 17:45:38,777 - DEBUG - Service ctest-nginx-svc-07663218 not present 2024-10-19 17:45:38,778 - INFO - Creating service ctest-nginx-svc-07663218 2024-10-19 17:45:38,800 - INFO - Created Service ctest-nginx-svc-07663218 2024-10-19 17:45:38,814 - WARNING - Service UUID 6f35216a-14a4-48fb-b26e-00e1980eb4ee not yet found in contrail-api 2024-10-19 17:45:39,822 - INFO - Validated that Service ctest-nginx-svc-07663218 is seen in contrail-api 2024-10-19 17:45:39,822 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=6f35216a-14a4-48fb-b26e-00e1980eb4ee 2024-10-19 17:45:39,828 - INFO - Service ctest-nginx-svc-07663218 with uuid 6f35216a-14a4-48fb-b26e-00e1980eb4ee found in kube manager 2024-10-19 17:45:39,828 - INFO - Service ctest-nginx-svc-07663218 verification passed 2024-10-19 17:45:40,916 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62429560 2024-10-19 17:45:40,916 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:45:40,917 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62429560 2024-10-19 17:45:40,981 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:45:40,981 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:45:40,981 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:45:40,981 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1} 2024-10-19 17:45:41,039 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62429560 2024-10-19 17:45:41,040 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:45:41,040 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62429560 2024-10-19 17:45:41,110 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:45:41,110 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:45:41,110 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:45:41,110 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1} 2024-10-19 17:45:41,114 - DEBUG - Network policy ingress-on-service not present 2024-10-19 17:45:41,114 - INFO - Creating Network Policy ingress-on-service 2024-10-19 17:45:41,130 - INFO - Network policy found in k8s 2024-10-19 17:45:41,130 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fdd00b2e-a69e-4538-b630-c67ffe226d2a 2024-10-19 17:45:41,151 - INFO - Network Policy ingress-on-service with uuid fdd00b2e-a69e-4538-b630-c67ffe226d2a found in kube manager 2024-10-19 17:45:41,202 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-19 17:45:41,203 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-19 17:45:41,203 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fdd00b2e-a69e-4538-b630-c67ffe226d2a 2024-10-19 17:45:41,238 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-19 17:45:43,239 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fdd00b2e-a69e-4538-b630-c67ffe226d2a 2024-10-19 17:45:43,274 - INFO - Network policy with name ingress-on-service found in agent 2024-10-19 17:45:43,274 - INFO - Network Policy ingress-on-service verification passed 2024-10-19 17:45:48,337 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:48,337 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:48,337 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:53,456 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:53,456 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:53,456 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:58,525 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:58,525 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:45:58,526 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:03,584 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:03,584 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:03,584 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:08,642 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:08,643 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:08,643 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:13,731 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:13,732 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:13,732 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:18,812 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:18,812 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:18,813 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:23,877 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:23,877 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:23,877 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:28,938 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:28,938 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:28,938 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:34,011 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:34,011 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:34,011 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:34,011 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62429560': 0, 'ctest-pod-57184717': 0} 2024-10-19 17:46:34,079 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-62429560 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:46:34,079 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:46:34,079 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-62429560 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:46:34,138 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:46:34,138 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:46:34,138 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:46:34,138 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1} 2024-10-19 17:46:39,201 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:39,201 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:39,201 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:44,267 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:44,268 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:44,268 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:49,329 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:49,329 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:49,329 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:54,393 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:54,393 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:54,393 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:59,471 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:59,471 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:46:59,471 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:04,523 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:04,523 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:04,523 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:09,596 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:09,596 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:09,596 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:14,654 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:14,655 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:14,655 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:19,712 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:19,712 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:19,712 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:24,778 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:24,778 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:24,778 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:24,778 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62429560': 0, 'ctest-pod-57184717': 0} 2024-10-19 17:47:26,839 - DEBUG - [Pod ctest-pod-27399550] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.832 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.338/0.832 ms 2024-10-19 17:47:26,839 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-27399550 with expectation True passed 2024-10-19 17:47:28,899 - DEBUG - [Pod ctest-pod-83177514] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.551 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.240/0.551 ms 2024-10-19 17:47:28,900 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83177514 with expectation True passed 2024-10-19 17:47:30,969 - DEBUG - [Pod ctest-pod-67973534] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.664 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.268/0.664 ms 2024-10-19 17:47:30,969 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67973534 with expectation True passed 2024-10-19 17:47:31,030 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:47:31,030 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-19 17:47:31,030 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:47:31,030 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27399550 passed 2024-10-19 17:47:31,093 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:47:31,093 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-19 17:47:31,093 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:47:31,093 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27399550 passed 2024-10-19 17:47:36,153 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 17:47:36,154 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 17:47:36,154 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 17:47:36,154 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83177514 passed 2024-10-19 17:47:41,223 - DEBUG - [Pod ctest-pod-61678341] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-19 17:47:41,223 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-19 17:47:41,224 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-19 17:47:41,224 - INFO - wget check of of http://10.47.255.251 from ctest-pod-61678341 passed 2024-10-19 17:47:41,238 - INFO - Updating Network Policy ingress-on-service 2024-10-19 17:47:46,322 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:46,322 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:46,322 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:51,383 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:51,383 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:51,383 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:56,450 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:56,450 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:47:56,450 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:01,519 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:01,520 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:01,520 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:06,587 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:06,587 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:06,587 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:11,646 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:11,646 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:11,646 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:16,715 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:16,716 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:16,716 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:21,774 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:21,774 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:21,774 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:26,824 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:26,824 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:26,824 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:31,900 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:31,900 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:31,900 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) wget: download timed out 2024-10-19 17:48:31,900 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62429560': 0, 'ctest-pod-57184717': 0} 2024-10-19 17:48:31,972 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:31,972 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:31,972 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,057 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-62429560 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,057 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,057 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-62429560 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,057 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1} 2024-10-19 17:48:32,111 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:48:32,112 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,112 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:48:32,169 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,170 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,170 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,217 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,218 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,218 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,264 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,264 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,264 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,314 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,314 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,314 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717 Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 17:48:32,365 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:48:32,365 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,365 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57184717 2024-10-19 17:48:32,412 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62429560 2024-10-19 17:48:32,412 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed 2024-10-19 17:48:32,412 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62429560 2024-10-19 17:48:32,412 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 6} 2024-10-19 17:48:34,477 - DEBUG - [Pod ctest-pod-27399550] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.797 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.100 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.327/0.797 ms 2024-10-19 17:48:34,477 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-27399550 with expectation True passed 2024-10-19 17:48:36,548 - DEBUG - [Pod ctest-pod-83177514] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.927 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.065 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.354/0.927 ms 2024-10-19 17:48:36,548 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83177514 with expectation True passed 2024-10-19 17:48:38,629 - DEBUG - [Pod ctest-pod-67973534] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.268 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.064 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.064/0.469/1.268 ms 2024-10-19 17:48:38,629 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67973534 with expectation True passed 2024-10-19 17:48:38,689 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:48:38,690 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-19 17:48:38,690 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:48:38,690 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27399550 passed 2024-10-19 17:48:38,766 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:48:38,767 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-19 17:48:38,767 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:48:38,767 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27399550 passed 2024-10-19 17:48:43,828 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 17:48:43,828 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 17:48:43,828 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 17:48:43,828 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83177514 passed 2024-10-19 17:48:43,896 - DEBUG - [Pod ctest-pod-61678341] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:48:43,896 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-19 17:48:43,897 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 17:48:43,897 - INFO - wget check of of http://10.47.255.251 from ctest-pod-61678341 passed 2024-10-19 17:48:43,897 - INFO - Deleting Network Policy : ingress-on-service 2024-10-19 17:48:43,897 - INFO - Deleting service : ctest-nginx-svc-07663218 2024-10-19 17:48:44,062 - DEBUG - No XMPP flaps were noticed during the test 2024-10-19 17:48:44,063 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-10-19 17:48:44,063 - INFO - -------------------------------------------------------------------------------- 2024-10-19 17:48:44,071 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-62429560 2024-10-19 17:48:44,073 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-57184717 2024-10-19 17:48:44,073 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-01638984 2024-10-19 17:48:44,074 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-13400935 2024-10-19 17:48:44,074 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-83177514 2024-10-19 17:48:44,075 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-27399550 2024-10-19 17:48:44,075 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-67973534 2024-10-19 17:48:44,076 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-61678341 2024-10-19 17:48:44,183 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,184 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,184 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,186 - WARNING - Pod uuid 3c836726-fa62-449d-a091-df0aa3e7dd32 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,200 - WARNING - Pod uuid c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,201 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,202 - WARNING - Pod uuid 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:44,202 - WARNING - Pod uuid fc0d6b2b-a844-409f-83ac-279df42a194b is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:49,198 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:49,211 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:49,211 - DEBUG - Pod 3c836726-fa62-449d-a091-df0aa3e7dd32 is not in agent 10.0.0.29 VM list 2024-10-19 17:48:49,213 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:49,226 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:49,227 - DEBUG - VMI e7fb4a52-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:48:49,227 - INFO - Verified that pod ctest-pod-62429560 is removed in agent 2024-10-19 17:48:49,229 - DEBUG - Pod 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c is not in agent 10.0.0.29 VM list 2024-10-19 17:48:49,230 - DEBUG - Pod fc0d6b2b-a844-409f-83ac-279df42a194b is not in agent 10.0.0.29 VM list 2024-10-19 17:48:49,232 - DEBUG - Pod c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d is not in agent 10.0.0.29 VM list 2024-10-19 17:48:49,244 - DEBUG - VMI e9e7f5e0-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:48:49,244 - INFO - Verified that pod ctest-pod-13400935 is removed in agent 2024-10-19 17:48:49,246 - DEBUG - VMI e9581b0a-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:48:49,246 - INFO - Verified that pod ctest-pod-01638984 is removed in agent 2024-10-19 17:48:49,247 - DEBUG - VMI e892d124-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:48:49,247 - INFO - Verified that pod ctest-pod-57184717 is removed in agent 2024-10-19 17:48:54,207 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:54,221 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:54,234 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:54,454 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:59,216 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:59,229 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:59,241 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:48:59,464 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:04,225 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:04,238 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:04,249 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:04,473 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:09,233 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:09,245 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:09,257 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:09,483 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:14,249 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:14,256 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:14,264 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:14,492 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list 2024-10-19 17:49:19,259 - DEBUG - Pod dafc9cf3-0785-464c-b29e-a1cc779f71db is not in agent 10.0.0.29 VM list 2024-10-19 17:49:19,270 - DEBUG - Pod 95695d9f-4f03-470b-836c-e8f55b097150 is not in agent 10.0.0.29 VM list 2024-10-19 17:49:19,273 - DEBUG - Pod 8eb38753-9d19-47b9-880a-31259b521f96 is not in agent 10.0.0.29 VM list 2024-10-19 17:49:19,274 - DEBUG - VMI eb0a7aec-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:49:19,274 - INFO - Verified that pod ctest-pod-27399550 is removed in agent 2024-10-19 17:49:19,281 - DEBUG - VMI ea86be1e-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:49:19,281 - INFO - Verified that pod ctest-pod-83177514 is removed in agent 2024-10-19 17:49:19,283 - DEBUG - VMI ec119c2c-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:49:19,283 - INFO - Verified that pod ctest-pod-61678341 is removed in agent 2024-10-19 17:49:19,500 - DEBUG - Pod 897bbe83-56f3-4702-a487-8004c641f15f is not in agent 10.0.0.29 VM list 2024-10-19 17:49:19,507 - DEBUG - VMI eb91216e-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29 2024-10-19 17:49:19,507 - INFO - Verified that pod ctest-pod-67973534 is removed in agent 2024-10-19 17:49:19,508 - INFO - Deleting namespace ctest-non-default-64796336 2024-10-19 17:49:19,528 - DEBUG - Namespace ctest-non-default-64796336 still in k8s 2024-10-19 17:49:21,534 - DEBUG - Namespace ctest-non-default-64796336 still in k8s 2024-10-19 17:49:23,539 - DEBUG - Namespace ctest-non-default-64796336 still in k8s 2024-10-19 17:49:25,544 - DEBUG - Namespace ctest-non-default-64796336 is not in k8s 2024-10-19 17:49:25,544 - DEBUG - No need to check project deletion in contrail-api 2024-10-19 17:49:25,544 - INFO - Deleting namespace ctest-new-default-60332994 2024-10-19 17:49:25,553 - DEBUG - Namespace ctest-new-default-60332994 still in k8s 2024-10-19 17:49:27,558 - DEBUG - Namespace ctest-new-default-60332994 still in k8s 2024-10-19 17:49:29,562 - DEBUG - Namespace ctest-new-default-60332994 still in k8s 2024-10-19 17:49:31,566 - DEBUG - Namespace ctest-new-default-60332994 is not in k8s 2024-10-19 17:49:31,567 - DEBUG - No need to check project deletion in contrail-api