2024-08-27 03:25:47,806 - INFO - Using existing project ['default-domain', 'k8s-default'](8ba1203a-8a38-42e9-872c-c2332468f2d9) 2024-08-27 03:25:47,828 - DEBUG - Namespace ctest-new-default-30089877 not present 2024-08-27 03:25:47,845 - INFO - Created namespace ctest-new-default-30089877 2024-08-27 03:25:50,850 - DEBUG - Namespace ctest-non-default-69128420 not present 2024-08-27 03:25:50,860 - INFO - Created namespace ctest-non-default-69128420 2024-08-27 03:25:53,882 - DEBUG - Pod ctest-pod-85171450 not present 2024-08-27 03:25:53,883 - INFO - Creating Pod ctest-pod-85171450 2024-08-27 03:25:53,907 - DEBUG - Pod : ctest-pod-85171450 UUID is 65e75a8f-0489-41ff-b883-3f84c036bc9b 2024-08-27 03:25:53,910 - DEBUG - Pod ctest-pod-36597773 not present 2024-08-27 03:25:53,910 - INFO - Creating Pod ctest-pod-36597773 2024-08-27 03:25:53,938 - DEBUG - Pod : ctest-pod-36597773 UUID is 25512fa1-5595-4592-9bca-a98c81cbf207 2024-08-27 03:25:53,940 - DEBUG - Pod ctest-pod-57399813 not present 2024-08-27 03:25:53,941 - INFO - Creating Pod ctest-pod-57399813 2024-08-27 03:25:53,961 - DEBUG - Pod : ctest-pod-57399813 UUID is f2e761d4-da18-4390-8ae5-1b1ebedfa569 2024-08-27 03:25:53,964 - DEBUG - Pod ctest-pod-27888377 not present 2024-08-27 03:25:53,965 - INFO - Creating Pod ctest-pod-27888377 2024-08-27 03:25:54,003 - DEBUG - Pod : ctest-pod-27888377 UUID is b3655fd9-6999-437e-88ba-c9fb46b8820f 2024-08-27 03:25:54,005 - DEBUG - Pod ctest-pod-60330645 not present 2024-08-27 03:25:54,005 - INFO - Creating Pod ctest-pod-60330645 2024-08-27 03:25:54,028 - DEBUG - Pod : ctest-pod-60330645 UUID is d7bb45af-1c30-4c20-93a0-7b90e66c875f 2024-08-27 03:25:54,031 - DEBUG - Pod ctest-pod-77608194 not present 2024-08-27 03:25:54,031 - INFO - Creating Pod ctest-pod-77608194 2024-08-27 03:25:54,048 - DEBUG - Pod : ctest-pod-77608194 UUID is e229c970-3723-4ef3-bacf-cd4907996d14 2024-08-27 03:25:54,050 - DEBUG - Pod ctest-pod-25923373 not present 2024-08-27 03:25:54,050 - INFO - Creating Pod ctest-pod-25923373 2024-08-27 03:25:54,070 - DEBUG - Pod : ctest-pod-25923373 UUID is 6367f3c1-3b7d-45a2-8f44-aa8ac938460a 2024-08-27 03:25:54,073 - DEBUG - Pod ctest-pod-95864177 not present 2024-08-27 03:25:54,073 - INFO - Creating Pod ctest-pod-95864177 2024-08-27 03:25:54,102 - DEBUG - Pod : ctest-pod-95864177 UUID is bcc4615a-8143-416f-932d-31e68ccada3a 2024-08-27 03:25:54,293 - INFO - Project default-domain:k8s-ctest-new-default-30089877 for Namespace ctest-new-default-30089877 is seen in contrail-api 2024-08-27 03:25:54,293 - DEBUG - Project uuid in Contrail is 32d88e4c-7e95-4c8f-9ebf-d4ffecd83929 2024-08-27 03:25:54,487 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=43869165-2666-4460-a5aa-e1768aa7b0da 2024-08-27 03:25:54,493 - INFO - Namespace ctest-new-default-30089877 with uuid 43869165-2666-4460-a5aa-e1768aa7b0da found in kube manager 2024-08-27 03:25:54,493 - INFO - Namespace ctest-new-default-30089877 verification passed 2024-08-27 03:25:54,702 - INFO - Project default-domain:k8s-ctest-non-default-69128420 for Namespace ctest-non-default-69128420 is seen in contrail-api 2024-08-27 03:25:54,703 - DEBUG - Project uuid in Contrail is 69d237e9-541a-4ba4-85f1-495edba9a46a 2024-08-27 03:25:54,703 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=d1c19d63-c9b8-4359-8691-a112c527ec67 2024-08-27 03:25:54,710 - INFO - Namespace ctest-non-default-69128420 with uuid d1c19d63-c9b8-4359-8691-a112c527ec67 found in kube manager 2024-08-27 03:25:54,710 - INFO - Namespace ctest-non-default-69128420 verification passed 2024-08-27 03:25:54,717 - DEBUG - Pod ctest-pod-85171450 not in running state.Currently in Pending 2024-08-27 03:25:59,726 - DEBUG - Pod ctest-pod-85171450 not in running state.Currently in Pending 2024-08-27 03:26:04,734 - DEBUG - Pod ctest-pod-85171450 not in running state.Currently in Pending 2024-08-27 03:26:09,742 - INFO - Pod ctest-pod-85171450 is in running state.Got IP 10.47.255.251 2024-08-27 03:26:09,755 - DEBUG - Pod ctest-pod-85171450 has vmi 120d45ae-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:09,755 - INFO - Verified pod ctest-pod-85171450 in contrail-api 2024-08-27 03:26:09,771 - DEBUG - VMI 120d45ae-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:09,771 - INFO - Verified Pod ctest-pod-85171450 in agent 10.0.0.52 2024-08-27 03:26:09,771 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=65e75a8f-0489-41ff-b883-3f84c036bc9b 2024-08-27 03:26:09,777 - INFO - Pod ctest-pod-85171450 with uuid 65e75a8f-0489-41ff-b883-3f84c036bc9b found in kube manager 2024-08-27 03:26:09,777 - INFO - Pod ctest-pod-85171450 verification passed 2024-08-27 03:26:09,783 - INFO - Pod ctest-pod-36597773 is in running state.Got IP 10.47.255.250 2024-08-27 03:26:09,796 - DEBUG - Pod ctest-pod-36597773 has vmi 12859f72-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:09,797 - INFO - Verified pod ctest-pod-36597773 in contrail-api 2024-08-27 03:26:09,812 - DEBUG - VMI 12859f72-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:09,812 - INFO - Verified Pod ctest-pod-36597773 in agent 10.0.0.52 2024-08-27 03:26:09,812 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=25512fa1-5595-4592-9bca-a98c81cbf207 2024-08-27 03:26:09,817 - INFO - Pod ctest-pod-36597773 with uuid 25512fa1-5595-4592-9bca-a98c81cbf207 found in kube manager 2024-08-27 03:26:09,817 - INFO - Pod ctest-pod-36597773 verification passed 2024-08-27 03:26:09,823 - INFO - Pod ctest-pod-57399813 is in running state.Got IP 10.47.255.249 2024-08-27 03:26:09,877 - DEBUG - Pod ctest-pod-57399813 has vmi 131d7496-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:09,877 - INFO - Verified pod ctest-pod-57399813 in contrail-api 2024-08-27 03:26:09,895 - DEBUG - VMI 131d7496-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:09,895 - INFO - Verified Pod ctest-pod-57399813 in agent 10.0.0.52 2024-08-27 03:26:09,896 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=f2e761d4-da18-4390-8ae5-1b1ebedfa569 2024-08-27 03:26:09,901 - INFO - Pod ctest-pod-57399813 with uuid f2e761d4-da18-4390-8ae5-1b1ebedfa569 found in kube manager 2024-08-27 03:26:09,901 - INFO - Pod ctest-pod-57399813 verification passed 2024-08-27 03:26:09,906 - INFO - Pod ctest-pod-27888377 is in running state.Got IP 10.47.255.248 2024-08-27 03:26:09,962 - DEBUG - Pod ctest-pod-27888377 has vmi 139cb116-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:09,962 - INFO - Verified pod ctest-pod-27888377 in contrail-api 2024-08-27 03:26:09,976 - DEBUG - VMI 139cb116-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:09,976 - INFO - Verified Pod ctest-pod-27888377 in agent 10.0.0.52 2024-08-27 03:26:09,976 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=b3655fd9-6999-437e-88ba-c9fb46b8820f 2024-08-27 03:26:09,981 - INFO - Pod ctest-pod-27888377 with uuid b3655fd9-6999-437e-88ba-c9fb46b8820f found in kube manager 2024-08-27 03:26:09,981 - INFO - Pod ctest-pod-27888377 verification passed 2024-08-27 03:26:09,987 - DEBUG - Pod ctest-pod-60330645 not in running state.Currently in Pending 2024-08-27 03:26:14,995 - INFO - Pod ctest-pod-60330645 is in running state.Got IP 10.47.255.247 2024-08-27 03:26:15,012 - DEBUG - Pod ctest-pod-60330645 has vmi 14241e6c-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:15,012 - INFO - Verified pod ctest-pod-60330645 in contrail-api 2024-08-27 03:26:15,026 - DEBUG - VMI 14241e6c-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:15,027 - INFO - Verified Pod ctest-pod-60330645 in agent 10.0.0.52 2024-08-27 03:26:15,027 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=d7bb45af-1c30-4c20-93a0-7b90e66c875f 2024-08-27 03:26:15,032 - INFO - Pod ctest-pod-60330645 with uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f found in kube manager 2024-08-27 03:26:15,032 - INFO - Pod ctest-pod-60330645 verification passed 2024-08-27 03:26:15,039 - INFO - Pod ctest-pod-25923373 is in running state.Got IP 10.47.255.245 2024-08-27 03:26:15,050 - DEBUG - Pod ctest-pod-25923373 has vmi 150cf2cc-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:15,050 - INFO - Verified pod ctest-pod-25923373 in contrail-api 2024-08-27 03:26:15,065 - DEBUG - VMI 150cf2cc-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:15,065 - INFO - Verified Pod ctest-pod-25923373 in agent 10.0.0.52 2024-08-27 03:26:15,065 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=6367f3c1-3b7d-45a2-8f44-aa8ac938460a 2024-08-27 03:26:15,071 - INFO - Pod ctest-pod-25923373 with uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a found in kube manager 2024-08-27 03:26:15,071 - INFO - Pod ctest-pod-25923373 verification passed 2024-08-27 03:26:15,077 - INFO - Pod ctest-pod-77608194 is in running state.Got IP 10.47.255.246 2024-08-27 03:26:15,132 - DEBUG - Pod ctest-pod-77608194 has vmi 149053de-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:15,132 - INFO - Verified pod ctest-pod-77608194 in contrail-api 2024-08-27 03:26:15,145 - DEBUG - VMI 149053de-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:15,145 - INFO - Verified Pod ctest-pod-77608194 in agent 10.0.0.52 2024-08-27 03:26:15,146 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=e229c970-3723-4ef3-bacf-cd4907996d14 2024-08-27 03:26:15,151 - INFO - Pod ctest-pod-77608194 with uuid e229c970-3723-4ef3-bacf-cd4907996d14 found in kube manager 2024-08-27 03:26:15,151 - INFO - Pod ctest-pod-77608194 verification passed 2024-08-27 03:26:15,157 - INFO - Pod ctest-pod-95864177 is in running state.Got IP 10.47.255.244 2024-08-27 03:26:15,218 - DEBUG - Pod ctest-pod-95864177 has vmi 158f46f0-6424-11ef-94dd-fa163e8d1c0b 2024-08-27 03:26:15,218 - INFO - Verified pod ctest-pod-95864177 in contrail-api 2024-08-27 03:26:15,232 - DEBUG - VMI 158f46f0-6424-11ef-94dd-fa163e8d1c0b is active in agent 10.0.0.52 2024-08-27 03:26:15,232 - INFO - Verified Pod ctest-pod-95864177 in agent 10.0.0.52 2024-08-27 03:26:15,232 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=bcc4615a-8143-416f-932d-31e68ccada3a 2024-08-27 03:26:15,237 - INFO - Pod ctest-pod-95864177 with uuid bcc4615a-8143-416f-932d-31e68ccada3a found in kube manager 2024-08-27 03:26:15,237 - INFO - Pod ctest-pod-95864177 verification passed 2024-08-27 03:26:15,237 - INFO - ================================================================================ 2024-08-27 03:26:15,237 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-27 03:26:15,237 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-27 03:26:15,492 - DEBUG - Nothing to compare xmpp stats {'10.0.0.52': {'10.0.0.33': '0'}} with 2024-08-27 03:26:15,493 - INFO - Initial checks done. Running the testcase now 2024-08-27 03:26:15,493 - INFO - 2024-08-27 03:26:15,552 - DEBUG - [Pod ctest-pod-85171450] Cmd: echo ctest-pod-85171450 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:26:15,609 - DEBUG - [Pod ctest-pod-36597773] Cmd: echo ctest-pod-36597773 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:26:15,681 - DEBUG - [Pod ctest-pod-57399813] Cmd: echo ctest-pod-57399813 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:26:15,752 - DEBUG - [Pod ctest-pod-27888377] Cmd: echo ctest-pod-27888377 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:26:15,755 - DEBUG - Service ctest-nginx-svc-91882194 not present 2024-08-27 03:26:15,755 - INFO - Creating service ctest-nginx-svc-91882194 2024-08-27 03:26:15,769 - INFO - Created Service ctest-nginx-svc-91882194 2024-08-27 03:26:15,774 - WARNING - Service UUID 4e1c945b-4597-43ec-8fc4-1f30b98e98b2 not yet found in contrail-api 2024-08-27 03:26:16,784 - INFO - Validated that Service ctest-nginx-svc-91882194 is seen in contrail-api 2024-08-27 03:26:16,784 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=4e1c945b-4597-43ec-8fc4-1f30b98e98b2 2024-08-27 03:26:16,790 - INFO - Service ctest-nginx-svc-91882194 with uuid 4e1c945b-4597-43ec-8fc4-1f30b98e98b2 found in kube manager 2024-08-27 03:26:16,790 - INFO - Service ctest-nginx-svc-91882194 verification passed 2024-08-27 03:26:17,868 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85171450 2024-08-27 03:26:17,868 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:26:17,869 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85171450 2024-08-27 03:26:17,931 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-36597773 2024-08-27 03:26:17,931 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:26:17,931 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-36597773 2024-08-27 03:26:17,931 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85171450': 1, 'ctest-pod-36597773': 1} 2024-08-27 03:26:17,992 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:26:17,992 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:26:17,992 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:26:18,046 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:26:18,047 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:26:18,047 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:26:18,104 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:26:18,104 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:26:18,104 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:26:18,104 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85171450': 1, 'ctest-pod-36597773': 2} 2024-08-27 03:26:18,109 - DEBUG - Network policy ingress-on-service not present 2024-08-27 03:26:18,110 - INFO - Creating Network Policy ingress-on-service 2024-08-27 03:26:18,126 - INFO - Network policy found in k8s 2024-08-27 03:26:18,127 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6b20d3a3-b442-4fa0-8788-8bb919395048 2024-08-27 03:26:18,132 - INFO - Network Policy ingress-on-service with uuid 6b20d3a3-b442-4fa0-8788-8bb919395048 found in kube manager 2024-08-27 03:26:18,172 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-27 03:26:18,173 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-27 03:26:18,173 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6b20d3a3-b442-4fa0-8788-8bb919395048 2024-08-27 03:26:18,205 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-27 03:26:20,206 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6b20d3a3-b442-4fa0-8788-8bb919395048 2024-08-27 03:26:20,244 - INFO - Network policy with name ingress-on-service found in agent 2024-08-27 03:26:20,244 - INFO - Network Policy ingress-on-service verification passed 2024-08-27 03:26:25,298 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:25,298 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:25,298 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:30,351 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:30,352 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:30,352 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:35,429 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:35,429 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:35,429 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:40,503 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:40,503 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:40,503 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:45,558 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:45,558 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:45,558 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:50,609 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:50,609 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:50,609 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:55,666 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:55,666 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:26:55,666 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:00,746 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:00,746 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:00,746 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:05,814 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:05,814 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:05,814 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:10,894 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:10,894 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:10,894 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:10,894 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-85171450': 0, 'ctest-pod-36597773': 0} 2024-08-27 03:27:10,963 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:27:10,963 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:27:10,963 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:27:11,030 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:27:11,031 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:27:11,031 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:27:11,031 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85171450': 1, 'ctest-pod-36597773': 1} 2024-08-27 03:27:16,107 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:16,107 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:16,107 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:21,162 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:21,162 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:21,162 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:26,211 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:26,212 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:26,212 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:31,277 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:31,277 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:31,277 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:36,363 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:36,364 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:36,364 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:41,425 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:41,425 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:41,425 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:46,487 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:46,487 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:46,488 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:51,565 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:51,565 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:51,565 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:56,622 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:56,622 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:27:56,622 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:01,693 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:01,693 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:01,693 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:01,693 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-85171450': 0, 'ctest-pod-36597773': 0} 2024-08-27 03:28:03,770 - DEBUG - [Pod ctest-pod-77608194] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.801 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.322/0.801 ms 2024-08-27 03:28:03,770 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-77608194 with expectation True passed 2024-08-27 03:28:05,837 - DEBUG - [Pod ctest-pod-60330645] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.015 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.389/1.015 ms 2024-08-27 03:28:05,838 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60330645 with expectation True passed 2024-08-27 03:28:07,902 - DEBUG - [Pod ctest-pod-25923373] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.869 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.335/0.869 ms 2024-08-27 03:28:07,902 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-25923373 with expectation True passed 2024-08-27 03:28:07,982 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:28:07,982 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:28:07,982 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:28:07,982 - INFO - wget check of of http://10.47.255.251 from ctest-pod-77608194 passed 2024-08-27 03:28:08,060 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:28:08,060 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:28:08,060 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:28:08,060 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77608194 passed 2024-08-27 03:28:13,125 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:28:13,125 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:28:13,125 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:28:13,125 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60330645 passed 2024-08-27 03:28:18,182 - DEBUG - [Pod ctest-pod-95864177] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-27 03:28:18,182 - DEBUG - [Pod Pod ctest-pod-95864177] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-27 03:28:18,182 - DEBUG - [Pod Pod ctest-pod-95864177] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-27 03:28:18,182 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95864177 passed 2024-08-27 03:28:18,195 - INFO - Updating Network Policy ingress-on-service 2024-08-27 03:28:23,260 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:23,261 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:23,261 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:28,328 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:28,328 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:28,328 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:33,390 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:33,390 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:33,390 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:38,461 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:38,461 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:38,461 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:43,534 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:43,534 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:43,534 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:48,593 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:48,593 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:48,593 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:53,662 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:53,662 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:53,662 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:58,733 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:58,733 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:28:58,734 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:03,797 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:03,797 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:03,797 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:08,871 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:08,871 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:08,871 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) wget: download timed out 2024-08-27 03:29:08,871 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-85171450': 0, 'ctest-pod-36597773': 0} 2024-08-27 03:29:08,943 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85171450 2024-08-27 03:29:08,943 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:29:08,943 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85171450 2024-08-27 03:29:09,016 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.217.142:80 (10.101.217.142:80) ctest-pod-85171450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,016 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:29:09,016 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: Connecting to 10.101.217.142:80 (10.101.217.142:80) ctest-pod-85171450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,088 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,088 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:29:09,088 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,088 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85171450': 2, 'ctest-pod-36597773': 1} 2024-08-27 03:29:09,169 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,169 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:29:09,169 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,232 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,232 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:29:09,232 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: ctest-pod-85171450 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,298 - DEBUG - [Pod ctest-pod-25923373] Cmd: wget http://10.101.217.142:80/ -O - -T 5 -t 1 , Output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,298 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd wget http://10.101.217.142:80/ -O - -T 5 -t 1 passed 2024-08-27 03:29:09,298 - DEBUG - [Pod Pod ctest-pod-25923373] Cmd output: ctest-pod-36597773 Connecting to 10.101.217.142:80 (10.101.217.142:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:29:09,298 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85171450': 2, 'ctest-pod-36597773': 1} 2024-08-27 03:29:11,372 - DEBUG - [Pod ctest-pod-77608194] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.909 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.353/0.909 ms 2024-08-27 03:29:11,372 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-77608194 with expectation True passed 2024-08-27 03:29:13,431 - DEBUG - [Pod ctest-pod-60330645] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.835 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.334/0.835 ms 2024-08-27 03:29:13,431 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60330645 with expectation True passed 2024-08-27 03:29:15,502 - DEBUG - [Pod ctest-pod-25923373] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.020 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.399/1.020 ms 2024-08-27 03:29:15,502 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-25923373 with expectation True passed 2024-08-27 03:29:15,578 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:29:15,579 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:29:15,579 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:29:15,579 - INFO - wget check of of http://10.47.255.251 from ctest-pod-77608194 passed 2024-08-27 03:29:15,656 - DEBUG - [Pod ctest-pod-77608194] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:29:15,656 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:29:15,656 - DEBUG - [Pod Pod ctest-pod-77608194] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:29:15,656 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77608194 passed 2024-08-27 03:29:20,727 - DEBUG - [Pod ctest-pod-60330645] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:29:20,727 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:29:20,727 - DEBUG - [Pod Pod ctest-pod-60330645] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:29:20,727 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60330645 passed 2024-08-27 03:29:20,776 - DEBUG - [Pod ctest-pod-95864177] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:29:20,776 - DEBUG - [Pod Pod ctest-pod-95864177] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:29:20,776 - DEBUG - [Pod Pod ctest-pod-95864177] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:29:20,776 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95864177 passed 2024-08-27 03:29:20,776 - INFO - Deleting Network Policy : ingress-on-service 2024-08-27 03:29:20,777 - INFO - Deleting service : ctest-nginx-svc-91882194 2024-08-27 03:29:21,041 - DEBUG - No XMPP flaps were noticed during the test
2024-08-27 03:29:21,041 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-08-27 03:29:21,041 - INFO - -------------------------------------------------------------------------------- 2024-08-27 03:29:21,047 - INFO - Deleting pod ctest-new-default-30089877:ctest-pod-85171450 2024-08-27 03:29:21,048 - INFO - Deleting pod ctest-new-default-30089877:ctest-pod-36597773 2024-08-27 03:29:21,049 - INFO - Deleting pod ctest-non-default-69128420:ctest-pod-57399813 2024-08-27 03:29:21,049 - INFO - Deleting pod ctest-non-default-69128420:ctest-pod-27888377 2024-08-27 03:29:21,050 - INFO - Deleting pod ctest-new-default-30089877:ctest-pod-60330645 2024-08-27 03:29:21,050 - INFO - Deleting pod ctest-new-default-30089877:ctest-pod-77608194 2024-08-27 03:29:21,051 - INFO - Deleting pod ctest-non-default-69128420:ctest-pod-25923373 2024-08-27 03:29:21,051 - INFO - Deleting pod ctest-non-default-69128420:ctest-pod-95864177 2024-08-27 03:29:21,231 - WARNING - Pod uuid 65e75a8f-0489-41ff-b883-3f84c036bc9b is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,231 - WARNING - Pod uuid 25512fa1-5595-4592-9bca-a98c81cbf207 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,233 - WARNING - Pod uuid f2e761d4-da18-4390-8ae5-1b1ebedfa569 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,233 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,234 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,234 - WARNING - Pod uuid b3655fd9-6999-437e-88ba-c9fb46b8820f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,235 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:21,235 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:26,264 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:26,267 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:26,268 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:26,268 - DEBUG - Pod 25512fa1-5595-4592-9bca-a98c81cbf207 is not in agent 10.0.0.52 VM list 2024-08-27 03:29:26,270 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:26,270 - DEBUG - Pod b3655fd9-6999-437e-88ba-c9fb46b8820f is not in agent 10.0.0.52 VM list 2024-08-27 03:29:26,272 - DEBUG - Pod f2e761d4-da18-4390-8ae5-1b1ebedfa569 is not in agent 10.0.0.52 VM list 2024-08-27 03:29:26,273 - DEBUG - Pod 65e75a8f-0489-41ff-b883-3f84c036bc9b is not in agent 10.0.0.52 VM list 2024-08-27 03:29:26,288 - DEBUG - VMI 12859f72-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:26,288 - INFO - Verified that pod ctest-pod-36597773 is removed in agent 2024-08-27 03:29:26,290 - DEBUG - VMI 139cb116-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:26,290 - INFO - Verified that pod ctest-pod-27888377 is removed in agent 2024-08-27 03:29:26,291 - DEBUG - VMI 131d7496-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:26,291 - INFO - Verified that pod ctest-pod-57399813 is removed in agent 2024-08-27 03:29:26,291 - DEBUG - VMI 120d45ae-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:26,291 - INFO - Verified that pod ctest-pod-85171450 is removed in agent 2024-08-27 03:29:31,286 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:31,291 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:31,292 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:31,293 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:36,301 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:36,310 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:36,311 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:36,312 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:41,311 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:41,327 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:41,327 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:41,329 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:46,320 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:46,344 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:46,346 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:46,346 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:51,392 - WARNING - Pod uuid bcc4615a-8143-416f-932d-31e68ccada3a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:51,395 - WARNING - Pod uuid d7bb45af-1c30-4c20-93a0-7b90e66c875f is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:51,395 - WARNING - Pod uuid e229c970-3723-4ef3-bacf-cd4907996d14 is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:51,396 - WARNING - Pod uuid 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is still seen in agent 10.0.0.52 VM list 2024-08-27 03:29:56,412 - DEBUG - Pod bcc4615a-8143-416f-932d-31e68ccada3a is not in agent 10.0.0.52 VM list 2024-08-27 03:29:56,416 - DEBUG - Pod d7bb45af-1c30-4c20-93a0-7b90e66c875f is not in agent 10.0.0.52 VM list 2024-08-27 03:29:56,418 - DEBUG - Pod e229c970-3723-4ef3-bacf-cd4907996d14 is not in agent 10.0.0.52 VM list 2024-08-27 03:29:56,419 - DEBUG - Pod 6367f3c1-3b7d-45a2-8f44-aa8ac938460a is not in agent 10.0.0.52 VM list 2024-08-27 03:29:56,433 - DEBUG - VMI 14241e6c-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:56,433 - INFO - Verified that pod ctest-pod-60330645 is removed in agent 2024-08-27 03:29:56,435 - DEBUG - VMI 150cf2cc-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:56,435 - INFO - Verified that pod ctest-pod-25923373 is removed in agent 2024-08-27 03:29:56,436 - DEBUG - VMI 149053de-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:56,436 - INFO - Verified that pod ctest-pod-77608194 is removed in agent 2024-08-27 03:29:56,436 - DEBUG - VMI 158f46f0-6424-11ef-94dd-fa163e8d1c0b is removed from agent 10.0.0.52 2024-08-27 03:29:56,436 - INFO - Verified that pod ctest-pod-95864177 is removed in agent 2024-08-27 03:29:56,436 - INFO - Deleting namespace ctest-non-default-69128420 2024-08-27 03:29:56,462 - DEBUG - Namespace ctest-non-default-69128420 still in k8s 2024-08-27 03:29:58,467 - DEBUG - Namespace ctest-non-default-69128420 still in k8s 2024-08-27 03:30:00,474 - DEBUG - Namespace ctest-non-default-69128420 still in k8s 2024-08-27 03:30:02,478 - DEBUG - Namespace ctest-non-default-69128420 is not in k8s 2024-08-27 03:30:02,479 - DEBUG - No need to check project deletion in contrail-api 2024-08-27 03:30:02,479 - INFO - Deleting namespace ctest-new-default-30089877 2024-08-27 03:30:02,489 - DEBUG - Namespace ctest-new-default-30089877 still in k8s 2024-08-27 03:30:04,494 - DEBUG - Namespace ctest-new-default-30089877 still in k8s 2024-08-27 03:30:06,501 - DEBUG - Namespace ctest-new-default-30089877 still in k8s 2024-08-27 03:30:08,506 - DEBUG - Namespace ctest-new-default-30089877 is not in k8s 2024-08-27 03:30:08,506 - DEBUG - No need to check project deletion in contrail-api