2024-09-18 02:56:41,909 - INFO - Using existing project ['default-domain', 'k8s-default'](fa947c0e-3a42-43c1-84bb-b2666e098b36) 2024-09-18 02:56:41,933 - DEBUG - Namespace ctest-new-default-64669463 not present 2024-09-18 02:56:41,950 - INFO - Created namespace ctest-new-default-64669463 2024-09-18 02:56:44,953 - DEBUG - Namespace ctest-non-default-38507529 not present 2024-09-18 02:56:44,960 - INFO - Created namespace ctest-non-default-38507529 2024-09-18 02:56:47,989 - DEBUG - Pod ctest-pod-48434729 not present 2024-09-18 02:56:47,989 - INFO - Creating Pod ctest-pod-48434729 2024-09-18 02:56:48,022 - DEBUG - Pod : ctest-pod-48434729 UUID is e3685083-0248-474c-8f3c-0603b3772150 2024-09-18 02:56:48,025 - DEBUG - Pod ctest-pod-96764603 not present 2024-09-18 02:56:48,025 - INFO - Creating Pod ctest-pod-96764603 2024-09-18 02:56:48,086 - DEBUG - Pod : ctest-pod-96764603 UUID is a39c2ef5-0290-4b1d-b77d-4c4aa929fdac 2024-09-18 02:56:48,089 - DEBUG - Pod ctest-pod-28758751 not present 2024-09-18 02:56:48,089 - INFO - Creating Pod ctest-pod-28758751 2024-09-18 02:56:48,116 - DEBUG - Pod : ctest-pod-28758751 UUID is 78afe267-ced3-4e18-bbcb-178e59738ffd 2024-09-18 02:56:48,118 - DEBUG - Pod ctest-pod-91784360 not present 2024-09-18 02:56:48,119 - INFO - Creating Pod ctest-pod-91784360 2024-09-18 02:56:48,157 - DEBUG - Pod : ctest-pod-91784360 UUID is 80f8723c-206b-4a22-bafe-b849415dd771 2024-09-18 02:56:48,159 - DEBUG - Pod ctest-pod-21909770 not present 2024-09-18 02:56:48,159 - INFO - Creating Pod ctest-pod-21909770 2024-09-18 02:56:48,178 - DEBUG - Pod : ctest-pod-21909770 UUID is b5671d4c-c7b2-42b6-bb16-fe70abb15e0f 2024-09-18 02:56:48,181 - DEBUG - Pod ctest-pod-87040047 not present 2024-09-18 02:56:48,181 - INFO - Creating Pod ctest-pod-87040047 2024-09-18 02:56:48,200 - DEBUG - Pod : ctest-pod-87040047 UUID is 670186ef-ff4f-4cdf-8275-bf4085250a5a 2024-09-18 02:56:48,203 - DEBUG - Pod ctest-pod-55489328 not present 2024-09-18 02:56:48,203 - INFO - Creating Pod ctest-pod-55489328 2024-09-18 02:56:48,226 - DEBUG - Pod : ctest-pod-55489328 UUID is 83450e63-253c-4dd5-9616-61671ef48efd 2024-09-18 02:56:48,228 - DEBUG - Pod ctest-pod-66474418 not present 2024-09-18 02:56:48,228 - INFO - Creating Pod ctest-pod-66474418 2024-09-18 02:56:48,244 - DEBUG - Pod : ctest-pod-66474418 UUID is bf683d53-69f5-4be3-8b41-59c8a2ecb980 2024-09-18 02:56:48,441 - INFO - Project default-domain:k8s-ctest-new-default-64669463 for Namespace ctest-new-default-64669463 is seen in contrail-api 2024-09-18 02:56:48,441 - DEBUG - Project uuid in Contrail is a87f7a2f-a22d-468b-bb49-82f02d58209d 2024-09-18 02:56:48,569 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=9b225c1b-90a2-4954-a1b3-d91e22797785 2024-09-18 02:56:48,574 - INFO - Namespace ctest-new-default-64669463 with uuid 9b225c1b-90a2-4954-a1b3-d91e22797785 found in kube manager 2024-09-18 02:56:48,574 - INFO - Namespace ctest-new-default-64669463 verification passed 2024-09-18 02:56:48,849 - INFO - Project default-domain:k8s-ctest-non-default-38507529 for Namespace ctest-non-default-38507529 is seen in contrail-api 2024-09-18 02:56:48,849 - DEBUG - Project uuid in Contrail is 2412c6e0-07d7-4a18-aa95-87f439118eb9 2024-09-18 02:56:48,849 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=9e3771cd-d692-4d77-9ecd-3a00698d911c 2024-09-18 02:56:48,853 - INFO - Namespace ctest-non-default-38507529 with uuid 9e3771cd-d692-4d77-9ecd-3a00698d911c found in kube manager 2024-09-18 02:56:48,853 - INFO - Namespace ctest-non-default-38507529 verification passed 2024-09-18 02:56:48,858 - DEBUG - Pod ctest-pod-48434729 not in running state.Currently in Pending 2024-09-18 02:56:53,863 - DEBUG - Pod ctest-pod-48434729 not in running state.Currently in Pending 2024-09-18 02:56:58,869 - DEBUG - Pod ctest-pod-48434729 not in running state.Currently in Pending 2024-09-18 02:57:03,874 - INFO - Pod ctest-pod-48434729 is in running state.Got IP 10.47.255.251 2024-09-18 02:57:03,905 - DEBUG - Pod ctest-pod-48434729 has vmi a6acc72e-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:03,905 - INFO - Verified pod ctest-pod-48434729 in contrail-api 2024-09-18 02:57:03,924 - DEBUG - VMI a6acc72e-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:03,925 - INFO - Verified Pod ctest-pod-48434729 in agent 10.0.0.45 2024-09-18 02:57:03,925 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=e3685083-0248-474c-8f3c-0603b3772150 2024-09-18 02:57:03,932 - INFO - Pod ctest-pod-48434729 with uuid e3685083-0248-474c-8f3c-0603b3772150 found in kube manager 2024-09-18 02:57:03,932 - INFO - Pod ctest-pod-48434729 verification passed 2024-09-18 02:57:03,938 - INFO - Pod ctest-pod-96764603 is in running state.Got IP 10.47.255.250 2024-09-18 02:57:04,004 - DEBUG - Pod ctest-pod-96764603 has vmi a72ad628-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:04,004 - INFO - Verified pod ctest-pod-96764603 in contrail-api 2024-09-18 02:57:04,018 - DEBUG - VMI a72ad628-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:04,018 - INFO - Verified Pod ctest-pod-96764603 in agent 10.0.0.45 2024-09-18 02:57:04,018 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=a39c2ef5-0290-4b1d-b77d-4c4aa929fdac 2024-09-18 02:57:04,023 - INFO - Pod ctest-pod-96764603 with uuid a39c2ef5-0290-4b1d-b77d-4c4aa929fdac found in kube manager 2024-09-18 02:57:04,023 - INFO - Pod ctest-pod-96764603 verification passed 2024-09-18 02:57:04,030 - INFO - Pod ctest-pod-28758751 is in running state.Got IP 10.47.255.249 2024-09-18 02:57:04,049 - DEBUG - Pod ctest-pod-28758751 has vmi a7d1bc68-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:04,049 - INFO - Verified pod ctest-pod-28758751 in contrail-api 2024-09-18 02:57:04,071 - DEBUG - VMI a7d1bc68-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:04,071 - INFO - Verified Pod ctest-pod-28758751 in agent 10.0.0.45 2024-09-18 02:57:04,071 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=78afe267-ced3-4e18-bbcb-178e59738ffd 2024-09-18 02:57:04,078 - INFO - Pod ctest-pod-28758751 with uuid 78afe267-ced3-4e18-bbcb-178e59738ffd found in kube manager 2024-09-18 02:57:04,078 - INFO - Pod ctest-pod-28758751 verification passed 2024-09-18 02:57:04,083 - INFO - Pod ctest-pod-91784360 is in running state.Got IP 10.47.255.248 2024-09-18 02:57:04,145 - DEBUG - Pod ctest-pod-91784360 has vmi a849f386-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:04,145 - INFO - Verified pod ctest-pod-91784360 in contrail-api 2024-09-18 02:57:04,162 - DEBUG - VMI a849f386-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:04,162 - INFO - Verified Pod ctest-pod-91784360 in agent 10.0.0.45 2024-09-18 02:57:04,162 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=80f8723c-206b-4a22-bafe-b849415dd771 2024-09-18 02:57:04,173 - INFO - Pod ctest-pod-91784360 with uuid 80f8723c-206b-4a22-bafe-b849415dd771 found in kube manager 2024-09-18 02:57:04,174 - INFO - Pod ctest-pod-91784360 verification passed 2024-09-18 02:57:04,184 - INFO - Pod ctest-pod-21909770 is in running state.Got IP 10.47.255.247 2024-09-18 02:57:04,205 - DEBUG - Pod ctest-pod-21909770 has vmi a8debb6a-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:04,205 - INFO - Verified pod ctest-pod-21909770 in contrail-api 2024-09-18 02:57:04,218 - DEBUG - VMI a8debb6a-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:04,219 - INFO - Verified Pod ctest-pod-21909770 in agent 10.0.0.45 2024-09-18 02:57:04,219 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=b5671d4c-c7b2-42b6-bb16-fe70abb15e0f 2024-09-18 02:57:04,227 - INFO - Pod ctest-pod-21909770 with uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f found in kube manager 2024-09-18 02:57:04,227 - INFO - Pod ctest-pod-21909770 verification passed 2024-09-18 02:57:04,233 - INFO - Pod ctest-pod-55489328 is in running state.Got IP 10.47.255.245 2024-09-18 02:57:04,313 - DEBUG - Pod ctest-pod-55489328 has vmi a9cf26cc-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:04,313 - INFO - Verified pod ctest-pod-55489328 in contrail-api 2024-09-18 02:57:04,328 - DEBUG - VMI a9cf26cc-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:04,328 - INFO - Verified Pod ctest-pod-55489328 in agent 10.0.0.45 2024-09-18 02:57:04,328 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=83450e63-253c-4dd5-9616-61671ef48efd 2024-09-18 02:57:04,333 - INFO - Pod ctest-pod-55489328 with uuid 83450e63-253c-4dd5-9616-61671ef48efd found in kube manager 2024-09-18 02:57:04,333 - INFO - Pod ctest-pod-55489328 verification passed 2024-09-18 02:57:04,338 - DEBUG - Pod ctest-pod-87040047 not in running state.Currently in Pending 2024-09-18 02:57:09,345 - INFO - Pod ctest-pod-87040047 is in running state.Got IP 10.47.255.246 2024-09-18 02:57:09,367 - DEBUG - Pod ctest-pod-87040047 has vmi a9582b08-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:09,367 - INFO - Verified pod ctest-pod-87040047 in contrail-api 2024-09-18 02:57:09,380 - DEBUG - VMI a9582b08-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:09,381 - INFO - Verified Pod ctest-pod-87040047 in agent 10.0.0.45 2024-09-18 02:57:09,381 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=670186ef-ff4f-4cdf-8275-bf4085250a5a 2024-09-18 02:57:09,385 - INFO - Pod ctest-pod-87040047 with uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a found in kube manager 2024-09-18 02:57:09,385 - INFO - Pod ctest-pod-87040047 verification passed 2024-09-18 02:57:09,390 - INFO - Pod ctest-pod-66474418 is in running state.Got IP 10.47.255.244 2024-09-18 02:57:09,449 - DEBUG - Pod ctest-pod-66474418 has vmi aa45ae82-7569-11ef-8b3d-fa163e4fbb18 2024-09-18 02:57:09,449 - INFO - Verified pod ctest-pod-66474418 in contrail-api 2024-09-18 02:57:09,465 - DEBUG - VMI aa45ae82-7569-11ef-8b3d-fa163e4fbb18 is active in agent 10.0.0.45 2024-09-18 02:57:09,466 - INFO - Verified Pod ctest-pod-66474418 in agent 10.0.0.45 2024-09-18 02:57:09,466 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=bf683d53-69f5-4be3-8b41-59c8a2ecb980 2024-09-18 02:57:09,471 - INFO - Pod ctest-pod-66474418 with uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 found in kube manager 2024-09-18 02:57:09,472 - INFO - Pod ctest-pod-66474418 verification passed 2024-09-18 02:57:09,472 - INFO - ================================================================================ 2024-09-18 02:57:09,472 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-18 02:57:09,472 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-18 02:57:09,663 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.34': '0'}} with 2024-09-18 02:57:09,663 - INFO - Initial checks done. Running the testcase now 2024-09-18 02:57:09,663 - INFO - 2024-09-18 02:57:09,721 - DEBUG - [Pod ctest-pod-48434729] Cmd: echo ctest-pod-48434729 > /usr/share/nginx/html/index.html, Output: 2024-09-18 02:57:09,781 - DEBUG - [Pod ctest-pod-96764603] Cmd: echo ctest-pod-96764603 > /usr/share/nginx/html/index.html, Output: 2024-09-18 02:57:09,852 - DEBUG - [Pod ctest-pod-28758751] Cmd: echo ctest-pod-28758751 > /usr/share/nginx/html/index.html, Output: 2024-09-18 02:57:09,909 - DEBUG - [Pod ctest-pod-91784360] Cmd: echo ctest-pod-91784360 > /usr/share/nginx/html/index.html, Output: 2024-09-18 02:57:09,914 - DEBUG - Service ctest-nginx-svc-09057866 not present 2024-09-18 02:57:09,914 - INFO - Creating service ctest-nginx-svc-09057866 2024-09-18 02:57:09,926 - INFO - Created Service ctest-nginx-svc-09057866 2024-09-18 02:57:09,935 - WARNING - Service UUID 91edf00b-5ee9-4cb6-8532-8af5d2b337d8 not yet found in contrail-api 2024-09-18 02:57:10,949 - INFO - Validated that Service ctest-nginx-svc-09057866 is seen in contrail-api 2024-09-18 02:57:10,957 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_LoadbalancerDatabaseList?x=91edf00b-5ee9-4cb6-8532-8af5d2b337d8 2024-09-18 02:57:10,975 - INFO - Service ctest-nginx-svc-09057866 with uuid 91edf00b-5ee9-4cb6-8532-8af5d2b337d8 found in kube manager 2024-09-18 02:57:10,975 - INFO - Service ctest-nginx-svc-09057866 verification passed 2024-09-18 02:57:12,051 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96764603 2024-09-18 02:57:12,051 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:57:12,051 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96764603 2024-09-18 02:57:12,106 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:57:12,107 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:57:12,107 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:57:12,107 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48434729': 1, 'ctest-pod-96764603': 1} 2024-09-18 02:57:12,181 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:57:12,181 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:57:12,181 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:57:12,267 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) ctest-pod-96764603 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:57:12,267 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:57:12,267 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) ctest-pod-96764603 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:57:12,267 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48434729': 1, 'ctest-pod-96764603': 1} 2024-09-18 02:57:12,270 - DEBUG - Network policy ingress-on-service not present 2024-09-18 02:57:12,271 - INFO - Creating Network Policy ingress-on-service 2024-09-18 02:57:12,288 - INFO - Network policy found in k8s 2024-09-18 02:57:12,288 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=93479708-fd31-4283-b317-8a9fd41eddb6 2024-09-18 02:57:12,308 - INFO - Network Policy ingress-on-service with uuid 93479708-fd31-4283-b317-8a9fd41eddb6 found in kube manager 2024-09-18 02:57:12,343 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-18 02:57:12,344 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-18 02:57:12,344 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=93479708-fd31-4283-b317-8a9fd41eddb6 2024-09-18 02:57:12,391 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-18 02:57:14,391 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=93479708-fd31-4283-b317-8a9fd41eddb6 2024-09-18 02:57:14,428 - INFO - Network policy with name ingress-on-service found in agent 2024-09-18 02:57:14,428 - INFO - Network Policy ingress-on-service verification passed 2024-09-18 02:57:19,487 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:19,488 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:19,488 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:24,550 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:24,551 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:24,551 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:29,622 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:29,622 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:29,622 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:34,684 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:34,684 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:34,685 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:39,743 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:39,743 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:39,743 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:44,819 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:44,819 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:44,819 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:49,863 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:49,863 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:49,863 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:54,924 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:54,924 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:54,924 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:59,987 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:59,987 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:57:59,987 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:05,052 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:05,053 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:05,053 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:05,053 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48434729': 0, 'ctest-pod-96764603': 0} 2024-09-18 02:58:05,126 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:58:05,126 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:58:05,126 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:58:05,179 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:58:05,179 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:58:05,179 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:58:05,253 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:58:05,253 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 02:58:05,254 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 02:58:05,254 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48434729': 1, 'ctest-pod-96764603': 2} 2024-09-18 02:58:10,321 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:10,321 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:10,321 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:15,389 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:15,389 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:15,389 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:20,459 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:20,459 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:20,460 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:25,525 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:25,525 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:25,525 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:30,595 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:30,595 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:30,595 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:35,675 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:35,675 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:35,675 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:40,727 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:40,727 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:40,727 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:45,930 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:45,930 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:45,930 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:50,983 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:50,983 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:50,983 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:56,036 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:56,036 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:56,036 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:58:56,036 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48434729': 0, 'ctest-pod-96764603': 0} 2024-09-18 02:58:58,088 - DEBUG - [Pod ctest-pod-87040047] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.209 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.455/1.209 ms 2024-09-18 02:58:58,088 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-87040047 with expectation True passed 2024-09-18 02:59:00,150 - DEBUG - [Pod ctest-pod-21909770] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=7.160 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/2.442/7.160 ms 2024-09-18 02:59:00,150 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21909770 with expectation True passed 2024-09-18 02:59:02,222 - DEBUG - [Pod ctest-pod-55489328] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.842 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.329/0.842 ms 2024-09-18 02:59:02,223 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-55489328 with expectation True passed 2024-09-18 02:59:02,296 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 02:59:02,296 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 02:59:02,296 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 02:59:02,296 - INFO - wget check of of http://10.47.255.251 from ctest-pod-87040047 passed 2024-09-18 02:59:02,357 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 02:59:02,357 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 02:59:02,357 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 02:59:02,357 - INFO - wget check of of http://10.47.255.250 from ctest-pod-87040047 passed 2024-09-18 02:59:07,410 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 02:59:07,411 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 02:59:07,411 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 02:59:07,411 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21909770 passed 2024-09-18 02:59:12,476 - DEBUG - [Pod ctest-pod-66474418] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 02:59:12,476 - DEBUG - [Pod Pod ctest-pod-66474418] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 02:59:12,476 - DEBUG - [Pod Pod ctest-pod-66474418] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 02:59:12,476 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66474418 passed 2024-09-18 02:59:12,485 - INFO - Updating Network Policy ingress-on-service 2024-09-18 02:59:18,011 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:18,012 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:18,012 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:23,075 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:23,075 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:23,075 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:28,128 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:28,128 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:28,128 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:33,197 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:33,197 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:33,197 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:38,255 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:38,255 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:38,255 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:43,308 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:43,308 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:43,308 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:48,372 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:48,373 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:48,373 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:53,462 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:53,462 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:53,462 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:58,523 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:58,523 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 02:59:58,523 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 03:00:03,582 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 03:00:03,582 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 03:00:03,582 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.101.66.173:80 (10.101.66.173:80) wget: download timed out 2024-09-18 03:00:03,583 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48434729': 0, 'ctest-pod-96764603': 0} 2024-09-18 03:00:03,646 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,646 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 03:00:03,646 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,705 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,705 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 03:00:03,705 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,705 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48434729': 1, 'ctest-pod-96764603': 1} 2024-09-18 03:00:03,757 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,757 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 03:00:03,757 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: ctest-pod-96764603 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,821 - DEBUG - [Pod ctest-pod-55489328] Cmd: wget http://10.101.66.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,821 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd wget http://10.101.66.173:80/ -O - -T 5 -t 1 passed 2024-09-18 03:00:03,821 - DEBUG - [Pod Pod ctest-pod-55489328] Cmd output: ctest-pod-48434729 Connecting to 10.101.66.173:80 (10.101.66.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 03:00:03,821 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48434729': 1, 'ctest-pod-96764603': 1} 2024-09-18 03:00:05,883 - DEBUG - [Pod ctest-pod-87040047] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.505 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.223/0.505 ms 2024-09-18 03:00:05,883 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-87040047 with expectation True passed 2024-09-18 03:00:07,942 - DEBUG - [Pod ctest-pod-21909770] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.232 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.467/1.232 ms 2024-09-18 03:00:07,943 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21909770 with expectation True passed 2024-09-18 03:00:09,990 - DEBUG - [Pod ctest-pod-55489328] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.603 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.590/1.603 ms 2024-09-18 03:00:09,990 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-55489328 with expectation True passed 2024-09-18 03:00:10,045 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 03:00:10,045 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 03:00:10,045 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 03:00:10,045 - INFO - wget check of of http://10.47.255.251 from ctest-pod-87040047 passed 2024-09-18 03:00:10,098 - DEBUG - [Pod ctest-pod-87040047] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 03:00:10,098 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 03:00:10,098 - DEBUG - [Pod Pod ctest-pod-87040047] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 03:00:10,098 - INFO - wget check of of http://10.47.255.250 from ctest-pod-87040047 passed 2024-09-18 03:00:15,164 - DEBUG - [Pod ctest-pod-21909770] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 03:00:15,164 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 03:00:15,164 - DEBUG - [Pod Pod ctest-pod-21909770] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 03:00:15,164 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21909770 passed 2024-09-18 03:00:15,222 - DEBUG - [Pod ctest-pod-66474418] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 03:00:15,222 - DEBUG - [Pod Pod ctest-pod-66474418] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 03:00:15,222 - DEBUG - [Pod Pod ctest-pod-66474418] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 03:00:15,222 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66474418 passed 2024-09-18 03:00:15,222 - INFO - Deleting Network Policy : ingress-on-service 2024-09-18 03:00:15,223 - INFO - Deleting service : ctest-nginx-svc-09057866 2024-09-18 03:00:15,477 - DEBUG - No XMPP flaps were noticed during the test 2024-09-18 03:00:15,477 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-09-18 03:00:15,477 - INFO - -------------------------------------------------------------------------------- 2024-09-18 03:00:15,482 - INFO - Deleting pod ctest-new-default-64669463:ctest-pod-48434729 2024-09-18 03:00:15,483 - INFO - Deleting pod ctest-new-default-64669463:ctest-pod-96764603 2024-09-18 03:00:15,483 - INFO - Deleting pod ctest-non-default-38507529:ctest-pod-28758751 2024-09-18 03:00:15,484 - INFO - Deleting pod ctest-non-default-38507529:ctest-pod-91784360 2024-09-18 03:00:15,484 - INFO - Deleting pod ctest-new-default-64669463:ctest-pod-21909770 2024-09-18 03:00:15,484 - INFO - Deleting pod ctest-new-default-64669463:ctest-pod-87040047 2024-09-18 03:00:15,485 - INFO - Deleting pod ctest-non-default-38507529:ctest-pod-55489328 2024-09-18 03:00:15,485 - INFO - Deleting pod ctest-non-default-38507529:ctest-pod-66474418 2024-09-18 03:00:15,617 - WARNING - Pod uuid 78afe267-ced3-4e18-bbcb-178e59738ffd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,618 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,618 - WARNING - Pod uuid 80f8723c-206b-4a22-bafe-b849415dd771 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,623 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,625 - WARNING - Pod uuid e3685083-0248-474c-8f3c-0603b3772150 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,625 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,625 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:15,626 - WARNING - Pod uuid a39c2ef5-0290-4b1d-b77d-4c4aa929fdac is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:20,635 - DEBUG - Pod 78afe267-ced3-4e18-bbcb-178e59738ffd is not in agent 10.0.0.45 VM list 2024-09-18 03:00:20,639 - DEBUG - Pod 80f8723c-206b-4a22-bafe-b849415dd771 is not in agent 10.0.0.45 VM list 2024-09-18 03:00:20,641 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:20,643 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:20,656 - DEBUG - Pod a39c2ef5-0290-4b1d-b77d-4c4aa929fdac is not in agent 10.0.0.45 VM list 2024-09-18 03:00:20,658 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:20,658 - DEBUG - Pod e3685083-0248-474c-8f3c-0603b3772150 is not in agent 10.0.0.45 VM list 2024-09-18 03:00:20,665 - DEBUG - VMI a849f386-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:20,665 - INFO - Verified that pod ctest-pod-91784360 is removed in agent 2024-09-18 03:00:20,665 - DEBUG - VMI a7d1bc68-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:20,665 - INFO - Verified that pod ctest-pod-28758751 is removed in agent 2024-09-18 03:00:20,666 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:20,673 - DEBUG - VMI a6acc72e-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:20,673 - INFO - Verified that pod ctest-pod-48434729 is removed in agent 2024-09-18 03:00:20,674 - DEBUG - VMI a72ad628-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:20,674 - INFO - Verified that pod ctest-pod-96764603 is removed in agent 2024-09-18 03:00:25,653 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:25,654 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:25,665 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:25,673 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:30,669 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:30,670 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:30,677 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:30,683 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:35,684 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:35,687 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:35,687 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:35,692 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:40,702 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:40,705 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:40,707 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:40,708 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:45,738 - WARNING - Pod uuid b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:45,740 - WARNING - Pod uuid 670186ef-ff4f-4cdf-8275-bf4085250a5a is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:45,740 - WARNING - Pod uuid 83450e63-253c-4dd5-9616-61671ef48efd is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:45,740 - WARNING - Pod uuid bf683d53-69f5-4be3-8b41-59c8a2ecb980 is still seen in agent 10.0.0.45 VM list 2024-09-18 03:00:50,760 - DEBUG - Pod 670186ef-ff4f-4cdf-8275-bf4085250a5a is not in agent 10.0.0.45 VM list 2024-09-18 03:00:50,762 - DEBUG - Pod bf683d53-69f5-4be3-8b41-59c8a2ecb980 is not in agent 10.0.0.45 VM list 2024-09-18 03:00:50,763 - DEBUG - Pod b5671d4c-c7b2-42b6-bb16-fe70abb15e0f is not in agent 10.0.0.45 VM list 2024-09-18 03:00:50,767 - DEBUG - Pod 83450e63-253c-4dd5-9616-61671ef48efd is not in agent 10.0.0.45 VM list 2024-09-18 03:00:50,780 - DEBUG - VMI aa45ae82-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:50,780 - INFO - Verified that pod ctest-pod-66474418 is removed in agent 2024-09-18 03:00:50,780 - DEBUG - VMI a9582b08-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:50,780 - INFO - Verified that pod ctest-pod-87040047 is removed in agent 2024-09-18 03:00:50,781 - DEBUG - VMI a8debb6a-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:50,781 - INFO - Verified that pod ctest-pod-21909770 is removed in agent 2024-09-18 03:00:50,782 - DEBUG - VMI a9cf26cc-7569-11ef-8b3d-fa163e4fbb18 is removed from agent 10.0.0.45 2024-09-18 03:00:50,782 - INFO - Verified that pod ctest-pod-55489328 is removed in agent 2024-09-18 03:00:50,782 - INFO - Deleting namespace ctest-non-default-38507529 2024-09-18 03:00:51,181 - DEBUG - Namespace ctest-non-default-38507529 still in k8s 2024-09-18 03:00:53,186 - DEBUG - Namespace ctest-non-default-38507529 still in k8s 2024-09-18 03:00:55,200 - DEBUG - Namespace ctest-non-default-38507529 still in k8s 2024-09-18 03:00:57,210 - DEBUG - Namespace ctest-non-default-38507529 is not in k8s 2024-09-18 03:00:57,210 - DEBUG - No need to check project deletion in contrail-api 2024-09-18 03:00:57,210 - INFO - Deleting namespace ctest-new-default-64669463 2024-09-18 03:00:57,217 - DEBUG - Namespace ctest-new-default-64669463 still in k8s 2024-09-18 03:00:59,222 - DEBUG - Namespace ctest-new-default-64669463 still in k8s 2024-09-18 03:01:01,227 - DEBUG - Namespace ctest-new-default-64669463 still in k8s 2024-09-18 03:01:03,231 - DEBUG - Namespace ctest-new-default-64669463 is not in k8s 2024-09-18 03:01:03,232 - DEBUG - No need to check project deletion in contrail-api