2024-09-05 07:59:38,848 - INFO - Using existing project ['default-domain', 'k8s-default'](294433ce-7986-4db2-b35b-a18d5fc12a94) 2024-09-05 07:59:38,867 - DEBUG - Namespace ctest-new-default-50392942 not present 2024-09-05 07:59:38,884 - INFO - Created namespace ctest-new-default-50392942 2024-09-05 07:59:41,887 - DEBUG - Namespace ctest-non-default-40318934 not present 2024-09-05 07:59:41,894 - INFO - Created namespace ctest-non-default-40318934 2024-09-05 07:59:44,919 - DEBUG - Pod ctest-pod-07927141 not present 2024-09-05 07:59:44,919 - INFO - Creating Pod ctest-pod-07927141 2024-09-05 07:59:44,963 - DEBUG - Pod : ctest-pod-07927141 UUID is 0a965d83-c8ac-40b2-b2b2-f5e3dc25c9d4 2024-09-05 07:59:44,966 - DEBUG - Pod ctest-pod-29475304 not present 2024-09-05 07:59:44,966 - INFO - Creating Pod ctest-pod-29475304 2024-09-05 07:59:44,997 - DEBUG - Pod : ctest-pod-29475304 UUID is 7f072f51-9751-479b-91d9-db13873be570 2024-09-05 07:59:45,000 - DEBUG - Pod ctest-pod-81625874 not present 2024-09-05 07:59:45,000 - INFO - Creating Pod ctest-pod-81625874 2024-09-05 07:59:45,036 - DEBUG - Pod : ctest-pod-81625874 UUID is 06db71fd-0e61-42f0-bb82-c9caef08f793 2024-09-05 07:59:45,042 - DEBUG - Pod ctest-pod-11437761 not present 2024-09-05 07:59:45,042 - INFO - Creating Pod ctest-pod-11437761 2024-09-05 07:59:45,084 - DEBUG - Pod : ctest-pod-11437761 UUID is da77aa9b-3060-4624-b766-ec9d535bd993 2024-09-05 07:59:45,086 - DEBUG - Pod ctest-pod-48633742 not present 2024-09-05 07:59:45,086 - INFO - Creating Pod ctest-pod-48633742 2024-09-05 07:59:45,103 - DEBUG - Pod : ctest-pod-48633742 UUID is bbf1af45-3e02-400c-8057-e47f033a998b 2024-09-05 07:59:45,105 - DEBUG - Pod ctest-pod-79176898 not present 2024-09-05 07:59:45,105 - INFO - Creating Pod ctest-pod-79176898 2024-09-05 07:59:45,121 - DEBUG - Pod : ctest-pod-79176898 UUID is 8aecc264-5ac0-4389-b4d4-1446a31195aa 2024-09-05 07:59:45,123 - DEBUG - Pod ctest-pod-93500222 not present 2024-09-05 07:59:45,123 - INFO - Creating Pod ctest-pod-93500222 2024-09-05 07:59:45,156 - DEBUG - Pod : ctest-pod-93500222 UUID is 48c19ac6-4d2a-450e-9d59-a49949bb06c3 2024-09-05 07:59:45,170 - DEBUG - Pod ctest-pod-04532692 not present 2024-09-05 07:59:45,170 - INFO - Creating Pod ctest-pod-04532692 2024-09-05 07:59:45,192 - DEBUG - Pod : ctest-pod-04532692 UUID is 53ed67d9-4f62-48e4-83a9-ad9df3175e53 2024-09-05 07:59:45,476 - INFO - Project default-domain:k8s-ctest-new-default-50392942 for Namespace ctest-new-default-50392942 is seen in contrail-api 2024-09-05 07:59:45,477 - DEBUG - Project uuid in Contrail is abd818d2-383f-4d86-b861-ff6318459de7 2024-09-05 07:59:45,624 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=38c219e3-9ba2-47dc-99c8-9eb1564ddca3 2024-09-05 07:59:45,628 - INFO - Namespace ctest-new-default-50392942 with uuid 38c219e3-9ba2-47dc-99c8-9eb1564ddca3 found in kube manager 2024-09-05 07:59:45,629 - INFO - Namespace ctest-new-default-50392942 verification passed 2024-09-05 07:59:45,829 - INFO - Project default-domain:k8s-ctest-non-default-40318934 for Namespace ctest-non-default-40318934 is seen in contrail-api 2024-09-05 07:59:45,829 - DEBUG - Project uuid in Contrail is c41390c1-93f9-4131-99f8-f552df8c73bb 2024-09-05 07:59:45,829 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=eb5af076-247e-46af-9f38-f0b1682a020d 2024-09-05 07:59:45,833 - INFO - Namespace ctest-non-default-40318934 with uuid eb5af076-247e-46af-9f38-f0b1682a020d found in kube manager 2024-09-05 07:59:45,833 - INFO - Namespace ctest-non-default-40318934 verification passed 2024-09-05 07:59:45,839 - DEBUG - Pod ctest-pod-07927141 not in running state.Currently in Pending 2024-09-05 07:59:50,845 - DEBUG - Pod ctest-pod-07927141 not in running state.Currently in Pending 2024-09-05 07:59:55,853 - DEBUG - Pod ctest-pod-07927141 not in running state.Currently in Pending 2024-09-05 08:00:00,860 - INFO - Pod ctest-pod-07927141 is in running state.Got IP 10.47.255.251 2024-09-05 08:00:00,873 - DEBUG - Pod ctest-pod-07927141 has vmi d1695fb6-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:00,873 - INFO - Verified pod ctest-pod-07927141 in contrail-api 2024-09-05 08:00:00,888 - DEBUG - VMI d1695fb6-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:00,888 - INFO - Verified Pod ctest-pod-07927141 in agent 10.0.0.34 2024-09-05 08:00:00,889 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=0a965d83-c8ac-40b2-b2b2-f5e3dc25c9d4 2024-09-05 08:00:00,893 - INFO - Pod ctest-pod-07927141 with uuid 0a965d83-c8ac-40b2-b2b2-f5e3dc25c9d4 found in kube manager 2024-09-05 08:00:00,893 - INFO - Pod ctest-pod-07927141 verification passed 2024-09-05 08:00:00,899 - INFO - Pod ctest-pod-29475304 is in running state.Got IP 10.47.255.250 2024-09-05 08:00:00,953 - DEBUG - Pod ctest-pod-29475304 has vmi d1dfa7ac-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:00,954 - INFO - Verified pod ctest-pod-29475304 in contrail-api 2024-09-05 08:00:00,966 - DEBUG - VMI d1dfa7ac-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:00,966 - INFO - Verified Pod ctest-pod-29475304 in agent 10.0.0.34 2024-09-05 08:00:00,966 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=7f072f51-9751-479b-91d9-db13873be570 2024-09-05 08:00:00,971 - INFO - Pod ctest-pod-29475304 with uuid 7f072f51-9751-479b-91d9-db13873be570 found in kube manager 2024-09-05 08:00:00,971 - INFO - Pod ctest-pod-29475304 verification passed 2024-09-05 08:00:00,977 - INFO - Pod ctest-pod-81625874 is in running state.Got IP 10.47.255.249 2024-09-05 08:00:01,032 - DEBUG - Pod ctest-pod-81625874 has vmi d256de58-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:01,032 - INFO - Verified pod ctest-pod-81625874 in contrail-api 2024-09-05 08:00:01,045 - DEBUG - VMI d256de58-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:01,045 - INFO - Verified Pod ctest-pod-81625874 in agent 10.0.0.34 2024-09-05 08:00:01,045 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=06db71fd-0e61-42f0-bb82-c9caef08f793 2024-09-05 08:00:01,049 - INFO - Pod ctest-pod-81625874 with uuid 06db71fd-0e61-42f0-bb82-c9caef08f793 found in kube manager 2024-09-05 08:00:01,050 - INFO - Pod ctest-pod-81625874 verification passed 2024-09-05 08:00:01,056 - INFO - Pod ctest-pod-11437761 is in running state.Got IP 10.47.255.248 2024-09-05 08:00:01,065 - DEBUG - Pod ctest-pod-11437761 has vmi d2befbb4-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:01,065 - INFO - Verified pod ctest-pod-11437761 in contrail-api 2024-09-05 08:00:01,078 - DEBUG - VMI d2befbb4-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:01,078 - INFO - Verified Pod ctest-pod-11437761 in agent 10.0.0.34 2024-09-05 08:00:01,079 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=da77aa9b-3060-4624-b766-ec9d535bd993 2024-09-05 08:00:01,083 - INFO - Pod ctest-pod-11437761 with uuid da77aa9b-3060-4624-b766-ec9d535bd993 found in kube manager 2024-09-05 08:00:01,083 - INFO - Pod ctest-pod-11437761 verification passed 2024-09-05 08:00:01,089 - INFO - Pod ctest-pod-48633742 is in running state.Got IP 10.47.255.247 2024-09-05 08:00:01,142 - DEBUG - Pod ctest-pod-48633742 has vmi d3394f04-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:01,142 - INFO - Verified pod ctest-pod-48633742 in contrail-api 2024-09-05 08:00:01,156 - DEBUG - VMI d3394f04-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:01,157 - INFO - Verified Pod ctest-pod-48633742 in agent 10.0.0.34 2024-09-05 08:00:01,157 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=bbf1af45-3e02-400c-8057-e47f033a998b 2024-09-05 08:00:01,161 - INFO - Pod ctest-pod-48633742 with uuid bbf1af45-3e02-400c-8057-e47f033a998b found in kube manager 2024-09-05 08:00:01,162 - INFO - Pod ctest-pod-48633742 verification passed 2024-09-05 08:00:01,166 - DEBUG - Pod ctest-pod-93500222 not in running state.Currently in Pending 2024-09-05 08:00:06,172 - INFO - Pod ctest-pod-93500222 is in running state.Got IP 10.47.255.245 2024-09-05 08:00:06,182 - DEBUG - Pod ctest-pod-93500222 has vmi d402f93a-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:06,182 - INFO - Verified pod ctest-pod-93500222 in contrail-api 2024-09-05 08:00:06,197 - DEBUG - VMI d402f93a-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:06,197 - INFO - Verified Pod ctest-pod-93500222 in agent 10.0.0.34 2024-09-05 08:00:06,197 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=48c19ac6-4d2a-450e-9d59-a49949bb06c3 2024-09-05 08:00:06,203 - INFO - Pod ctest-pod-93500222 with uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 found in kube manager 2024-09-05 08:00:06,203 - INFO - Pod ctest-pod-93500222 verification passed 2024-09-05 08:00:06,208 - INFO - Pod ctest-pod-79176898 is in running state.Got IP 10.47.255.246 2024-09-05 08:00:06,262 - DEBUG - Pod ctest-pod-79176898 has vmi d39efc00-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:06,262 - INFO - Verified pod ctest-pod-79176898 in contrail-api 2024-09-05 08:00:06,273 - DEBUG - VMI d39efc00-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:06,273 - INFO - Verified Pod ctest-pod-79176898 in agent 10.0.0.34 2024-09-05 08:00:06,273 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=8aecc264-5ac0-4389-b4d4-1446a31195aa 2024-09-05 08:00:06,278 - INFO - Pod ctest-pod-79176898 with uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa found in kube manager 2024-09-05 08:00:06,278 - INFO - Pod ctest-pod-79176898 verification passed 2024-09-05 08:00:06,283 - INFO - Pod ctest-pod-04532692 is in running state.Got IP 10.47.255.244 2024-09-05 08:00:06,293 - DEBUG - Pod ctest-pod-04532692 has vmi d46ba4b2-6b5c-11ef-b6f7-fa163ef3d854 2024-09-05 08:00:06,293 - INFO - Verified pod ctest-pod-04532692 in contrail-api 2024-09-05 08:00:06,305 - DEBUG - VMI d46ba4b2-6b5c-11ef-b6f7-fa163ef3d854 is active in agent 10.0.0.34 2024-09-05 08:00:06,306 - INFO - Verified Pod ctest-pod-04532692 in agent 10.0.0.34 2024-09-05 08:00:06,306 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=53ed67d9-4f62-48e4-83a9-ad9df3175e53 2024-09-05 08:00:06,310 - INFO - Pod ctest-pod-04532692 with uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 found in kube manager 2024-09-05 08:00:06,310 - INFO - Pod ctest-pod-04532692 verification passed 2024-09-05 08:00:06,310 - INFO - ================================================================================ 2024-09-05 08:00:06,310 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-05 08:00:06,310 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-05 08:00:06,562 - DEBUG - Nothing to compare xmpp stats {'10.0.0.34': {'10.0.0.24': '0'}} with 2024-09-05 08:00:06,562 - INFO - Initial checks done. Running the testcase now 2024-09-05 08:00:06,562 - INFO - 2024-09-05 08:00:06,627 - DEBUG - [Pod ctest-pod-07927141] Cmd: echo ctest-pod-07927141 > /usr/share/nginx/html/index.html, Output: 2024-09-05 08:00:06,701 - DEBUG - [Pod ctest-pod-29475304] Cmd: echo ctest-pod-29475304 > /usr/share/nginx/html/index.html, Output: 2024-09-05 08:00:06,752 - DEBUG - [Pod ctest-pod-81625874] Cmd: echo ctest-pod-81625874 > /usr/share/nginx/html/index.html, Output: 2024-09-05 08:00:06,822 - DEBUG - [Pod ctest-pod-11437761] Cmd: echo ctest-pod-11437761 > /usr/share/nginx/html/index.html, Output: 2024-09-05 08:00:06,825 - DEBUG - Service ctest-nginx-svc-13145855 not present 2024-09-05 08:00:06,825 - INFO - Creating service ctest-nginx-svc-13145855 2024-09-05 08:00:06,842 - INFO - Created Service ctest-nginx-svc-13145855 2024-09-05 08:00:06,851 - WARNING - Service UUID 6b08145b-f4fd-4319-a8f0-6b2907a2f540 not yet found in contrail-api 2024-09-05 08:00:07,862 - INFO - Validated that Service ctest-nginx-svc-13145855 is seen in contrail-api 2024-09-05 08:00:07,863 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=6b08145b-f4fd-4319-a8f0-6b2907a2f540 2024-09-05 08:00:07,869 - INFO - Service ctest-nginx-svc-13145855 with uuid 6b08145b-f4fd-4319-a8f0-6b2907a2f540 found in kube manager 2024-09-05 08:00:07,869 - INFO - Service ctest-nginx-svc-13145855 verification passed 2024-09-05 08:00:07,924 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:07,924 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:07,924 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:07,970 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:07,970 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:07,970 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,028 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,028 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,028 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,074 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,074 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,074 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,129 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29475304 2024-09-05 08:00:08,131 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,131 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29475304 2024-09-05 08:00:08,182 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,182 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,182 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,242 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,242 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,242 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,242 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07927141': 1, 'ctest-pod-29475304': 6} 2024-09-05 08:00:08,302 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,303 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,303 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,355 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07927141 2024-09-05 08:00:08,355 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,355 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07927141 2024-09-05 08:00:08,418 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) ctest-pod-29475304 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,418 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:00:08,418 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) ctest-pod-29475304 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:00:08,418 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07927141': 2, 'ctest-pod-29475304': 1} 2024-09-05 08:00:08,422 - DEBUG - Network policy ingress-on-service not present 2024-09-05 08:00:08,422 - INFO - Creating Network Policy ingress-on-service 2024-09-05 08:00:08,436 - INFO - Network policy found in k8s 2024-09-05 08:00:08,436 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=66a486c8-4254-4875-9f18-d9aec7376739 2024-09-05 08:00:08,441 - INFO - Network Policy ingress-on-service with uuid 66a486c8-4254-4875-9f18-d9aec7376739 found in kube manager 2024-09-05 08:00:08,472 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-05 08:00:08,473 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-05 08:00:08,473 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=66a486c8-4254-4875-9f18-d9aec7376739 2024-09-05 08:00:08,512 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-05 08:00:10,514 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=66a486c8-4254-4875-9f18-d9aec7376739 2024-09-05 08:00:10,557 - INFO - Network policy with name ingress-on-service found in agent 2024-09-05 08:00:10,557 - INFO - Network Policy ingress-on-service verification passed 2024-09-05 08:00:15,617 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:15,617 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:15,617 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:18,741 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-09-05 08:00:28,804 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:28,804 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:28,804 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:33,867 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:33,867 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:33,867 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:38,915 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:38,916 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:38,916 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:43,998 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:43,998 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:43,998 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:49,051 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:49,051 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:49,051 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:54,112 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:54,112 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:54,112 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:59,168 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:59,168 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:00:59,168 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:04,236 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:04,236 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:04,236 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:09,292 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:09,292 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:09,292 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:09,292 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07927141': 0, 'ctest-pod-29475304': 0} 2024-09-05 08:01:09,350 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:01:09,350 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:01:09,350 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:01:09,408 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:01:09,408 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:01:09,408 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:01:09,408 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07927141': 1, 'ctest-pod-29475304': 1} 2024-09-05 08:01:14,467 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:14,468 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:14,468 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:19,534 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:19,534 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:19,534 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:24,607 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:24,607 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:24,607 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:29,653 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:29,654 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:29,654 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:34,728 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:34,728 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:34,728 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:39,783 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:39,783 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:39,783 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:44,848 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:44,848 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:44,848 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:49,896 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:49,896 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:49,896 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:54,959 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:54,959 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:01:54,959 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:00,020 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:00,020 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:00,020 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:00,020 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07927141': 0, 'ctest-pod-29475304': 0} 2024-09-05 08:02:02,093 - DEBUG - [Pod ctest-pod-79176898] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.285 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.482/1.285 ms 2024-09-05 08:02:02,093 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79176898 with expectation True passed 2024-09-05 08:02:04,164 - DEBUG - [Pod ctest-pod-48633742] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.942 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.370/0.942 ms 2024-09-05 08:02:04,164 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-48633742 with expectation True passed 2024-09-05 08:02:06,216 - DEBUG - [Pod ctest-pod-93500222] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.797 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.316/0.797 ms 2024-09-05 08:02:06,216 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93500222 with expectation True passed 2024-09-05 08:02:06,269 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:02:06,269 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-05 08:02:06,269 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:02:06,269 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79176898 passed 2024-09-05 08:02:06,325 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:02:06,325 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 08:02:06,325 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:02:06,325 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79176898 passed 2024-09-05 08:02:11,376 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 08:02:11,376 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 08:02:11,376 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 08:02:11,376 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48633742 passed 2024-09-05 08:02:16,427 - DEBUG - [Pod ctest-pod-04532692] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-05 08:02:16,427 - DEBUG - [Pod Pod ctest-pod-04532692] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-05 08:02:16,427 - DEBUG - [Pod Pod ctest-pod-04532692] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-05 08:02:16,427 - INFO - wget check of of http://10.47.255.251 from ctest-pod-04532692 passed 2024-09-05 08:02:16,435 - INFO - Updating Network Policy ingress-on-service 2024-09-05 08:02:21,490 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:21,491 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:21,491 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:26,541 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:26,541 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:26,541 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:31,604 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:31,604 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:31,604 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:36,654 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:36,654 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:36,654 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:41,703 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:41,704 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:41,704 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:46,771 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:46,771 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:46,771 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:51,826 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:51,827 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:51,827 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:56,891 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:56,892 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:02:56,892 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:01,948 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:01,948 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:01,948 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:07,003 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:07,003 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:07,003 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) wget: download timed out 2024-09-05 08:03:07,003 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07927141': 0, 'ctest-pod-29475304': 0} 2024-09-05 08:03:07,067 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07927141 2024-09-05 08:03:07,067 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:03:07,068 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07927141 2024-09-05 08:03:07,125 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:03:07,125 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:03:07,125 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:03:07,125 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07927141': 1, 'ctest-pod-29475304': 1} 2024-09-05 08:03:07,191 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:03:07,191 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:03:07,191 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: ctest-pod-07927141 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:03:07,244 - DEBUG - [Pod ctest-pod-93500222] Cmd: wget http://10.96.114.149:80/ -O - -T 5 -t 1 , Output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:03:07,244 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd wget http://10.96.114.149:80/ -O - -T 5 -t 1 passed 2024-09-05 08:03:07,244 - DEBUG - [Pod Pod ctest-pod-93500222] Cmd output: ctest-pod-29475304 Connecting to 10.96.114.149:80 (10.96.114.149:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 08:03:07,244 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07927141': 1, 'ctest-pod-29475304': 1} 2024-09-05 08:03:09,297 - DEBUG - [Pod ctest-pod-79176898] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.596 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.060 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.253/0.596 ms 2024-09-05 08:03:09,297 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79176898 with expectation True passed 2024-09-05 08:03:11,350 - DEBUG - [Pod ctest-pod-48633742] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.147 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.095/0.448/1.147 ms 2024-09-05 08:03:11,350 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-48633742 with expectation True passed 2024-09-05 08:03:13,411 - DEBUG - [Pod ctest-pod-93500222] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.858 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.340/0.858 ms 2024-09-05 08:03:13,411 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93500222 with expectation True passed 2024-09-05 08:03:13,476 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:03:13,477 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-05 08:03:13,477 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:03:13,477 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79176898 passed 2024-09-05 08:03:13,545 - DEBUG - [Pod ctest-pod-79176898] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:03:13,545 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 08:03:13,545 - DEBUG - [Pod Pod ctest-pod-79176898] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:03:13,545 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79176898 passed 2024-09-05 08:03:18,612 - DEBUG - [Pod ctest-pod-48633742] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 08:03:18,612 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 08:03:18,612 - DEBUG - [Pod Pod ctest-pod-48633742] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 08:03:18,612 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48633742 passed 2024-09-05 08:03:18,660 - DEBUG - [Pod ctest-pod-04532692] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:03:18,660 - DEBUG - [Pod Pod ctest-pod-04532692] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-05 08:03:18,660 - DEBUG - [Pod Pod ctest-pod-04532692] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 08:03:18,660 - INFO - wget check of of http://10.47.255.251 from ctest-pod-04532692 passed 2024-09-05 08:03:18,661 - INFO - Deleting Network Policy : ingress-on-service 2024-09-05 08:03:18,661 - INFO - Deleting service : ctest-nginx-svc-13145855 2024-09-05 08:03:18,898 - DEBUG - No XMPP flaps were noticed during the test 2024-09-05 08:03:18,898 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2024-09-05 08:03:18,898 - INFO - -------------------------------------------------------------------------------- 2024-09-05 08:03:18,903 - INFO - Deleting pod ctest-new-default-50392942:ctest-pod-07927141 2024-09-05 08:03:18,904 - INFO - Deleting pod ctest-new-default-50392942:ctest-pod-29475304 2024-09-05 08:03:18,904 - INFO - Deleting pod ctest-non-default-40318934:ctest-pod-81625874 2024-09-05 08:03:18,904 - INFO - Deleting pod ctest-non-default-40318934:ctest-pod-11437761 2024-09-05 08:03:18,905 - INFO - Deleting pod ctest-new-default-50392942:ctest-pod-48633742 2024-09-05 08:03:18,905 - INFO - Deleting pod ctest-new-default-50392942:ctest-pod-79176898 2024-09-05 08:03:18,905 - INFO - Deleting pod ctest-non-default-40318934:ctest-pod-93500222 2024-09-05 08:03:18,906 - INFO - Deleting pod ctest-non-default-40318934:ctest-pod-04532692 2024-09-05 08:03:19,060 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,060 - WARNING - Pod uuid 7f072f51-9751-479b-91d9-db13873be570 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,061 - WARNING - Pod uuid 06db71fd-0e61-42f0-bb82-c9caef08f793 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,061 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,062 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,062 - WARNING - Pod uuid da77aa9b-3060-4624-b766-ec9d535bd993 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,063 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:19,063 - WARNING - Pod uuid 0a965d83-c8ac-40b2-b2b2-f5e3dc25c9d4 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:24,091 - DEBUG - Pod 7f072f51-9751-479b-91d9-db13873be570 is not in agent 10.0.0.34 VM list 2024-09-05 08:03:24,093 - DEBUG - Pod 06db71fd-0e61-42f0-bb82-c9caef08f793 is not in agent 10.0.0.34 VM list 2024-09-05 08:03:24,097 - DEBUG - Pod 0a965d83-c8ac-40b2-b2b2-f5e3dc25c9d4 is not in agent 10.0.0.34 VM list 2024-09-05 08:03:24,098 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:24,099 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:24,099 - DEBUG - Pod da77aa9b-3060-4624-b766-ec9d535bd993 is not in agent 10.0.0.34 VM list 2024-09-05 08:03:24,100 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:24,100 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:24,114 - DEBUG - VMI d1dfa7ac-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:24,114 - INFO - Verified that pod ctest-pod-29475304 is removed in agent 2024-09-05 08:03:24,116 - DEBUG - VMI d1695fb6-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:24,116 - INFO - Verified that pod ctest-pod-07927141 is removed in agent 2024-09-05 08:03:24,116 - DEBUG - VMI d256de58-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:24,116 - INFO - Verified that pod ctest-pod-81625874 is removed in agent 2024-09-05 08:03:24,117 - DEBUG - VMI d2befbb4-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:24,117 - INFO - Verified that pod ctest-pod-11437761 is removed in agent 2024-09-05 08:03:29,119 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:29,121 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:29,121 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:29,121 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:34,136 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:34,138 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:34,139 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:34,139 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:39,154 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:39,156 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:39,156 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:39,156 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:44,182 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:44,182 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:44,183 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:44,184 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:49,204 - WARNING - Pod uuid bbf1af45-3e02-400c-8057-e47f033a998b is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:49,209 - WARNING - Pod uuid 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:49,210 - WARNING - Pod uuid 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:49,210 - WARNING - Pod uuid 8aecc264-5ac0-4389-b4d4-1446a31195aa is still seen in agent 10.0.0.34 VM list 2024-09-05 08:03:54,214 - DEBUG - Pod bbf1af45-3e02-400c-8057-e47f033a998b is not in agent 10.0.0.34 VM list 2024-09-05 08:03:54,226 - DEBUG - Pod 53ed67d9-4f62-48e4-83a9-ad9df3175e53 is not in agent 10.0.0.34 VM list 2024-09-05 08:03:54,229 - DEBUG - VMI d3394f04-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:54,229 - INFO - Verified that pod ctest-pod-48633742 is removed in agent 2024-09-05 08:03:54,229 - DEBUG - Pod 48c19ac6-4d2a-450e-9d59-a49949bb06c3 is not in agent 10.0.0.34 VM list 2024-09-05 08:03:54,231 - DEBUG - Pod 8aecc264-5ac0-4389-b4d4-1446a31195aa is not in agent 10.0.0.34 VM list 2024-09-05 08:03:54,240 - DEBUG - VMI d46ba4b2-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:54,240 - INFO - Verified that pod ctest-pod-04532692 is removed in agent 2024-09-05 08:03:54,242 - DEBUG - VMI d402f93a-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:54,242 - INFO - Verified that pod ctest-pod-93500222 is removed in agent 2024-09-05 08:03:54,242 - DEBUG - VMI d39efc00-6b5c-11ef-b6f7-fa163ef3d854 is removed from agent 10.0.0.34 2024-09-05 08:03:54,242 - INFO - Verified that pod ctest-pod-79176898 is removed in agent 2024-09-05 08:03:54,242 - INFO - Deleting namespace ctest-non-default-40318934 2024-09-05 08:03:54,258 - DEBUG - Namespace ctest-non-default-40318934 still in k8s 2024-09-05 08:03:56,262 - DEBUG - Namespace ctest-non-default-40318934 still in k8s 2024-09-05 08:03:58,266 - DEBUG - Namespace ctest-non-default-40318934 still in k8s 2024-09-05 08:04:00,271 - DEBUG - Namespace ctest-non-default-40318934 is not in k8s 2024-09-05 08:04:00,271 - DEBUG - No need to check project deletion in contrail-api 2024-09-05 08:04:00,272 - INFO - Deleting namespace ctest-new-default-50392942 2024-09-05 08:04:00,286 - DEBUG - Namespace ctest-new-default-50392942 still in k8s 2024-09-05 08:04:02,291 - DEBUG - Namespace ctest-new-default-50392942 still in k8s 2024-09-05 08:04:04,295 - DEBUG - Namespace ctest-new-default-50392942 still in k8s 2024-09-05 08:04:06,300 - DEBUG - Namespace ctest-new-default-50392942 is not in k8s 2024-09-05 08:04:06,300 - DEBUG - No need to check project deletion in contrail-api