2024-09-17 06:32:38,356 - INFO - Using existing project ['default-domain', 'k8s-default'](4245a7fa-84d0-4e87-ba62-2f0d9f720ad1) 2024-09-17 06:32:38,378 - DEBUG - Namespace ctest-new-default-48680213 not present 2024-09-17 06:32:38,384 - INFO - Created namespace ctest-new-default-48680213 2024-09-17 06:32:41,389 - DEBUG - Namespace ctest-non-default-41865421 not present 2024-09-17 06:32:41,400 - INFO - Created namespace ctest-non-default-41865421 2024-09-17 06:32:44,418 - DEBUG - Pod ctest-pod-85382966 not present 2024-09-17 06:32:44,419 - INFO - Creating Pod ctest-pod-85382966 2024-09-17 06:32:44,440 - DEBUG - Pod : ctest-pod-85382966 UUID is 42eff66c-167a-4c19-be32-9bc8d8979c8d 2024-09-17 06:32:44,443 - DEBUG - Pod ctest-pod-26142856 not present 2024-09-17 06:32:44,443 - INFO - Creating Pod ctest-pod-26142856 2024-09-17 06:32:44,474 - DEBUG - Pod : ctest-pod-26142856 UUID is 7e268e9e-aaf9-49b8-8d8d-5bbaaf2709c5 2024-09-17 06:32:44,476 - DEBUG - Pod ctest-pod-59810177 not present 2024-09-17 06:32:44,476 - INFO - Creating Pod ctest-pod-59810177 2024-09-17 06:32:44,519 - DEBUG - Pod : ctest-pod-59810177 UUID is d6a86f62-6e7c-4a65-a96e-40a368d3deb9 2024-09-17 06:32:44,524 - DEBUG - Pod ctest-pod-78024131 not present 2024-09-17 06:32:44,524 - INFO - Creating Pod ctest-pod-78024131 2024-09-17 06:32:44,549 - DEBUG - Pod : ctest-pod-78024131 UUID is 55eb2641-3b3f-445d-8989-dcf5fe3acf5f 2024-09-17 06:32:44,550 - DEBUG - Pod ctest-pod-64357378 not present 2024-09-17 06:32:44,551 - INFO - Creating Pod ctest-pod-64357378 2024-09-17 06:32:44,570 - DEBUG - Pod : ctest-pod-64357378 UUID is ec463860-ca12-4dcd-963c-696641d0bcb1 2024-09-17 06:32:44,572 - DEBUG - Pod ctest-pod-56349923 not present 2024-09-17 06:32:44,572 - INFO - Creating Pod ctest-pod-56349923 2024-09-17 06:32:44,585 - DEBUG - Pod : ctest-pod-56349923 UUID is 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 2024-09-17 06:32:44,587 - DEBUG - Pod ctest-pod-21726723 not present 2024-09-17 06:32:44,587 - INFO - Creating Pod ctest-pod-21726723 2024-09-17 06:32:44,602 - DEBUG - Pod : ctest-pod-21726723 UUID is b538417d-317f-4abe-b650-c5d15ba1b937 2024-09-17 06:32:44,604 - DEBUG - Pod ctest-pod-29573151 not present 2024-09-17 06:32:44,604 - INFO - Creating Pod ctest-pod-29573151 2024-09-17 06:32:44,622 - DEBUG - Pod : ctest-pod-29573151 UUID is 339d5217-cb29-4176-b109-8218439151cc 2024-09-17 06:32:44,801 - INFO - Project default-domain:k8s-ctest-new-default-48680213 for Namespace ctest-new-default-48680213 is seen in contrail-api 2024-09-17 06:32:44,802 - DEBUG - Project uuid in Contrail is 6dd7802e-4cd4-4808-ad1b-77a222392749 2024-09-17 06:32:44,987 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=0bb9e9ac-ffbf-4601-b3fc-e5a41c59fc3e 2024-09-17 06:32:45,003 - INFO - Namespace ctest-new-default-48680213 with uuid 0bb9e9ac-ffbf-4601-b3fc-e5a41c59fc3e found in kube manager 2024-09-17 06:32:45,004 - INFO - Namespace ctest-new-default-48680213 verification passed 2024-09-17 06:32:45,255 - INFO - Project default-domain:k8s-ctest-non-default-41865421 for Namespace ctest-non-default-41865421 is seen in contrail-api 2024-09-17 06:32:45,255 - DEBUG - Project uuid in Contrail is c83c44ff-1f43-4fa3-a5d4-829d2487a802 2024-09-17 06:32:45,255 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=6d1cd879-05a7-4fc3-9edd-79812dc93e8f 2024-09-17 06:32:45,260 - INFO - Namespace ctest-non-default-41865421 with uuid 6d1cd879-05a7-4fc3-9edd-79812dc93e8f found in kube manager 2024-09-17 06:32:45,260 - INFO - Namespace ctest-non-default-41865421 verification passed 2024-09-17 06:32:45,265 - DEBUG - Pod ctest-pod-85382966 not in running state.Currently in Pending 2024-09-17 06:32:50,273 - DEBUG - Pod ctest-pod-85382966 not in running state.Currently in Pending 2024-09-17 06:32:55,279 - INFO - Pod ctest-pod-85382966 is in running state.Got IP 10.47.255.251 2024-09-17 06:32:55,300 - DEBUG - Pod ctest-pod-85382966 has vmi a6d305a2-74be-11ef-825e-fa163e1f6438 2024-09-17 06:32:55,300 - INFO - Verified pod ctest-pod-85382966 in contrail-api 2024-09-17 06:32:55,312 - DEBUG - VMI a6d305a2-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:32:55,313 - INFO - Verified Pod ctest-pod-85382966 in agent 10.0.0.28 2024-09-17 06:32:55,313 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=42eff66c-167a-4c19-be32-9bc8d8979c8d 2024-09-17 06:32:55,317 - INFO - Pod ctest-pod-85382966 with uuid 42eff66c-167a-4c19-be32-9bc8d8979c8d found in kube manager 2024-09-17 06:32:55,317 - INFO - Pod ctest-pod-85382966 verification passed 2024-09-17 06:32:55,322 - DEBUG - Pod ctest-pod-26142856 not in running state.Currently in Pending 2024-09-17 06:33:00,328 - INFO - Pod ctest-pod-26142856 is in running state.Got IP 10.47.255.250 2024-09-17 06:33:00,349 - DEBUG - Pod ctest-pod-26142856 has vmi a79d75d0-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,349 - INFO - Verified pod ctest-pod-26142856 in contrail-api 2024-09-17 06:33:00,371 - DEBUG - VMI a79d75d0-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,372 - INFO - Verified Pod ctest-pod-26142856 in agent 10.0.0.28 2024-09-17 06:33:00,372 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=7e268e9e-aaf9-49b8-8d8d-5bbaaf2709c5 2024-09-17 06:33:00,378 - INFO - Pod ctest-pod-26142856 with uuid 7e268e9e-aaf9-49b8-8d8d-5bbaaf2709c5 found in kube manager 2024-09-17 06:33:00,378 - INFO - Pod ctest-pod-26142856 verification passed 2024-09-17 06:33:00,387 - INFO - Pod ctest-pod-59810177 is in running state.Got IP 10.47.255.249 2024-09-17 06:33:00,455 - DEBUG - Pod ctest-pod-59810177 has vmi a84a21c2-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,455 - INFO - Verified pod ctest-pod-59810177 in contrail-api 2024-09-17 06:33:00,469 - DEBUG - VMI a84a21c2-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,469 - INFO - Verified Pod ctest-pod-59810177 in agent 10.0.0.28 2024-09-17 06:33:00,469 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=d6a86f62-6e7c-4a65-a96e-40a368d3deb9 2024-09-17 06:33:00,474 - INFO - Pod ctest-pod-59810177 with uuid d6a86f62-6e7c-4a65-a96e-40a368d3deb9 found in kube manager 2024-09-17 06:33:00,474 - INFO - Pod ctest-pod-59810177 verification passed 2024-09-17 06:33:00,479 - INFO - Pod ctest-pod-78024131 is in running state.Got IP 10.47.255.248 2024-09-17 06:33:00,499 - DEBUG - Pod ctest-pod-78024131 has vmi a8cabc60-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,499 - INFO - Verified pod ctest-pod-78024131 in contrail-api 2024-09-17 06:33:00,515 - DEBUG - VMI a8cabc60-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,516 - INFO - Verified Pod ctest-pod-78024131 in agent 10.0.0.28 2024-09-17 06:33:00,516 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=55eb2641-3b3f-445d-8989-dcf5fe3acf5f 2024-09-17 06:33:00,521 - INFO - Pod ctest-pod-78024131 with uuid 55eb2641-3b3f-445d-8989-dcf5fe3acf5f found in kube manager 2024-09-17 06:33:00,521 - INFO - Pod ctest-pod-78024131 verification passed 2024-09-17 06:33:00,526 - INFO - Pod ctest-pod-64357378 is in running state.Got IP 10.47.255.247 2024-09-17 06:33:00,591 - DEBUG - Pod ctest-pod-64357378 has vmi a969c152-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,591 - INFO - Verified pod ctest-pod-64357378 in contrail-api 2024-09-17 06:33:00,606 - DEBUG - VMI a969c152-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,606 - INFO - Verified Pod ctest-pod-64357378 in agent 10.0.0.28 2024-09-17 06:33:00,606 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=ec463860-ca12-4dcd-963c-696641d0bcb1 2024-09-17 06:33:00,611 - INFO - Pod ctest-pod-64357378 with uuid ec463860-ca12-4dcd-963c-696641d0bcb1 found in kube manager 2024-09-17 06:33:00,611 - INFO - Pod ctest-pod-64357378 verification passed 2024-09-17 06:33:00,616 - INFO - Pod ctest-pod-21726723 is in running state.Got IP 10.47.255.245 2024-09-17 06:33:00,683 - DEBUG - Pod ctest-pod-21726723 has vmi aa576984-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,683 - INFO - Verified pod ctest-pod-21726723 in contrail-api 2024-09-17 06:33:00,702 - DEBUG - VMI aa576984-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,702 - INFO - Verified Pod ctest-pod-21726723 in agent 10.0.0.28 2024-09-17 06:33:00,702 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=b538417d-317f-4abe-b650-c5d15ba1b937 2024-09-17 06:33:00,707 - INFO - Pod ctest-pod-21726723 with uuid b538417d-317f-4abe-b650-c5d15ba1b937 found in kube manager 2024-09-17 06:33:00,707 - INFO - Pod ctest-pod-21726723 verification passed 2024-09-17 06:33:00,712 - INFO - Pod ctest-pod-56349923 is in running state.Got IP 10.47.255.246 2024-09-17 06:33:00,729 - DEBUG - Pod ctest-pod-56349923 has vmi a9e3941e-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,729 - INFO - Verified pod ctest-pod-56349923 in contrail-api 2024-09-17 06:33:00,745 - DEBUG - VMI a9e3941e-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,745 - INFO - Verified Pod ctest-pod-56349923 in agent 10.0.0.28 2024-09-17 06:33:00,745 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=1ac19c4e-b1cf-44dc-b15a-2ed29b956432 2024-09-17 06:33:00,751 - INFO - Pod ctest-pod-56349923 with uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 found in kube manager 2024-09-17 06:33:00,751 - INFO - Pod ctest-pod-56349923 verification passed 2024-09-17 06:33:00,756 - INFO - Pod ctest-pod-29573151 is in running state.Got IP 10.47.255.244 2024-09-17 06:33:00,814 - DEBUG - Pod ctest-pod-29573151 has vmi aad613ec-74be-11ef-825e-fa163e1f6438 2024-09-17 06:33:00,814 - INFO - Verified pod ctest-pod-29573151 in contrail-api 2024-09-17 06:33:00,830 - DEBUG - VMI aad613ec-74be-11ef-825e-fa163e1f6438 is active in agent 10.0.0.28 2024-09-17 06:33:00,830 - INFO - Verified Pod ctest-pod-29573151 in agent 10.0.0.28 2024-09-17 06:33:00,830 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=339d5217-cb29-4176-b109-8218439151cc 2024-09-17 06:33:00,835 - INFO - Pod ctest-pod-29573151 with uuid 339d5217-cb29-4176-b109-8218439151cc found in kube manager 2024-09-17 06:33:00,835 - INFO - Pod ctest-pod-29573151 verification passed 2024-09-17 06:33:00,835 - INFO - ================================================================================ 2024-09-17 06:33:00,835 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-17 06:33:00,835 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-17 06:33:01,084 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.40': '0'}} with 2024-09-17 06:33:01,085 - INFO - Initial checks done. Running the testcase now 2024-09-17 06:33:01,085 - INFO - 2024-09-17 06:33:01,142 - DEBUG - [Pod ctest-pod-85382966] Cmd: echo ctest-pod-85382966 > /usr/share/nginx/html/index.html, Output: 2024-09-17 06:33:01,210 - DEBUG - [Pod ctest-pod-26142856] Cmd: echo ctest-pod-26142856 > /usr/share/nginx/html/index.html, Output: 2024-09-17 06:33:01,281 - DEBUG - [Pod ctest-pod-59810177] Cmd: echo ctest-pod-59810177 > /usr/share/nginx/html/index.html, Output: 2024-09-17 06:33:01,335 - DEBUG - [Pod ctest-pod-78024131] Cmd: echo ctest-pod-78024131 > /usr/share/nginx/html/index.html, Output: 2024-09-17 06:33:01,338 - DEBUG - Service ctest-nginx-svc-86422593 not present 2024-09-17 06:33:01,339 - INFO - Creating service ctest-nginx-svc-86422593 2024-09-17 06:33:01,358 - INFO - Created Service ctest-nginx-svc-86422593 2024-09-17 06:33:01,369 - WARNING - Service UUID 9b8ff160-7cd8-4979-a9cf-6f3b5f9d20b8 not yet found in contrail-api 2024-09-17 06:33:02,377 - INFO - Validated that Service ctest-nginx-svc-86422593 is seen in contrail-api 2024-09-17 06:33:02,377 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_LoadbalancerDatabaseList?x=9b8ff160-7cd8-4979-a9cf-6f3b5f9d20b8 2024-09-17 06:33:02,383 - INFO - Service ctest-nginx-svc-86422593 with uuid 9b8ff160-7cd8-4979-a9cf-6f3b5f9d20b8 found in kube manager 2024-09-17 06:33:02,383 - INFO - Service ctest-nginx-svc-86422593 verification passed 2024-09-17 06:33:03,464 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85382966 2024-09-17 06:33:03,999 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:03,999 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85382966 2024-09-17 06:33:04,079 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,079 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,079 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,139 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,139 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,139 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,214 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,214 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,214 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,273 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26142856 2024-09-17 06:33:04,273 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,273 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26142856 2024-09-17 06:33:04,273 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85382966': 4, 'ctest-pod-26142856': 1} 2024-09-17 06:33:04,343 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,343 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,343 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,397 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85382966 2024-09-17 06:33:04,397 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,397 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85382966 2024-09-17 06:33:04,457 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,457 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:04,457 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:04,457 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85382966': 2, 'ctest-pod-26142856': 1} 2024-09-17 06:33:04,460 - DEBUG - Network policy ingress-on-service not present 2024-09-17 06:33:04,460 - INFO - Creating Network Policy ingress-on-service 2024-09-17 06:33:04,473 - INFO - Network policy found in k8s 2024-09-17 06:33:04,473 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=926a25f0-02bb-4b32-b8c0-b60f1b8bd404 2024-09-17 06:33:04,502 - INFO - Network Policy ingress-on-service with uuid 926a25f0-02bb-4b32-b8c0-b60f1b8bd404 found in kube manager 2024-09-17 06:33:04,535 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-17 06:33:04,535 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-17 06:33:04,535 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=926a25f0-02bb-4b32-b8c0-b60f1b8bd404 2024-09-17 06:33:04,565 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-17 06:33:06,566 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=926a25f0-02bb-4b32-b8c0-b60f1b8bd404 2024-09-17 06:33:06,602 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-17 06:33:08,602 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=926a25f0-02bb-4b32-b8c0-b60f1b8bd404 2024-09-17 06:33:08,633 - INFO - Network policy with name ingress-on-service found in agent 2024-09-17 06:33:08,633 - INFO - Network Policy ingress-on-service verification passed 2024-09-17 06:33:13,691 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:13,691 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:13,691 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:18,753 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:18,753 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:18,753 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:23,825 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:23,825 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:23,825 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:28,899 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:28,899 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:28,899 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:33,972 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:33,972 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:33,972 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:39,042 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:39,042 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:39,042 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:44,116 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:44,116 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:44,116 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:49,205 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:49,205 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:49,206 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:54,286 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:54,286 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:54,286 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:59,334 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:59,335 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:59,335 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:33:59,335 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-85382966': 0, 'ctest-pod-26142856': 0} 2024-09-17 06:33:59,400 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:59,400 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:59,400 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:33:59,450 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85382966 2024-09-17 06:33:59,450 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:33:59,450 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-85382966 2024-09-17 06:33:59,450 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85382966': 1, 'ctest-pod-26142856': 1} 2024-09-17 06:34:04,505 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:04,505 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:04,505 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:09,570 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:09,571 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:09,571 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:14,662 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:14,662 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:14,662 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:19,738 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:19,738 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:19,738 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:24,809 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:24,810 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:24,810 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:29,877 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:29,877 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:29,877 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:34,937 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:34,937 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:34,937 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:40,014 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:40,014 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:40,014 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:45,073 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:45,073 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:45,073 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:50,123 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:50,124 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:50,124 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:34:50,124 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-85382966': 0, 'ctest-pod-26142856': 0} 2024-09-17 06:34:52,250 - DEBUG - [Pod ctest-pod-56349923] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.553 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.238/0.553 ms 2024-09-17 06:34:52,250 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-56349923 with expectation True passed 2024-09-17 06:34:54,335 - DEBUG - [Pod ctest-pod-64357378] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.483 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.211/0.483 ms 2024-09-17 06:34:54,335 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64357378 with expectation True passed 2024-09-17 06:34:56,401 - DEBUG - [Pod ctest-pod-21726723] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.900 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.354/0.900 ms 2024-09-17 06:34:56,401 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21726723 with expectation True passed 2024-09-17 06:34:56,475 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:34:56,475 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-17 06:34:56,475 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:34:56,475 - INFO - wget check of of http://10.47.255.251 from ctest-pod-56349923 passed 2024-09-17 06:34:56,538 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:34:56,538 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-17 06:34:56,538 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:34:56,538 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56349923 passed 2024-09-17 06:35:01,590 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 06:35:01,590 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 06:35:01,590 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 06:35:01,590 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64357378 passed 2024-09-17 06:35:06,650 - DEBUG - [Pod ctest-pod-29573151] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-17 06:35:06,650 - DEBUG - [Pod Pod ctest-pod-29573151] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-17 06:35:06,650 - DEBUG - [Pod Pod ctest-pod-29573151] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-17 06:35:06,650 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29573151 passed 2024-09-17 06:35:06,657 - INFO - Updating Network Policy ingress-on-service 2024-09-17 06:35:11,766 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:11,766 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:11,766 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:16,841 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:16,841 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:16,842 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:21,891 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:21,891 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:21,891 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:26,963 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:26,963 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:26,963 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:32,028 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:32,028 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:32,028 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:37,093 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:37,093 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:37,093 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:42,174 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:42,174 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:42,174 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:47,237 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:47,237 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:47,237 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:52,297 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:52,297 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:52,297 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:57,367 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:57,368 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:57,368 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) wget: download timed out 2024-09-17 06:35:57,368 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-85382966': 0, 'ctest-pod-26142856': 0} 2024-09-17 06:35:57,436 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,436 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,436 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,495 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26142856 2024-09-17 06:35:57,495 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,495 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26142856 2024-09-17 06:35:57,559 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,559 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,559 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,614 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,614 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,614 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: ctest-pod-26142856 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,799 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,800 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,800 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,800 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85382966': 1, 'ctest-pod-26142856': 4} 2024-09-17 06:35:57,875 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,875 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,875 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,944 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:57,944 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:57,944 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: ctest-pod-85382966 Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-17 06:35:58,006 - DEBUG - [Pod ctest-pod-21726723] Cmd: wget http://10.98.234.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26142856 2024-09-17 06:35:58,006 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd wget http://10.98.234.4:80/ -O - -T 5 -t 1 passed 2024-09-17 06:35:58,006 - DEBUG - [Pod Pod ctest-pod-21726723] Cmd output: Connecting to 10.98.234.4:80 (10.98.234.4:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26142856 2024-09-17 06:35:58,006 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-85382966': 2, 'ctest-pod-26142856': 1} 2024-09-17 06:36:00,065 - DEBUG - [Pod ctest-pod-56349923] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.656 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.272/0.656 ms 2024-09-17 06:36:00,065 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-56349923 with expectation True passed 2024-09-17 06:36:02,154 - DEBUG - [Pod ctest-pod-64357378] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.097 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.420/1.097 ms 2024-09-17 06:36:02,154 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64357378 with expectation True passed 2024-09-17 06:36:04,221 - DEBUG - [Pod ctest-pod-21726723] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.967 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.373/0.967 ms 2024-09-17 06:36:04,221 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21726723 with expectation True passed 2024-09-17 06:36:04,287 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:36:04,287 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-17 06:36:04,287 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:36:04,287 - INFO - wget check of of http://10.47.255.251 from ctest-pod-56349923 passed 2024-09-17 06:36:04,359 - DEBUG - [Pod ctest-pod-56349923] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:36:04,359 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-17 06:36:04,359 - DEBUG - [Pod Pod ctest-pod-56349923] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:36:04,359 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56349923 passed 2024-09-17 06:36:09,427 - DEBUG - [Pod ctest-pod-64357378] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 06:36:09,427 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 06:36:09,427 - DEBUG - [Pod Pod ctest-pod-64357378] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-17 06:36:09,427 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64357378 passed 2024-09-17 06:36:09,490 - DEBUG - [Pod ctest-pod-29573151] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:36:09,490 - DEBUG - [Pod Pod ctest-pod-29573151] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-17 06:36:09,490 - DEBUG - [Pod Pod ctest-pod-29573151] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-17 06:36:09,490 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29573151 passed 2024-09-17 06:36:09,490 - INFO - Deleting Network Policy : ingress-on-service 2024-09-17 06:36:09,490 - INFO - Deleting service : ctest-nginx-svc-86422593 2024-09-17 06:36:09,724 - DEBUG - No XMPP flaps were noticed during the test
2024-09-17 06:36:09,724 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2024-09-17 06:36:09,724 - INFO - -------------------------------------------------------------------------------- 2024-09-17 06:36:09,730 - INFO - Deleting pod ctest-new-default-48680213:ctest-pod-85382966 2024-09-17 06:36:09,731 - INFO - Deleting pod ctest-new-default-48680213:ctest-pod-26142856 2024-09-17 06:36:09,731 - INFO - Deleting pod ctest-non-default-41865421:ctest-pod-59810177 2024-09-17 06:36:09,731 - INFO - Deleting pod ctest-non-default-41865421:ctest-pod-78024131 2024-09-17 06:36:09,732 - INFO - Deleting pod ctest-new-default-48680213:ctest-pod-64357378 2024-09-17 06:36:09,732 - INFO - Deleting pod ctest-new-default-48680213:ctest-pod-56349923 2024-09-17 06:36:09,732 - INFO - Deleting pod ctest-non-default-41865421:ctest-pod-21726723 2024-09-17 06:36:09,733 - INFO - Deleting pod ctest-non-default-41865421:ctest-pod-29573151 2024-09-17 06:36:09,835 - WARNING - Pod uuid 42eff66c-167a-4c19-be32-9bc8d8979c8d is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,837 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,899 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,901 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,901 - WARNING - Pod uuid 7e268e9e-aaf9-49b8-8d8d-5bbaaf2709c5 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,902 - WARNING - Pod uuid d6a86f62-6e7c-4a65-a96e-40a368d3deb9 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,902 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:09,903 - WARNING - Pod uuid 55eb2641-3b3f-445d-8989-dcf5fe3acf5f is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:14,848 - DEBUG - Pod 42eff66c-167a-4c19-be32-9bc8d8979c8d is not in agent 10.0.0.28 VM list 2024-09-17 06:36:14,851 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:14,856 - DEBUG - VMI a6d305a2-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:14,856 - INFO - Verified that pod ctest-pod-85382966 is removed in agent 2024-09-17 06:36:14,929 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:14,931 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:14,932 - DEBUG - Pod 55eb2641-3b3f-445d-8989-dcf5fe3acf5f is not in agent 10.0.0.28 VM list 2024-09-17 06:36:14,933 - DEBUG - Pod 7e268e9e-aaf9-49b8-8d8d-5bbaaf2709c5 is not in agent 10.0.0.28 VM list 2024-09-17 06:36:14,934 - DEBUG - Pod d6a86f62-6e7c-4a65-a96e-40a368d3deb9 is not in agent 10.0.0.28 VM list 2024-09-17 06:36:14,936 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:14,949 - DEBUG - VMI a84a21c2-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:14,949 - INFO - Verified that pod ctest-pod-59810177 is removed in agent 2024-09-17 06:36:14,950 - DEBUG - VMI a79d75d0-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:14,950 - INFO - Verified that pod ctest-pod-26142856 is removed in agent 2024-09-17 06:36:14,951 - DEBUG - VMI a8cabc60-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:14,951 - INFO - Verified that pod ctest-pod-78024131 is removed in agent 2024-09-17 06:36:19,860 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:19,943 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:19,945 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:19,946 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:24,868 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:24,958 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:24,960 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:24,960 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:29,877 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:29,999 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:30,004 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:30,005 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:34,885 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:35,011 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:35,019 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:35,022 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:39,894 - WARNING - Pod uuid b538417d-317f-4abe-b650-c5d15ba1b937 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:40,036 - WARNING - Pod uuid 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:40,039 - WARNING - Pod uuid ec463860-ca12-4dcd-963c-696641d0bcb1 is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:40,039 - WARNING - Pod uuid 339d5217-cb29-4176-b109-8218439151cc is still seen in agent 10.0.0.28 VM list 2024-09-17 06:36:44,903 - DEBUG - Pod b538417d-317f-4abe-b650-c5d15ba1b937 is not in agent 10.0.0.28 VM list 2024-09-17 06:36:44,909 - DEBUG - VMI aa576984-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:44,909 - INFO - Verified that pod ctest-pod-21726723 is removed in agent 2024-09-17 06:36:45,053 - DEBUG - Pod 1ac19c4e-b1cf-44dc-b15a-2ed29b956432 is not in agent 10.0.0.28 VM list 2024-09-17 06:36:45,056 - DEBUG - Pod 339d5217-cb29-4176-b109-8218439151cc is not in agent 10.0.0.28 VM list 2024-09-17 06:36:45,057 - DEBUG - Pod ec463860-ca12-4dcd-963c-696641d0bcb1 is not in agent 10.0.0.28 VM list 2024-09-17 06:36:45,069 - DEBUG - VMI a9e3941e-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:45,069 - INFO - Verified that pod ctest-pod-56349923 is removed in agent 2024-09-17 06:36:45,071 - DEBUG - VMI aad613ec-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:45,071 - INFO - Verified that pod ctest-pod-29573151 is removed in agent 2024-09-17 06:36:45,071 - DEBUG - VMI a969c152-74be-11ef-825e-fa163e1f6438 is removed from agent 10.0.0.28 2024-09-17 06:36:45,071 - INFO - Verified that pod ctest-pod-64357378 is removed in agent 2024-09-17 06:36:45,071 - INFO - Deleting namespace ctest-non-default-41865421 2024-09-17 06:36:45,090 - DEBUG - Namespace ctest-non-default-41865421 still in k8s 2024-09-17 06:36:47,095 - DEBUG - Namespace ctest-non-default-41865421 still in k8s 2024-09-17 06:36:49,100 - DEBUG - Namespace ctest-non-default-41865421 still in k8s 2024-09-17 06:36:51,103 - DEBUG - Namespace ctest-non-default-41865421 is not in k8s 2024-09-17 06:36:51,103 - DEBUG - No need to check project deletion in contrail-api 2024-09-17 06:36:51,103 - INFO - Deleting namespace ctest-new-default-48680213 2024-09-17 06:36:51,114 - DEBUG - Namespace ctest-new-default-48680213 still in k8s 2024-09-17 06:36:53,118 - DEBUG - Namespace ctest-new-default-48680213 still in k8s 2024-09-17 06:36:55,122 - DEBUG - Namespace ctest-new-default-48680213 still in k8s 2024-09-17 06:36:57,126 - DEBUG - Namespace ctest-new-default-48680213 is not in k8s 2024-09-17 06:36:57,127 - DEBUG - No need to check project deletion in contrail-api