2024-10-19 13:01:44,279 - INFO - Using existing project ['default-domain', 'k8s-default'](9ff57667-eb1c-476e-9943-9e96eddedb8b) 2024-10-19 13:01:44,296 - DEBUG - Namespace ctest-new-default-20433592 not present 2024-10-19 13:01:44,307 - INFO - Created namespace ctest-new-default-20433592 2024-10-19 13:01:47,313 - DEBUG - Namespace ctest-non-default-91148350 not present 2024-10-19 13:01:47,324 - INFO - Created namespace ctest-non-default-91148350 2024-10-19 13:01:50,341 - DEBUG - Pod ctest-pod-36693689 not present 2024-10-19 13:01:50,342 - INFO - Creating Pod ctest-pod-36693689 2024-10-19 13:01:50,510 - DEBUG - Pod : ctest-pod-36693689 UUID is eb286b49-5836-4d52-b9b1-3a7416662b04 2024-10-19 13:01:50,514 - DEBUG - Pod ctest-pod-49435332 not present 2024-10-19 13:01:50,514 - INFO - Creating Pod ctest-pod-49435332 2024-10-19 13:01:50,550 - DEBUG - Pod : ctest-pod-49435332 UUID is 1e42e2ba-c1a0-45f8-b83e-386d651b38b8 2024-10-19 13:01:50,556 - DEBUG - Pod ctest-pod-24416890 not present 2024-10-19 13:01:50,557 - INFO - Creating Pod ctest-pod-24416890 2024-10-19 13:01:50,580 - DEBUG - Pod : ctest-pod-24416890 UUID is 40e7af2a-ca3f-41b2-8988-64ab29f94f45 2024-10-19 13:01:50,582 - DEBUG - Pod ctest-pod-00904778 not present 2024-10-19 13:01:50,582 - INFO - Creating Pod ctest-pod-00904778 2024-10-19 13:01:50,649 - DEBUG - Pod : ctest-pod-00904778 UUID is cb93f0de-ab45-4235-be87-c7590655b370 2024-10-19 13:01:50,655 - DEBUG - Pod ctest-pod-35411749 not present 2024-10-19 13:01:50,655 - INFO - Creating Pod ctest-pod-35411749 2024-10-19 13:01:50,683 - DEBUG - Pod : ctest-pod-35411749 UUID is 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 2024-10-19 13:01:50,685 - DEBUG - Pod ctest-pod-12578103 not present 2024-10-19 13:01:50,685 - INFO - Creating Pod ctest-pod-12578103 2024-10-19 13:01:50,700 - DEBUG - Pod : ctest-pod-12578103 UUID is 3b8776ca-81f8-4601-8e5a-8e79f399290c 2024-10-19 13:01:50,705 - DEBUG - Pod ctest-pod-53187124 not present 2024-10-19 13:01:50,706 - INFO - Creating Pod ctest-pod-53187124 2024-10-19 13:01:50,720 - DEBUG - Pod : ctest-pod-53187124 UUID is ae512858-115a-4b3f-858f-7f30257c0417 2024-10-19 13:01:50,722 - DEBUG - Pod ctest-pod-49651624 not present 2024-10-19 13:01:50,722 - INFO - Creating Pod ctest-pod-49651624 2024-10-19 13:01:50,735 - DEBUG - Pod : ctest-pod-49651624 UUID is 9eb741da-a2a4-4c81-8f4f-3d59e6466361 2024-10-19 13:01:50,919 - INFO - Project default-domain:k8s-ctest-new-default-20433592 for Namespace ctest-new-default-20433592 is seen in contrail-api 2024-10-19 13:01:50,919 - DEBUG - Project uuid in Contrail is c6e86494-efbc-4131-b0a7-5248a17e0225 2024-10-19 13:01:51,081 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=cbe0cc72-a5cf-4ed6-937c-133e9acc5779 2024-10-19 13:01:51,086 - INFO - Namespace ctest-new-default-20433592 with uuid cbe0cc72-a5cf-4ed6-937c-133e9acc5779 found in kube manager 2024-10-19 13:01:51,086 - INFO - Namespace ctest-new-default-20433592 verification passed 2024-10-19 13:01:51,329 - INFO - Project default-domain:k8s-ctest-non-default-91148350 for Namespace ctest-non-default-91148350 is seen in contrail-api 2024-10-19 13:01:51,329 - DEBUG - Project uuid in Contrail is 30e5a9ea-6992-4542-b793-53bb57a26022 2024-10-19 13:01:51,329 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=296df222-c59a-44b1-a754-62d6d597ccd2 2024-10-19 13:01:51,336 - INFO - Namespace ctest-non-default-91148350 with uuid 296df222-c59a-44b1-a754-62d6d597ccd2 found in kube manager 2024-10-19 13:01:51,337 - INFO - Namespace ctest-non-default-91148350 verification passed 2024-10-19 13:01:51,342 - DEBUG - Pod ctest-pod-36693689 not in running state.Currently in Pending 2024-10-19 13:01:56,350 - DEBUG - Pod ctest-pod-36693689 not in running state.Currently in Pending 2024-10-19 13:02:01,363 - DEBUG - Pod ctest-pod-36693689 not in running state.Currently in Pending 2024-10-19 13:02:06,370 - INFO - Pod ctest-pod-36693689 is in running state.Got IP 10.47.255.251 2024-10-19 13:02:06,427 - DEBUG - Pod ctest-pod-36693689 has vmi 4f629b5a-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:06,427 - INFO - Verified pod ctest-pod-36693689 in contrail-api 2024-10-19 13:02:06,442 - DEBUG - VMI 4f629b5a-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:06,442 - INFO - Verified Pod ctest-pod-36693689 in agent 10.0.0.28 2024-10-19 13:02:06,442 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=eb286b49-5836-4d52-b9b1-3a7416662b04 2024-10-19 13:02:06,447 - INFO - Pod ctest-pod-36693689 with uuid eb286b49-5836-4d52-b9b1-3a7416662b04 found in kube manager 2024-10-19 13:02:06,447 - INFO - Pod ctest-pod-36693689 verification passed 2024-10-19 13:02:06,452 - INFO - Pod ctest-pod-49435332 is in running state.Got IP 10.47.255.250 2024-10-19 13:02:06,470 - DEBUG - Pod ctest-pod-49435332 has vmi 4feb6a66-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:06,470 - INFO - Verified pod ctest-pod-49435332 in contrail-api 2024-10-19 13:02:06,484 - DEBUG - VMI 4feb6a66-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:06,485 - INFO - Verified Pod ctest-pod-49435332 in agent 10.0.0.28 2024-10-19 13:02:06,485 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=1e42e2ba-c1a0-45f8-b83e-386d651b38b8 2024-10-19 13:02:06,489 - INFO - Pod ctest-pod-49435332 with uuid 1e42e2ba-c1a0-45f8-b83e-386d651b38b8 found in kube manager 2024-10-19 13:02:06,489 - INFO - Pod ctest-pod-49435332 verification passed 2024-10-19 13:02:06,494 - INFO - Pod ctest-pod-24416890 is in running state.Got IP 10.47.255.249 2024-10-19 13:02:06,556 - DEBUG - Pod ctest-pod-24416890 has vmi 5090b462-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:06,556 - INFO - Verified pod ctest-pod-24416890 in contrail-api 2024-10-19 13:02:06,572 - DEBUG - VMI 5090b462-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:06,572 - INFO - Verified Pod ctest-pod-24416890 in agent 10.0.0.28 2024-10-19 13:02:06,573 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=40e7af2a-ca3f-41b2-8988-64ab29f94f45 2024-10-19 13:02:06,578 - INFO - Pod ctest-pod-24416890 with uuid 40e7af2a-ca3f-41b2-8988-64ab29f94f45 found in kube manager 2024-10-19 13:02:06,578 - INFO - Pod ctest-pod-24416890 verification passed 2024-10-19 13:02:06,583 - INFO - Pod ctest-pod-00904778 is in running state.Got IP 10.47.255.248 2024-10-19 13:02:06,643 - DEBUG - Pod ctest-pod-00904778 has vmi 510d56b6-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:06,643 - INFO - Verified pod ctest-pod-00904778 in contrail-api 2024-10-19 13:02:06,658 - DEBUG - VMI 510d56b6-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:06,658 - INFO - Verified Pod ctest-pod-00904778 in agent 10.0.0.28 2024-10-19 13:02:06,659 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=cb93f0de-ab45-4235-be87-c7590655b370 2024-10-19 13:02:06,663 - INFO - Pod ctest-pod-00904778 with uuid cb93f0de-ab45-4235-be87-c7590655b370 found in kube manager 2024-10-19 13:02:06,663 - INFO - Pod ctest-pod-00904778 verification passed 2024-10-19 13:02:06,670 - DEBUG - Pod ctest-pod-35411749 not in running state.Currently in Pending 2024-10-19 13:02:11,675 - INFO - Pod ctest-pod-35411749 is in running state.Got IP 10.47.255.247 2024-10-19 13:02:11,693 - DEBUG - Pod ctest-pod-35411749 has vmi 519b2cac-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:11,693 - INFO - Verified pod ctest-pod-35411749 in contrail-api 2024-10-19 13:02:11,706 - DEBUG - VMI 519b2cac-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:11,707 - INFO - Verified Pod ctest-pod-35411749 in agent 10.0.0.28 2024-10-19 13:02:11,707 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=7c499ede-80bc-4f3e-b5d4-6b94a1679d89 2024-10-19 13:02:11,711 - INFO - Pod ctest-pod-35411749 with uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 found in kube manager 2024-10-19 13:02:11,711 - INFO - Pod ctest-pod-35411749 verification passed 2024-10-19 13:02:11,716 - INFO - Pod ctest-pod-53187124 is in running state.Got IP 10.47.255.245 2024-10-19 13:02:11,775 - DEBUG - Pod ctest-pod-53187124 has vmi 52930a12-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:11,775 - INFO - Verified pod ctest-pod-53187124 in contrail-api 2024-10-19 13:02:11,788 - DEBUG - VMI 52930a12-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:11,788 - INFO - Verified Pod ctest-pod-53187124 in agent 10.0.0.28 2024-10-19 13:02:11,788 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=ae512858-115a-4b3f-858f-7f30257c0417 2024-10-19 13:02:11,792 - INFO - Pod ctest-pod-53187124 with uuid ae512858-115a-4b3f-858f-7f30257c0417 found in kube manager 2024-10-19 13:02:11,792 - INFO - Pod ctest-pod-53187124 verification passed 2024-10-19 13:02:11,797 - INFO - Pod ctest-pod-12578103 is in running state.Got IP 10.47.255.246 2024-10-19 13:02:11,813 - DEBUG - Pod ctest-pod-12578103 has vmi 5215613e-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:11,814 - INFO - Verified pod ctest-pod-12578103 in contrail-api 2024-10-19 13:02:11,831 - DEBUG - VMI 5215613e-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:11,832 - INFO - Verified Pod ctest-pod-12578103 in agent 10.0.0.28 2024-10-19 13:02:11,832 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=3b8776ca-81f8-4601-8e5a-8e79f399290c 2024-10-19 13:02:11,836 - INFO - Pod ctest-pod-12578103 with uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c found in kube manager 2024-10-19 13:02:11,836 - INFO - Pod ctest-pod-12578103 verification passed 2024-10-19 13:02:11,841 - INFO - Pod ctest-pod-49651624 is in running state.Got IP 10.47.255.244 2024-10-19 13:02:11,902 - DEBUG - Pod ctest-pod-49651624 has vmi 53087c70-8e1a-11ef-9830-fa163e1b8634 2024-10-19 13:02:11,902 - INFO - Verified pod ctest-pod-49651624 in contrail-api 2024-10-19 13:02:11,917 - DEBUG - VMI 53087c70-8e1a-11ef-9830-fa163e1b8634 is active in agent 10.0.0.28 2024-10-19 13:02:11,917 - INFO - Verified Pod ctest-pod-49651624 in agent 10.0.0.28 2024-10-19 13:02:11,917 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=9eb741da-a2a4-4c81-8f4f-3d59e6466361 2024-10-19 13:02:11,921 - INFO - Pod ctest-pod-49651624 with uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 found in kube manager 2024-10-19 13:02:11,921 - INFO - Pod ctest-pod-49651624 verification passed 2024-10-19 13:02:11,922 - INFO - ================================================================================ 2024-10-19 13:02:11,922 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-19 13:02:11,922 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-19 13:02:12,144 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.12': '0'}} with 2024-10-19 13:02:12,144 - INFO - Initial checks done. Running the testcase now 2024-10-19 13:02:12,144 - INFO - 2024-10-19 13:02:12,214 - DEBUG - [Pod ctest-pod-36693689] Cmd: echo ctest-pod-36693689 > /usr/share/nginx/html/index.html, Output: 2024-10-19 13:02:12,294 - DEBUG - [Pod ctest-pod-49435332] Cmd: echo ctest-pod-49435332 > /usr/share/nginx/html/index.html, Output: 2024-10-19 13:02:12,345 - DEBUG - [Pod ctest-pod-24416890] Cmd: echo ctest-pod-24416890 > /usr/share/nginx/html/index.html, Output: 2024-10-19 13:02:12,403 - DEBUG - [Pod ctest-pod-00904778] Cmd: echo ctest-pod-00904778 > /usr/share/nginx/html/index.html, Output: 2024-10-19 13:02:12,406 - DEBUG - Service ctest-nginx-svc-09711885 not present 2024-10-19 13:02:12,406 - INFO - Creating service ctest-nginx-svc-09711885 2024-10-19 13:02:12,418 - INFO - Created Service ctest-nginx-svc-09711885 2024-10-19 13:02:12,430 - WARNING - Service UUID aef63fa6-ef5d-4f1d-bf2f-492918ba78fb not yet found in contrail-api 2024-10-19 13:02:13,458 - INFO - Validated that Service ctest-nginx-svc-09711885 is seen in contrail-api 2024-10-19 13:02:13,458 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=aef63fa6-ef5d-4f1d-bf2f-492918ba78fb 2024-10-19 13:02:13,465 - INFO - Service ctest-nginx-svc-09711885 with uuid aef63fa6-ef5d-4f1d-bf2f-492918ba78fb found in kube manager 2024-10-19 13:02:13,465 - INFO - Service ctest-nginx-svc-09711885 verification passed 2024-10-19 13:02:14,545 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) ctest-pod-36693689 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,545 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:02:14,545 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) ctest-pod-36693689 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,594 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,594 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:02:14,594 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,644 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,644 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:02:14,644 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,644 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-36693689': 2, 'ctest-pod-49435332': 1} 2024-10-19 13:02:14,695 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,695 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:02:14,695 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:02:14,767 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-49435332 2024-10-19 13:02:14,767 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:02:14,767 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-49435332 2024-10-19 13:02:14,767 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-36693689': 1, 'ctest-pod-49435332': 1} 2024-10-19 13:02:14,770 - DEBUG - Network policy ingress-on-service not present 2024-10-19 13:02:14,771 - INFO - Creating Network Policy ingress-on-service 2024-10-19 13:02:14,787 - INFO - Network policy found in k8s 2024-10-19 13:02:14,787 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=530d3217-1ba6-4df5-9913-c4425e29ccbe 2024-10-19 13:02:14,792 - INFO - Network Policy ingress-on-service with uuid 530d3217-1ba6-4df5-9913-c4425e29ccbe found in kube manager 2024-10-19 13:02:14,824 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-19 13:02:14,824 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-19 13:02:14,824 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=530d3217-1ba6-4df5-9913-c4425e29ccbe 2024-10-19 13:02:14,852 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-19 13:02:16,853 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=530d3217-1ba6-4df5-9913-c4425e29ccbe 2024-10-19 13:02:16,889 - INFO - Network policy with name ingress-on-service found in agent 2024-10-19 13:02:16,889 - INFO - Network Policy ingress-on-service verification passed 2024-10-19 13:02:21,945 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:21,945 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:21,945 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:26,998 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:26,998 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:26,998 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:32,045 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:32,046 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:32,046 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:37,101 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:37,102 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:37,102 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:42,152 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:42,153 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:42,153 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:47,209 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:47,209 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:47,209 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:52,280 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:52,280 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:52,280 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:57,335 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:57,336 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:02:57,336 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:02,400 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:02,401 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:02,401 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:07,473 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:07,473 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:07,474 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:07,474 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-36693689': 0, 'ctest-pod-49435332': 0} 2024-10-19 13:03:07,531 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-36693689 2024-10-19 13:03:07,531 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:03:07,531 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-36693689 2024-10-19 13:03:07,595 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:03:07,595 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:03:07,595 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:03:07,595 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-36693689': 1, 'ctest-pod-49435332': 1} 2024-10-19 13:03:12,648 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:12,648 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:12,648 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:17,713 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:17,713 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:17,713 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:22,778 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:22,779 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:22,779 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:27,837 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:27,837 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:27,837 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:32,896 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:32,896 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:32,896 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:37,959 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:37,959 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:37,959 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:43,032 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:43,033 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:43,033 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:48,101 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:48,101 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:48,101 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:53,173 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:53,173 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:53,173 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:58,224 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:58,225 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:58,225 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:03:58,225 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-36693689': 0, 'ctest-pod-49435332': 0} 2024-10-19 13:04:00,286 - DEBUG - [Pod ctest-pod-12578103] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.758 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.104 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.310/0.758 ms 2024-10-19 13:04:00,286 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12578103 with expectation True passed 2024-10-19 13:04:02,349 - DEBUG - [Pod ctest-pod-35411749] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.506 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.224/0.506 ms 2024-10-19 13:04:02,349 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35411749 with expectation True passed 2024-10-19 13:04:04,420 - DEBUG - [Pod ctest-pod-53187124] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.733 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.293/0.733 ms 2024-10-19 13:04:04,420 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53187124 with expectation True passed 2024-10-19 13:04:04,502 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:04:04,502 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-19 13:04:04,502 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:04:04,502 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12578103 passed 2024-10-19 13:04:04,567 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:04:04,567 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-19 13:04:04,567 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:04:04,567 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12578103 passed 2024-10-19 13:04:09,634 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 13:04:09,634 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 13:04:09,634 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 13:04:09,634 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35411749 passed 2024-10-19 13:04:14,690 - DEBUG - [Pod ctest-pod-49651624] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-19 13:04:14,690 - DEBUG - [Pod Pod ctest-pod-49651624] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-19 13:04:14,690 - DEBUG - [Pod Pod ctest-pod-49651624] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-19 13:04:14,690 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49651624 passed 2024-10-19 13:04:14,697 - INFO - Updating Network Policy ingress-on-service 2024-10-19 13:04:19,772 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:19,772 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:19,772 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:24,833 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:24,834 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:24,834 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:29,900 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:29,900 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:29,900 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:34,970 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:34,970 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:34,970 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:40,033 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:40,033 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:40,033 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:45,098 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:45,098 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:45,098 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:50,152 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:50,152 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:50,152 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:55,241 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:55,241 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:04:55,241 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:00,298 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:00,298 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:00,298 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:05,348 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:05,349 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:05,349 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.108.84.133:80 (10.108.84.133:80) wget: download timed out 2024-10-19 13:05:05,349 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-36693689': 0, 'ctest-pod-49435332': 0} 2024-10-19 13:05:05,405 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,405 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:05:05,405 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,471 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,471 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:05:05,471 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,471 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-36693689': 1, 'ctest-pod-49435332': 1} 2024-10-19 13:05:05,523 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,523 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:05:05,523 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,578 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,578 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:05:05,578 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: ctest-pod-36693689 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,630 - DEBUG - [Pod ctest-pod-53187124] Cmd: wget http://10.108.84.133:80/ -O - -T 5 -t 1 , Output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,630 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd wget http://10.108.84.133:80/ -O - -T 5 -t 1 passed 2024-10-19 13:05:05,630 - DEBUG - [Pod Pod ctest-pod-53187124] Cmd output: ctest-pod-49435332 Connecting to 10.108.84.133:80 (10.108.84.133:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-19 13:05:05,630 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-36693689': 2, 'ctest-pod-49435332': 1} 2024-10-19 13:05:07,694 - DEBUG - [Pod ctest-pod-12578103] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.892 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.053 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.053/0.341/0.892 ms 2024-10-19 13:05:07,694 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12578103 with expectation True passed 2024-10-19 13:05:09,761 - DEBUG - [Pod ctest-pod-35411749] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.428 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.532/1.428 ms 2024-10-19 13:05:09,761 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35411749 with expectation True passed 2024-10-19 13:05:11,820 - DEBUG - [Pod ctest-pod-53187124] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.496 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.215/0.496 ms 2024-10-19 13:05:11,820 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53187124 with expectation True passed 2024-10-19 13:05:11,883 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:05:11,883 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-19 13:05:11,883 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:05:11,883 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12578103 passed 2024-10-19 13:05:11,946 - DEBUG - [Pod ctest-pod-12578103] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:05:11,946 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-19 13:05:11,946 - DEBUG - [Pod Pod ctest-pod-12578103] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:05:11,946 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12578103 passed 2024-10-19 13:05:17,011 - DEBUG - [Pod ctest-pod-35411749] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 13:05:17,011 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 13:05:17,011 - DEBUG - [Pod Pod ctest-pod-35411749] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-19 13:05:17,011 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35411749 passed 2024-10-19 13:05:17,099 - DEBUG - [Pod ctest-pod-49651624] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:05:17,099 - DEBUG - [Pod Pod ctest-pod-49651624] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-19 13:05:17,099 - DEBUG - [Pod Pod ctest-pod-49651624] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-19 13:05:17,099 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49651624 passed 2024-10-19 13:05:17,099 - INFO - Deleting Network Policy : ingress-on-service 2024-10-19 13:05:17,099 - INFO - Deleting service : ctest-nginx-svc-09711885 2024-10-19 13:05:17,324 - DEBUG - No XMPP flaps were noticed during the test 2024-10-19 13:05:17,324 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-10-19 13:05:17,324 - INFO - -------------------------------------------------------------------------------- 2024-10-19 13:05:17,329 - INFO - Deleting pod ctest-new-default-20433592:ctest-pod-36693689 2024-10-19 13:05:17,330 - INFO - Deleting pod ctest-new-default-20433592:ctest-pod-49435332 2024-10-19 13:05:17,330 - INFO - Deleting pod ctest-non-default-91148350:ctest-pod-24416890 2024-10-19 13:05:17,330 - INFO - Deleting pod ctest-non-default-91148350:ctest-pod-00904778 2024-10-19 13:05:17,331 - INFO - Deleting pod ctest-new-default-20433592:ctest-pod-35411749 2024-10-19 13:05:17,331 - INFO - Deleting pod ctest-new-default-20433592:ctest-pod-12578103 2024-10-19 13:05:17,331 - INFO - Deleting pod ctest-non-default-91148350:ctest-pod-53187124 2024-10-19 13:05:17,331 - INFO - Deleting pod ctest-non-default-91148350:ctest-pod-49651624 2024-10-19 13:05:17,441 - WARNING - Pod uuid eb286b49-5836-4d52-b9b1-3a7416662b04 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,443 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,480 - WARNING - Pod uuid 40e7af2a-ca3f-41b2-8988-64ab29f94f45 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,482 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,482 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,482 - WARNING - Pod uuid cb93f0de-ab45-4235-be87-c7590655b370 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,483 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:17,483 - WARNING - Pod uuid 1e42e2ba-c1a0-45f8-b83e-386d651b38b8 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:22,453 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:22,454 - DEBUG - Pod eb286b49-5836-4d52-b9b1-3a7416662b04 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:22,461 - DEBUG - VMI 4f629b5a-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:22,461 - INFO - Verified that pod ctest-pod-36693689 is removed in agent 2024-10-19 13:05:22,506 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:22,506 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:22,508 - DEBUG - Pod cb93f0de-ab45-4235-be87-c7590655b370 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:22,509 - DEBUG - Pod 1e42e2ba-c1a0-45f8-b83e-386d651b38b8 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:22,511 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:22,511 - DEBUG - Pod 40e7af2a-ca3f-41b2-8988-64ab29f94f45 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:22,524 - DEBUG - VMI 510d56b6-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:22,524 - INFO - Verified that pod ctest-pod-00904778 is removed in agent 2024-10-19 13:05:22,525 - DEBUG - VMI 4feb6a66-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:22,526 - INFO - Verified that pod ctest-pod-49435332 is removed in agent 2024-10-19 13:05:22,526 - DEBUG - VMI 5090b462-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:22,526 - INFO - Verified that pod ctest-pod-24416890 is removed in agent 2024-10-19 13:05:27,464 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:27,523 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:27,526 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:27,526 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:32,472 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:32,538 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:32,539 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:32,540 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:37,480 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:37,552 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:37,554 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:37,554 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:42,490 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:42,569 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:42,571 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:42,571 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:47,629 - WARNING - Pod uuid 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:47,630 - WARNING - Pod uuid 3b8776ca-81f8-4601-8e5a-8e79f399290c is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:47,630 - WARNING - Pod uuid 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:47,631 - WARNING - Pod uuid ae512858-115a-4b3f-858f-7f30257c0417 is still seen in agent 10.0.0.28 VM list 2024-10-19 13:05:52,646 - DEBUG - Pod 9eb741da-a2a4-4c81-8f4f-3d59e6466361 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:52,649 - DEBUG - Pod 3b8776ca-81f8-4601-8e5a-8e79f399290c is not in agent 10.0.0.28 VM list 2024-10-19 13:05:52,651 - DEBUG - Pod 7c499ede-80bc-4f3e-b5d4-6b94a1679d89 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:52,662 - DEBUG - VMI 53087c70-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:52,662 - INFO - Verified that pod ctest-pod-49651624 is removed in agent 2024-10-19 13:05:52,663 - DEBUG - VMI 5215613e-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:52,663 - INFO - Verified that pod ctest-pod-12578103 is removed in agent 2024-10-19 13:05:52,664 - DEBUG - VMI 519b2cac-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:52,664 - INFO - Verified that pod ctest-pod-35411749 is removed in agent 2024-10-19 13:05:52,677 - DEBUG - Pod ae512858-115a-4b3f-858f-7f30257c0417 is not in agent 10.0.0.28 VM list 2024-10-19 13:05:52,684 - DEBUG - VMI 52930a12-8e1a-11ef-9830-fa163e1b8634 is removed from agent 10.0.0.28 2024-10-19 13:05:52,684 - INFO - Verified that pod ctest-pod-53187124 is removed in agent 2024-10-19 13:05:52,684 - INFO - Deleting namespace ctest-non-default-91148350 2024-10-19 13:05:52,703 - DEBUG - Namespace ctest-non-default-91148350 still in k8s 2024-10-19 13:05:54,707 - DEBUG - Namespace ctest-non-default-91148350 still in k8s 2024-10-19 13:05:56,713 - DEBUG - Namespace ctest-non-default-91148350 still in k8s 2024-10-19 13:05:58,716 - DEBUG - Namespace ctest-non-default-91148350 is not in k8s 2024-10-19 13:05:58,717 - DEBUG - No need to check project deletion in contrail-api 2024-10-19 13:05:58,717 - INFO - Deleting namespace ctest-new-default-20433592 2024-10-19 13:05:58,730 - DEBUG - Namespace ctest-new-default-20433592 still in k8s 2024-10-19 13:06:00,735 - DEBUG - Namespace ctest-new-default-20433592 still in k8s 2024-10-19 13:06:02,740 - DEBUG - Namespace ctest-new-default-20433592 still in k8s 2024-10-19 13:06:04,745 - DEBUG - Namespace ctest-new-default-20433592 is not in k8s 2024-10-19 13:06:04,745 - DEBUG - No need to check project deletion in contrail-api