2025-03-27 15:13:53,703 - INFO - Using existing project ['default-domain', 'k8s-default'](2d246f7d-6d49-44da-a413-862f547b3d26)
2025-03-27 15:13:53,724 - DEBUG - Namespace ctest-new-default-15700107 not present
2025-03-27 15:13:53,732 - INFO - Created namespace ctest-new-default-15700107
2025-03-27 15:13:56,738 - DEBUG - Namespace ctest-non-default-24527911 not present
2025-03-27 15:13:56,745 - INFO - Created namespace ctest-non-default-24527911
2025-03-27 15:13:59,764 - DEBUG - Pod ctest-pod-43787859 not present
2025-03-27 15:13:59,764 - INFO - Creating Pod ctest-pod-43787859
2025-03-27 15:13:59,800 - DEBUG - Pod : ctest-pod-43787859 UUID is bf6216e4-46bb-49d8-9e6f-f83a4395416b
2025-03-27 15:13:59,806 - DEBUG - Pod ctest-pod-84973383 not present
2025-03-27 15:13:59,806 - INFO - Creating Pod ctest-pod-84973383
2025-03-27 15:13:59,842 - DEBUG - Pod : ctest-pod-84973383 UUID is f98b2d36-f6e5-4c22-91c2-f0bc05907c61
2025-03-27 15:13:59,844 - DEBUG - Pod ctest-pod-04333082 not present
2025-03-27 15:13:59,844 - INFO - Creating Pod ctest-pod-04333082
2025-03-27 15:13:59,862 - DEBUG - Pod : ctest-pod-04333082 UUID is 0d1c98da-f0dd-400f-bc23-d635edda3377
2025-03-27 15:13:59,878 - DEBUG - Pod ctest-pod-45683646 not present
2025-03-27 15:13:59,878 - INFO - Creating Pod ctest-pod-45683646
2025-03-27 15:13:59,901 - DEBUG - Pod : ctest-pod-45683646 UUID is 995aa331-7496-41c5-a78c-39bcb0af1a20
2025-03-27 15:13:59,903 - DEBUG - Pod ctest-pod-39964761 not present
2025-03-27 15:13:59,904 - INFO - Creating Pod ctest-pod-39964761
2025-03-27 15:13:59,923 - DEBUG - Pod : ctest-pod-39964761 UUID is d714f11c-d560-49ec-8de4-c4d968dcd033
2025-03-27 15:13:59,924 - DEBUG - Pod ctest-pod-26721938 not present
2025-03-27 15:13:59,925 - INFO - Creating Pod ctest-pod-26721938
2025-03-27 15:13:59,943 - DEBUG - Pod : ctest-pod-26721938 UUID is 32237782-8a7b-49ef-bec0-1a19d73ba841
2025-03-27 15:13:59,946 - DEBUG - Pod ctest-pod-61188843 not present
2025-03-27 15:13:59,946 - INFO - Creating Pod ctest-pod-61188843
2025-03-27 15:13:59,962 - DEBUG - Pod : ctest-pod-61188843 UUID is 39d9e2f7-3674-4999-acc3-5c8899874dde
2025-03-27 15:13:59,964 - DEBUG - Pod ctest-pod-26829910 not present
2025-03-27 15:13:59,965 - INFO - Creating Pod ctest-pod-26829910
2025-03-27 15:13:59,986 - DEBUG - Pod : ctest-pod-26829910 UUID is ae3fcfc1-197a-4db4-bbbd-c14462e175ce
2025-03-27 15:14:00,148 - INFO - Project default-domain:k8s-ctest-new-default-15700107 for Namespace ctest-new-default-15700107 is seen in contrail-api
2025-03-27 15:14:00,149 - DEBUG - Project uuid in Contrail is 1aff52f1-8c1e-4be1-8bc2-ea358ed78b54
2025-03-27 15:14:00,276 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=d658fb10-bb58-4377-80fa-b3f0c263f928
2025-03-27 15:14:00,280 - INFO - Namespace ctest-new-default-15700107 with uuid d658fb10-bb58-4377-80fa-b3f0c263f928 found in kube manager
2025-03-27 15:14:00,281 - INFO - Namespace ctest-new-default-15700107 verification passed
2025-03-27 15:14:00,553 - INFO - Project default-domain:k8s-ctest-non-default-24527911 for Namespace ctest-non-default-24527911 is seen in contrail-api
2025-03-27 15:14:00,554 - DEBUG - Project uuid in Contrail is 1a80e2d9-fe83-401d-8590-eb1102c26b63
2025-03-27 15:14:00,554 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=0396846e-877f-48c0-9d90-f4b9451f9f3d
2025-03-27 15:14:00,559 - INFO - Namespace ctest-non-default-24527911 with uuid 0396846e-877f-48c0-9d90-f4b9451f9f3d found in kube manager
2025-03-27 15:14:00,560 - INFO - Namespace ctest-non-default-24527911 verification passed
2025-03-27 15:14:00,565 - DEBUG - Pod ctest-pod-43787859 not in running state.Currently in Pending
2025-03-27 15:14:05,571 - DEBUG - Pod ctest-pod-43787859 not in running state.Currently in Pending
2025-03-27 15:14:10,578 - DEBUG - Pod ctest-pod-43787859 not in running state.Currently in Pending
2025-03-27 15:14:15,583 - INFO - Pod ctest-pod-43787859 is in running state.Got IP 10.47.255.251
2025-03-27 15:14:15,596 - DEBUG - Pod ctest-pod-43787859 has vmi 1d421606-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:15,596 - INFO - Verified pod ctest-pod-43787859 in contrail-api
2025-03-27 15:14:15,612 - DEBUG - VMI 1d421606-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:15,612 - INFO - Verified Pod ctest-pod-43787859 in agent 10.0.0.31
2025-03-27 15:14:15,613 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=bf6216e4-46bb-49d8-9e6f-f83a4395416b
2025-03-27 15:14:15,617 - INFO - Pod ctest-pod-43787859 with uuid bf6216e4-46bb-49d8-9e6f-f83a4395416b found in kube manager
2025-03-27 15:14:15,617 - INFO - Pod ctest-pod-43787859 verification passed
2025-03-27 15:14:15,621 - INFO - Pod ctest-pod-84973383 is in running state.Got IP 10.47.255.250
2025-03-27 15:14:15,677 - DEBUG - Pod ctest-pod-84973383 has vmi 1dc35f86-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:15,677 - INFO - Verified pod ctest-pod-84973383 in contrail-api
2025-03-27 15:14:15,692 - DEBUG - VMI 1dc35f86-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:15,692 - INFO - Verified Pod ctest-pod-84973383 in agent 10.0.0.31
2025-03-27 15:14:15,692 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=f98b2d36-f6e5-4c22-91c2-f0bc05907c61
2025-03-27 15:14:15,697 - INFO - Pod ctest-pod-84973383 with uuid f98b2d36-f6e5-4c22-91c2-f0bc05907c61 found in kube manager
2025-03-27 15:14:15,697 - INFO - Pod ctest-pod-84973383 verification passed
2025-03-27 15:14:15,702 - INFO - Pod ctest-pod-04333082 is in running state.Got IP 10.47.255.249
2025-03-27 15:14:15,721 - DEBUG - Pod ctest-pod-04333082 has vmi 1e6af692-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:15,722 - INFO - Verified pod ctest-pod-04333082 in contrail-api
2025-03-27 15:14:15,735 - DEBUG - VMI 1e6af692-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:15,736 - INFO - Verified Pod ctest-pod-04333082 in agent 10.0.0.31
2025-03-27 15:14:15,736 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=0d1c98da-f0dd-400f-bc23-d635edda3377
2025-03-27 15:14:15,740 - INFO - Pod ctest-pod-04333082 with uuid 0d1c98da-f0dd-400f-bc23-d635edda3377 found in kube manager
2025-03-27 15:14:15,740 - INFO - Pod ctest-pod-04333082 verification passed
2025-03-27 15:14:15,744 - INFO - Pod ctest-pod-45683646 is in running state.Got IP 10.47.255.248
2025-03-27 15:14:15,801 - DEBUG - Pod ctest-pod-45683646 has vmi 1ee852c2-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:15,801 - INFO - Verified pod ctest-pod-45683646 in contrail-api
2025-03-27 15:14:15,816 - DEBUG - VMI 1ee852c2-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:15,816 - INFO - Verified Pod ctest-pod-45683646 in agent 10.0.0.31
2025-03-27 15:14:15,816 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=995aa331-7496-41c5-a78c-39bcb0af1a20
2025-03-27 15:14:15,821 - INFO - Pod ctest-pod-45683646 with uuid 995aa331-7496-41c5-a78c-39bcb0af1a20 found in kube manager
2025-03-27 15:14:15,821 - INFO - Pod ctest-pod-45683646 verification passed
2025-03-27 15:14:15,826 - DEBUG - Pod ctest-pod-39964761 not in running state.Currently in Pending
2025-03-27 15:14:20,832 - INFO - Pod ctest-pod-39964761 is in running state.Got IP 10.47.255.247
2025-03-27 15:14:20,845 - DEBUG - Pod ctest-pod-39964761 has vmi 1f6fa5e2-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:20,845 - INFO - Verified pod ctest-pod-39964761 in contrail-api
2025-03-27 15:14:20,860 - DEBUG - VMI 1f6fa5e2-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:20,861 - INFO - Verified Pod ctest-pod-39964761 in agent 10.0.0.31
2025-03-27 15:14:20,861 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d714f11c-d560-49ec-8de4-c4d968dcd033
2025-03-27 15:14:20,865 - INFO - Pod ctest-pod-39964761 with uuid d714f11c-d560-49ec-8de4-c4d968dcd033 found in kube manager
2025-03-27 15:14:20,865 - INFO - Pod ctest-pod-39964761 verification passed
2025-03-27 15:14:20,874 - INFO - Pod ctest-pod-61188843 is in running state.Got IP 10.47.255.245
2025-03-27 15:14:20,929 - DEBUG - Pod ctest-pod-61188843 has vmi 20593f36-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:20,929 - INFO - Verified pod ctest-pod-61188843 in contrail-api
2025-03-27 15:14:20,943 - DEBUG - VMI 20593f36-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:20,943 - INFO - Verified Pod ctest-pod-61188843 in agent 10.0.0.31
2025-03-27 15:14:20,943 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=39d9e2f7-3674-4999-acc3-5c8899874dde
2025-03-27 15:14:20,947 - INFO - Pod ctest-pod-61188843 with uuid 39d9e2f7-3674-4999-acc3-5c8899874dde found in kube manager
2025-03-27 15:14:20,948 - INFO - Pod ctest-pod-61188843 verification passed
2025-03-27 15:14:20,952 - INFO - Pod ctest-pod-26721938 is in running state.Got IP 10.47.255.246
2025-03-27 15:14:21,005 - DEBUG - Pod ctest-pod-26721938 has vmi 1fe30758-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:21,005 - INFO - Verified pod ctest-pod-26721938 in contrail-api
2025-03-27 15:14:21,022 - DEBUG - VMI 1fe30758-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:21,022 - INFO - Verified Pod ctest-pod-26721938 in agent 10.0.0.31
2025-03-27 15:14:21,022 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=32237782-8a7b-49ef-bec0-1a19d73ba841
2025-03-27 15:14:21,026 - INFO - Pod ctest-pod-26721938 with uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 found in kube manager
2025-03-27 15:14:21,026 - INFO - Pod ctest-pod-26721938 verification passed
2025-03-27 15:14:21,031 - INFO - Pod ctest-pod-26829910 is in running state.Got IP 10.47.255.244
2025-03-27 15:14:21,049 - DEBUG - Pod ctest-pod-26829910 has vmi 20ce86ce-0b1e-11f0-a3cb-fa163e3aa370
2025-03-27 15:14:21,049 - INFO - Verified pod ctest-pod-26829910 in contrail-api
2025-03-27 15:14:21,065 - DEBUG - VMI 20ce86ce-0b1e-11f0-a3cb-fa163e3aa370 is active in agent 10.0.0.31
2025-03-27 15:14:21,066 - INFO - Verified Pod ctest-pod-26829910 in agent 10.0.0.31
2025-03-27 15:14:21,066 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=ae3fcfc1-197a-4db4-bbbd-c14462e175ce
2025-03-27 15:14:21,070 - INFO - Pod ctest-pod-26829910 with uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce found in kube manager
2025-03-27 15:14:21,070 - INFO - Pod ctest-pod-26829910 verification passed
2025-03-27 15:14:21,070 - INFO - ================================================================================
2025-03-27 15:14:21,070 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-27 15:14:21,070 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-27 15:14:21,308 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.0.0.27': '0'}} with
2025-03-27 15:14:21,309 - INFO - Initial checks done. Running the testcase now
2025-03-27 15:14:21,309 - INFO -
2025-03-27 15:14:21,386 - DEBUG - [Pod ctest-pod-43787859] Cmd: echo ctest-pod-43787859 > /usr/share/nginx/html/index.html, Output:
2025-03-27 15:14:21,461 - DEBUG - [Pod ctest-pod-84973383] Cmd: echo ctest-pod-84973383 > /usr/share/nginx/html/index.html, Output:
2025-03-27 15:14:21,524 - DEBUG - [Pod ctest-pod-04333082] Cmd: echo ctest-pod-04333082 > /usr/share/nginx/html/index.html, Output:
2025-03-27 15:14:21,584 - DEBUG - [Pod ctest-pod-45683646] Cmd: echo ctest-pod-45683646 > /usr/share/nginx/html/index.html, Output:
2025-03-27 15:14:21,587 - DEBUG - Service ctest-nginx-svc-65436143 not present
2025-03-27 15:14:21,587 - INFO - Creating service ctest-nginx-svc-65436143
2025-03-27 15:14:21,607 - INFO - Created Service ctest-nginx-svc-65436143
2025-03-27 15:14:21,618 - WARNING - Service UUID 7b78e207-cb60-404c-9dab-18603a6fa15a not yet found in contrail-api
2025-03-27 15:14:22,627 - INFO - Validated that Service ctest-nginx-svc-65436143 is seen in contrail-api
2025-03-27 15:14:22,627 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=7b78e207-cb60-404c-9dab-18603a6fa15a
2025-03-27 15:14:22,631 - INFO - Service ctest-nginx-svc-65436143 with uuid 7b78e207-cb60-404c-9dab-18603a6fa15a found in kube manager
2025-03-27 15:14:22,631 - INFO - Service ctest-nginx-svc-65436143 verification passed
2025-03-27 15:14:23,690 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
ctest-pod-43787859
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,690 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:14:23,690 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
ctest-pod-43787859
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,762 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43787859
2025-03-27 15:14:23,762 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:14:23,762 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43787859
2025-03-27 15:14:23,823 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,823 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:14:23,823 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,884 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
ctest-pod-84973383
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,884 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:14:23,884 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
ctest-pod-84973383
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,884 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-43787859': 3, 'ctest-pod-84973383': 1}
2025-03-27 15:14:23,947 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:23,947 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:14:23,947 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:14:24,055 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-84973383
2025-03-27 15:14:24,055 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:14:24,055 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-84973383
2025-03-27 15:14:24,055 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-43787859': 1, 'ctest-pod-84973383': 1}
2025-03-27 15:14:24,058 - DEBUG - Network policy ingress-on-service not present
2025-03-27 15:14:24,058 - INFO - Creating Network Policy ingress-on-service
2025-03-27 15:14:24,068 - INFO - Network policy found in k8s
2025-03-27 15:14:24,068 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9c691d16-bf30-44aa-b996-fcb262642bb2
2025-03-27 15:14:24,072 - INFO - Network Policy ingress-on-service with uuid 9c691d16-bf30-44aa-b996-fcb262642bb2 found in kube manager
2025-03-27 15:14:24,105 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-27 15:14:24,105 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-27 15:14:24,105 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9c691d16-bf30-44aa-b996-fcb262642bb2
2025-03-27 15:14:24,134 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-27 15:14:26,134 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9c691d16-bf30-44aa-b996-fcb262642bb2
2025-03-27 15:14:26,167 - INFO - Network policy with name ingress-on-service found in agent
2025-03-27 15:14:26,167 - INFO - Network Policy ingress-on-service verification passed
2025-03-27 15:14:31,236 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:31,236 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:31,236 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:36,301 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:36,301 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:36,301 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:41,367 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:41,368 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:41,368 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:46,446 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:46,446 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:46,446 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:51,510 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:51,510 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:51,510 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:56,579 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:56,579 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:14:56,579 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:01,641 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:01,641 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:01,641 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:06,708 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:06,708 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:06,708 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:11,775 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:11,775 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:11,775 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:16,828 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:16,828 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:16,828 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:16,828 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-43787859': 0, 'ctest-pod-84973383': 0}
2025-03-27 15:15:16,894 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:16,895 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:15:16,895 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:16,964 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:16,964 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:15:16,964 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:17,033 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:17,033 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:15:17,033 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:17,128 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:17,128 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:15:17,128 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:15:17,128 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-43787859': 1, 'ctest-pod-84973383': 3}
2025-03-27 15:15:22,211 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:22,212 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:22,212 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:27,296 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:27,296 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:27,296 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:32,371 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:32,371 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:32,371 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:37,451 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:37,452 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:37,452 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:42,518 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:42,519 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:42,519 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:47,619 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:47,619 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:47,619 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:52,700 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:52,700 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:52,700 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:57,772 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:57,772 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:15:57,773 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:02,851 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:02,851 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:02,851 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:07,926 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:07,926 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:07,926 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:07,926 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-43787859': 0, 'ctest-pod-84973383': 0}
2025-03-27 15:16:09,988 - DEBUG - [Pod ctest-pod-26721938] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.548 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.230/0.548 ms
2025-03-27 15:16:09,988 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26721938 with expectation True passed
2025-03-27 15:16:12,070 - DEBUG - [Pod ctest-pod-39964761] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.404 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.108 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.096/0.202/0.404 ms
2025-03-27 15:16:12,070 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39964761 with expectation True passed
2025-03-27 15:16:14,141 - DEBUG - [Pod ctest-pod-61188843] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.050 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.096 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.407/1.050 ms
2025-03-27 15:16:14,141 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61188843 with expectation True passed
2025-03-27 15:16:14,222 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:16:14,222 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-27 15:16:14,222 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:16:14,222 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26721938 passed
2025-03-27 15:16:14,306 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:16:14,307 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-27 15:16:14,307 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:16:14,307 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26721938 passed
2025-03-27 15:16:16,435 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-03-27 15:16:26,502 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-27 15:16:26,502 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-27 15:16:26,502 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-27 15:16:26,502 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39964761 passed
2025-03-27 15:16:31,579 - DEBUG - [Pod ctest-pod-26829910] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-27 15:16:31,579 - DEBUG - [Pod Pod ctest-pod-26829910] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-27 15:16:31,579 - DEBUG - [Pod Pod ctest-pod-26829910] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-27 15:16:31,579 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26829910 passed
2025-03-27 15:16:31,587 - INFO - Updating Network Policy ingress-on-service
2025-03-27 15:16:36,667 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:36,667 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:36,668 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:41,727 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:41,727 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:41,727 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:46,778 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:46,779 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:46,779 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:51,839 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:51,839 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:51,839 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:56,904 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:56,904 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:16:56,904 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:01,975 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:01,976 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:01,976 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:07,032 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:07,032 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:07,032 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:12,096 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:12,096 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:12,096 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:17,173 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:17,173 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:17,173 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:22,232 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:22,232 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:22,232 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
wget: download timed out
2025-03-27 15:17:22,232 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-43787859': 0, 'ctest-pod-84973383': 0}
2025-03-27 15:17:22,308 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43787859
2025-03-27 15:17:22,308 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:17:22,308 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43787859
2025-03-27 15:17:22,362 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-84973383
2025-03-27 15:17:22,362 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:17:22,362 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-84973383
2025-03-27 15:17:22,362 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-43787859': 1, 'ctest-pod-84973383': 1}
2025-03-27 15:17:22,420 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:17:22,420 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:17:22,420 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:17:22,474 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:17:22,474 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:17:22,474 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: ctest-pod-84973383
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:17:22,537 - DEBUG - [Pod ctest-pod-61188843] Cmd: wget http://10.109.205.17:80/ -O - -T 5 -t 1 , Output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:17:22,537 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd wget http://10.109.205.17:80/ -O - -T 5 -t 1 passed
2025-03-27 15:17:22,537 - DEBUG - [Pod Pod ctest-pod-61188843] Cmd output: ctest-pod-43787859
Connecting to 10.109.205.17:80 (10.109.205.17:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-27 15:17:22,537 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-43787859': 1, 'ctest-pod-84973383': 2}
2025-03-27 15:17:24,612 - DEBUG - [Pod ctest-pod-26721938] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.220 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.104 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.470/1.220 ms
2025-03-27 15:17:24,612 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26721938 with expectation True passed
2025-03-27 15:17:26,676 - DEBUG - [Pod ctest-pod-39964761] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.606 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.588/1.606 ms
2025-03-27 15:17:26,676 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39964761 with expectation True passed
2025-03-27 15:17:28,738 - DEBUG - [Pod ctest-pod-61188843] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.413 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.089/0.202/0.413 ms
2025-03-27 15:17:28,738 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61188843 with expectation True passed
2025-03-27 15:17:28,809 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:17:28,809 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-27 15:17:28,809 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:17:28,809 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26721938 passed
2025-03-27 15:17:28,877 - DEBUG - [Pod ctest-pod-26721938] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:17:28,877 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-27 15:17:28,877 - DEBUG - [Pod Pod ctest-pod-26721938] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:17:28,877 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26721938 passed
2025-03-27 15:17:33,938 - DEBUG - [Pod ctest-pod-39964761] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-27 15:17:33,939 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-27 15:17:33,939 - DEBUG - [Pod Pod ctest-pod-39964761] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-27 15:17:33,939 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39964761 passed
2025-03-27 15:17:34,002 - DEBUG - [Pod ctest-pod-26829910] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:17:34,002 - DEBUG - [Pod Pod ctest-pod-26829910] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-27 15:17:34,002 - DEBUG - [Pod Pod ctest-pod-26829910] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-27 15:17:34,002 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26829910 passed
2025-03-27 15:17:34,002 - INFO - Deleting Network Policy : ingress-on-service
2025-03-27 15:17:34,003 - INFO - Deleting service : ctest-nginx-svc-65436143
2025-03-27 15:17:34,237 - DEBUG - No XMPP flaps were noticed during the test
2025-03-27 15:17:34,237 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-03-27 15:17:34,237 - INFO - --------------------------------------------------------------------------------
2025-03-27 15:17:34,243 - INFO - Deleting pod ctest-new-default-15700107:ctest-pod-43787859
2025-03-27 15:17:34,244 - INFO - Deleting pod ctest-new-default-15700107:ctest-pod-84973383
2025-03-27 15:17:34,244 - INFO - Deleting pod ctest-non-default-24527911:ctest-pod-04333082
2025-03-27 15:17:34,245 - INFO - Deleting pod ctest-non-default-24527911:ctest-pod-45683646
2025-03-27 15:17:34,245 - INFO - Deleting pod ctest-new-default-15700107:ctest-pod-39964761
2025-03-27 15:17:34,246 - INFO - Deleting pod ctest-new-default-15700107:ctest-pod-26721938
2025-03-27 15:17:34,246 - INFO - Deleting pod ctest-non-default-24527911:ctest-pod-61188843
2025-03-27 15:17:34,246 - INFO - Deleting pod ctest-non-default-24527911:ctest-pod-26829910
2025-03-27 15:17:34,401 - WARNING - Pod uuid 995aa331-7496-41c5-a78c-39bcb0af1a20 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,401 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,402 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,403 - WARNING - Pod uuid f98b2d36-f6e5-4c22-91c2-f0bc05907c61 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,403 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,403 - WARNING - Pod uuid 0d1c98da-f0dd-400f-bc23-d635edda3377 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,404 - WARNING - Pod uuid bf6216e4-46bb-49d8-9e6f-f83a4395416b is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:34,404 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:39,439 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:39,439 - DEBUG - Pod 0d1c98da-f0dd-400f-bc23-d635edda3377 is not in agent 10.0.0.31 VM list
2025-03-27 15:17:39,441 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:39,441 - DEBUG - Pod 995aa331-7496-41c5-a78c-39bcb0af1a20 is not in agent 10.0.0.31 VM list
2025-03-27 15:17:39,442 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:39,443 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:39,443 - DEBUG - Pod f98b2d36-f6e5-4c22-91c2-f0bc05907c61 is not in agent 10.0.0.31 VM list
2025-03-27 15:17:39,446 - DEBUG - Pod bf6216e4-46bb-49d8-9e6f-f83a4395416b is not in agent 10.0.0.31 VM list
2025-03-27 15:17:39,459 - DEBUG - VMI 1ee852c2-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:17:39,459 - INFO - Verified that pod ctest-pod-45683646 is removed in agent
2025-03-27 15:17:39,460 - DEBUG - VMI 1dc35f86-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:17:39,460 - INFO - Verified that pod ctest-pod-84973383 is removed in agent
2025-03-27 15:17:39,462 - DEBUG - VMI 1e6af692-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:17:39,462 - INFO - Verified that pod ctest-pod-04333082 is removed in agent
2025-03-27 15:17:39,463 - DEBUG - VMI 1d421606-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:17:39,463 - INFO - Verified that pod ctest-pod-43787859 is removed in agent
2025-03-27 15:17:44,464 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:44,465 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:44,465 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:44,465 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:49,486 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:49,486 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:49,487 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:49,488 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:54,507 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:54,508 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:54,509 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:54,509 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:59,526 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:59,528 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:59,529 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:17:59,529 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:18:04,576 - WARNING - Pod uuid d714f11c-d560-49ec-8de4-c4d968dcd033 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:18:04,583 - WARNING - Pod uuid 39d9e2f7-3674-4999-acc3-5c8899874dde is still seen in agent 10.0.0.31 VM list
2025-03-27 15:18:04,585 - WARNING - Pod uuid 32237782-8a7b-49ef-bec0-1a19d73ba841 is still seen in agent 10.0.0.31 VM list
2025-03-27 15:18:04,585 - WARNING - Pod uuid ae3fcfc1-197a-4db4-bbbd-c14462e175ce is still seen in agent 10.0.0.31 VM list
2025-03-27 15:18:09,584 - DEBUG - Pod d714f11c-d560-49ec-8de4-c4d968dcd033 is not in agent 10.0.0.31 VM list
2025-03-27 15:18:09,601 - DEBUG - Pod ae3fcfc1-197a-4db4-bbbd-c14462e175ce is not in agent 10.0.0.31 VM list
2025-03-27 15:18:09,603 - DEBUG - VMI 1f6fa5e2-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:18:09,603 - INFO - Verified that pod ctest-pod-39964761 is removed in agent
2025-03-27 15:18:09,605 - DEBUG - Pod 39d9e2f7-3674-4999-acc3-5c8899874dde is not in agent 10.0.0.31 VM list
2025-03-27 15:18:09,606 - DEBUG - Pod 32237782-8a7b-49ef-bec0-1a19d73ba841 is not in agent 10.0.0.31 VM list
2025-03-27 15:18:09,621 - DEBUG - VMI 1fe30758-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:18:09,621 - INFO - Verified that pod ctest-pod-26721938 is removed in agent
2025-03-27 15:18:09,622 - DEBUG - VMI 20593f36-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:18:09,622 - INFO - Verified that pod ctest-pod-61188843 is removed in agent
2025-03-27 15:18:09,623 - DEBUG - VMI 20ce86ce-0b1e-11f0-a3cb-fa163e3aa370 is removed from agent 10.0.0.31
2025-03-27 15:18:09,623 - INFO - Verified that pod ctest-pod-26829910 is removed in agent
2025-03-27 15:18:09,623 - INFO - Deleting namespace ctest-non-default-24527911
2025-03-27 15:18:09,640 - DEBUG - Namespace ctest-non-default-24527911 still in k8s
2025-03-27 15:18:11,644 - DEBUG - Namespace ctest-non-default-24527911 still in k8s
2025-03-27 15:18:13,648 - DEBUG - Namespace ctest-non-default-24527911 still in k8s
2025-03-27 15:18:15,652 - DEBUG - Namespace ctest-non-default-24527911 is not in k8s
2025-03-27 15:18:15,652 - DEBUG - No need to check project deletion in contrail-api
2025-03-27 15:18:15,653 - INFO - Deleting namespace ctest-new-default-15700107
2025-03-27 15:18:15,661 - DEBUG - Namespace ctest-new-default-15700107 still in k8s
2025-03-27 15:18:17,665 - DEBUG - Namespace ctest-new-default-15700107 still in k8s
2025-03-27 15:18:19,669 - DEBUG - Namespace ctest-new-default-15700107 still in k8s
2025-03-27 15:18:21,674 - DEBUG - Namespace ctest-new-default-15700107 is not in k8s
2025-03-27 15:18:21,674 - DEBUG - No need to check project deletion in contrail-api