2025-10-31 05:24:34,257 - INFO - Using existing project ['default-domain', 'k8s-default'](79340e99-4a12-4ae9-9e45-dfe67dd9c65c)
2025-10-31 05:24:34,279 - DEBUG - Namespace ctest-new-default-75318410 not present
2025-10-31 05:24:34,295 - INFO - Created namespace ctest-new-default-75318410
2025-10-31 05:24:37,299 - DEBUG - Namespace ctest-non-default-92893912 not present
2025-10-31 05:24:37,311 - INFO - Created namespace ctest-non-default-92893912
2025-10-31 05:24:40,340 - DEBUG - Pod ctest-pod-91378435 not present
2025-10-31 05:24:40,341 - INFO - Creating Pod ctest-pod-91378435
2025-10-31 05:24:40,403 - DEBUG - Pod : ctest-pod-91378435 UUID is 298a294e-7876-4d1f-8374-4d43c5a997d0
2025-10-31 05:24:40,420 - DEBUG - Pod ctest-pod-19823348 not present
2025-10-31 05:24:40,421 - INFO - Creating Pod ctest-pod-19823348
2025-10-31 05:24:40,460 - DEBUG - Pod : ctest-pod-19823348 UUID is 83356b45-e3fb-4f21-bd3a-546ec641b5d3
2025-10-31 05:24:40,464 - DEBUG - Pod ctest-pod-95613466 not present
2025-10-31 05:24:40,465 - INFO - Creating Pod ctest-pod-95613466
2025-10-31 05:24:40,503 - DEBUG - Pod : ctest-pod-95613466 UUID is a4c4cff7-e50a-43d1-8b70-4556754bf7fe
2025-10-31 05:24:40,507 - DEBUG - Pod ctest-pod-48534670 not present
2025-10-31 05:24:40,508 - INFO - Creating Pod ctest-pod-48534670
2025-10-31 05:24:40,546 - DEBUG - Pod : ctest-pod-48534670 UUID is 40c6fbc2-e2a8-4b04-bf42-fb3539418477
2025-10-31 05:24:40,549 - DEBUG - Pod ctest-pod-73791998 not present
2025-10-31 05:24:40,550 - INFO - Creating Pod ctest-pod-73791998
2025-10-31 05:24:40,600 - DEBUG - Pod : ctest-pod-73791998 UUID is 4d72b933-aa4b-4402-b17c-7f630fe8831a
2025-10-31 05:24:40,604 - DEBUG - Pod ctest-pod-78687359 not present
2025-10-31 05:24:40,622 - INFO - Creating Pod ctest-pod-78687359
2025-10-31 05:24:40,657 - DEBUG - Pod : ctest-pod-78687359 UUID is 38a47f72-a3ea-42af-b401-e9035d01cb21
2025-10-31 05:24:40,660 - DEBUG - Pod ctest-pod-71886853 not present
2025-10-31 05:24:40,661 - INFO - Creating Pod ctest-pod-71886853
2025-10-31 05:24:40,701 - DEBUG - Pod : ctest-pod-71886853 UUID is 6da00324-4f26-4317-959d-ea53c8516e51
2025-10-31 05:24:40,705 - DEBUG - Pod ctest-pod-25208390 not present
2025-10-31 05:24:40,705 - INFO - Creating Pod ctest-pod-25208390
2025-10-31 05:24:40,735 - DEBUG - Pod : ctest-pod-25208390 UUID is 61911647-3e27-4033-9f13-b889b862c1c4
2025-10-31 05:24:41,076 - INFO - Project default-domain:k8s-ctest-new-default-75318410 for Namespace ctest-new-default-75318410 is seen in contrail-api
2025-10-31 05:24:41,076 - DEBUG - Project uuid in Contrail is 9ab7ab4c-140c-46d0-badc-73564a4f4245
2025-10-31 05:24:41,325 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=52c670ff-df10-45b5-a204-33a539acf1ea
2025-10-31 05:24:41,330 - INFO - Namespace ctest-new-default-75318410 with uuid 52c670ff-df10-45b5-a204-33a539acf1ea found in kube manager
2025-10-31 05:24:41,331 - INFO - Namespace ctest-new-default-75318410 verification passed
2025-10-31 05:24:41,657 - INFO - Project default-domain:k8s-ctest-non-default-92893912 for Namespace ctest-non-default-92893912 is seen in contrail-api
2025-10-31 05:24:41,657 - DEBUG - Project uuid in Contrail is 31feefc9-6e98-4a2f-ab4e-b866b8672240
2025-10-31 05:24:41,657 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=3a6fe6df-f261-4ab4-9711-5deb8a281860
2025-10-31 05:24:41,671 - INFO - Namespace ctest-non-default-92893912 with uuid 3a6fe6df-f261-4ab4-9711-5deb8a281860 found in kube manager
2025-10-31 05:24:41,671 - INFO - Namespace ctest-non-default-92893912 verification passed
2025-10-31 05:24:41,689 - DEBUG - Pod ctest-pod-91378435 not in running state.Currently in Pending
2025-10-31 05:24:46,697 - DEBUG - Pod ctest-pod-91378435 not in running state.Currently in Pending
2025-10-31 05:24:51,706 - DEBUG - Pod ctest-pod-91378435 not in running state.Currently in Pending
2025-10-31 05:24:56,714 - INFO - Pod ctest-pod-91378435 is in running state.Got IP 10.47.255.251
2025-10-31 05:24:56,769 - DEBUG - Pod ctest-pod-91378435 has vmi e79d6f76-b619-11f0-86b2-fa163e60e769
2025-10-31 05:24:56,769 - INFO - Verified pod ctest-pod-91378435 in contrail-api
2025-10-31 05:24:56,786 - DEBUG - VMI e79d6f76-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:24:56,786 - INFO - Verified Pod ctest-pod-91378435 in agent 10.0.0.240
2025-10-31 05:24:56,786 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=298a294e-7876-4d1f-8374-4d43c5a997d0
2025-10-31 05:24:56,793 - INFO - Pod ctest-pod-91378435 with uuid 298a294e-7876-4d1f-8374-4d43c5a997d0 found in kube manager
2025-10-31 05:24:56,793 - INFO - Pod ctest-pod-91378435 verification passed
2025-10-31 05:24:56,803 - INFO - Pod ctest-pod-19823348 is in running state.Got IP 10.47.255.250
2025-10-31 05:24:56,822 - DEBUG - Pod ctest-pod-19823348 has vmi e82ccc84-b619-11f0-86b2-fa163e60e769
2025-10-31 05:24:56,822 - INFO - Verified pod ctest-pod-19823348 in contrail-api
2025-10-31 05:24:56,835 - DEBUG - VMI e82ccc84-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:24:56,835 - INFO - Verified Pod ctest-pod-19823348 in agent 10.0.0.240
2025-10-31 05:24:56,835 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=83356b45-e3fb-4f21-bd3a-546ec641b5d3
2025-10-31 05:24:56,840 - INFO - Pod ctest-pod-19823348 with uuid 83356b45-e3fb-4f21-bd3a-546ec641b5d3 found in kube manager
2025-10-31 05:24:56,840 - INFO - Pod ctest-pod-19823348 verification passed
2025-10-31 05:24:56,847 - INFO - Pod ctest-pod-95613466 is in running state.Got IP 10.47.255.249
2025-10-31 05:24:56,905 - DEBUG - Pod ctest-pod-95613466 has vmi e8e0a560-b619-11f0-86b2-fa163e60e769
2025-10-31 05:24:56,905 - INFO - Verified pod ctest-pod-95613466 in contrail-api
2025-10-31 05:24:56,920 - DEBUG - VMI e8e0a560-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:24:56,921 - INFO - Verified Pod ctest-pod-95613466 in agent 10.0.0.240
2025-10-31 05:24:56,921 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=a4c4cff7-e50a-43d1-8b70-4556754bf7fe
2025-10-31 05:24:56,926 - INFO - Pod ctest-pod-95613466 with uuid a4c4cff7-e50a-43d1-8b70-4556754bf7fe found in kube manager
2025-10-31 05:24:56,926 - INFO - Pod ctest-pod-95613466 verification passed
2025-10-31 05:24:56,935 - INFO - Pod ctest-pod-48534670 is in running state.Got IP 10.47.255.248
2025-10-31 05:24:56,989 - DEBUG - Pod ctest-pod-48534670 has vmi e970b218-b619-11f0-86b2-fa163e60e769
2025-10-31 05:24:56,989 - INFO - Verified pod ctest-pod-48534670 in contrail-api
2025-10-31 05:24:57,001 - DEBUG - VMI e970b218-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:24:57,001 - INFO - Verified Pod ctest-pod-48534670 in agent 10.0.0.240
2025-10-31 05:24:57,001 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=40c6fbc2-e2a8-4b04-bf42-fb3539418477
2025-10-31 05:24:57,006 - INFO - Pod ctest-pod-48534670 with uuid 40c6fbc2-e2a8-4b04-bf42-fb3539418477 found in kube manager
2025-10-31 05:24:57,006 - INFO - Pod ctest-pod-48534670 verification passed
2025-10-31 05:24:57,013 - DEBUG - Pod ctest-pod-73791998 not in running state.Currently in Pending
2025-10-31 05:25:02,022 - INFO - Pod ctest-pod-73791998 is in running state.Got IP 10.47.255.247
2025-10-31 05:25:02,037 - DEBUG - Pod ctest-pod-73791998 has vmi ea08ff32-b619-11f0-86b2-fa163e60e769
2025-10-31 05:25:02,037 - INFO - Verified pod ctest-pod-73791998 in contrail-api
2025-10-31 05:25:02,050 - DEBUG - VMI ea08ff32-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:25:02,050 - INFO - Verified Pod ctest-pod-73791998 in agent 10.0.0.240
2025-10-31 05:25:02,051 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=4d72b933-aa4b-4402-b17c-7f630fe8831a
2025-10-31 05:25:02,055 - INFO - Pod ctest-pod-73791998 with uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a found in kube manager
2025-10-31 05:25:02,055 - INFO - Pod ctest-pod-73791998 verification passed
2025-10-31 05:25:02,064 - INFO - Pod ctest-pod-71886853 is in running state.Got IP 10.47.255.245
2025-10-31 05:25:02,125 - DEBUG - Pod ctest-pod-71886853 has vmi eb092dd0-b619-11f0-86b2-fa163e60e769
2025-10-31 05:25:02,125 - INFO - Verified pod ctest-pod-71886853 in contrail-api
2025-10-31 05:25:02,138 - DEBUG - VMI eb092dd0-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:25:02,139 - INFO - Verified Pod ctest-pod-71886853 in agent 10.0.0.240
2025-10-31 05:25:02,139 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=6da00324-4f26-4317-959d-ea53c8516e51
2025-10-31 05:25:02,143 - INFO - Pod ctest-pod-71886853 with uuid 6da00324-4f26-4317-959d-ea53c8516e51 found in kube manager
2025-10-31 05:25:02,144 - INFO - Pod ctest-pod-71886853 verification passed
2025-10-31 05:25:02,151 - INFO - Pod ctest-pod-78687359 is in running state.Got IP 10.47.255.246
2025-10-31 05:25:02,165 - DEBUG - Pod ctest-pod-78687359 has vmi ea85b572-b619-11f0-86b2-fa163e60e769
2025-10-31 05:25:02,165 - INFO - Verified pod ctest-pod-78687359 in contrail-api
2025-10-31 05:25:02,181 - DEBUG - VMI ea85b572-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:25:02,182 - INFO - Verified Pod ctest-pod-78687359 in agent 10.0.0.240
2025-10-31 05:25:02,182 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=38a47f72-a3ea-42af-b401-e9035d01cb21
2025-10-31 05:25:02,188 - INFO - Pod ctest-pod-78687359 with uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 found in kube manager
2025-10-31 05:25:02,188 - INFO - Pod ctest-pod-78687359 verification passed
2025-10-31 05:25:02,198 - INFO - Pod ctest-pod-25208390 is in running state.Got IP 10.47.255.244
2025-10-31 05:25:02,257 - DEBUG - Pod ctest-pod-25208390 has vmi eb855626-b619-11f0-86b2-fa163e60e769
2025-10-31 05:25:02,257 - INFO - Verified pod ctest-pod-25208390 in contrail-api
2025-10-31 05:25:02,270 - DEBUG - VMI eb855626-b619-11f0-86b2-fa163e60e769 is active in agent 10.0.0.240
2025-10-31 05:25:02,271 - INFO - Verified Pod ctest-pod-25208390 in agent 10.0.0.240
2025-10-31 05:25:02,271 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=61911647-3e27-4033-9f13-b889b862c1c4
2025-10-31 05:25:02,275 - INFO - Pod ctest-pod-25208390 with uuid 61911647-3e27-4033-9f13-b889b862c1c4 found in kube manager
2025-10-31 05:25:02,275 - INFO - Pod ctest-pod-25208390 verification passed
2025-10-31 05:25:02,276 - INFO - ================================================================================
2025-10-31 05:25:02,276 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-31 05:25:02,276 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-31 05:25:02,543 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.0.0.241': '0'}} with
2025-10-31 05:25:02,543 - INFO - Initial checks done. Running the testcase now
2025-10-31 05:25:02,543 - INFO -
2025-10-31 05:25:02,608 - DEBUG - [Pod ctest-pod-91378435] Cmd: echo ctest-pod-91378435 > /usr/share/nginx/html/index.html, Output:
2025-10-31 05:25:02,664 - DEBUG - [Pod ctest-pod-19823348] Cmd: echo ctest-pod-19823348 > /usr/share/nginx/html/index.html, Output:
2025-10-31 05:25:02,726 - DEBUG - [Pod ctest-pod-95613466] Cmd: echo ctest-pod-95613466 > /usr/share/nginx/html/index.html, Output:
2025-10-31 05:25:02,791 - DEBUG - [Pod ctest-pod-48534670] Cmd: echo ctest-pod-48534670 > /usr/share/nginx/html/index.html, Output:
2025-10-31 05:25:02,794 - DEBUG - Service ctest-nginx-svc-26541688 not present
2025-10-31 05:25:02,795 - INFO - Creating service ctest-nginx-svc-26541688
2025-10-31 05:25:02,820 - INFO - Created Service ctest-nginx-svc-26541688
2025-10-31 05:25:02,830 - WARNING - Service UUID cf49b0e4-17ce-4a85-b31e-207e76c002dd not yet found in contrail-api
2025-10-31 05:25:03,839 - INFO - Validated that Service ctest-nginx-svc-26541688 is seen in contrail-api
2025-10-31 05:25:03,839 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_LoadbalancerDatabaseList?x=cf49b0e4-17ce-4a85-b31e-207e76c002dd
2025-10-31 05:25:03,843 - INFO - Service ctest-nginx-svc-26541688 with uuid cf49b0e4-17ce-4a85-b31e-207e76c002dd found in kube manager
2025-10-31 05:25:03,844 - INFO - Service ctest-nginx-svc-26541688 verification passed
2025-10-31 05:25:04,910 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
ctest-pod-91378435
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:04,910 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:25:04,910 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
ctest-pod-91378435
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:04,963 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:04,963 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:25:04,963 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:04,963 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91378435': 1, 'ctest-pod-19823348': 1}
2025-10-31 05:25:05,022 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:05,022 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:25:05,022 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:05,074 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:05,074 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:25:05,074 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:25:05,074 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91378435': 1, 'ctest-pod-19823348': 1}
2025-10-31 05:25:05,078 - DEBUG - Network policy ingress-on-service not present
2025-10-31 05:25:05,079 - INFO - Creating Network Policy ingress-on-service
2025-10-31 05:25:05,096 - INFO - Network policy found in k8s
2025-10-31 05:25:05,096 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=26d24502-e999-4621-abd6-aa846d8f6fe3
2025-10-31 05:25:05,103 - INFO - Network Policy ingress-on-service with uuid 26d24502-e999-4621-abd6-aa846d8f6fe3 found in kube manager
2025-10-31 05:25:05,133 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-31 05:25:05,133 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-31 05:25:05,133 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=26d24502-e999-4621-abd6-aa846d8f6fe3
2025-10-31 05:25:05,158 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-31 05:25:07,160 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=26d24502-e999-4621-abd6-aa846d8f6fe3
2025-10-31 05:25:07,188 - INFO - Network policy with name ingress-on-service found in agent
2025-10-31 05:25:07,188 - INFO - Network Policy ingress-on-service verification passed
2025-10-31 05:25:12,241 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:12,241 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:12,242 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:17,293 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:17,293 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:17,293 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:22,359 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:22,359 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:22,359 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:27,421 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:27,421 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:27,421 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:32,475 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:32,476 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:32,476 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:37,531 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:37,531 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:37,532 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:42,590 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:42,591 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:42,591 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:47,652 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:47,652 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:47,652 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:52,702 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:52,702 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:52,702 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:25:57,563 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-31 05:26:07,628 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:07,629 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:07,629 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:07,629 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91378435': 0, 'ctest-pod-19823348': 0}
2025-10-31 05:26:07,695 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:26:07,695 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:26:07,695 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:26:07,757 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:26:07,757 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:26:07,757 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:26:07,757 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91378435': 1, 'ctest-pod-19823348': 1}
2025-10-31 05:26:12,823 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:12,823 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:12,823 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:17,877 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:17,877 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:17,877 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:22,934 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:22,934 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:22,934 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:27,991 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:27,991 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:27,991 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:33,066 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:33,066 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:33,066 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:38,117 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:38,118 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:38,118 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:43,172 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:43,172 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:43,172 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:48,234 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:48,234 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:48,234 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:53,285 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:53,285 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:53,285 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:58,338 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:58,338 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:58,338 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:26:58,338 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91378435': 0, 'ctest-pod-19823348': 0}
2025-10-31 05:27:00,391 - DEBUG - [Pod ctest-pod-78687359] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=15.146 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.120 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/5.113/15.146 ms
2025-10-31 05:27:00,391 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-78687359 with expectation True passed
2025-10-31 05:27:02,480 - DEBUG - [Pod ctest-pod-73791998] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.439 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.197/0.439 ms
2025-10-31 05:27:02,480 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73791998 with expectation True passed
2025-10-31 05:27:04,535 - DEBUG - [Pod ctest-pod-71886853] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.814 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.330/0.814 ms
2025-10-31 05:27:04,535 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71886853 with expectation True passed
2025-10-31 05:27:04,594 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:27:04,594 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-31 05:27:04,594 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:27:04,594 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78687359 passed
2025-10-31 05:27:04,648 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:27:04,648 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-31 05:27:04,648 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:27:04,648 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78687359 passed
2025-10-31 05:27:09,702 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 05:27:09,703 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 05:27:09,703 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 05:27:09,703 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73791998 passed
2025-10-31 05:27:14,756 - DEBUG - [Pod ctest-pod-25208390] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-31 05:27:14,756 - DEBUG - [Pod Pod ctest-pod-25208390] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-31 05:27:14,756 - DEBUG - [Pod Pod ctest-pod-25208390] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-31 05:27:14,756 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25208390 passed
2025-10-31 05:27:14,767 - INFO - Updating Network Policy ingress-on-service
2025-10-31 05:27:19,833 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:19,833 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:19,833 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:24,887 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:24,887 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:24,887 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:29,942 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:29,943 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:29,943 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:35,007 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:35,007 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:35,007 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:40,058 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:40,058 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:40,058 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:45,119 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:45,119 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:45,119 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:50,174 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:50,174 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:50,174 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:55,234 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:55,234 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:27:55,234 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:00,290 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:00,290 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:00,290 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:05,335 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:05,336 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:05,336 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.110.164.223:80 (10.110.164.223:80)
wget: download timed out
2025-10-31 05:28:05,336 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91378435': 0, 'ctest-pod-19823348': 0}
2025-10-31 05:28:05,395 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,395 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,395 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,455 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,455 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,455 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,509 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,509 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,509 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,509 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91378435': 2, 'ctest-pod-19823348': 1}
2025-10-31 05:28:05,568 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,568 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,568 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,625 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,625 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,625 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,684 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,684 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,685 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: ctest-pod-19823348
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,743 - DEBUG - [Pod ctest-pod-71886853] Cmd: wget http://10.110.164.223:80/ -O - -T 5 -t 1 , Output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,743 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd wget http://10.110.164.223:80/ -O - -T 5 -t 1 passed
2025-10-31 05:28:05,743 - DEBUG - [Pod Pod ctest-pod-71886853] Cmd output: ctest-pod-91378435
Connecting to 10.110.164.223:80 (10.110.164.223:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 05:28:05,743 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91378435': 1, 'ctest-pod-19823348': 3}
2025-10-31 05:28:07,794 - DEBUG - [Pod ctest-pod-78687359] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.979 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.114 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.095/0.396/0.979 ms
2025-10-31 05:28:07,794 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-78687359 with expectation True passed
2025-10-31 05:28:09,856 - DEBUG - [Pod ctest-pod-73791998] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.106 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.423/1.106 ms
2025-10-31 05:28:09,857 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73791998 with expectation True passed
2025-10-31 05:28:11,907 - DEBUG - [Pod ctest-pod-71886853] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.770 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.317/0.770 ms
2025-10-31 05:28:11,907 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71886853 with expectation True passed
2025-10-31 05:28:11,962 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:28:11,962 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-31 05:28:11,962 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:28:11,962 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78687359 passed
2025-10-31 05:28:12,023 - DEBUG - [Pod ctest-pod-78687359] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:28:12,023 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-31 05:28:12,023 - DEBUG - [Pod Pod ctest-pod-78687359] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:28:12,023 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78687359 passed
2025-10-31 05:28:17,074 - DEBUG - [Pod ctest-pod-73791998] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 05:28:17,074 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 05:28:17,074 - DEBUG - [Pod Pod ctest-pod-73791998] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 05:28:17,074 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73791998 passed
2025-10-31 05:28:17,127 - DEBUG - [Pod ctest-pod-25208390] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:28:17,127 - DEBUG - [Pod Pod ctest-pod-25208390] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-31 05:28:17,127 - DEBUG - [Pod Pod ctest-pod-25208390] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 05:28:17,127 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25208390 passed
2025-10-31 05:28:17,128 - INFO - Deleting Network Policy : ingress-on-service
2025-10-31 05:28:17,128 - INFO - Deleting service : ctest-nginx-svc-26541688
2025-10-31 05:28:17,386 - DEBUG - No XMPP flaps were noticed during the test
2025-10-31 05:28:17,386 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2025-10-31 05:28:17,386 - INFO - --------------------------------------------------------------------------------
2025-10-31 05:28:17,392 - INFO - Deleting pod ctest-new-default-75318410:ctest-pod-91378435
2025-10-31 05:28:17,393 - INFO - Deleting pod ctest-new-default-75318410:ctest-pod-19823348
2025-10-31 05:28:17,394 - INFO - Deleting pod ctest-non-default-92893912:ctest-pod-95613466
2025-10-31 05:28:17,395 - INFO - Deleting pod ctest-non-default-92893912:ctest-pod-48534670
2025-10-31 05:28:17,395 - INFO - Deleting pod ctest-new-default-75318410:ctest-pod-73791998
2025-10-31 05:28:17,396 - INFO - Deleting pod ctest-new-default-75318410:ctest-pod-78687359
2025-10-31 05:28:17,396 - INFO - Deleting pod ctest-non-default-92893912:ctest-pod-71886853
2025-10-31 05:28:17,397 - INFO - Deleting pod ctest-non-default-92893912:ctest-pod-25208390
2025-10-31 05:28:17,614 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,617 - WARNING - Pod uuid a4c4cff7-e50a-43d1-8b70-4556754bf7fe is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,617 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,618 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,618 - WARNING - Pod uuid 40c6fbc2-e2a8-4b04-bf42-fb3539418477 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,619 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,619 - WARNING - Pod uuid 83356b45-e3fb-4f21-bd3a-546ec641b5d3 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:17,620 - WARNING - Pod uuid 298a294e-7876-4d1f-8374-4d43c5a997d0 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:22,633 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:22,643 - DEBUG - Pod 40c6fbc2-e2a8-4b04-bf42-fb3539418477 is not in agent 10.0.0.240 VM list
2025-10-31 05:28:22,645 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:22,647 - DEBUG - Pod 298a294e-7876-4d1f-8374-4d43c5a997d0 is not in agent 10.0.0.240 VM list
2025-10-31 05:28:22,649 - DEBUG - Pod 83356b45-e3fb-4f21-bd3a-546ec641b5d3 is not in agent 10.0.0.240 VM list
2025-10-31 05:28:22,650 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:22,650 - DEBUG - Pod a4c4cff7-e50a-43d1-8b70-4556754bf7fe is not in agent 10.0.0.240 VM list
2025-10-31 05:28:22,652 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:22,664 - DEBUG - VMI e79d6f76-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:22,664 - INFO - Verified that pod ctest-pod-91378435 is removed in agent
2025-10-31 05:28:22,665 - DEBUG - VMI e8e0a560-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:22,665 - INFO - Verified that pod ctest-pod-95613466 is removed in agent
2025-10-31 05:28:22,667 - DEBUG - VMI e82ccc84-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:22,667 - INFO - Verified that pod ctest-pod-19823348 is removed in agent
2025-10-31 05:28:22,667 - DEBUG - VMI e970b218-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:22,668 - INFO - Verified that pod ctest-pod-48534670 is removed in agent
2025-10-31 05:28:27,642 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:27,655 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:27,662 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:27,662 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:32,650 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:32,662 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:32,672 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:32,673 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:37,658 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:37,669 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:37,683 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:37,683 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:42,666 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:42,677 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:42,694 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:42,696 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:47,721 - WARNING - Pod uuid 6da00324-4f26-4317-959d-ea53c8516e51 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:47,721 - WARNING - Pod uuid 38a47f72-a3ea-42af-b401-e9035d01cb21 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:47,723 - WARNING - Pod uuid 61911647-3e27-4033-9f13-b889b862c1c4 is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:47,723 - WARNING - Pod uuid 4d72b933-aa4b-4402-b17c-7f630fe8831a is still seen in agent 10.0.0.240 VM list
2025-10-31 05:28:52,737 - DEBUG - Pod 6da00324-4f26-4317-959d-ea53c8516e51 is not in agent 10.0.0.240 VM list
2025-10-31 05:28:52,740 - DEBUG - Pod 4d72b933-aa4b-4402-b17c-7f630fe8831a is not in agent 10.0.0.240 VM list
2025-10-31 05:28:52,741 - DEBUG - Pod 61911647-3e27-4033-9f13-b889b862c1c4 is not in agent 10.0.0.240 VM list
2025-10-31 05:28:52,742 - DEBUG - Pod 38a47f72-a3ea-42af-b401-e9035d01cb21 is not in agent 10.0.0.240 VM list
2025-10-31 05:28:52,754 - DEBUG - VMI ea08ff32-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:52,754 - INFO - Verified that pod ctest-pod-73791998 is removed in agent
2025-10-31 05:28:52,757 - DEBUG - VMI ea85b572-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:52,757 - INFO - Verified that pod ctest-pod-78687359 is removed in agent
2025-10-31 05:28:52,757 - DEBUG - VMI eb092dd0-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:52,757 - INFO - Verified that pod ctest-pod-71886853 is removed in agent
2025-10-31 05:28:52,758 - DEBUG - VMI eb855626-b619-11f0-86b2-fa163e60e769 is removed from agent 10.0.0.240
2025-10-31 05:28:52,758 - INFO - Verified that pod ctest-pod-25208390 is removed in agent
2025-10-31 05:28:52,758 - INFO - Deleting namespace ctest-non-default-92893912
2025-10-31 05:28:52,782 - DEBUG - Namespace ctest-non-default-92893912 still in k8s
2025-10-31 05:28:54,789 - DEBUG - Namespace ctest-non-default-92893912 still in k8s
2025-10-31 05:28:56,795 - DEBUG - Namespace ctest-non-default-92893912 still in k8s
2025-10-31 05:28:58,800 - DEBUG - Namespace ctest-non-default-92893912 is not in k8s
2025-10-31 05:28:58,800 - DEBUG - No need to check project deletion in contrail-api
2025-10-31 05:28:58,800 - INFO - Deleting namespace ctest-new-default-75318410
2025-10-31 05:28:58,819 - DEBUG - Namespace ctest-new-default-75318410 still in k8s
2025-10-31 05:29:00,835 - DEBUG - Namespace ctest-new-default-75318410 still in k8s
2025-10-31 05:29:02,842 - DEBUG - Namespace ctest-new-default-75318410 still in k8s
2025-10-31 05:29:04,846 - DEBUG - Namespace ctest-new-default-75318410 is not in k8s
2025-10-31 05:29:04,846 - DEBUG - No need to check project deletion in contrail-api