2025-01-15 00:32:51,090 - INFO - Using existing project ['default-domain', 'k8s-default'](b39cbe42-6f41-4648-9170-ac79349baee7)
2025-01-15 00:32:51,114 - DEBUG - Namespace ctest-new-default-75695071 not present
2025-01-15 00:32:51,124 - INFO - Created namespace ctest-new-default-75695071
2025-01-15 00:32:54,128 - DEBUG - Namespace ctest-non-default-93769004 not present
2025-01-15 00:32:54,134 - INFO - Created namespace ctest-non-default-93769004
2025-01-15 00:32:57,155 - DEBUG - Pod ctest-pod-20286539 not present
2025-01-15 00:32:57,155 - INFO - Creating Pod ctest-pod-20286539
2025-01-15 00:32:57,186 - DEBUG - Pod : ctest-pod-20286539 UUID is d525621b-e323-45bd-a299-b369c834756f
2025-01-15 00:32:57,188 - DEBUG - Pod ctest-pod-99721177 not present
2025-01-15 00:32:57,189 - INFO - Creating Pod ctest-pod-99721177
2025-01-15 00:32:57,227 - DEBUG - Pod : ctest-pod-99721177 UUID is 5418e580-825a-4e75-a828-d9b8788f2106
2025-01-15 00:32:57,230 - DEBUG - Pod ctest-pod-07796877 not present
2025-01-15 00:32:57,230 - INFO - Creating Pod ctest-pod-07796877
2025-01-15 00:32:57,272 - DEBUG - Pod : ctest-pod-07796877 UUID is 9171850e-b17d-49ce-ae25-00e165e0d5ac
2025-01-15 00:32:57,276 - DEBUG - Pod ctest-pod-78187872 not present
2025-01-15 00:32:57,276 - INFO - Creating Pod ctest-pod-78187872
2025-01-15 00:32:57,298 - DEBUG - Pod : ctest-pod-78187872 UUID is d24b5c96-dac5-476f-8f2f-c51b0c4e4ec4
2025-01-15 00:32:57,301 - DEBUG - Pod ctest-pod-22914556 not present
2025-01-15 00:32:57,302 - INFO - Creating Pod ctest-pod-22914556
2025-01-15 00:32:57,318 - DEBUG - Pod : ctest-pod-22914556 UUID is de7af4ff-8c1f-4ffa-b806-625a746f36da
2025-01-15 00:32:57,319 - DEBUG - Pod ctest-pod-63114332 not present
2025-01-15 00:32:57,320 - INFO - Creating Pod ctest-pod-63114332
2025-01-15 00:32:57,337 - DEBUG - Pod : ctest-pod-63114332 UUID is ec374880-9063-4562-93ee-6310cef71fd8
2025-01-15 00:32:57,339 - DEBUG - Pod ctest-pod-13272803 not present
2025-01-15 00:32:57,340 - INFO - Creating Pod ctest-pod-13272803
2025-01-15 00:32:57,353 - DEBUG - Pod : ctest-pod-13272803 UUID is 8838d502-660e-4f86-85c4-e7bb027b5e85
2025-01-15 00:32:57,355 - DEBUG - Pod ctest-pod-40564088 not present
2025-01-15 00:32:57,355 - INFO - Creating Pod ctest-pod-40564088
2025-01-15 00:32:57,375 - DEBUG - Pod : ctest-pod-40564088 UUID is 33e8c0b3-dbe5-43fd-a3db-dba772b28195
2025-01-15 00:32:57,552 - INFO - Project default-domain:k8s-ctest-new-default-75695071 for Namespace ctest-new-default-75695071 is seen in contrail-api
2025-01-15 00:32:57,552 - DEBUG - Project uuid in Contrail is 1525ac9b-58f9-4d8d-80ca-a7b243a52077
2025-01-15 00:32:57,695 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=97be8e29-4a72-4312-9f1f-ee946560ae00
2025-01-15 00:32:57,713 - INFO - Namespace ctest-new-default-75695071 with uuid 97be8e29-4a72-4312-9f1f-ee946560ae00 found in kube manager
2025-01-15 00:32:57,713 - INFO - Namespace ctest-new-default-75695071 verification passed
2025-01-15 00:32:57,944 - INFO - Project default-domain:k8s-ctest-non-default-93769004 for Namespace ctest-non-default-93769004 is seen in contrail-api
2025-01-15 00:32:57,944 - DEBUG - Project uuid in Contrail is d3e5fec0-fabd-4798-a616-53511d7320fc
2025-01-15 00:32:57,945 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=ceb2710e-a253-44a7-a25c-0a9e77d1c2fc
2025-01-15 00:32:57,950 - INFO - Namespace ctest-non-default-93769004 with uuid ceb2710e-a253-44a7-a25c-0a9e77d1c2fc found in kube manager
2025-01-15 00:32:57,950 - INFO - Namespace ctest-non-default-93769004 verification passed
2025-01-15 00:32:57,955 - DEBUG - Pod ctest-pod-20286539 not in running state.Currently in Pending
2025-01-15 00:33:02,962 - DEBUG - Pod ctest-pod-20286539 not in running state.Currently in Pending
2025-01-15 00:33:07,969 - DEBUG - Pod ctest-pod-20286539 not in running state.Currently in Pending
2025-01-15 00:33:12,975 - INFO - Pod ctest-pod-20286539 is in running state.Got IP 10.47.255.251
2025-01-15 00:33:12,989 - DEBUG - Pod ctest-pod-20286539 has vmi 4557deb0-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:12,989 - INFO - Verified pod ctest-pod-20286539 in contrail-api
2025-01-15 00:33:13,007 - DEBUG - VMI 4557deb0-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:13,008 - INFO - Verified Pod ctest-pod-20286539 in agent 10.0.0.28
2025-01-15 00:33:13,008 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=d525621b-e323-45bd-a299-b369c834756f
2025-01-15 00:33:13,014 - INFO - Pod ctest-pod-20286539 with uuid d525621b-e323-45bd-a299-b369c834756f found in kube manager
2025-01-15 00:33:13,014 - INFO - Pod ctest-pod-20286539 verification passed
2025-01-15 00:33:13,019 - INFO - Pod ctest-pod-99721177 is in running state.Got IP 10.47.255.250
2025-01-15 00:33:13,076 - DEBUG - Pod ctest-pod-99721177 has vmi 45d602a4-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:13,076 - INFO - Verified pod ctest-pod-99721177 in contrail-api
2025-01-15 00:33:13,090 - DEBUG - VMI 45d602a4-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:13,090 - INFO - Verified Pod ctest-pod-99721177 in agent 10.0.0.28
2025-01-15 00:33:13,090 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=5418e580-825a-4e75-a828-d9b8788f2106
2025-01-15 00:33:13,095 - INFO - Pod ctest-pod-99721177 with uuid 5418e580-825a-4e75-a828-d9b8788f2106 found in kube manager
2025-01-15 00:33:13,095 - INFO - Pod ctest-pod-99721177 verification passed
2025-01-15 00:33:13,102 - INFO - Pod ctest-pod-07796877 is in running state.Got IP 10.47.255.249
2025-01-15 00:33:13,116 - DEBUG - Pod ctest-pod-07796877 has vmi 4684c1f4-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:13,116 - INFO - Verified pod ctest-pod-07796877 in contrail-api
2025-01-15 00:33:13,129 - DEBUG - VMI 4684c1f4-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:13,129 - INFO - Verified Pod ctest-pod-07796877 in agent 10.0.0.28
2025-01-15 00:33:13,130 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=9171850e-b17d-49ce-ae25-00e165e0d5ac
2025-01-15 00:33:13,134 - INFO - Pod ctest-pod-07796877 with uuid 9171850e-b17d-49ce-ae25-00e165e0d5ac found in kube manager
2025-01-15 00:33:13,134 - INFO - Pod ctest-pod-07796877 verification passed
2025-01-15 00:33:13,139 - INFO - Pod ctest-pod-78187872 is in running state.Got IP 10.47.255.248
2025-01-15 00:33:13,196 - DEBUG - Pod ctest-pod-78187872 has vmi 470b8cfc-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:13,196 - INFO - Verified pod ctest-pod-78187872 in contrail-api
2025-01-15 00:33:13,209 - DEBUG - VMI 470b8cfc-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:13,210 - INFO - Verified Pod ctest-pod-78187872 in agent 10.0.0.28
2025-01-15 00:33:13,210 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=d24b5c96-dac5-476f-8f2f-c51b0c4e4ec4
2025-01-15 00:33:13,214 - INFO - Pod ctest-pod-78187872 with uuid d24b5c96-dac5-476f-8f2f-c51b0c4e4ec4 found in kube manager
2025-01-15 00:33:13,214 - INFO - Pod ctest-pod-78187872 verification passed
2025-01-15 00:33:13,219 - DEBUG - Pod ctest-pod-22914556 not in running state.Currently in Pending
2025-01-15 00:33:18,226 - INFO - Pod ctest-pod-22914556 is in running state.Got IP 10.47.255.247
2025-01-15 00:33:18,240 - DEBUG - Pod ctest-pod-22914556 has vmi 47a5cde4-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:18,240 - INFO - Verified pod ctest-pod-22914556 in contrail-api
2025-01-15 00:33:18,254 - DEBUG - VMI 47a5cde4-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:18,254 - INFO - Verified Pod ctest-pod-22914556 in agent 10.0.0.28
2025-01-15 00:33:18,254 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=de7af4ff-8c1f-4ffa-b806-625a746f36da
2025-01-15 00:33:18,259 - INFO - Pod ctest-pod-22914556 with uuid de7af4ff-8c1f-4ffa-b806-625a746f36da found in kube manager
2025-01-15 00:33:18,259 - INFO - Pod ctest-pod-22914556 verification passed
2025-01-15 00:33:18,335 - INFO - Pod ctest-pod-13272803 is in running state.Got IP 10.47.255.245
2025-01-15 00:33:18,392 - DEBUG - Pod ctest-pod-13272803 has vmi 48911574-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:18,392 - INFO - Verified pod ctest-pod-13272803 in contrail-api
2025-01-15 00:33:18,406 - DEBUG - VMI 48911574-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:18,406 - INFO - Verified Pod ctest-pod-13272803 in agent 10.0.0.28
2025-01-15 00:33:18,406 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=8838d502-660e-4f86-85c4-e7bb027b5e85
2025-01-15 00:33:18,411 - INFO - Pod ctest-pod-13272803 with uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 found in kube manager
2025-01-15 00:33:18,411 - INFO - Pod ctest-pod-13272803 verification passed
2025-01-15 00:33:18,423 - INFO - Pod ctest-pod-63114332 is in running state.Got IP 10.47.255.246
2025-01-15 00:33:18,438 - DEBUG - Pod ctest-pod-63114332 has vmi 481e4c38-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:18,439 - INFO - Verified pod ctest-pod-63114332 in contrail-api
2025-01-15 00:33:18,453 - DEBUG - VMI 481e4c38-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:18,453 - INFO - Verified Pod ctest-pod-63114332 in agent 10.0.0.28
2025-01-15 00:33:18,453 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=ec374880-9063-4562-93ee-6310cef71fd8
2025-01-15 00:33:18,459 - INFO - Pod ctest-pod-63114332 with uuid ec374880-9063-4562-93ee-6310cef71fd8 found in kube manager
2025-01-15 00:33:18,459 - INFO - Pod ctest-pod-63114332 verification passed
2025-01-15 00:33:18,468 - INFO - Pod ctest-pod-40564088 is in running state.Got IP 10.47.255.244
2025-01-15 00:33:18,524 - DEBUG - Pod ctest-pod-40564088 has vmi 4906d6ba-d2d8-11ef-ad21-fa163ecb6316
2025-01-15 00:33:18,524 - INFO - Verified pod ctest-pod-40564088 in contrail-api
2025-01-15 00:33:18,539 - DEBUG - VMI 4906d6ba-d2d8-11ef-ad21-fa163ecb6316 is active in agent 10.0.0.28
2025-01-15 00:33:18,539 - INFO - Verified Pod ctest-pod-40564088 in agent 10.0.0.28
2025-01-15 00:33:18,539 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=33e8c0b3-dbe5-43fd-a3db-dba772b28195
2025-01-15 00:33:18,545 - INFO - Pod ctest-pod-40564088 with uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 found in kube manager
2025-01-15 00:33:18,545 - INFO - Pod ctest-pod-40564088 verification passed
2025-01-15 00:33:18,545 - INFO - ================================================================================
2025-01-15 00:33:18,545 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-15 00:33:18,545 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-15 00:33:18,699 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.23': '0'}} with
2025-01-15 00:33:18,699 - INFO - Initial checks done. Running the testcase now
2025-01-15 00:33:18,699 - INFO -
2025-01-15 00:33:18,764 - DEBUG - [Pod ctest-pod-20286539] Cmd: echo ctest-pod-20286539 > /usr/share/nginx/html/index.html, Output:
2025-01-15 00:33:18,832 - DEBUG - [Pod ctest-pod-99721177] Cmd: echo ctest-pod-99721177 > /usr/share/nginx/html/index.html, Output:
2025-01-15 00:33:18,903 - DEBUG - [Pod ctest-pod-07796877] Cmd: echo ctest-pod-07796877 > /usr/share/nginx/html/index.html, Output:
2025-01-15 00:33:18,959 - DEBUG - [Pod ctest-pod-78187872] Cmd: echo ctest-pod-78187872 > /usr/share/nginx/html/index.html, Output:
2025-01-15 00:33:18,962 - DEBUG - Service ctest-nginx-svc-96692354 not present
2025-01-15 00:33:18,962 - INFO - Creating service ctest-nginx-svc-96692354
2025-01-15 00:33:18,986 - INFO - Created Service ctest-nginx-svc-96692354
2025-01-15 00:33:18,994 - WARNING - Service UUID 84507444-00e0-44d6-9aac-349bbb9f0f2d not yet found in contrail-api
2025-01-15 00:33:20,004 - INFO - Validated that Service ctest-nginx-svc-96692354 is seen in contrail-api
2025-01-15 00:33:20,004 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=84507444-00e0-44d6-9aac-349bbb9f0f2d
2025-01-15 00:33:20,013 - INFO - Service ctest-nginx-svc-96692354 with uuid 84507444-00e0-44d6-9aac-349bbb9f0f2d found in kube manager
2025-01-15 00:33:20,013 - INFO - Service ctest-nginx-svc-96692354 verification passed
2025-01-15 00:33:21,094 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
ctest-pod-99721177
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:33:21,094 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:33:21,094 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
ctest-pod-99721177
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:33:21,155 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:33:21,155 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:33:21,155 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:33:21,155 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-20286539': 1, 'ctest-pod-99721177': 1}
2025-01-15 00:33:21,210 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20286539
2025-01-15 00:33:21,210 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:33:21,210 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20286539
2025-01-15 00:33:21,267 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
ctest-pod-20286539
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:33:21,268 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:33:21,268 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
ctest-pod-20286539
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:33:21,339 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99721177
2025-01-15 00:33:21,340 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:33:21,340 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99721177
2025-01-15 00:33:21,340 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-20286539': 2, 'ctest-pod-99721177': 1}
2025-01-15 00:33:21,342 - DEBUG - Network policy ingress-on-service not present
2025-01-15 00:33:21,343 - INFO - Creating Network Policy ingress-on-service
2025-01-15 00:33:21,361 - INFO - Network policy found in k8s
2025-01-15 00:33:21,361 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bd561dce-2326-49f1-a429-9bfcaf47006e
2025-01-15 00:33:21,366 - INFO - Network Policy ingress-on-service with uuid bd561dce-2326-49f1-a429-9bfcaf47006e found in kube manager
2025-01-15 00:33:21,401 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-15 00:33:21,402 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-15 00:33:21,402 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bd561dce-2326-49f1-a429-9bfcaf47006e
2025-01-15 00:33:21,434 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-15 00:33:23,434 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bd561dce-2326-49f1-a429-9bfcaf47006e
2025-01-15 00:33:23,466 - INFO - Network policy with name ingress-on-service found in agent
2025-01-15 00:33:23,467 - INFO - Network Policy ingress-on-service verification passed
2025-01-15 00:33:28,538 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:28,538 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:28,538 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:33,600 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:33,600 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:33,600 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:38,669 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:38,669 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:38,669 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:43,730 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:43,730 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:43,730 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:48,800 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:48,800 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:48,800 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:53,861 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:53,862 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:53,862 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:58,927 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:58,927 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:33:58,927 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:03,994 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:03,994 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:03,994 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:09,056 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:09,056 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:09,056 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:14,130 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:14,130 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:14,130 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:14,130 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-20286539': 0, 'ctest-pod-99721177': 0}
2025-01-15 00:34:14,193 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-99721177
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:34:14,194 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:34:14,194 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: ctest-pod-99721177
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:34:14,251 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
ctest-pod-20286539
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:34:14,251 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:34:14,251 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
ctest-pod-20286539
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:34:14,251 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-20286539': 1, 'ctest-pod-99721177': 1}
2025-01-15 00:34:19,318 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:19,318 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:19,318 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:24,365 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:24,365 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:24,365 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:29,421 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:29,421 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:29,421 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:34,489 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:34,489 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:34,489 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:39,555 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:39,555 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:39,555 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:44,641 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:44,641 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:44,641 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:45,058 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-01-15 00:34:55,140 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:55,140 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:34:55,140 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:00,208 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:00,208 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:00,208 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:05,270 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:05,270 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:05,270 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:10,347 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:10,347 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:10,347 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:10,347 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-20286539': 0, 'ctest-pod-99721177': 0}
2025-01-15 00:35:12,402 - DEBUG - [Pod ctest-pod-63114332] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.470 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.206/0.470 ms
2025-01-15 00:35:12,403 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-63114332 with expectation True passed
2025-01-15 00:35:14,470 - DEBUG - [Pod ctest-pod-22914556] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.665 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.278/0.665 ms
2025-01-15 00:35:14,470 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22914556 with expectation True passed
2025-01-15 00:35:16,533 - DEBUG - [Pod ctest-pod-13272803] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.520 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.228/0.520 ms
2025-01-15 00:35:16,533 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13272803 with expectation True passed
2025-01-15 00:35:16,594 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:35:16,595 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 00:35:16,595 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:35:16,595 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63114332 passed
2025-01-15 00:35:16,659 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:35:16,659 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-15 00:35:16,659 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:35:16,659 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63114332 passed
2025-01-15 00:35:21,717 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 00:35:21,717 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 00:35:21,717 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 00:35:21,717 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22914556 passed
2025-01-15 00:35:26,791 - DEBUG - [Pod ctest-pod-40564088] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 00:35:26,791 - DEBUG - [Pod Pod ctest-pod-40564088] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 00:35:26,791 - DEBUG - [Pod Pod ctest-pod-40564088] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 00:35:26,791 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40564088 passed
2025-01-15 00:35:26,799 - INFO - Updating Network Policy ingress-on-service
2025-01-15 00:35:31,869 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:31,869 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:31,869 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:36,927 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:36,927 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:36,927 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:42,004 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:42,004 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:42,004 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:47,067 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:47,067 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:47,067 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:52,152 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:52,152 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:52,152 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:57,210 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:57,210 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:35:57,210 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:02,271 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:02,271 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:02,272 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:07,323 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:07,323 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:07,323 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:12,365 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:12,365 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:12,365 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:17,425 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:17,425 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:17,425 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
wget: download timed out
2025-01-15 00:36:17,425 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-20286539': 0, 'ctest-pod-99721177': 0}
2025-01-15 00:36:17,474 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20286539
2025-01-15 00:36:17,474 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:36:17,474 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20286539
2025-01-15 00:36:17,536 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,536 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:36:17,536 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,604 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,604 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:36:17,604 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,673 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-99721177
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,673 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:36:17,673 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: ctest-pod-99721177
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,673 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-20286539': 3, 'ctest-pod-99721177': 1}
2025-01-15 00:36:17,731 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,731 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:36:17,731 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: ctest-pod-20286539
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,804 - DEBUG - [Pod ctest-pod-13272803] Cmd: wget http://10.102.158.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-99721177
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,804 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd wget http://10.102.158.244:80/ -O - -T 5 -t 1 passed
2025-01-15 00:36:17,804 - DEBUG - [Pod Pod ctest-pod-13272803] Cmd output: ctest-pod-99721177
Connecting to 10.102.158.244:80 (10.102.158.244:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 00:36:17,804 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-20286539': 1, 'ctest-pod-99721177': 1}
2025-01-15 00:36:19,863 - DEBUG - [Pod ctest-pod-63114332] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.007 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.392/1.007 ms
2025-01-15 00:36:19,863 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-63114332 with expectation True passed
2025-01-15 00:36:21,926 - DEBUG - [Pod ctest-pod-22914556] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.877 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.340/0.877 ms
2025-01-15 00:36:21,926 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22914556 with expectation True passed
2025-01-15 00:36:23,980 - DEBUG - [Pod ctest-pod-13272803] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.732 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.054 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.054/0.289/0.732 ms
2025-01-15 00:36:23,980 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13272803 with expectation True passed
2025-01-15 00:36:24,032 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:36:24,032 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 00:36:24,032 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:36:24,032 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63114332 passed
2025-01-15 00:36:24,081 - DEBUG - [Pod ctest-pod-63114332] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:36:24,081 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-15 00:36:24,082 - DEBUG - [Pod Pod ctest-pod-63114332] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:36:24,082 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63114332 passed
2025-01-15 00:36:29,151 - DEBUG - [Pod ctest-pod-22914556] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 00:36:29,151 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 00:36:29,151 - DEBUG - [Pod Pod ctest-pod-22914556] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 00:36:29,151 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22914556 passed
2025-01-15 00:36:29,212 - DEBUG - [Pod ctest-pod-40564088] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:36:29,212 - DEBUG - [Pod Pod ctest-pod-40564088] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 00:36:29,212 - DEBUG - [Pod Pod ctest-pod-40564088] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 00:36:29,212 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40564088 passed
2025-01-15 00:36:29,213 - INFO - Deleting Network Policy : ingress-on-service
2025-01-15 00:36:29,213 - INFO - Deleting service : ctest-nginx-svc-96692354
2025-01-15 00:36:29,411 - DEBUG - No XMPP flaps were noticed during the test
2025-01-15 00:36:29,411 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11]
2025-01-15 00:36:29,411 - INFO - --------------------------------------------------------------------------------
2025-01-15 00:36:29,416 - INFO - Deleting pod ctest-new-default-75695071:ctest-pod-20286539
2025-01-15 00:36:29,416 - INFO - Deleting pod ctest-new-default-75695071:ctest-pod-99721177
2025-01-15 00:36:29,417 - INFO - Deleting pod ctest-non-default-93769004:ctest-pod-07796877
2025-01-15 00:36:29,417 - INFO - Deleting pod ctest-non-default-93769004:ctest-pod-78187872
2025-01-15 00:36:29,418 - INFO - Deleting pod ctest-new-default-75695071:ctest-pod-22914556
2025-01-15 00:36:29,418 - INFO - Deleting pod ctest-new-default-75695071:ctest-pod-63114332
2025-01-15 00:36:29,418 - INFO - Deleting pod ctest-non-default-93769004:ctest-pod-13272803
2025-01-15 00:36:29,419 - INFO - Deleting pod ctest-non-default-93769004:ctest-pod-40564088
2025-01-15 00:36:29,513 - WARNING - Pod uuid d525621b-e323-45bd-a299-b369c834756f is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,552 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,553 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,553 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,556 - WARNING - Pod uuid 9171850e-b17d-49ce-ae25-00e165e0d5ac is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,556 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,557 - WARNING - Pod uuid d24b5c96-dac5-476f-8f2f-c51b0c4e4ec4 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:29,557 - WARNING - Pod uuid 5418e580-825a-4e75-a828-d9b8788f2106 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:34,523 - DEBUG - Pod d525621b-e323-45bd-a299-b369c834756f is not in agent 10.0.0.28 VM list
2025-01-15 00:36:34,528 - DEBUG - VMI 4557deb0-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:36:34,528 - INFO - Verified that pod ctest-pod-20286539 is removed in agent
2025-01-15 00:36:34,582 - DEBUG - Pod 9171850e-b17d-49ce-ae25-00e165e0d5ac is not in agent 10.0.0.28 VM list
2025-01-15 00:36:34,584 - DEBUG - Pod d24b5c96-dac5-476f-8f2f-c51b0c4e4ec4 is not in agent 10.0.0.28 VM list
2025-01-15 00:36:34,585 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:34,585 - DEBUG - Pod 5418e580-825a-4e75-a828-d9b8788f2106 is not in agent 10.0.0.28 VM list
2025-01-15 00:36:34,589 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:34,589 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:34,589 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:34,597 - DEBUG - VMI 4684c1f4-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:36:34,598 - INFO - Verified that pod ctest-pod-07796877 is removed in agent
2025-01-15 00:36:34,599 - DEBUG - VMI 45d602a4-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:36:34,599 - INFO - Verified that pod ctest-pod-99721177 is removed in agent
2025-01-15 00:36:34,599 - DEBUG - VMI 470b8cfc-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:36:34,599 - INFO - Verified that pod ctest-pod-78187872 is removed in agent
2025-01-15 00:36:39,597 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:39,606 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:39,608 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:39,608 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:44,604 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:44,617 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:44,619 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:44,619 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:49,612 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:49,633 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:49,635 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:49,636 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:54,620 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:54,642 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:54,650 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:54,653 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:59,633 - WARNING - Pod uuid 8838d502-660e-4f86-85c4-e7bb027b5e85 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:59,650 - WARNING - Pod uuid 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:59,670 - WARNING - Pod uuid de7af4ff-8c1f-4ffa-b806-625a746f36da is still seen in agent 10.0.0.28 VM list
2025-01-15 00:36:59,670 - WARNING - Pod uuid ec374880-9063-4562-93ee-6310cef71fd8 is still seen in agent 10.0.0.28 VM list
2025-01-15 00:37:04,641 - DEBUG - Pod 8838d502-660e-4f86-85c4-e7bb027b5e85 is not in agent 10.0.0.28 VM list
2025-01-15 00:37:04,648 - DEBUG - VMI 48911574-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:37:04,648 - INFO - Verified that pod ctest-pod-13272803 is removed in agent
2025-01-15 00:37:04,658 - DEBUG - Pod 33e8c0b3-dbe5-43fd-a3db-dba772b28195 is not in agent 10.0.0.28 VM list
2025-01-15 00:37:04,664 - DEBUG - VMI 4906d6ba-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:37:04,664 - INFO - Verified that pod ctest-pod-40564088 is removed in agent
2025-01-15 00:37:04,681 - DEBUG - Pod ec374880-9063-4562-93ee-6310cef71fd8 is not in agent 10.0.0.28 VM list
2025-01-15 00:37:04,684 - DEBUG - Pod de7af4ff-8c1f-4ffa-b806-625a746f36da is not in agent 10.0.0.28 VM list
2025-01-15 00:37:04,694 - DEBUG - VMI 481e4c38-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:37:04,694 - INFO - Verified that pod ctest-pod-63114332 is removed in agent
2025-01-15 00:37:04,695 - DEBUG - VMI 47a5cde4-d2d8-11ef-ad21-fa163ecb6316 is removed from agent 10.0.0.28
2025-01-15 00:37:04,695 - INFO - Verified that pod ctest-pod-22914556 is removed in agent
2025-01-15 00:37:04,695 - INFO - Deleting namespace ctest-non-default-93769004
2025-01-15 00:37:04,726 - DEBUG - Namespace ctest-non-default-93769004 still in k8s
2025-01-15 00:37:06,733 - DEBUG - Namespace ctest-non-default-93769004 still in k8s
2025-01-15 00:37:08,738 - DEBUG - Namespace ctest-non-default-93769004 still in k8s
2025-01-15 00:37:10,742 - DEBUG - Namespace ctest-non-default-93769004 is not in k8s
2025-01-15 00:37:10,743 - DEBUG - No need to check project deletion in contrail-api
2025-01-15 00:37:10,743 - INFO - Deleting namespace ctest-new-default-75695071
2025-01-15 00:37:10,751 - DEBUG - Namespace ctest-new-default-75695071 still in k8s
2025-01-15 00:37:12,756 - DEBUG - Namespace ctest-new-default-75695071 still in k8s
2025-01-15 00:37:14,762 - DEBUG - Namespace ctest-new-default-75695071 still in k8s
2025-01-15 00:37:16,766 - DEBUG - Namespace ctest-new-default-75695071 is not in k8s
2025-01-15 00:37:16,766 - DEBUG - No need to check project deletion in contrail-api