2025-09-29 01:36:05,278 - INFO - Using existing project ['default-domain', 'k8s-default'](ced9b103-eec6-4ce2-a9dd-9c069b80ac6a)
2025-09-29 01:36:05,297 - DEBUG - Namespace ctest-new-default-10683157 not present
2025-09-29 01:36:05,305 - INFO - Created namespace ctest-new-default-10683157
2025-09-29 01:36:08,309 - DEBUG - Namespace ctest-non-default-60862706 not present
2025-09-29 01:36:08,324 - INFO - Created namespace ctest-non-default-60862706
2025-09-29 01:36:11,343 - DEBUG - Pod ctest-pod-84599157 not present
2025-09-29 01:36:11,344 - INFO - Creating Pod ctest-pod-84599157
2025-09-29 01:36:11,367 - DEBUG - Pod : ctest-pod-84599157 UUID is 4fe3b67e-74b9-455b-82a3-6aae02ee41b7
2025-09-29 01:36:11,372 - DEBUG - Pod ctest-pod-26663474 not present
2025-09-29 01:36:11,372 - INFO - Creating Pod ctest-pod-26663474
2025-09-29 01:36:11,413 - DEBUG - Pod : ctest-pod-26663474 UUID is c902e4b0-61dc-4fda-9c76-3a1b19efffce
2025-09-29 01:36:11,416 - DEBUG - Pod ctest-pod-42934628 not present
2025-09-29 01:36:11,416 - INFO - Creating Pod ctest-pod-42934628
2025-09-29 01:36:11,454 - DEBUG - Pod : ctest-pod-42934628 UUID is efa22a62-c72f-4bdd-ac46-38583d4c3167
2025-09-29 01:36:11,456 - DEBUG - Pod ctest-pod-02659269 not present
2025-09-29 01:36:11,457 - INFO - Creating Pod ctest-pod-02659269
2025-09-29 01:36:11,481 - DEBUG - Pod : ctest-pod-02659269 UUID is ae4c22f5-caf0-45ec-b68b-6854864dd7be
2025-09-29 01:36:11,484 - DEBUG - Pod ctest-pod-24510326 not present
2025-09-29 01:36:11,484 - INFO - Creating Pod ctest-pod-24510326
2025-09-29 01:36:11,509 - DEBUG - Pod : ctest-pod-24510326 UUID is 134c39e8-e78f-493f-8a7d-1d8213d2d536
2025-09-29 01:36:11,511 - DEBUG - Pod ctest-pod-03393134 not present
2025-09-29 01:36:11,511 - INFO - Creating Pod ctest-pod-03393134
2025-09-29 01:36:11,532 - DEBUG - Pod : ctest-pod-03393134 UUID is 963598a8-db31-4cb4-a184-d8fcd43cc75f
2025-09-29 01:36:11,534 - DEBUG - Pod ctest-pod-57808365 not present
2025-09-29 01:36:11,534 - INFO - Creating Pod ctest-pod-57808365
2025-09-29 01:36:11,552 - DEBUG - Pod : ctest-pod-57808365 UUID is 84451c72-2e0d-49b7-b2ed-f9e7fce686f6
2025-09-29 01:36:11,554 - DEBUG - Pod ctest-pod-39852275 not present
2025-09-29 01:36:11,555 - INFO - Creating Pod ctest-pod-39852275
2025-09-29 01:36:11,574 - DEBUG - Pod : ctest-pod-39852275 UUID is b46be6ef-0515-4202-801b-9df00a22796f
2025-09-29 01:36:11,754 - INFO - Project default-domain:k8s-ctest-new-default-10683157 for Namespace ctest-new-default-10683157 is seen in contrail-api
2025-09-29 01:36:11,754 - DEBUG - Project uuid in Contrail is 44fecedd-8d2e-487e-a007-8eabf573554a
2025-09-29 01:36:11,936 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=1662389e-d736-4a78-b399-fe0926d2900b
2025-09-29 01:36:11,941 - INFO - Namespace ctest-new-default-10683157 with uuid 1662389e-d736-4a78-b399-fe0926d2900b found in kube manager
2025-09-29 01:36:11,941 - INFO - Namespace ctest-new-default-10683157 verification passed
2025-09-29 01:36:12,137 - INFO - Project default-domain:k8s-ctest-non-default-60862706 for Namespace ctest-non-default-60862706 is seen in contrail-api
2025-09-29 01:36:12,137 - DEBUG - Project uuid in Contrail is f3311820-c355-4491-a926-6b589d546126
2025-09-29 01:36:12,137 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=b2ac3e82-ecba-412e-87ee-539526bb17dc
2025-09-29 01:36:12,142 - INFO - Namespace ctest-non-default-60862706 with uuid b2ac3e82-ecba-412e-87ee-539526bb17dc found in kube manager
2025-09-29 01:36:12,142 - INFO - Namespace ctest-non-default-60862706 verification passed
2025-09-29 01:36:12,150 - DEBUG - Pod ctest-pod-84599157 not in running state.Currently in Pending
2025-09-29 01:36:17,159 - DEBUG - Pod ctest-pod-84599157 not in running state.Currently in Pending
2025-09-29 01:36:22,167 - INFO - Pod ctest-pod-84599157 is in running state.Got IP 10.47.255.251
2025-09-29 01:36:22,180 - DEBUG - Pod ctest-pod-84599157 has vmi aedee826-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:22,180 - INFO - Verified pod ctest-pod-84599157 in contrail-api
2025-09-29 01:36:22,189 - DEBUG - VMI aedee826-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:22,190 - INFO - Verified Pod ctest-pod-84599157 in agent 10.0.0.22
2025-09-29 01:36:22,190 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4fe3b67e-74b9-455b-82a3-6aae02ee41b7
2025-09-29 01:36:22,193 - INFO - Pod ctest-pod-84599157 with uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 found in kube manager
2025-09-29 01:36:22,193 - INFO - Pod ctest-pod-84599157 verification passed
2025-09-29 01:36:22,199 - INFO - Pod ctest-pod-26663474 is in running state.Got IP 10.47.255.250
2025-09-29 01:36:22,256 - DEBUG - Pod ctest-pod-26663474 has vmi af5a9124-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:22,256 - INFO - Verified pod ctest-pod-26663474 in contrail-api
2025-09-29 01:36:22,267 - DEBUG - VMI af5a9124-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:22,267 - INFO - Verified Pod ctest-pod-26663474 in agent 10.0.0.22
2025-09-29 01:36:22,268 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=c902e4b0-61dc-4fda-9c76-3a1b19efffce
2025-09-29 01:36:22,273 - INFO - Pod ctest-pod-26663474 with uuid c902e4b0-61dc-4fda-9c76-3a1b19efffce found in kube manager
2025-09-29 01:36:22,273 - INFO - Pod ctest-pod-26663474 verification passed
2025-09-29 01:36:22,283 - DEBUG - Pod ctest-pod-42934628 not in running state.Currently in Pending
2025-09-29 01:36:27,290 - INFO - Pod ctest-pod-42934628 is in running state.Got IP 10.47.255.249
2025-09-29 01:36:27,302 - DEBUG - Pod ctest-pod-42934628 has vmi aff6d7a0-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:27,302 - INFO - Verified pod ctest-pod-42934628 in contrail-api
2025-09-29 01:36:27,314 - DEBUG - VMI aff6d7a0-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:27,314 - INFO - Verified Pod ctest-pod-42934628 in agent 10.0.0.22
2025-09-29 01:36:27,315 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=efa22a62-c72f-4bdd-ac46-38583d4c3167
2025-09-29 01:36:27,324 - INFO - Pod ctest-pod-42934628 with uuid efa22a62-c72f-4bdd-ac46-38583d4c3167 found in kube manager
2025-09-29 01:36:27,324 - INFO - Pod ctest-pod-42934628 verification passed
2025-09-29 01:36:27,335 - INFO - Pod ctest-pod-02659269 is in running state.Got IP 10.47.255.248
2025-09-29 01:36:27,394 - DEBUG - Pod ctest-pod-02659269 has vmi b06a276e-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:27,394 - INFO - Verified pod ctest-pod-02659269 in contrail-api
2025-09-29 01:36:27,408 - DEBUG - VMI b06a276e-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:27,408 - INFO - Verified Pod ctest-pod-02659269 in agent 10.0.0.22
2025-09-29 01:36:27,408 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ae4c22f5-caf0-45ec-b68b-6854864dd7be
2025-09-29 01:36:27,413 - INFO - Pod ctest-pod-02659269 with uuid ae4c22f5-caf0-45ec-b68b-6854864dd7be found in kube manager
2025-09-29 01:36:27,413 - INFO - Pod ctest-pod-02659269 verification passed
2025-09-29 01:36:27,420 - DEBUG - Pod ctest-pod-24510326 not in running state.Currently in Pending
2025-09-29 01:36:32,427 - INFO - Pod ctest-pod-24510326 is in running state.Got IP 10.47.255.247
2025-09-29 01:36:32,458 - DEBUG - Pod ctest-pod-24510326 has vmi b0f16134-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:32,458 - INFO - Verified pod ctest-pod-24510326 in contrail-api
2025-09-29 01:36:32,484 - DEBUG - VMI b0f16134-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:32,484 - INFO - Verified Pod ctest-pod-24510326 in agent 10.0.0.22
2025-09-29 01:36:32,489 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=134c39e8-e78f-493f-8a7d-1d8213d2d536
2025-09-29 01:36:32,496 - INFO - Pod ctest-pod-24510326 with uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 found in kube manager
2025-09-29 01:36:32,497 - INFO - Pod ctest-pod-24510326 verification passed
2025-09-29 01:36:32,509 - INFO - Pod ctest-pod-57808365 is in running state.Got IP 10.47.255.245
2025-09-29 01:36:32,574 - DEBUG - Pod ctest-pod-57808365 has vmi b1c01380-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:32,574 - INFO - Verified pod ctest-pod-57808365 in contrail-api
2025-09-29 01:36:32,588 - DEBUG - VMI b1c01380-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:32,588 - INFO - Verified Pod ctest-pod-57808365 in agent 10.0.0.22
2025-09-29 01:36:32,588 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=84451c72-2e0d-49b7-b2ed-f9e7fce686f6
2025-09-29 01:36:32,595 - INFO - Pod ctest-pod-57808365 with uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 found in kube manager
2025-09-29 01:36:32,595 - INFO - Pod ctest-pod-57808365 verification passed
2025-09-29 01:36:32,604 - INFO - Pod ctest-pod-03393134 is in running state.Got IP 10.47.255.246
2025-09-29 01:36:32,626 - DEBUG - Pod ctest-pod-03393134 has vmi b15d2c0c-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:32,626 - INFO - Verified pod ctest-pod-03393134 in contrail-api
2025-09-29 01:36:32,641 - DEBUG - VMI b15d2c0c-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:32,641 - INFO - Verified Pod ctest-pod-03393134 in agent 10.0.0.22
2025-09-29 01:36:32,641 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=963598a8-db31-4cb4-a184-d8fcd43cc75f
2025-09-29 01:36:32,648 - INFO - Pod ctest-pod-03393134 with uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f found in kube manager
2025-09-29 01:36:32,648 - INFO - Pod ctest-pod-03393134 verification passed
2025-09-29 01:36:32,656 - INFO - Pod ctest-pod-39852275 is in running state.Got IP 10.47.255.244
2025-09-29 01:36:32,713 - DEBUG - Pod ctest-pod-39852275 has vmi b221a776-9cd4-11f0-9c1a-fa163eefd82b
2025-09-29 01:36:32,713 - INFO - Verified pod ctest-pod-39852275 in contrail-api
2025-09-29 01:36:32,728 - DEBUG - VMI b221a776-9cd4-11f0-9c1a-fa163eefd82b is active in agent 10.0.0.22
2025-09-29 01:36:32,729 - INFO - Verified Pod ctest-pod-39852275 in agent 10.0.0.22
2025-09-29 01:36:32,734 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b46be6ef-0515-4202-801b-9df00a22796f
2025-09-29 01:36:32,740 - INFO - Pod ctest-pod-39852275 with uuid b46be6ef-0515-4202-801b-9df00a22796f found in kube manager
2025-09-29 01:36:32,740 - INFO - Pod ctest-pod-39852275 verification passed
2025-09-29 01:36:32,740 - INFO - ================================================================================
2025-09-29 01:36:32,740 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-09-29 01:36:32,740 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-09-29 01:36:33,001 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with
2025-09-29 01:36:33,001 - INFO - Initial checks done. Running the testcase now
2025-09-29 01:36:33,001 - INFO -
2025-09-29 01:36:33,059 - DEBUG - [Pod ctest-pod-84599157] Cmd: echo ctest-pod-84599157 > /usr/share/nginx/html/index.html, Output:
2025-09-29 01:36:33,121 - DEBUG - [Pod ctest-pod-26663474] Cmd: echo ctest-pod-26663474 > /usr/share/nginx/html/index.html, Output:
2025-09-29 01:36:33,184 - DEBUG - [Pod ctest-pod-42934628] Cmd: echo ctest-pod-42934628 > /usr/share/nginx/html/index.html, Output:
2025-09-29 01:36:33,244 - DEBUG - [Pod ctest-pod-02659269] Cmd: echo ctest-pod-02659269 > /usr/share/nginx/html/index.html, Output:
2025-09-29 01:36:33,248 - DEBUG - Service ctest-nginx-svc-80409630 not present
2025-09-29 01:36:33,248 - INFO - Creating service ctest-nginx-svc-80409630
2025-09-29 01:36:33,265 - INFO - Created Service ctest-nginx-svc-80409630
2025-09-29 01:36:33,274 - WARNING - Service UUID d81a4716-9c5e-4828-9c6c-f92d8750d5c8 not yet found in contrail-api
2025-09-29 01:36:34,282 - INFO - Validated that Service ctest-nginx-svc-80409630 is seen in contrail-api
2025-09-29 01:36:34,283 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=d81a4716-9c5e-4828-9c6c-f92d8750d5c8
2025-09-29 01:36:34,287 - INFO - Service ctest-nginx-svc-80409630 with uuid d81a4716-9c5e-4828-9c6c-f92d8750d5c8 found in kube manager
2025-09-29 01:36:34,287 - INFO - Service ctest-nginx-svc-80409630 verification passed
2025-09-29 01:36:35,363 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
ctest-pod-26663474
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,364 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:36:35,364 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
ctest-pod-26663474
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,426 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26663474
2025-09-29 01:36:35,427 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:36:35,427 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26663474
2025-09-29 01:36:35,480 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,480 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:36:35,480 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,480 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-84599157': 1, 'ctest-pod-26663474': 2}
2025-09-29 01:36:35,537 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,538 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:36:35,538 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,599 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,600 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:36:35,600 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:36:35,600 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-84599157': 1, 'ctest-pod-26663474': 1}
2025-09-29 01:36:35,603 - DEBUG - Network policy ingress-on-service not present
2025-09-29 01:36:35,603 - INFO - Creating Network Policy ingress-on-service
2025-09-29 01:36:35,622 - INFO - Network policy found in k8s
2025-09-29 01:36:35,622 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c5437f1f-dfcd-4b98-916e-cc1acc378a45
2025-09-29 01:36:35,627 - INFO - Network Policy ingress-on-service with uuid c5437f1f-dfcd-4b98-916e-cc1acc378a45 found in kube manager
2025-09-29 01:36:35,656 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-09-29 01:36:35,656 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-09-29 01:36:35,656 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c5437f1f-dfcd-4b98-916e-cc1acc378a45
2025-09-29 01:36:35,683 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-29 01:36:37,686 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c5437f1f-dfcd-4b98-916e-cc1acc378a45
2025-09-29 01:36:37,716 - INFO - Network policy with name ingress-on-service found in agent
2025-09-29 01:36:37,716 - INFO - Network Policy ingress-on-service verification passed
2025-09-29 01:36:42,784 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:42,785 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:42,785 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:47,840 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:47,840 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:47,840 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:52,898 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:52,899 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:52,899 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:57,955 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:57,955 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:36:57,955 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:03,012 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:03,012 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:03,012 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:08,062 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:08,062 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:08,062 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:11,508 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-09-29 01:37:21,570 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:21,570 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:21,570 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:26,619 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:26,619 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:26,619 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:31,670 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:31,670 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:31,670 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:36,723 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:36,723 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:36,723 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:36,723 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-84599157': 0, 'ctest-pod-26663474': 0}
2025-09-29 01:37:36,780 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26663474
2025-09-29 01:37:36,780 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:37:36,780 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26663474
2025-09-29 01:37:36,826 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-84599157
2025-09-29 01:37:36,827 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:37:36,827 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-84599157
2025-09-29 01:37:36,827 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-84599157': 1, 'ctest-pod-26663474': 1}
2025-09-29 01:37:41,877 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:41,877 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:41,877 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:46,934 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:46,934 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:46,934 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:51,986 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:51,986 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:51,986 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:57,035 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:57,035 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:37:57,035 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:02,091 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:02,091 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:02,091 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:07,137 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:07,137 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:07,138 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:12,184 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:12,184 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:12,185 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:17,232 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:17,232 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:17,232 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:22,285 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:22,286 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:22,286 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:27,337 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:27,338 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:27,338 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:27,338 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-84599157': 0, 'ctest-pod-26663474': 0}
2025-09-29 01:38:29,390 - DEBUG - [Pod ctest-pod-03393134] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.396 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.184/0.396 ms
2025-09-29 01:38:29,391 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-03393134 with expectation True passed
2025-09-29 01:38:31,442 - DEBUG - [Pod ctest-pod-24510326] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.383 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.182/0.383 ms
2025-09-29 01:38:31,442 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24510326 with expectation True passed
2025-09-29 01:38:33,494 - DEBUG - [Pod ctest-pod-57808365] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.509 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.219/0.509 ms
2025-09-29 01:38:33,494 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-57808365 with expectation True passed
2025-09-29 01:38:33,547 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:38:33,548 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-29 01:38:33,548 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:38:33,548 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03393134 passed
2025-09-29 01:38:33,597 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:38:33,597 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-29 01:38:33,597 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:38:33,597 - INFO - wget check of of http://10.47.255.250 from ctest-pod-03393134 passed
2025-09-29 01:38:38,659 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-29 01:38:38,660 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-29 01:38:38,660 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-29 01:38:38,660 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24510326 passed
2025-09-29 01:38:43,714 - DEBUG - [Pod ctest-pod-39852275] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-29 01:38:43,714 - DEBUG - [Pod Pod ctest-pod-39852275] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-29 01:38:43,714 - DEBUG - [Pod Pod ctest-pod-39852275] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-29 01:38:43,714 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39852275 passed
2025-09-29 01:38:43,730 - INFO - Updating Network Policy ingress-on-service
2025-09-29 01:38:48,807 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:48,808 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:48,808 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:53,859 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:53,859 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:53,859 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:58,913 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:58,913 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:38:58,914 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:03,966 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:03,966 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:03,966 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:09,010 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:09,010 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:09,010 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:14,062 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:14,063 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:14,063 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:19,121 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:19,121 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:19,121 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:24,170 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:24,171 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:24,171 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:29,224 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:29,224 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:29,224 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:34,269 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:34,270 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:34,270 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
wget: download timed out
2025-09-29 01:39:34,270 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-84599157': 0, 'ctest-pod-26663474': 0}
2025-09-29 01:39:34,319 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26663474
2025-09-29 01:39:34,320 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:39:34,320 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26663474
2025-09-29 01:39:34,371 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,371 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:39:34,371 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,433 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,433 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:39:34,433 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,489 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,489 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:39:34,489 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,489 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-84599157': 1, 'ctest-pod-26663474': 3}
2025-09-29 01:39:34,551 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,551 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:39:34,551 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: ctest-pod-84599157
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,603 - DEBUG - [Pod ctest-pod-57808365] Cmd: wget http://10.98.136.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,603 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd wget http://10.98.136.164:80/ -O - -T 5 -t 1 passed
2025-09-29 01:39:34,603 - DEBUG - [Pod Pod ctest-pod-57808365] Cmd output: ctest-pod-26663474
Connecting to 10.98.136.164:80 (10.98.136.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-29 01:39:34,603 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-84599157': 1, 'ctest-pod-26663474': 1}
2025-09-29 01:39:36,650 - DEBUG - [Pod ctest-pod-03393134] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.058 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.409/1.058 ms
2025-09-29 01:39:36,650 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-03393134 with expectation True passed
2025-09-29 01:39:38,703 - DEBUG - [Pod ctest-pod-24510326] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.239 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.468/1.239 ms
2025-09-29 01:39:38,703 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24510326 with expectation True passed
2025-09-29 01:39:40,749 - DEBUG - [Pod ctest-pod-57808365] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.430 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.093/0.207/0.430 ms
2025-09-29 01:39:40,749 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-57808365 with expectation True passed
2025-09-29 01:39:40,795 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:39:40,795 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-29 01:39:40,795 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:39:40,795 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03393134 passed
2025-09-29 01:39:40,842 - DEBUG - [Pod ctest-pod-03393134] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:39:40,843 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-29 01:39:40,843 - DEBUG - [Pod Pod ctest-pod-03393134] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:39:40,843 - INFO - wget check of of http://10.47.255.250 from ctest-pod-03393134 passed
2025-09-29 01:39:45,889 - DEBUG - [Pod ctest-pod-24510326] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-29 01:39:45,890 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-29 01:39:45,890 - DEBUG - [Pod Pod ctest-pod-24510326] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-29 01:39:45,890 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24510326 passed
2025-09-29 01:39:45,951 - DEBUG - [Pod ctest-pod-39852275] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:39:45,951 - DEBUG - [Pod Pod ctest-pod-39852275] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-29 01:39:45,951 - DEBUG - [Pod Pod ctest-pod-39852275] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-29 01:39:45,951 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39852275 passed
2025-09-29 01:39:45,951 - INFO - Deleting Network Policy : ingress-on-service
2025-09-29 01:39:45,952 - INFO - Deleting service : ctest-nginx-svc-80409630
2025-09-29 01:39:46,221 - DEBUG - No XMPP flaps were noticed during the test
2025-09-29 01:39:46,221 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-09-29 01:39:46,221 - INFO - --------------------------------------------------------------------------------
2025-09-29 01:39:46,225 - INFO - Deleting pod ctest-new-default-10683157:ctest-pod-84599157
2025-09-29 01:39:46,226 - INFO - Deleting pod ctest-new-default-10683157:ctest-pod-26663474
2025-09-29 01:39:46,226 - INFO - Deleting pod ctest-non-default-60862706:ctest-pod-42934628
2025-09-29 01:39:46,226 - INFO - Deleting pod ctest-non-default-60862706:ctest-pod-02659269
2025-09-29 01:39:46,227 - INFO - Deleting pod ctest-new-default-10683157:ctest-pod-24510326
2025-09-29 01:39:46,227 - INFO - Deleting pod ctest-new-default-10683157:ctest-pod-03393134
2025-09-29 01:39:46,227 - INFO - Deleting pod ctest-non-default-60862706:ctest-pod-57808365
2025-09-29 01:39:46,228 - INFO - Deleting pod ctest-non-default-60862706:ctest-pod-39852275
2025-09-29 01:39:46,395 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,396 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,397 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,399 - WARNING - Pod uuid c902e4b0-61dc-4fda-9c76-3a1b19efffce is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,419 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,420 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,421 - WARNING - Pod uuid efa22a62-c72f-4bdd-ac46-38583d4c3167 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:46,421 - WARNING - Pod uuid ae4c22f5-caf0-45ec-b68b-6854864dd7be is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:51,408 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:51,410 - DEBUG - Pod c902e4b0-61dc-4fda-9c76-3a1b19efffce is not in agent 10.0.0.22 VM list
2025-09-29 01:39:51,411 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:51,411 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:51,415 - DEBUG - VMI af5a9124-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:39:51,415 - INFO - Verified that pod ctest-pod-26663474 is removed in agent
2025-09-29 01:39:51,434 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:51,436 - DEBUG - Pod ae4c22f5-caf0-45ec-b68b-6854864dd7be is not in agent 10.0.0.22 VM list
2025-09-29 01:39:51,437 - DEBUG - Pod efa22a62-c72f-4bdd-ac46-38583d4c3167 is not in agent 10.0.0.22 VM list
2025-09-29 01:39:51,438 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:51,444 - DEBUG - VMI aff6d7a0-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:39:51,444 - INFO - Verified that pod ctest-pod-42934628 is removed in agent
2025-09-29 01:39:51,445 - DEBUG - VMI b06a276e-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:39:51,445 - INFO - Verified that pod ctest-pod-02659269 is removed in agent
2025-09-29 01:39:56,420 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:56,422 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:56,422 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:56,441 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:39:56,445 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:01,433 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:01,434 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:01,435 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:01,448 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:01,452 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:06,449 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:06,453 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:06,454 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:06,465 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:06,465 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:11,461 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:11,462 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:11,462 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:11,472 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:11,473 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:16,493 - WARNING - Pod uuid 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:16,494 - WARNING - Pod uuid 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:16,494 - WARNING - Pod uuid 134c39e8-e78f-493f-8a7d-1d8213d2d536 is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:16,495 - WARNING - Pod uuid b46be6ef-0515-4202-801b-9df00a22796f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:16,495 - WARNING - Pod uuid 963598a8-db31-4cb4-a184-d8fcd43cc75f is still seen in agent 10.0.0.22 VM list
2025-09-29 01:40:21,511 - DEBUG - Pod 4fe3b67e-74b9-455b-82a3-6aae02ee41b7 is not in agent 10.0.0.22 VM list
2025-09-29 01:40:21,514 - DEBUG - Pod 963598a8-db31-4cb4-a184-d8fcd43cc75f is not in agent 10.0.0.22 VM list
2025-09-29 01:40:21,515 - DEBUG - Pod b46be6ef-0515-4202-801b-9df00a22796f is not in agent 10.0.0.22 VM list
2025-09-29 01:40:21,516 - DEBUG - Pod 134c39e8-e78f-493f-8a7d-1d8213d2d536 is not in agent 10.0.0.22 VM list
2025-09-29 01:40:21,517 - DEBUG - Pod 84451c72-2e0d-49b7-b2ed-f9e7fce686f6 is not in agent 10.0.0.22 VM list
2025-09-29 01:40:21,530 - DEBUG - VMI b221a776-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:40:21,530 - INFO - Verified that pod ctest-pod-39852275 is removed in agent
2025-09-29 01:40:21,530 - DEBUG - VMI b15d2c0c-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:40:21,530 - INFO - Verified that pod ctest-pod-03393134 is removed in agent
2025-09-29 01:40:21,532 - DEBUG - VMI b1c01380-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:40:21,532 - INFO - Verified that pod ctest-pod-57808365 is removed in agent
2025-09-29 01:40:21,532 - DEBUG - VMI aedee826-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:40:21,532 - INFO - Verified that pod ctest-pod-84599157 is removed in agent
2025-09-29 01:40:21,532 - DEBUG - VMI b0f16134-9cd4-11f0-9c1a-fa163eefd82b is removed from agent 10.0.0.22
2025-09-29 01:40:21,532 - INFO - Verified that pod ctest-pod-24510326 is removed in agent
2025-09-29 01:40:21,532 - INFO - Deleting namespace ctest-non-default-60862706
2025-09-29 01:40:21,551 - DEBUG - Namespace ctest-non-default-60862706 still in k8s
2025-09-29 01:40:23,556 - DEBUG - Namespace ctest-non-default-60862706 still in k8s
2025-09-29 01:40:25,561 - DEBUG - Namespace ctest-non-default-60862706 still in k8s
2025-09-29 01:40:27,565 - DEBUG - Namespace ctest-non-default-60862706 is not in k8s
2025-09-29 01:40:27,565 - DEBUG - No need to check project deletion in contrail-api
2025-09-29 01:40:27,565 - INFO - Deleting namespace ctest-new-default-10683157
2025-09-29 01:40:27,573 - DEBUG - Namespace ctest-new-default-10683157 still in k8s
2025-09-29 01:40:29,578 - DEBUG - Namespace ctest-new-default-10683157 still in k8s
2025-09-29 01:40:31,582 - DEBUG - Namespace ctest-new-default-10683157 still in k8s
2025-09-29 01:40:33,587 - DEBUG - Namespace ctest-new-default-10683157 is not in k8s
2025-09-29 01:40:33,587 - DEBUG - No need to check project deletion in contrail-api