2025-10-31 00:17:56,144 - INFO - Using existing project ['default-domain', 'k8s-default'](69f272bc-e2b4-48a2-9faa-9a83b57ee365)
2025-10-31 00:17:56,164 - DEBUG - Namespace ctest-new-default-29886787 not present
2025-10-31 00:17:56,173 - INFO - Created namespace ctest-new-default-29886787
2025-10-31 00:17:59,176 - DEBUG - Namespace ctest-non-default-44419009 not present
2025-10-31 00:17:59,188 - INFO - Created namespace ctest-non-default-44419009
2025-10-31 00:18:02,220 - DEBUG - Pod ctest-pod-09882295 not present
2025-10-31 00:18:02,221 - INFO - Creating Pod ctest-pod-09882295
2025-10-31 00:18:02,262 - DEBUG - Pod : ctest-pod-09882295 UUID is d851f4e6-7cf2-46a5-8ab9-90ff6cd5ba07
2025-10-31 00:18:02,265 - DEBUG - Pod ctest-pod-69205653 not present
2025-10-31 00:18:02,266 - INFO - Creating Pod ctest-pod-69205653
2025-10-31 00:18:02,291 - DEBUG - Pod : ctest-pod-69205653 UUID is 0c0ba259-04ef-4bed-8de9-8fd89b862974
2025-10-31 00:18:02,298 - DEBUG - Pod ctest-pod-05393563 not present
2025-10-31 00:18:02,300 - INFO - Creating Pod ctest-pod-05393563
2025-10-31 00:18:02,336 - DEBUG - Pod : ctest-pod-05393563 UUID is b5046fe1-520c-4671-b6de-38c597f1c8ec
2025-10-31 00:18:02,339 - DEBUG - Pod ctest-pod-97846649 not present
2025-10-31 00:18:02,340 - INFO - Creating Pod ctest-pod-97846649
2025-10-31 00:18:02,367 - DEBUG - Pod : ctest-pod-97846649 UUID is d074ef1f-8b1f-4edc-9fdb-7e13ff6854aa
2025-10-31 00:18:02,370 - DEBUG - Pod ctest-pod-51599916 not present
2025-10-31 00:18:02,372 - INFO - Creating Pod ctest-pod-51599916
2025-10-31 00:18:02,397 - DEBUG - Pod : ctest-pod-51599916 UUID is ca6e85fe-c45e-44e3-9e9e-cccdaa874845
2025-10-31 00:18:02,401 - DEBUG - Pod ctest-pod-71388841 not present
2025-10-31 00:18:02,401 - INFO - Creating Pod ctest-pod-71388841
2025-10-31 00:18:02,428 - DEBUG - Pod : ctest-pod-71388841 UUID is 05140860-8f72-4cd6-8435-fb364dc72301
2025-10-31 00:18:02,441 - DEBUG - Pod ctest-pod-18571103 not present
2025-10-31 00:18:02,442 - INFO - Creating Pod ctest-pod-18571103
2025-10-31 00:18:02,468 - DEBUG - Pod : ctest-pod-18571103 UUID is 2fc123d2-987d-467a-8327-fd29b36fc8ae
2025-10-31 00:18:02,471 - DEBUG - Pod ctest-pod-54219735 not present
2025-10-31 00:18:02,471 - INFO - Creating Pod ctest-pod-54219735
2025-10-31 00:18:02,501 - DEBUG - Pod : ctest-pod-54219735 UUID is 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564
2025-10-31 00:18:02,713 - INFO - Project default-domain:k8s-ctest-new-default-29886787 for Namespace ctest-new-default-29886787 is seen in contrail-api
2025-10-31 00:18:02,713 - DEBUG - Project uuid in Contrail is 1b982276-d294-4ee8-b4c4-a5b221a54c35
2025-10-31 00:18:02,863 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=2f3c065d-1d6c-4191-9734-20dfdd3dc846
2025-10-31 00:18:02,868 - INFO - Namespace ctest-new-default-29886787 with uuid 2f3c065d-1d6c-4191-9734-20dfdd3dc846 found in kube manager
2025-10-31 00:18:02,868 - INFO - Namespace ctest-new-default-29886787 verification passed
2025-10-31 00:18:03,124 - INFO - Project default-domain:k8s-ctest-non-default-44419009 for Namespace ctest-non-default-44419009 is seen in contrail-api
2025-10-31 00:18:03,124 - DEBUG - Project uuid in Contrail is 24c2da59-be46-4ef3-ac14-ae30ac584bc9
2025-10-31 00:18:03,125 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=89ec8d92-fd08-40d9-8ba5-e2859eabf0a9
2025-10-31 00:18:03,128 - INFO - Namespace ctest-non-default-44419009 with uuid 89ec8d92-fd08-40d9-8ba5-e2859eabf0a9 found in kube manager
2025-10-31 00:18:03,129 - INFO - Namespace ctest-non-default-44419009 verification passed
2025-10-31 00:18:03,138 - DEBUG - Pod ctest-pod-09882295 not in running state.Currently in Pending
2025-10-31 00:18:08,146 - DEBUG - Pod ctest-pod-09882295 not in running state.Currently in Pending
2025-10-31 00:18:13,154 - DEBUG - Pod ctest-pod-09882295 not in running state.Currently in Pending
2025-10-31 00:18:18,163 - INFO - Pod ctest-pod-09882295 is in running state.Got IP 10.47.255.251
2025-10-31 00:18:18,175 - DEBUG - Pod ctest-pod-09882295 has vmi 1137c0b4-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,175 - INFO - Verified pod ctest-pod-09882295 in contrail-api
2025-10-31 00:18:18,187 - DEBUG - VMI 1137c0b4-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,187 - INFO - Verified Pod ctest-pod-09882295 in agent 10.0.0.242
2025-10-31 00:18:18,187 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=d851f4e6-7cf2-46a5-8ab9-90ff6cd5ba07
2025-10-31 00:18:18,192 - INFO - Pod ctest-pod-09882295 with uuid d851f4e6-7cf2-46a5-8ab9-90ff6cd5ba07 found in kube manager
2025-10-31 00:18:18,193 - INFO - Pod ctest-pod-09882295 verification passed
2025-10-31 00:18:18,199 - INFO - Pod ctest-pod-69205653 is in running state.Got IP 10.47.255.250
2025-10-31 00:18:18,251 - DEBUG - Pod ctest-pod-69205653 has vmi 11b29ea6-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,251 - INFO - Verified pod ctest-pod-69205653 in contrail-api
2025-10-31 00:18:18,261 - DEBUG - VMI 11b29ea6-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,261 - INFO - Verified Pod ctest-pod-69205653 in agent 10.0.0.242
2025-10-31 00:18:18,261 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=0c0ba259-04ef-4bed-8de9-8fd89b862974
2025-10-31 00:18:18,271 - INFO - Pod ctest-pod-69205653 with uuid 0c0ba259-04ef-4bed-8de9-8fd89b862974 found in kube manager
2025-10-31 00:18:18,271 - INFO - Pod ctest-pod-69205653 verification passed
2025-10-31 00:18:18,278 - INFO - Pod ctest-pod-05393563 is in running state.Got IP 10.47.255.249
2025-10-31 00:18:18,290 - DEBUG - Pod ctest-pod-05393563 has vmi 124fc0aa-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,290 - INFO - Verified pod ctest-pod-05393563 in contrail-api
2025-10-31 00:18:18,302 - DEBUG - VMI 124fc0aa-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,302 - INFO - Verified Pod ctest-pod-05393563 in agent 10.0.0.242
2025-10-31 00:18:18,302 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=b5046fe1-520c-4671-b6de-38c597f1c8ec
2025-10-31 00:18:18,306 - INFO - Pod ctest-pod-05393563 with uuid b5046fe1-520c-4671-b6de-38c597f1c8ec found in kube manager
2025-10-31 00:18:18,307 - INFO - Pod ctest-pod-05393563 verification passed
2025-10-31 00:18:18,315 - INFO - Pod ctest-pod-97846649 is in running state.Got IP 10.47.255.248
2025-10-31 00:18:18,372 - DEBUG - Pod ctest-pod-97846649 has vmi 12c93002-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,372 - INFO - Verified pod ctest-pod-97846649 in contrail-api
2025-10-31 00:18:18,384 - DEBUG - VMI 12c93002-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,384 - INFO - Verified Pod ctest-pod-97846649 in agent 10.0.0.242
2025-10-31 00:18:18,384 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=d074ef1f-8b1f-4edc-9fdb-7e13ff6854aa
2025-10-31 00:18:18,388 - INFO - Pod ctest-pod-97846649 with uuid d074ef1f-8b1f-4edc-9fdb-7e13ff6854aa found in kube manager
2025-10-31 00:18:18,389 - INFO - Pod ctest-pod-97846649 verification passed
2025-10-31 00:18:18,397 - INFO - Pod ctest-pod-51599916 is in running state.Got IP 10.47.255.247
2025-10-31 00:18:18,452 - DEBUG - Pod ctest-pod-51599916 has vmi 134f3e54-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,452 - INFO - Verified pod ctest-pod-51599916 in contrail-api
2025-10-31 00:18:18,465 - DEBUG - VMI 134f3e54-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,465 - INFO - Verified Pod ctest-pod-51599916 in agent 10.0.0.242
2025-10-31 00:18:18,466 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=ca6e85fe-c45e-44e3-9e9e-cccdaa874845
2025-10-31 00:18:18,470 - INFO - Pod ctest-pod-51599916 with uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 found in kube manager
2025-10-31 00:18:18,470 - INFO - Pod ctest-pod-51599916 verification passed
2025-10-31 00:18:18,479 - INFO - Pod ctest-pod-18571103 is in running state.Got IP 10.47.255.245
2025-10-31 00:18:18,494 - DEBUG - Pod ctest-pod-18571103 has vmi 14260952-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,494 - INFO - Verified pod ctest-pod-18571103 in contrail-api
2025-10-31 00:18:18,507 - DEBUG - VMI 14260952-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,507 - INFO - Verified Pod ctest-pod-18571103 in agent 10.0.0.242
2025-10-31 00:18:18,507 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=2fc123d2-987d-467a-8327-fd29b36fc8ae
2025-10-31 00:18:18,512 - INFO - Pod ctest-pod-18571103 with uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae found in kube manager
2025-10-31 00:18:18,512 - INFO - Pod ctest-pod-18571103 verification passed
2025-10-31 00:18:18,520 - INFO - Pod ctest-pod-71388841 is in running state.Got IP 10.47.255.246
2025-10-31 00:18:18,575 - DEBUG - Pod ctest-pod-71388841 has vmi 13b49ef2-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,575 - INFO - Verified pod ctest-pod-71388841 in contrail-api
2025-10-31 00:18:18,586 - DEBUG - VMI 13b49ef2-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,586 - INFO - Verified Pod ctest-pod-71388841 in agent 10.0.0.242
2025-10-31 00:18:18,586 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=05140860-8f72-4cd6-8435-fb364dc72301
2025-10-31 00:18:18,590 - INFO - Pod ctest-pod-71388841 with uuid 05140860-8f72-4cd6-8435-fb364dc72301 found in kube manager
2025-10-31 00:18:18,590 - INFO - Pod ctest-pod-71388841 verification passed
2025-10-31 00:18:18,596 - INFO - Pod ctest-pod-54219735 is in running state.Got IP 10.47.255.244
2025-10-31 00:18:18,660 - DEBUG - Pod ctest-pod-54219735 has vmi 14907756-b5ef-11f0-bf46-fa163ef08dc0
2025-10-31 00:18:18,660 - INFO - Verified pod ctest-pod-54219735 in contrail-api
2025-10-31 00:18:18,674 - DEBUG - VMI 14907756-b5ef-11f0-bf46-fa163ef08dc0 is active in agent 10.0.0.242
2025-10-31 00:18:18,674 - INFO - Verified Pod ctest-pod-54219735 in agent 10.0.0.242
2025-10-31 00:18:18,674 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=1ef3d61c-9558-40e8-b5c5-e4fd6f0db564
2025-10-31 00:18:18,679 - INFO - Pod ctest-pod-54219735 with uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 found in kube manager
2025-10-31 00:18:18,679 - INFO - Pod ctest-pod-54219735 verification passed
2025-10-31 00:18:18,679 - INFO - ================================================================================
2025-10-31 00:18:18,679 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-31 00:18:18,679 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-31 00:18:18,878 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.65': '0'}} with
2025-10-31 00:18:18,878 - INFO - Initial checks done. Running the testcase now
2025-10-31 00:18:18,878 - INFO -
2025-10-31 00:18:18,934 - DEBUG - [Pod ctest-pod-09882295] Cmd: echo ctest-pod-09882295 > /usr/share/nginx/html/index.html, Output:
2025-10-31 00:18:18,982 - DEBUG - [Pod ctest-pod-69205653] Cmd: echo ctest-pod-69205653 > /usr/share/nginx/html/index.html, Output:
2025-10-31 00:18:19,036 - DEBUG - [Pod ctest-pod-05393563] Cmd: echo ctest-pod-05393563 > /usr/share/nginx/html/index.html, Output:
2025-10-31 00:18:19,072 - DEBUG - [Pod ctest-pod-97846649] Cmd: echo ctest-pod-97846649 > /usr/share/nginx/html/index.html, Output:
2025-10-31 00:18:19,075 - DEBUG - Service ctest-nginx-svc-02888253 not present
2025-10-31 00:18:19,075 - INFO - Creating service ctest-nginx-svc-02888253
2025-10-31 00:18:19,092 - INFO - Created Service ctest-nginx-svc-02888253
2025-10-31 00:18:19,105 - WARNING - Service UUID 032fb066-1346-4877-a0d2-3cff590ce68b not yet found in contrail-api
2025-10-31 00:18:20,121 - INFO - Validated that Service ctest-nginx-svc-02888253 is seen in contrail-api
2025-10-31 00:18:20,121 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=032fb066-1346-4877-a0d2-3cff590ce68b
2025-10-31 00:18:20,124 - INFO - Service ctest-nginx-svc-02888253 with uuid 032fb066-1346-4877-a0d2-3cff590ce68b found in kube manager
2025-10-31 00:18:20,124 - INFO - Service ctest-nginx-svc-02888253 verification passed
2025-10-31 00:18:21,205 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-69205653
2025-10-31 00:18:21,205 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,205 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-69205653
2025-10-31 00:18:21,274 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,275 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,275 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,332 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,332 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,332 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,332 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09882295': 1, 'ctest-pod-69205653': 2}
2025-10-31 00:18:21,388 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,389 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,389 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,448 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,448 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,448 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,510 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,510 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,510 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,547 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,547 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:18:21,547 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:18:21,547 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09882295': 1, 'ctest-pod-69205653': 3}
2025-10-31 00:18:21,551 - DEBUG - Network policy ingress-on-service not present
2025-10-31 00:18:21,552 - INFO - Creating Network Policy ingress-on-service
2025-10-31 00:18:21,568 - INFO - Network policy found in k8s
2025-10-31 00:18:21,568 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c5ae234a-26e7-4419-a9a7-a779b286f768
2025-10-31 00:18:21,573 - INFO - Network Policy ingress-on-service with uuid c5ae234a-26e7-4419-a9a7-a779b286f768 found in kube manager
2025-10-31 00:18:21,603 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-31 00:18:21,603 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-31 00:18:21,603 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c5ae234a-26e7-4419-a9a7-a779b286f768
2025-10-31 00:18:21,627 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-31 00:18:23,627 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c5ae234a-26e7-4419-a9a7-a779b286f768
2025-10-31 00:18:23,660 - INFO - Network policy with name ingress-on-service found in agent
2025-10-31 00:18:23,660 - INFO - Network Policy ingress-on-service verification passed
2025-10-31 00:18:28,721 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:28,721 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:28,721 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:33,772 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:33,772 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:33,772 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:38,822 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:38,822 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:38,822 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:43,870 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:43,870 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:43,870 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:48,920 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:48,920 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:48,920 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:53,970 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:53,970 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:53,970 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:59,034 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:59,034 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:18:59,034 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:04,096 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:04,096 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:04,097 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:09,148 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:09,148 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:09,148 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:14,201 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:14,201 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:14,201 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:14,201 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09882295': 0, 'ctest-pod-69205653': 0}
2025-10-31 00:19:14,260 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:19:14,260 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:19:14,260 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:19:14,310 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:19:14,310 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:19:14,310 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:19:14,350 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:19:14,351 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:19:14,351 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:19:14,351 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09882295': 1, 'ctest-pod-69205653': 2}
2025-10-31 00:19:19,400 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:19,401 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:19,401 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:24,452 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:24,452 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:24,452 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:29,501 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:29,501 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:29,501 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:34,548 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:34,548 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:34,548 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:39,600 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:39,601 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:39,601 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:44,657 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:44,658 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:44,658 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:49,719 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:49,719 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:49,719 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:19:52,535 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-31 00:20:02,600 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:02,601 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:02,601 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:07,650 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:07,650 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:07,650 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:12,696 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:12,696 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:12,696 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:12,696 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09882295': 0, 'ctest-pod-69205653': 0}
2025-10-31 00:20:14,748 - DEBUG - [Pod ctest-pod-71388841] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.876 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.054 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.054/0.335/0.876 ms
2025-10-31 00:20:14,748 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-71388841 with expectation True passed
2025-10-31 00:20:16,797 - DEBUG - [Pod ctest-pod-51599916] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.426 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.189/0.426 ms
2025-10-31 00:20:16,797 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51599916 with expectation True passed
2025-10-31 00:20:18,849 - DEBUG - [Pod ctest-pod-18571103] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.392 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.182/0.392 ms
2025-10-31 00:20:18,849 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18571103 with expectation True passed
2025-10-31 00:20:18,901 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:20:18,902 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-31 00:20:18,902 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:20:18,902 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71388841 passed
2025-10-31 00:20:18,950 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:20:18,950 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-31 00:20:18,950 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:20:18,950 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71388841 passed
2025-10-31 00:20:24,004 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 00:20:24,004 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 00:20:24,004 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 00:20:24,004 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51599916 passed
2025-10-31 00:20:29,061 - DEBUG - [Pod ctest-pod-54219735] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-31 00:20:29,062 - DEBUG - [Pod Pod ctest-pod-54219735] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-31 00:20:29,062 - DEBUG - [Pod Pod ctest-pod-54219735] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-31 00:20:29,062 - INFO - wget check of of http://10.47.255.251 from ctest-pod-54219735 passed
2025-10-31 00:20:29,070 - INFO - Updating Network Policy ingress-on-service
2025-10-31 00:20:34,128 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:34,128 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:34,128 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:39,180 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:39,180 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:39,180 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:44,240 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:44,240 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:44,240 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:49,293 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:49,293 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:49,293 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:54,352 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:54,352 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:54,352 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:59,404 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:59,404 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:20:59,404 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:04,458 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:04,458 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:04,458 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:09,516 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:09,517 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:09,517 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:14,572 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:14,572 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:14,572 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:19,621 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:19,621 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:19,621 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.107.3.143:80 (10.107.3.143:80)
wget: download timed out
2025-10-31 00:21:19,621 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09882295': 0, 'ctest-pod-69205653': 0}
2025-10-31 00:21:19,667 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,667 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,667 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,722 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,722 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,722 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,774 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,774 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,774 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,809 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,809 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,809 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,809 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09882295': 1, 'ctest-pod-69205653': 3}
2025-10-31 00:21:19,857 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,858 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,858 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,908 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,908 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,908 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-69205653
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,982 - DEBUG - [Pod ctest-pod-18571103] Cmd: wget http://10.107.3.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,982 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd wget http://10.107.3.143:80/ -O - -T 5 -t 1 passed
2025-10-31 00:21:19,982 - DEBUG - [Pod Pod ctest-pod-18571103] Cmd output: ctest-pod-09882295
Connecting to 10.107.3.143:80 (10.107.3.143:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-31 00:21:19,982 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09882295': 1, 'ctest-pod-69205653': 2}
2025-10-31 00:21:22,050 - DEBUG - [Pod ctest-pod-71388841] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.663 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.276/0.663 ms
2025-10-31 00:21:22,051 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-71388841 with expectation True passed
2025-10-31 00:21:24,101 - DEBUG - [Pod ctest-pod-51599916] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.482 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.215/0.482 ms
2025-10-31 00:21:24,101 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51599916 with expectation True passed
2025-10-31 00:21:26,148 - DEBUG - [Pod ctest-pod-18571103] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.088 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.413/1.088 ms
2025-10-31 00:21:26,148 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18571103 with expectation True passed
2025-10-31 00:21:26,209 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:21:26,209 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-31 00:21:26,209 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:21:26,209 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71388841 passed
2025-10-31 00:21:26,258 - DEBUG - [Pod ctest-pod-71388841] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:21:26,258 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-31 00:21:26,258 - DEBUG - [Pod Pod ctest-pod-71388841] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:21:26,258 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71388841 passed
2025-10-31 00:21:31,313 - DEBUG - [Pod ctest-pod-51599916] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 00:21:31,313 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 00:21:31,313 - DEBUG - [Pod Pod ctest-pod-51599916] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-31 00:21:31,313 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51599916 passed
2025-10-31 00:21:31,365 - DEBUG - [Pod ctest-pod-54219735] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:21:31,365 - DEBUG - [Pod Pod ctest-pod-54219735] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-31 00:21:31,365 - DEBUG - [Pod Pod ctest-pod-54219735] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-31 00:21:31,365 - INFO - wget check of of http://10.47.255.251 from ctest-pod-54219735 passed
2025-10-31 00:21:31,366 - INFO - Deleting Network Policy : ingress-on-service
2025-10-31 00:21:31,366 - INFO - Deleting service : ctest-nginx-svc-02888253
2025-10-31 00:21:31,596 - DEBUG - No XMPP flaps were noticed during the test
2025-10-31 00:21:31,596 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-10-31 00:21:31,596 - INFO - --------------------------------------------------------------------------------
2025-10-31 00:21:31,602 - INFO - Deleting pod ctest-new-default-29886787:ctest-pod-09882295
2025-10-31 00:21:31,602 - INFO - Deleting pod ctest-new-default-29886787:ctest-pod-69205653
2025-10-31 00:21:31,603 - INFO - Deleting pod ctest-non-default-44419009:ctest-pod-05393563
2025-10-31 00:21:31,603 - INFO - Deleting pod ctest-non-default-44419009:ctest-pod-97846649
2025-10-31 00:21:31,604 - INFO - Deleting pod ctest-new-default-29886787:ctest-pod-51599916
2025-10-31 00:21:31,604 - INFO - Deleting pod ctest-new-default-29886787:ctest-pod-71388841
2025-10-31 00:21:31,605 - INFO - Deleting pod ctest-non-default-44419009:ctest-pod-18571103
2025-10-31 00:21:31,605 - INFO - Deleting pod ctest-non-default-44419009:ctest-pod-54219735
2025-10-31 00:21:31,741 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,742 - WARNING - Pod uuid b5046fe1-520c-4671-b6de-38c597f1c8ec is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,743 - WARNING - Pod uuid d074ef1f-8b1f-4edc-9fdb-7e13ff6854aa is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,743 - WARNING - Pod uuid d851f4e6-7cf2-46a5-8ab9-90ff6cd5ba07 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,744 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,744 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,744 - WARNING - Pod uuid 0c0ba259-04ef-4bed-8de9-8fd89b862974 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:31,745 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:36,768 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:36,769 - DEBUG - Pod 0c0ba259-04ef-4bed-8de9-8fd89b862974 is not in agent 10.0.0.242 VM list
2025-10-31 00:21:36,770 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:36,771 - DEBUG - Pod d074ef1f-8b1f-4edc-9fdb-7e13ff6854aa is not in agent 10.0.0.242 VM list
2025-10-31 00:21:36,772 - DEBUG - Pod d851f4e6-7cf2-46a5-8ab9-90ff6cd5ba07 is not in agent 10.0.0.242 VM list
2025-10-31 00:21:36,773 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:36,774 - DEBUG - Pod b5046fe1-520c-4671-b6de-38c597f1c8ec is not in agent 10.0.0.242 VM list
2025-10-31 00:21:36,777 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:36,792 - DEBUG - VMI 12c93002-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:21:36,792 - INFO - Verified that pod ctest-pod-97846649 is removed in agent
2025-10-31 00:21:36,793 - DEBUG - VMI 11b29ea6-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:21:36,793 - INFO - Verified that pod ctest-pod-69205653 is removed in agent
2025-10-31 00:21:36,794 - DEBUG - VMI 124fc0aa-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:21:36,794 - INFO - Verified that pod ctest-pod-05393563 is removed in agent
2025-10-31 00:21:36,795 - DEBUG - VMI 1137c0b4-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:21:36,795 - INFO - Verified that pod ctest-pod-09882295 is removed in agent
2025-10-31 00:21:41,777 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:41,777 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:41,783 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:41,784 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:46,797 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:46,798 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:46,798 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:46,803 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:51,807 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:51,808 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:51,812 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:51,813 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:56,817 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:56,818 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:56,821 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:21:56,822 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:22:01,836 - WARNING - Pod uuid ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:22:01,837 - WARNING - Pod uuid 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:22:01,838 - WARNING - Pod uuid 2fc123d2-987d-467a-8327-fd29b36fc8ae is still seen in agent 10.0.0.242 VM list
2025-10-31 00:22:01,838 - WARNING - Pod uuid 05140860-8f72-4cd6-8435-fb364dc72301 is still seen in agent 10.0.0.242 VM list
2025-10-31 00:22:06,853 - DEBUG - Pod 1ef3d61c-9558-40e8-b5c5-e4fd6f0db564 is not in agent 10.0.0.242 VM list
2025-10-31 00:22:06,854 - DEBUG - Pod 05140860-8f72-4cd6-8435-fb364dc72301 is not in agent 10.0.0.242 VM list
2025-10-31 00:22:06,856 - DEBUG - Pod ca6e85fe-c45e-44e3-9e9e-cccdaa874845 is not in agent 10.0.0.242 VM list
2025-10-31 00:22:06,858 - DEBUG - Pod 2fc123d2-987d-467a-8327-fd29b36fc8ae is not in agent 10.0.0.242 VM list
2025-10-31 00:22:06,868 - DEBUG - VMI 13b49ef2-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:22:06,868 - INFO - Verified that pod ctest-pod-71388841 is removed in agent
2025-10-31 00:22:06,868 - DEBUG - VMI 14907756-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:22:06,868 - INFO - Verified that pod ctest-pod-54219735 is removed in agent
2025-10-31 00:22:06,869 - DEBUG - VMI 14260952-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:22:06,869 - INFO - Verified that pod ctest-pod-18571103 is removed in agent
2025-10-31 00:22:06,870 - DEBUG - VMI 134f3e54-b5ef-11f0-bf46-fa163ef08dc0 is removed from agent 10.0.0.242
2025-10-31 00:22:06,870 - INFO - Verified that pod ctest-pod-51599916 is removed in agent
2025-10-31 00:22:06,870 - INFO - Deleting namespace ctest-non-default-44419009
2025-10-31 00:22:06,895 - DEBUG - Namespace ctest-non-default-44419009 still in k8s
2025-10-31 00:22:08,901 - DEBUG - Namespace ctest-non-default-44419009 still in k8s
2025-10-31 00:22:10,911 - DEBUG - Namespace ctest-non-default-44419009 still in k8s
2025-10-31 00:22:12,915 - DEBUG - Namespace ctest-non-default-44419009 is not in k8s
2025-10-31 00:22:12,916 - DEBUG - No need to check project deletion in contrail-api
2025-10-31 00:22:12,916 - INFO - Deleting namespace ctest-new-default-29886787
2025-10-31 00:22:12,926 - DEBUG - Namespace ctest-new-default-29886787 still in k8s
2025-10-31 00:22:14,932 - DEBUG - Namespace ctest-new-default-29886787 still in k8s
2025-10-31 00:22:16,937 - DEBUG - Namespace ctest-new-default-29886787 still in k8s
2025-10-31 00:22:18,941 - DEBUG - Namespace ctest-new-default-29886787 is not in k8s
2025-10-31 00:22:18,941 - DEBUG - No need to check project deletion in contrail-api