2026-03-23 01:49:39,256 - INFO - Using existing project ['default-domain', 'k8s-default'](fb441367-fe59-4fd3-87c6-48ec584ad81f)
2026-03-23 01:49:39,270 - DEBUG - Namespace ctest-new-default-03430230 not present
2026-03-23 01:49:39,282 - INFO - Created namespace ctest-new-default-03430230
2026-03-23 01:49:42,287 - DEBUG - Namespace ctest-non-default-39646490 not present
2026-03-23 01:49:42,297 - INFO - Created namespace ctest-non-default-39646490
2026-03-23 01:49:45,319 - DEBUG - Pod ctest-pod-03143817 not present
2026-03-23 01:49:45,320 - INFO - Creating Pod ctest-pod-03143817
2026-03-23 01:49:45,359 - DEBUG - Pod : ctest-pod-03143817 UUID is 27ec5a2a-0c71-4a81-ad4a-aebefaa48aa0
2026-03-23 01:49:45,361 - DEBUG - Pod ctest-pod-93551226 not present
2026-03-23 01:49:45,361 - INFO - Creating Pod ctest-pod-93551226
2026-03-23 01:49:45,387 - DEBUG - Pod : ctest-pod-93551226 UUID is c3ed54b3-de44-4813-8355-a79360f6dbfb
2026-03-23 01:49:45,395 - DEBUG - Pod ctest-pod-81183797 not present
2026-03-23 01:49:45,396 - INFO - Creating Pod ctest-pod-81183797
2026-03-23 01:49:45,427 - DEBUG - Pod : ctest-pod-81183797 UUID is 39a63e66-d151-4889-88c2-b03f168e0cda
2026-03-23 01:49:45,429 - DEBUG - Pod ctest-pod-50893454 not present
2026-03-23 01:49:45,430 - INFO - Creating Pod ctest-pod-50893454
2026-03-23 01:49:45,449 - DEBUG - Pod : ctest-pod-50893454 UUID is c7027ea1-ee83-4e5e-9864-952c23a9fc27
2026-03-23 01:49:45,450 - DEBUG - Pod ctest-pod-13183213 not present
2026-03-23 01:49:45,451 - INFO - Creating Pod ctest-pod-13183213
2026-03-23 01:49:45,469 - DEBUG - Pod : ctest-pod-13183213 UUID is b65e0103-52d1-4c0d-91c5-7e8546c0dbde
2026-03-23 01:49:45,471 - DEBUG - Pod ctest-pod-26168293 not present
2026-03-23 01:49:45,471 - INFO - Creating Pod ctest-pod-26168293
2026-03-23 01:49:45,489 - DEBUG - Pod : ctest-pod-26168293 UUID is eb07963c-0bdb-4268-a517-2955346abdc3
2026-03-23 01:49:45,490 - DEBUG - Pod ctest-pod-62417728 not present
2026-03-23 01:49:45,491 - INFO - Creating Pod ctest-pod-62417728
2026-03-23 01:49:45,507 - DEBUG - Pod : ctest-pod-62417728 UUID is 235a148d-5cd5-4163-81d1-0e9dac53e674
2026-03-23 01:49:45,509 - DEBUG - Pod ctest-pod-17685014 not present
2026-03-23 01:49:45,509 - INFO - Creating Pod ctest-pod-17685014
2026-03-23 01:49:45,525 - DEBUG - Pod : ctest-pod-17685014 UUID is 0c78e937-cfaa-449d-b73d-422c1c32c73e
2026-03-23 01:49:45,690 - INFO - Project default-domain:k8s-ctest-new-default-03430230 for Namespace ctest-new-default-03430230 is seen in contrail-api
2026-03-23 01:49:45,690 - DEBUG - Project uuid in Contrail is 2612ca41-ed51-4011-a5a7-605148007ce3
2026-03-23 01:49:45,861 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=ecfae675-851b-47d2-8f0e-c6285e3446f6
2026-03-23 01:49:45,865 - INFO - Namespace ctest-new-default-03430230 with uuid ecfae675-851b-47d2-8f0e-c6285e3446f6 found in kube manager
2026-03-23 01:49:45,865 - INFO - Namespace ctest-new-default-03430230 verification passed
2026-03-23 01:49:46,022 - INFO - Project default-domain:k8s-ctest-non-default-39646490 for Namespace ctest-non-default-39646490 is seen in contrail-api
2026-03-23 01:49:46,022 - DEBUG - Project uuid in Contrail is 53575413-50b2-49f9-a7ea-9c0adb015b22
2026-03-23 01:49:46,022 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=91bdcd39-0705-4f13-844f-6de21c8d379c
2026-03-23 01:49:46,027 - INFO - Namespace ctest-non-default-39646490 with uuid 91bdcd39-0705-4f13-844f-6de21c8d379c found in kube manager
2026-03-23 01:49:46,028 - INFO - Namespace ctest-non-default-39646490 verification passed
2026-03-23 01:49:46,035 - DEBUG - Pod ctest-pod-03143817 not in running state.Currently in Pending
2026-03-23 01:49:51,042 - DEBUG - Pod ctest-pod-03143817 not in running state.Currently in Pending
2026-03-23 01:49:56,050 - DEBUG - Pod ctest-pod-03143817 not in running state.Currently in Pending
2026-03-23 01:50:01,057 - INFO - Pod ctest-pod-03143817 is in running state.Got IP 10.47.255.251
2026-03-23 01:50:01,108 - DEBUG - Pod ctest-pod-03143817 has vmi 924f5d02-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:01,108 - INFO - Verified pod ctest-pod-03143817 in contrail-api
2026-03-23 01:50:01,120 - DEBUG - VMI 924f5d02-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:01,120 - INFO - Verified Pod ctest-pod-03143817 in agent 10.0.0.241
2026-03-23 01:50:01,120 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=27ec5a2a-0c71-4a81-ad4a-aebefaa48aa0
2026-03-23 01:50:01,124 - INFO - Pod ctest-pod-03143817 with uuid 27ec5a2a-0c71-4a81-ad4a-aebefaa48aa0 found in kube manager
2026-03-23 01:50:01,124 - INFO - Pod ctest-pod-03143817 verification passed
2026-03-23 01:50:01,129 - INFO - Pod ctest-pod-93551226 is in running state.Got IP 10.47.255.250
2026-03-23 01:50:01,140 - DEBUG - Pod ctest-pod-93551226 has vmi 92c399ce-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:01,140 - INFO - Verified pod ctest-pod-93551226 in contrail-api
2026-03-23 01:50:01,161 - DEBUG - VMI 92c399ce-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:01,161 - INFO - Verified Pod ctest-pod-93551226 in agent 10.0.0.241
2026-03-23 01:50:01,161 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c3ed54b3-de44-4813-8355-a79360f6dbfb
2026-03-23 01:50:01,165 - INFO - Pod ctest-pod-93551226 with uuid c3ed54b3-de44-4813-8355-a79360f6dbfb found in kube manager
2026-03-23 01:50:01,165 - INFO - Pod ctest-pod-93551226 verification passed
2026-03-23 01:50:01,170 - INFO - Pod ctest-pod-81183797 is in running state.Got IP 10.47.255.249
2026-03-23 01:50:01,181 - DEBUG - Pod ctest-pod-81183797 has vmi 935334a8-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:01,181 - INFO - Verified pod ctest-pod-81183797 in contrail-api
2026-03-23 01:50:01,192 - DEBUG - VMI 935334a8-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:01,193 - INFO - Verified Pod ctest-pod-81183797 in agent 10.0.0.241
2026-03-23 01:50:01,193 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=39a63e66-d151-4889-88c2-b03f168e0cda
2026-03-23 01:50:01,196 - INFO - Pod ctest-pod-81183797 with uuid 39a63e66-d151-4889-88c2-b03f168e0cda found in kube manager
2026-03-23 01:50:01,197 - INFO - Pod ctest-pod-81183797 verification passed
2026-03-23 01:50:01,205 - INFO - Pod ctest-pod-50893454 is in running state.Got IP 10.47.255.248
2026-03-23 01:50:01,259 - DEBUG - Pod ctest-pod-50893454 has vmi 93c9299c-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:01,259 - INFO - Verified pod ctest-pod-50893454 in contrail-api
2026-03-23 01:50:01,269 - DEBUG - VMI 93c9299c-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:01,270 - INFO - Verified Pod ctest-pod-50893454 in agent 10.0.0.241
2026-03-23 01:50:01,270 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c7027ea1-ee83-4e5e-9864-952c23a9fc27
2026-03-23 01:50:01,274 - INFO - Pod ctest-pod-50893454 with uuid c7027ea1-ee83-4e5e-9864-952c23a9fc27 found in kube manager
2026-03-23 01:50:01,274 - INFO - Pod ctest-pod-50893454 verification passed
2026-03-23 01:50:01,279 - DEBUG - Pod ctest-pod-13183213 not in running state.Currently in Pending
2026-03-23 01:50:06,287 - INFO - Pod ctest-pod-13183213 is in running state.Got IP 10.47.255.247
2026-03-23 01:50:06,298 - DEBUG - Pod ctest-pod-13183213 has vmi 944c2b30-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:06,298 - INFO - Verified pod ctest-pod-13183213 in contrail-api
2026-03-23 01:50:06,309 - DEBUG - VMI 944c2b30-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:06,310 - INFO - Verified Pod ctest-pod-13183213 in agent 10.0.0.241
2026-03-23 01:50:06,310 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=b65e0103-52d1-4c0d-91c5-7e8546c0dbde
2026-03-23 01:50:06,313 - INFO - Pod ctest-pod-13183213 with uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde found in kube manager
2026-03-23 01:50:06,313 - INFO - Pod ctest-pod-13183213 verification passed
2026-03-23 01:50:06,319 - INFO - Pod ctest-pod-62417728 is in running state.Got IP 10.47.255.245
2026-03-23 01:50:06,378 - DEBUG - Pod ctest-pod-62417728 has vmi 9523704a-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:06,378 - INFO - Verified pod ctest-pod-62417728 in contrail-api
2026-03-23 01:50:06,389 - DEBUG - VMI 9523704a-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:06,389 - INFO - Verified Pod ctest-pod-62417728 in agent 10.0.0.241
2026-03-23 01:50:06,389 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=235a148d-5cd5-4163-81d1-0e9dac53e674
2026-03-23 01:50:06,393 - INFO - Pod ctest-pod-62417728 with uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 found in kube manager
2026-03-23 01:50:06,393 - INFO - Pod ctest-pod-62417728 verification passed
2026-03-23 01:50:06,399 - INFO - Pod ctest-pod-26168293 is in running state.Got IP 10.47.255.246
2026-03-23 01:50:06,452 - DEBUG - Pod ctest-pod-26168293 has vmi 94b84040-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:06,452 - INFO - Verified pod ctest-pod-26168293 in contrail-api
2026-03-23 01:50:06,464 - DEBUG - VMI 94b84040-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:06,464 - INFO - Verified Pod ctest-pod-26168293 in agent 10.0.0.241
2026-03-23 01:50:06,464 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=eb07963c-0bdb-4268-a517-2955346abdc3
2026-03-23 01:50:06,468 - INFO - Pod ctest-pod-26168293 with uuid eb07963c-0bdb-4268-a517-2955346abdc3 found in kube manager
2026-03-23 01:50:06,468 - INFO - Pod ctest-pod-26168293 verification passed
2026-03-23 01:50:06,474 - INFO - Pod ctest-pod-17685014 is in running state.Got IP 10.47.255.244
2026-03-23 01:50:06,487 - DEBUG - Pod ctest-pod-17685014 has vmi 958467ba-265a-11f1-a0d1-fa163e3c5f90
2026-03-23 01:50:06,487 - INFO - Verified pod ctest-pod-17685014 in contrail-api
2026-03-23 01:50:06,503 - DEBUG - VMI 958467ba-265a-11f1-a0d1-fa163e3c5f90 is active in agent 10.0.0.241
2026-03-23 01:50:06,503 - INFO - Verified Pod ctest-pod-17685014 in agent 10.0.0.241
2026-03-23 01:50:06,503 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=0c78e937-cfaa-449d-b73d-422c1c32c73e
2026-03-23 01:50:06,507 - INFO - Pod ctest-pod-17685014 with uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e found in kube manager
2026-03-23 01:50:06,507 - INFO - Pod ctest-pod-17685014 verification passed
2026-03-23 01:50:06,507 - INFO - ================================================================================
2026-03-23 01:50:06,507 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2026-03-23 01:50:06,507 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2026-03-23 01:50:06,742 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.19': '0'}} with
2026-03-23 01:50:06,742 - INFO - Initial checks done. Running the testcase now
2026-03-23 01:50:06,742 - INFO -
2026-03-23 01:50:06,810 - DEBUG - [Pod ctest-pod-03143817] Cmd: echo ctest-pod-03143817 > /usr/share/nginx/html/index.html, Output:
2026-03-23 01:50:06,876 - DEBUG - [Pod ctest-pod-93551226] Cmd: echo ctest-pod-93551226 > /usr/share/nginx/html/index.html, Output:
2026-03-23 01:50:06,947 - DEBUG - [Pod ctest-pod-81183797] Cmd: echo ctest-pod-81183797 > /usr/share/nginx/html/index.html, Output:
2026-03-23 01:50:07,005 - DEBUG - [Pod ctest-pod-50893454] Cmd: echo ctest-pod-50893454 > /usr/share/nginx/html/index.html, Output:
2026-03-23 01:50:07,008 - DEBUG - Service ctest-nginx-svc-08857865 not present
2026-03-23 01:50:07,009 - INFO - Creating service ctest-nginx-svc-08857865
2026-03-23 01:50:07,025 - INFO - Created Service ctest-nginx-svc-08857865
2026-03-23 01:50:07,041 - WARNING - Service UUID bdc80a98-317f-457b-805f-0be37115b3bb not yet found in contrail-api
2026-03-23 01:50:08,071 - INFO - Validated that Service ctest-nginx-svc-08857865 is seen in contrail-api
2026-03-23 01:50:08,071 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=bdc80a98-317f-457b-805f-0be37115b3bb
2026-03-23 01:50:08,074 - INFO - Service ctest-nginx-svc-08857865 with uuid bdc80a98-317f-457b-805f-0be37115b3bb found in kube manager
2026-03-23 01:50:08,074 - INFO - Service ctest-nginx-svc-08857865 verification passed
2026-03-23 01:50:09,172 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
ctest-pod-03143817
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:50:09,172 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:50:09,172 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
ctest-pod-03143817
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:50:09,227 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03143817
2026-03-23 01:50:09,227 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:50:09,227 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03143817
2026-03-23 01:50:09,286 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:50:09,286 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:50:09,286 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:50:09,286 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03143817': 2, 'ctest-pod-93551226': 1}
2026-03-23 01:50:09,340 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03143817
2026-03-23 01:50:09,340 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:50:09,340 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03143817
2026-03-23 01:50:09,375 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:50:09,375 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:50:09,375 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:50:09,375 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03143817': 1, 'ctest-pod-93551226': 1}
2026-03-23 01:50:09,378 - DEBUG - Network policy ingress-on-service not present
2026-03-23 01:50:09,379 - INFO - Creating Network Policy ingress-on-service
2026-03-23 01:50:09,394 - INFO - Network policy found in k8s
2026-03-23 01:50:09,394 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4f5c961f-d409-4430-87d8-a8cd4ef75cf1
2026-03-23 01:50:09,401 - INFO - Network Policy ingress-on-service with uuid 4f5c961f-d409-4430-87d8-a8cd4ef75cf1 found in kube manager
2026-03-23 01:50:09,444 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2026-03-23 01:50:09,444 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2026-03-23 01:50:09,444 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4f5c961f-d409-4430-87d8-a8cd4ef75cf1
2026-03-23 01:50:09,466 - WARNING - Network policy with name ingress-on-service not found in agent
2026-03-23 01:50:11,467 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4f5c961f-d409-4430-87d8-a8cd4ef75cf1
2026-03-23 01:50:11,490 - INFO - Network policy with name ingress-on-service found in agent
2026-03-23 01:50:11,491 - INFO - Network Policy ingress-on-service verification passed
2026-03-23 01:50:16,559 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:16,559 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:16,559 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:21,623 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:21,623 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:21,624 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:26,679 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:26,679 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:26,679 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:31,740 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:31,741 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:31,741 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:36,799 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:36,799 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:36,799 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:41,850 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:41,851 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:41,851 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:46,904 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:46,904 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:46,904 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:51,955 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:51,955 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:51,955 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:57,003 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:50:57,003 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:50:57,003 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:02,059 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:02,059 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:02,059 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:02,059 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03143817': 0, 'ctest-pod-93551226': 0}
2026-03-23 01:51:02,124 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:51:02,134 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:51:02,134 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:51:02,204 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:51:02,204 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:51:02,204 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:51:02,204 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03143817': 1, 'ctest-pod-93551226': 1}
2026-03-23 01:51:07,269 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:07,269 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:07,269 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:12,324 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:12,324 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:12,324 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:17,383 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:17,383 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:17,383 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:22,435 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:22,435 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:22,435 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:27,487 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:27,487 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:27,487 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:27,833 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2026-03-23 01:51:37,895 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:37,895 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:37,895 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:42,944 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:42,944 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:42,944 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:47,996 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:47,996 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:47,996 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:53,049 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:53,049 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:53,049 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:58,107 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:58,108 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:51:58,108 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:51:58,108 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03143817': 0, 'ctest-pod-93551226': 0}
2026-03-23 01:52:00,159 - DEBUG - [Pod ctest-pod-26168293] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.584 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.106 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.252/0.584 ms
2026-03-23 01:52:00,159 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26168293 with expectation True passed
2026-03-23 01:52:02,214 - DEBUG - [Pod ctest-pod-13183213] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.850 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.335/0.850 ms
2026-03-23 01:52:02,214 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13183213 with expectation True passed
2026-03-23 01:52:04,269 - DEBUG - [Pod ctest-pod-62417728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.113 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.426/1.113 ms
2026-03-23 01:52:04,269 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62417728 with expectation True passed
2026-03-23 01:52:04,327 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:52:04,327 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-03-23 01:52:04,327 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-03143817
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:52:04,327 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26168293 passed
2026-03-23 01:52:04,383 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:52:04,383 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-03-23 01:52:04,383 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-93551226
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:52:04,383 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26168293 passed
2026-03-23 01:52:09,416 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 01:52:09,416 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-03-23 01:52:09,416 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 01:52:09,416 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13183213 passed
2026-03-23 01:52:14,465 - DEBUG - [Pod ctest-pod-17685014] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-03-23 01:52:14,465 - DEBUG - [Pod Pod ctest-pod-17685014] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed.
2026-03-23 01:52:14,465 - DEBUG - [Pod Pod ctest-pod-17685014] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-03-23 01:52:14,465 - INFO - wget check of of http://10.47.255.251 from ctest-pod-17685014 passed
2026-03-23 01:52:14,476 - INFO - Updating Network Policy ingress-on-service
2026-03-23 01:52:19,542 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:19,542 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:19,542 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:24,590 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:24,591 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:24,591 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:29,646 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:29,646 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:29,646 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:34,695 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:34,695 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:34,695 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:39,755 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:39,756 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:39,756 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:44,806 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:44,806 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:44,807 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:49,860 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:49,861 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:49,861 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:54,915 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:54,915 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:54,915 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:59,962 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:52:59,963 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:52:59,963 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:53:05,011 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:53:05,011 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 failed.
2026-03-23 01:53:05,011 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.101.60.248:80 (10.101.60.248:80)
wget: download timed out
2026-03-23 01:53:05,011 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03143817': 0, 'ctest-pod-93551226': 0}
2026-03-23 01:53:05,066 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,066 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,066 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,116 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,116 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,116 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,173 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,173 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,173 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,229 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,230 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,230 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,230 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03143817': 3, 'ctest-pod-93551226': 1}
2026-03-23 01:53:05,287 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,287 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,287 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,332 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,332 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,332 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,393 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,393 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,393 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: ctest-pod-03143817
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,445 - DEBUG - [Pod ctest-pod-62417728] Cmd: wget http://10.101.60.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,445 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd wget http://10.101.60.248:80/ -O - -T 5 -t 1 passed
2026-03-23 01:53:05,445 - DEBUG - [Pod Pod ctest-pod-62417728] Cmd output: ctest-pod-93551226
Connecting to 10.101.60.248:80 (10.101.60.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:05,445 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03143817': 3, 'ctest-pod-93551226': 1}
2026-03-23 01:53:07,499 - DEBUG - [Pod ctest-pod-26168293] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.840 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/0.340/0.840 ms
2026-03-23 01:53:07,499 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26168293 with expectation True passed
2026-03-23 01:53:09,552 - DEBUG - [Pod ctest-pod-13183213] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.810 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.136 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.095/0.347/0.810 ms
2026-03-23 01:53:09,552 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13183213 with expectation True passed
2026-03-23 01:53:11,603 - DEBUG - [Pod ctest-pod-62417728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.857 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.332/0.857 ms
2026-03-23 01:53:11,603 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62417728 with expectation True passed
2026-03-23 01:53:11,658 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03143817
2026-03-23 01:53:11,658 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-03-23 01:53:11,658 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03143817
2026-03-23 01:53:11,658 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26168293 passed
2026-03-23 01:53:11,712 - DEBUG - [Pod ctest-pod-26168293] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-93551226
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:11,712 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-03-23 01:53:11,712 - DEBUG - [Pod Pod ctest-pod-26168293] Cmd output: ctest-pod-93551226
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:11,712 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26168293 passed
2026-03-23 01:53:16,774 - DEBUG - [Pod ctest-pod-13183213] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 01:53:16,774 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-03-23 01:53:16,774 - DEBUG - [Pod Pod ctest-pod-13183213] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 01:53:16,774 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13183213 passed
2026-03-23 01:53:16,827 - DEBUG - [Pod ctest-pod-17685014] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-03143817
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:16,827 - DEBUG - [Pod Pod ctest-pod-17685014] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-03-23 01:53:16,827 - DEBUG - [Pod Pod ctest-pod-17685014] Cmd output: ctest-pod-03143817
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 01:53:16,827 - INFO - wget check of of http://10.47.255.251 from ctest-pod-17685014 passed
2026-03-23 01:53:16,827 - INFO - Deleting Network Policy : ingress-on-service
2026-03-23 01:53:16,828 - INFO - Deleting service : ctest-nginx-svc-08857865
2026-03-23 01:53:17,081 - DEBUG - No XMPP flaps were noticed during the test
2026-03-23 01:53:17,081 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11]
2026-03-23 01:53:17,081 - INFO - --------------------------------------------------------------------------------
2026-03-23 01:53:17,084 - INFO - Deleting pod ctest-new-default-03430230:ctest-pod-03143817
2026-03-23 01:53:17,085 - INFO - Deleting pod ctest-new-default-03430230:ctest-pod-93551226
2026-03-23 01:53:17,085 - INFO - Deleting pod ctest-non-default-39646490:ctest-pod-81183797
2026-03-23 01:53:17,086 - INFO - Deleting pod ctest-non-default-39646490:ctest-pod-50893454
2026-03-23 01:53:17,086 - INFO - Deleting pod ctest-new-default-03430230:ctest-pod-13183213
2026-03-23 01:53:17,086 - INFO - Deleting pod ctest-new-default-03430230:ctest-pod-26168293
2026-03-23 01:53:17,087 - INFO - Deleting pod ctest-non-default-39646490:ctest-pod-62417728
2026-03-23 01:53:17,087 - INFO - Deleting pod ctest-non-default-39646490:ctest-pod-17685014
2026-03-23 01:53:17,200 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,201 - WARNING - Pod uuid c7027ea1-ee83-4e5e-9864-952c23a9fc27 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,201 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,201 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,203 - WARNING - Pod uuid 27ec5a2a-0c71-4a81-ad4a-aebefaa48aa0 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,203 - WARNING - Pod uuid 39a63e66-d151-4889-88c2-b03f168e0cda is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,207 - WARNING - Pod uuid c3ed54b3-de44-4813-8355-a79360f6dbfb is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:17,207 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:22,226 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:22,227 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:22,227 - DEBUG - Pod 39a63e66-d151-4889-88c2-b03f168e0cda is not in agent 10.0.0.241 VM list
2026-03-23 01:53:22,230 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:22,230 - DEBUG - Pod c7027ea1-ee83-4e5e-9864-952c23a9fc27 is not in agent 10.0.0.241 VM list
2026-03-23 01:53:22,231 - DEBUG - Pod 27ec5a2a-0c71-4a81-ad4a-aebefaa48aa0 is not in agent 10.0.0.241 VM list
2026-03-23 01:53:22,232 - DEBUG - Pod c3ed54b3-de44-4813-8355-a79360f6dbfb is not in agent 10.0.0.241 VM list
2026-03-23 01:53:22,233 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:22,242 - DEBUG - VMI 92c399ce-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:22,242 - INFO - Verified that pod ctest-pod-93551226 is removed in agent
2026-03-23 01:53:22,243 - DEBUG - VMI 93c9299c-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:22,243 - INFO - Verified that pod ctest-pod-50893454 is removed in agent
2026-03-23 01:53:22,244 - DEBUG - VMI 935334a8-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:22,244 - INFO - Verified that pod ctest-pod-81183797 is removed in agent
2026-03-23 01:53:22,244 - DEBUG - VMI 924f5d02-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:22,244 - INFO - Verified that pod ctest-pod-03143817 is removed in agent
2026-03-23 01:53:27,245 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:27,246 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:27,247 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:27,247 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:32,254 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:32,259 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:32,260 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:32,260 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:37,262 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:37,270 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:37,271 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:37,272 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:42,269 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:42,282 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:42,282 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:42,283 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:47,299 - WARNING - Pod uuid b65e0103-52d1-4c0d-91c5-7e8546c0dbde is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:47,300 - WARNING - Pod uuid 235a148d-5cd5-4163-81d1-0e9dac53e674 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:47,300 - WARNING - Pod uuid 0c78e937-cfaa-449d-b73d-422c1c32c73e is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:47,301 - WARNING - Pod uuid eb07963c-0bdb-4268-a517-2955346abdc3 is still seen in agent 10.0.0.241 VM list
2026-03-23 01:53:52,319 - DEBUG - Pod 235a148d-5cd5-4163-81d1-0e9dac53e674 is not in agent 10.0.0.241 VM list
2026-03-23 01:53:52,321 - DEBUG - Pod 0c78e937-cfaa-449d-b73d-422c1c32c73e is not in agent 10.0.0.241 VM list
2026-03-23 01:53:52,321 - DEBUG - Pod eb07963c-0bdb-4268-a517-2955346abdc3 is not in agent 10.0.0.241 VM list
2026-03-23 01:53:52,322 - DEBUG - Pod b65e0103-52d1-4c0d-91c5-7e8546c0dbde is not in agent 10.0.0.241 VM list
2026-03-23 01:53:52,338 - DEBUG - VMI 9523704a-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:52,338 - INFO - Verified that pod ctest-pod-62417728 is removed in agent
2026-03-23 01:53:52,338 - DEBUG - VMI 958467ba-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:52,338 - INFO - Verified that pod ctest-pod-17685014 is removed in agent
2026-03-23 01:53:52,339 - DEBUG - VMI 944c2b30-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:52,339 - INFO - Verified that pod ctest-pod-13183213 is removed in agent
2026-03-23 01:53:52,340 - DEBUG - VMI 94b84040-265a-11f1-a0d1-fa163e3c5f90 is removed from agent 10.0.0.241
2026-03-23 01:53:52,340 - INFO - Verified that pod ctest-pod-26168293 is removed in agent
2026-03-23 01:53:52,340 - INFO - Deleting namespace ctest-non-default-39646490
2026-03-23 01:53:52,365 - DEBUG - Namespace ctest-non-default-39646490 still in k8s
2026-03-23 01:53:54,371 - DEBUG - Namespace ctest-non-default-39646490 still in k8s
2026-03-23 01:53:56,376 - DEBUG - Namespace ctest-non-default-39646490 still in k8s
2026-03-23 01:53:58,381 - DEBUG - Namespace ctest-non-default-39646490 is not in k8s
2026-03-23 01:53:58,381 - DEBUG - No need to check project deletion in contrail-api
2026-03-23 01:53:58,381 - INFO - Deleting namespace ctest-new-default-03430230
2026-03-23 01:53:58,399 - DEBUG - Namespace ctest-new-default-03430230 still in k8s
2026-03-23 01:54:00,405 - DEBUG - Namespace ctest-new-default-03430230 still in k8s
2026-03-23 01:54:02,411 - DEBUG - Namespace ctest-new-default-03430230 still in k8s
2026-03-23 01:54:04,417 - DEBUG - Namespace ctest-new-default-03430230 is not in k8s
2026-03-23 01:54:04,417 - DEBUG - No need to check project deletion in contrail-api