2025-10-24 20:00:15,672 - INFO - Using existing project ['default-domain', 'k8s-default'](b17da5b4-879e-486d-bdbf-fce975cdf556)
2025-10-24 20:00:15,687 - DEBUG - Namespace ctest-new-default-15400998 not present
2025-10-24 20:00:15,696 - INFO - Created namespace ctest-new-default-15400998
2025-10-24 20:00:18,700 - DEBUG - Namespace ctest-non-default-29690009 not present
2025-10-24 20:00:18,707 - INFO - Created namespace ctest-non-default-29690009
2025-10-24 20:00:21,727 - DEBUG - Pod ctest-pod-71588357 not present
2025-10-24 20:00:21,727 - INFO - Creating Pod ctest-pod-71588357
2025-10-24 20:00:21,748 - DEBUG - Pod : ctest-pod-71588357 UUID is ef85b436-b700-4b9d-b959-55211e486995
2025-10-24 20:00:21,751 - DEBUG - Pod ctest-pod-91258170 not present
2025-10-24 20:00:21,752 - INFO - Creating Pod ctest-pod-91258170
2025-10-24 20:00:21,782 - DEBUG - Pod : ctest-pod-91258170 UUID is 9904a15d-7eab-4036-ae1f-b2ec5640bfd3
2025-10-24 20:00:21,785 - DEBUG - Pod ctest-pod-21410481 not present
2025-10-24 20:00:21,785 - INFO - Creating Pod ctest-pod-21410481
2025-10-24 20:00:21,822 - DEBUG - Pod : ctest-pod-21410481 UUID is 15d464e0-1275-48c3-b37c-be9dc25dc25c
2025-10-24 20:00:21,825 - DEBUG - Pod ctest-pod-23117141 not present
2025-10-24 20:00:21,825 - INFO - Creating Pod ctest-pod-23117141
2025-10-24 20:00:21,844 - DEBUG - Pod : ctest-pod-23117141 UUID is e5394291-396c-459c-9ba7-3b51ca14c7f5
2025-10-24 20:00:21,847 - DEBUG - Pod ctest-pod-63641511 not present
2025-10-24 20:00:21,847 - INFO - Creating Pod ctest-pod-63641511
2025-10-24 20:00:21,864 - DEBUG - Pod : ctest-pod-63641511 UUID is 1aba4c7c-2f41-449e-b2b6-565d69229254
2025-10-24 20:00:21,868 - DEBUG - Pod ctest-pod-09907301 not present
2025-10-24 20:00:21,868 - INFO - Creating Pod ctest-pod-09907301
2025-10-24 20:00:21,892 - DEBUG - Pod : ctest-pod-09907301 UUID is 4b81850a-e53e-432d-9f37-918df1269baa
2025-10-24 20:00:21,894 - DEBUG - Pod ctest-pod-23431012 not present
2025-10-24 20:00:21,895 - INFO - Creating Pod ctest-pod-23431012
2025-10-24 20:00:21,912 - DEBUG - Pod : ctest-pod-23431012 UUID is 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708
2025-10-24 20:00:21,914 - DEBUG - Pod ctest-pod-49835537 not present
2025-10-24 20:00:21,915 - INFO - Creating Pod ctest-pod-49835537
2025-10-24 20:00:21,935 - DEBUG - Pod : ctest-pod-49835537 UUID is b0ad5a23-e9fd-429b-aa93-4d9aa46840a2
2025-10-24 20:00:22,082 - INFO - Project default-domain:k8s-ctest-new-default-15400998 for Namespace ctest-new-default-15400998 is seen in contrail-api
2025-10-24 20:00:22,082 - DEBUG - Project uuid in Contrail is d9fc672e-1c46-459f-8f33-7ce051ad05f4
2025-10-24 20:00:22,250 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=773271f2-fd05-4843-aab0-61eee5bcc66c
2025-10-24 20:00:22,254 - INFO - Namespace ctest-new-default-15400998 with uuid 773271f2-fd05-4843-aab0-61eee5bcc66c found in kube manager
2025-10-24 20:00:22,254 - INFO - Namespace ctest-new-default-15400998 verification passed
2025-10-24 20:00:22,504 - INFO - Project default-domain:k8s-ctest-non-default-29690009 for Namespace ctest-non-default-29690009 is seen in contrail-api
2025-10-24 20:00:22,504 - DEBUG - Project uuid in Contrail is b9528298-7624-40b4-9051-75e5c818b378
2025-10-24 20:00:22,504 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=795fb027-e093-415e-9ff8-72d4448ac1f5
2025-10-24 20:00:22,513 - INFO - Namespace ctest-non-default-29690009 with uuid 795fb027-e093-415e-9ff8-72d4448ac1f5 found in kube manager
2025-10-24 20:00:22,513 - INFO - Namespace ctest-non-default-29690009 verification passed
2025-10-24 20:00:22,519 - DEBUG - Pod ctest-pod-71588357 not in running state.Currently in Pending
2025-10-24 20:00:27,528 - DEBUG - Pod ctest-pod-71588357 not in running state.Currently in Pending
2025-10-24 20:00:32,534 - DEBUG - Pod ctest-pod-71588357 not in running state.Currently in Pending
2025-10-24 20:00:37,542 - INFO - Pod ctest-pod-71588357 is in running state.Got IP 10.47.255.251
2025-10-24 20:00:37,554 - DEBUG - Pod ctest-pod-71588357 has vmi 139854a2-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:37,554 - INFO - Verified pod ctest-pod-71588357 in contrail-api
2025-10-24 20:00:37,568 - DEBUG - VMI 139854a2-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:37,568 - INFO - Verified Pod ctest-pod-71588357 in agent 10.0.0.41
2025-10-24 20:00:37,568 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=ef85b436-b700-4b9d-b959-55211e486995
2025-10-24 20:00:37,573 - INFO - Pod ctest-pod-71588357 with uuid ef85b436-b700-4b9d-b959-55211e486995 found in kube manager
2025-10-24 20:00:37,573 - INFO - Pod ctest-pod-71588357 verification passed
2025-10-24 20:00:37,580 - INFO - Pod ctest-pod-91258170 is in running state.Got IP 10.47.255.250
2025-10-24 20:00:37,592 - DEBUG - Pod ctest-pod-91258170 has vmi 13f325f8-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:37,593 - INFO - Verified pod ctest-pod-91258170 in contrail-api
2025-10-24 20:00:37,605 - DEBUG - VMI 13f325f8-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:37,605 - INFO - Verified Pod ctest-pod-91258170 in agent 10.0.0.41
2025-10-24 20:00:37,605 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=9904a15d-7eab-4036-ae1f-b2ec5640bfd3
2025-10-24 20:00:37,609 - INFO - Pod ctest-pod-91258170 with uuid 9904a15d-7eab-4036-ae1f-b2ec5640bfd3 found in kube manager
2025-10-24 20:00:37,609 - INFO - Pod ctest-pod-91258170 verification passed
2025-10-24 20:00:37,616 - INFO - Pod ctest-pod-21410481 is in running state.Got IP 10.47.255.249
2025-10-24 20:00:37,675 - DEBUG - Pod ctest-pod-21410481 has vmi 14b4bf74-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:37,675 - INFO - Verified pod ctest-pod-21410481 in contrail-api
2025-10-24 20:00:37,686 - DEBUG - VMI 14b4bf74-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:37,687 - INFO - Verified Pod ctest-pod-21410481 in agent 10.0.0.41
2025-10-24 20:00:37,687 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=15d464e0-1275-48c3-b37c-be9dc25dc25c
2025-10-24 20:00:37,690 - INFO - Pod ctest-pod-21410481 with uuid 15d464e0-1275-48c3-b37c-be9dc25dc25c found in kube manager
2025-10-24 20:00:37,691 - INFO - Pod ctest-pod-21410481 verification passed
2025-10-24 20:00:37,697 - INFO - Pod ctest-pod-23117141 is in running state.Got IP 10.47.255.248
2025-10-24 20:00:37,748 - DEBUG - Pod ctest-pod-23117141 has vmi 1522a2aa-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:37,748 - INFO - Verified pod ctest-pod-23117141 in contrail-api
2025-10-24 20:00:37,758 - DEBUG - VMI 1522a2aa-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:37,759 - INFO - Verified Pod ctest-pod-23117141 in agent 10.0.0.41
2025-10-24 20:00:37,759 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=e5394291-396c-459c-9ba7-3b51ca14c7f5
2025-10-24 20:00:37,762 - INFO - Pod ctest-pod-23117141 with uuid e5394291-396c-459c-9ba7-3b51ca14c7f5 found in kube manager
2025-10-24 20:00:37,763 - INFO - Pod ctest-pod-23117141 verification passed
2025-10-24 20:00:37,768 - INFO - Pod ctest-pod-63641511 is in running state.Got IP 10.47.255.247
2025-10-24 20:00:37,778 - DEBUG - Pod ctest-pod-63641511 has vmi 15a6292c-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:37,778 - INFO - Verified pod ctest-pod-63641511 in contrail-api
2025-10-24 20:00:37,789 - DEBUG - VMI 15a6292c-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:37,789 - INFO - Verified Pod ctest-pod-63641511 in agent 10.0.0.41
2025-10-24 20:00:37,790 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1aba4c7c-2f41-449e-b2b6-565d69229254
2025-10-24 20:00:37,793 - INFO - Pod ctest-pod-63641511 with uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 found in kube manager
2025-10-24 20:00:37,793 - INFO - Pod ctest-pod-63641511 verification passed
2025-10-24 20:00:37,800 - INFO - Pod ctest-pod-23431012 is in running state.Got IP 10.47.255.245
2025-10-24 20:00:37,858 - DEBUG - Pod ctest-pod-23431012 has vmi 167688e2-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:37,858 - INFO - Verified pod ctest-pod-23431012 in contrail-api
2025-10-24 20:00:37,870 - DEBUG - VMI 167688e2-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:37,871 - INFO - Verified Pod ctest-pod-23431012 in agent 10.0.0.41
2025-10-24 20:00:37,871 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=7b8c05b2-7ed4-443a-9bb6-1817cdf4f708
2025-10-24 20:00:37,874 - INFO - Pod ctest-pod-23431012 with uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 found in kube manager
2025-10-24 20:00:37,874 - INFO - Pod ctest-pod-23431012 verification passed
2025-10-24 20:00:37,880 - DEBUG - Pod ctest-pod-09907301 not in running state.Currently in Pending
2025-10-24 20:00:42,889 - INFO - Pod ctest-pod-09907301 is in running state.Got IP 10.47.255.246
2025-10-24 20:00:42,904 - DEBUG - Pod ctest-pod-09907301 has vmi 1613bb0e-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:42,904 - INFO - Verified pod ctest-pod-09907301 in contrail-api
2025-10-24 20:00:42,918 - DEBUG - VMI 1613bb0e-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:42,918 - INFO - Verified Pod ctest-pod-09907301 in agent 10.0.0.41
2025-10-24 20:00:42,919 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=4b81850a-e53e-432d-9f37-918df1269baa
2025-10-24 20:00:42,924 - INFO - Pod ctest-pod-09907301 with uuid 4b81850a-e53e-432d-9f37-918df1269baa found in kube manager
2025-10-24 20:00:42,924 - INFO - Pod ctest-pod-09907301 verification passed
2025-10-24 20:00:42,931 - INFO - Pod ctest-pod-49835537 is in running state.Got IP 10.47.255.244
2025-10-24 20:00:42,990 - DEBUG - Pod ctest-pod-49835537 has vmi 16dd2f52-b114-11f0-bb9f-fa163eb544d8
2025-10-24 20:00:42,990 - INFO - Verified pod ctest-pod-49835537 in contrail-api
2025-10-24 20:00:43,006 - DEBUG - VMI 16dd2f52-b114-11f0-bb9f-fa163eb544d8 is active in agent 10.0.0.41
2025-10-24 20:00:43,007 - INFO - Verified Pod ctest-pod-49835537 in agent 10.0.0.41
2025-10-24 20:00:43,007 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=b0ad5a23-e9fd-429b-aa93-4d9aa46840a2
2025-10-24 20:00:43,011 - INFO - Pod ctest-pod-49835537 with uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 found in kube manager
2025-10-24 20:00:43,011 - INFO - Pod ctest-pod-49835537 verification passed
2025-10-24 20:00:43,011 - INFO - ================================================================================
2025-10-24 20:00:43,011 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-24 20:00:43,011 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-24 20:00:43,254 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.249': '0'}} with
2025-10-24 20:00:43,254 - INFO - Initial checks done. Running the testcase now
2025-10-24 20:00:43,254 - INFO -
2025-10-24 20:00:43,314 - DEBUG - [Pod ctest-pod-71588357] Cmd: echo ctest-pod-71588357 > /usr/share/nginx/html/index.html, Output:
2025-10-24 20:00:43,366 - DEBUG - [Pod ctest-pod-91258170] Cmd: echo ctest-pod-91258170 > /usr/share/nginx/html/index.html, Output:
2025-10-24 20:00:43,439 - DEBUG - [Pod ctest-pod-21410481] Cmd: echo ctest-pod-21410481 > /usr/share/nginx/html/index.html, Output:
2025-10-24 20:00:43,500 - DEBUG - [Pod ctest-pod-23117141] Cmd: echo ctest-pod-23117141 > /usr/share/nginx/html/index.html, Output:
2025-10-24 20:00:43,507 - DEBUG - Service ctest-nginx-svc-84286514 not present
2025-10-24 20:00:43,508 - INFO - Creating service ctest-nginx-svc-84286514
2025-10-24 20:00:43,523 - INFO - Created Service ctest-nginx-svc-84286514
2025-10-24 20:00:43,529 - WARNING - Service UUID b2e99176-e2ae-4f71-8049-e12cf18f76c4 not yet found in contrail-api
2025-10-24 20:00:44,535 - INFO - Validated that Service ctest-nginx-svc-84286514 is seen in contrail-api
2025-10-24 20:00:44,535 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=b2e99176-e2ae-4f71-8049-e12cf18f76c4
2025-10-24 20:00:44,540 - INFO - Service ctest-nginx-svc-84286514 with uuid b2e99176-e2ae-4f71-8049-e12cf18f76c4 found in kube manager
2025-10-24 20:00:44,543 - INFO - Service ctest-nginx-svc-84286514 verification passed
2025-10-24 20:00:45,615 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:00:45,615 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:00:45,615 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:00:45,672 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,672 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:00:45,672 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,672 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71588357': 1, 'ctest-pod-91258170': 1}
2025-10-24 20:00:45,731 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,731 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:00:45,731 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,783 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,783 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:00:45,783 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,839 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,839 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:00:45,839 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:00:45,839 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71588357': 1, 'ctest-pod-91258170': 2}
2025-10-24 20:00:45,843 - DEBUG - Network policy ingress-on-service not present
2025-10-24 20:00:45,844 - INFO - Creating Network Policy ingress-on-service
2025-10-24 20:00:45,858 - INFO - Network policy found in k8s
2025-10-24 20:00:45,859 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=71ea1759-efb1-41ec-9d36-2f2e5288499e
2025-10-24 20:00:45,862 - INFO - Network Policy ingress-on-service with uuid 71ea1759-efb1-41ec-9d36-2f2e5288499e found in kube manager
2025-10-24 20:00:45,888 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-24 20:00:45,888 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-24 20:00:45,888 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=71ea1759-efb1-41ec-9d36-2f2e5288499e
2025-10-24 20:00:45,915 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-24 20:00:47,916 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=71ea1759-efb1-41ec-9d36-2f2e5288499e
2025-10-24 20:00:47,959 - INFO - Network policy with name ingress-on-service found in agent
2025-10-24 20:00:47,960 - INFO - Network Policy ingress-on-service verification passed
2025-10-24 20:00:53,011 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:00:53,011 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:00:53,011 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:00:58,063 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:00:58,063 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:00:58,064 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:03,111 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:03,111 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:03,111 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:08,159 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:08,159 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:08,159 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:13,232 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:13,232 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:13,232 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:18,279 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:18,279 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:18,279 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:23,330 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:23,330 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:23,330 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:28,382 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:28,382 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:28,382 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:33,435 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:33,436 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:33,436 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:38,488 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:38,488 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:38,488 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:38,488 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71588357': 0, 'ctest-pod-91258170': 0}
2025-10-24 20:01:38,542 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,542 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,542 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,579 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,579 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,579 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,632 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:01:38,633 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,633 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:01:38,685 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,685 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,685 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,746 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,747 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,747 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,804 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:01:38,804 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,804 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:01:38,859 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,859 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,859 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:01:38,914 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-91258170
2025-10-24 20:01:38,914 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:01:38,914 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-91258170
2025-10-24 20:01:38,914 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71588357': 7, 'ctest-pod-91258170': 1}
2025-10-24 20:01:43,967 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:43,967 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:43,967 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:49,028 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:49,028 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:49,028 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:54,078 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:54,078 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:54,078 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:59,135 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:59,135 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:01:59,135 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:04,178 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:04,179 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:04,179 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:09,236 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:09,236 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:09,236 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:14,295 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:14,295 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:14,295 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:19,346 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:19,346 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:19,346 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:24,394 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:24,394 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:24,394 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:29,447 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:29,447 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:29,447 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:29,447 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71588357': 0, 'ctest-pod-91258170': 0}
2025-10-24 20:02:31,500 - DEBUG - [Pod ctest-pod-09907301] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.738 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.297/0.738 ms
2025-10-24 20:02:31,500 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09907301 with expectation True passed
2025-10-24 20:02:33,543 - DEBUG - [Pod ctest-pod-63641511] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.419 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.528/1.419 ms
2025-10-24 20:02:33,543 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63641511 with expectation True passed
2025-10-24 20:02:35,604 - DEBUG - [Pod ctest-pod-23431012] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.679 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.108 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.287/0.679 ms
2025-10-24 20:02:35,604 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23431012 with expectation True passed
2025-10-24 20:02:35,662 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:02:35,663 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-24 20:02:35,663 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:02:35,663 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09907301 passed
2025-10-24 20:02:35,717 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:02:35,717 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-24 20:02:35,717 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:02:35,717 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09907301 passed
2025-10-24 20:02:40,766 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-24 20:02:40,767 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-24 20:02:40,767 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-24 20:02:40,767 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63641511 passed
2025-10-24 20:02:45,821 - DEBUG - [Pod ctest-pod-49835537] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-24 20:02:45,821 - DEBUG - [Pod Pod ctest-pod-49835537] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-24 20:02:45,821 - DEBUG - [Pod Pod ctest-pod-49835537] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-24 20:02:45,821 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49835537 passed
2025-10-24 20:02:45,831 - INFO - Updating Network Policy ingress-on-service
2025-10-24 20:02:50,900 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:50,900 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:50,900 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:55,950 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:55,950 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:02:55,950 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:01,003 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:01,003 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:01,003 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:06,054 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:06,054 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:06,054 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:11,103 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:11,103 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:11,103 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:16,151 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:16,151 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:16,151 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:21,223 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:21,223 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:21,223 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:26,274 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:26,274 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:26,275 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:31,322 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:31,322 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:31,322 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:36,376 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:36,376 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:36,376 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
wget: download timed out
2025-10-24 20:03:36,376 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71588357': 0, 'ctest-pod-91258170': 0}
2025-10-24 20:03:36,436 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,436 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:03:36,436 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,516 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,516 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:03:36,516 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,516 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71588357': 1, 'ctest-pod-91258170': 1}
2025-10-24 20:03:36,570 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,570 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:03:36,570 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: ctest-pod-71588357
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,630 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:03:36,631 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:03:36,631 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71588357
2025-10-24 20:03:36,696 - DEBUG - [Pod ctest-pod-23431012] Cmd: wget http://10.98.135.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,696 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd wget http://10.98.135.196:80/ -O - -T 5 -t 1 passed
2025-10-24 20:03:36,696 - DEBUG - [Pod Pod ctest-pod-23431012] Cmd output: ctest-pod-91258170
Connecting to 10.98.135.196:80 (10.98.135.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-24 20:03:36,696 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71588357': 2, 'ctest-pod-91258170': 1}
2025-10-24 20:03:38,759 - DEBUG - [Pod ctest-pod-09907301] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.558 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.234/0.558 ms
2025-10-24 20:03:38,759 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09907301 with expectation True passed
2025-10-24 20:03:40,798 - DEBUG - [Pod ctest-pod-63641511] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.154 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.434/1.154 ms
2025-10-24 20:03:40,798 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63641511 with expectation True passed
2025-10-24 20:03:41,437 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-24 20:03:48,511 - DEBUG - [Pod ctest-pod-23431012] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.133 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.432/1.133 ms
2025-10-24 20:03:48,512 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23431012 with expectation True passed
2025-10-24 20:03:48,568 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:03:48,568 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-24 20:03:48,568 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:03:48,569 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09907301 passed
2025-10-24 20:03:48,603 - DEBUG - [Pod ctest-pod-09907301] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:03:48,603 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-24 20:03:48,603 - DEBUG - [Pod Pod ctest-pod-09907301] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:03:48,603 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09907301 passed
2025-10-24 20:03:53,650 - DEBUG - [Pod ctest-pod-63641511] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-24 20:03:53,650 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-24 20:03:53,650 - DEBUG - [Pod Pod ctest-pod-63641511] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-24 20:03:53,650 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63641511 passed
2025-10-24 20:03:53,700 - DEBUG - [Pod ctest-pod-49835537] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:03:53,701 - DEBUG - [Pod Pod ctest-pod-49835537] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-24 20:03:53,701 - DEBUG - [Pod Pod ctest-pod-49835537] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-24 20:03:53,701 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49835537 passed
2025-10-24 20:03:53,701 - INFO - Deleting Network Policy : ingress-on-service
2025-10-24 20:03:53,701 - INFO - Deleting service : ctest-nginx-svc-84286514
2025-10-24 20:03:53,913 - DEBUG - No XMPP flaps were noticed during the test
2025-10-24 20:03:53,913 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-10-24 20:03:53,913 - INFO - --------------------------------------------------------------------------------
2025-10-24 20:03:53,917 - INFO - Deleting pod ctest-new-default-15400998:ctest-pod-71588357
2025-10-24 20:03:53,917 - INFO - Deleting pod ctest-new-default-15400998:ctest-pod-91258170
2025-10-24 20:03:53,918 - INFO - Deleting pod ctest-non-default-29690009:ctest-pod-21410481
2025-10-24 20:03:53,918 - INFO - Deleting pod ctest-non-default-29690009:ctest-pod-23117141
2025-10-24 20:03:53,920 - INFO - Deleting pod ctest-new-default-15400998:ctest-pod-63641511
2025-10-24 20:03:53,921 - INFO - Deleting pod ctest-new-default-15400998:ctest-pod-09907301
2025-10-24 20:03:53,921 - INFO - Deleting pod ctest-non-default-29690009:ctest-pod-23431012
2025-10-24 20:03:53,921 - INFO - Deleting pod ctest-non-default-29690009:ctest-pod-49835537
2025-10-24 20:03:54,046 - WARNING - Pod uuid ef85b436-b700-4b9d-b959-55211e486995 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,047 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,101 - WARNING - Pod uuid 9904a15d-7eab-4036-ae1f-b2ec5640bfd3 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,102 - WARNING - Pod uuid 15d464e0-1275-48c3-b37c-be9dc25dc25c is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,102 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,103 - WARNING - Pod uuid e5394291-396c-459c-9ba7-3b51ca14c7f5 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,103 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:54,103 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:59,056 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:59,057 - DEBUG - Pod ef85b436-b700-4b9d-b959-55211e486995 is not in agent 10.0.0.41 VM list
2025-10-24 20:03:59,061 - DEBUG - VMI 139854a2-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:03:59,061 - INFO - Verified that pod ctest-pod-71588357 is removed in agent
2025-10-24 20:03:59,126 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:59,127 - DEBUG - Pod e5394291-396c-459c-9ba7-3b51ca14c7f5 is not in agent 10.0.0.41 VM list
2025-10-24 20:03:59,129 - DEBUG - Pod 9904a15d-7eab-4036-ae1f-b2ec5640bfd3 is not in agent 10.0.0.41 VM list
2025-10-24 20:03:59,130 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:59,130 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:03:59,130 - DEBUG - Pod 15d464e0-1275-48c3-b37c-be9dc25dc25c is not in agent 10.0.0.41 VM list
2025-10-24 20:03:59,140 - DEBUG - VMI 1522a2aa-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:03:59,140 - INFO - Verified that pod ctest-pod-23117141 is removed in agent
2025-10-24 20:03:59,141 - DEBUG - VMI 14b4bf74-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:03:59,141 - INFO - Verified that pod ctest-pod-21410481 is removed in agent
2025-10-24 20:03:59,141 - DEBUG - VMI 13f325f8-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:03:59,141 - INFO - Verified that pod ctest-pod-91258170 is removed in agent
2025-10-24 20:04:04,062 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:04,134 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:04,140 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:04,141 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:09,070 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:09,144 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:09,149 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:09,150 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:14,076 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:14,153 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:14,160 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:14,161 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:19,083 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:19,160 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:19,171 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:19,172 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:24,090 - WARNING - Pod uuid 4b81850a-e53e-432d-9f37-918df1269baa is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:24,167 - WARNING - Pod uuid 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:24,180 - WARNING - Pod uuid 1aba4c7c-2f41-449e-b2b6-565d69229254 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:24,181 - WARNING - Pod uuid b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is still seen in agent 10.0.0.41 VM list
2025-10-24 20:04:29,098 - DEBUG - Pod 4b81850a-e53e-432d-9f37-918df1269baa is not in agent 10.0.0.41 VM list
2025-10-24 20:04:29,103 - DEBUG - VMI 1613bb0e-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:04:29,103 - INFO - Verified that pod ctest-pod-09907301 is removed in agent
2025-10-24 20:04:29,174 - DEBUG - Pod 7b8c05b2-7ed4-443a-9bb6-1817cdf4f708 is not in agent 10.0.0.41 VM list
2025-10-24 20:04:29,179 - DEBUG - VMI 167688e2-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:04:29,179 - INFO - Verified that pod ctest-pod-23431012 is removed in agent
2025-10-24 20:04:29,188 - DEBUG - Pod 1aba4c7c-2f41-449e-b2b6-565d69229254 is not in agent 10.0.0.41 VM list
2025-10-24 20:04:29,190 - DEBUG - Pod b0ad5a23-e9fd-429b-aa93-4d9aa46840a2 is not in agent 10.0.0.41 VM list
2025-10-24 20:04:29,197 - DEBUG - VMI 15a6292c-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:04:29,198 - INFO - Verified that pod ctest-pod-63641511 is removed in agent
2025-10-24 20:04:29,198 - DEBUG - VMI 16dd2f52-b114-11f0-bb9f-fa163eb544d8 is removed from agent 10.0.0.41
2025-10-24 20:04:29,198 - INFO - Verified that pod ctest-pod-49835537 is removed in agent
2025-10-24 20:04:29,198 - INFO - Deleting namespace ctest-non-default-29690009
2025-10-24 20:04:29,214 - DEBUG - Namespace ctest-non-default-29690009 still in k8s
2025-10-24 20:04:31,218 - DEBUG - Namespace ctest-non-default-29690009 still in k8s
2025-10-24 20:04:33,223 - DEBUG - Namespace ctest-non-default-29690009 still in k8s
2025-10-24 20:04:35,226 - DEBUG - Namespace ctest-non-default-29690009 is not in k8s
2025-10-24 20:04:35,226 - DEBUG - No need to check project deletion in contrail-api
2025-10-24 20:04:35,226 - INFO - Deleting namespace ctest-new-default-15400998
2025-10-24 20:04:35,234 - DEBUG - Namespace ctest-new-default-15400998 still in k8s
2025-10-24 20:04:37,238 - DEBUG - Namespace ctest-new-default-15400998 still in k8s
2025-10-24 20:04:39,243 - DEBUG - Namespace ctest-new-default-15400998 still in k8s
2025-10-24 20:04:41,246 - DEBUG - Namespace ctest-new-default-15400998 is not in k8s
2025-10-24 20:04:41,246 - DEBUG - No need to check project deletion in contrail-api