2026-04-25 02:16:18,614 - INFO - Using existing project ['default-domain', 'k8s-default'](d698ae20-2c00-4719-b6f4-5ffec2947e3d)
2026-04-25 02:16:18,632 - DEBUG - Namespace ctest-new-default-15335820 not present
2026-04-25 02:16:18,823 - INFO - Created namespace ctest-new-default-15335820
2026-04-25 02:16:21,827 - DEBUG - Namespace ctest-non-default-87476462 not present
2026-04-25 02:16:21,840 - INFO - Created namespace ctest-non-default-87476462
2026-04-25 02:16:24,863 - DEBUG - Pod ctest-pod-95201736 not present
2026-04-25 02:16:24,863 - INFO - Creating Pod ctest-pod-95201736
2026-04-25 02:16:24,908 - DEBUG - Pod : ctest-pod-95201736 UUID is 5061146e-efd4-41b4-9175-1437112aa544
2026-04-25 02:16:24,911 - DEBUG - Pod ctest-pod-75158952 not present
2026-04-25 02:16:24,912 - INFO - Creating Pod ctest-pod-75158952
2026-04-25 02:16:24,945 - DEBUG - Pod : ctest-pod-75158952 UUID is 49c0606f-4a80-47de-9dcf-30b3bd33755d
2026-04-25 02:16:24,949 - DEBUG - Pod ctest-pod-89299704 not present
2026-04-25 02:16:24,949 - INFO - Creating Pod ctest-pod-89299704
2026-04-25 02:16:24,993 - DEBUG - Pod : ctest-pod-89299704 UUID is 8843e12f-fb3e-4455-ad67-94ad1422d6d7
2026-04-25 02:16:24,995 - DEBUG - Pod ctest-pod-47256910 not present
2026-04-25 02:16:24,996 - INFO - Creating Pod ctest-pod-47256910
2026-04-25 02:16:25,024 - DEBUG - Pod : ctest-pod-47256910 UUID is 768b3fba-3d2a-4ba4-a143-cd2b6970fb51
2026-04-25 02:16:25,027 - DEBUG - Pod ctest-pod-01777663 not present
2026-04-25 02:16:25,027 - INFO - Creating Pod ctest-pod-01777663
2026-04-25 02:16:25,049 - DEBUG - Pod : ctest-pod-01777663 UUID is 989ff733-c498-49ea-bdfd-ca41d6f3b38e
2026-04-25 02:16:25,052 - DEBUG - Pod ctest-pod-22299563 not present
2026-04-25 02:16:25,052 - INFO - Creating Pod ctest-pod-22299563
2026-04-25 02:16:25,074 - DEBUG - Pod : ctest-pod-22299563 UUID is c8d7bf1f-bda2-43aa-bb35-f17e7f538f63
2026-04-25 02:16:25,077 - DEBUG - Pod ctest-pod-17371400 not present
2026-04-25 02:16:25,077 - INFO - Creating Pod ctest-pod-17371400
2026-04-25 02:16:25,106 - DEBUG - Pod : ctest-pod-17371400 UUID is 73b6eb67-58d5-409b-a09a-76d039cfb627
2026-04-25 02:16:25,109 - DEBUG - Pod ctest-pod-19265372 not present
2026-04-25 02:16:25,110 - INFO - Creating Pod ctest-pod-19265372
2026-04-25 02:16:25,166 - DEBUG - Pod : ctest-pod-19265372 UUID is 4954fc4a-30ff-4250-9ced-b839422a78b9
2026-04-25 02:16:25,317 - INFO - Project default-domain:k8s-ctest-new-default-15335820 for Namespace ctest-new-default-15335820 is seen in contrail-api
2026-04-25 02:16:25,317 - DEBUG - Project uuid in Contrail is 0c099e55-8509-43a3-85dd-253feb3bc46c
2026-04-25 02:16:25,495 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=73ef892e-2a94-4cec-8de0-f4880c405808
2026-04-25 02:16:25,499 - INFO - Namespace ctest-new-default-15335820 with uuid 73ef892e-2a94-4cec-8de0-f4880c405808 found in kube manager
2026-04-25 02:16:25,499 - INFO - Namespace ctest-new-default-15335820 verification passed
2026-04-25 02:16:25,694 - INFO - Project default-domain:k8s-ctest-non-default-87476462 for Namespace ctest-non-default-87476462 is seen in contrail-api
2026-04-25 02:16:25,694 - DEBUG - Project uuid in Contrail is 62936f44-5905-4267-992e-165a5a2f99c2
2026-04-25 02:16:25,694 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=4b83bed3-7945-471f-bb2f-b9bbbdefc9a1
2026-04-25 02:16:25,699 - INFO - Namespace ctest-non-default-87476462 with uuid 4b83bed3-7945-471f-bb2f-b9bbbdefc9a1 found in kube manager
2026-04-25 02:16:25,699 - INFO - Namespace ctest-non-default-87476462 verification passed
2026-04-25 02:16:25,706 - DEBUG - Pod ctest-pod-95201736 not in running state.Currently in Pending
2026-04-25 02:16:30,718 - DEBUG - Pod ctest-pod-95201736 not in running state.Currently in Pending
2026-04-25 02:16:35,726 - INFO - Pod ctest-pod-95201736 is in running state.Got IP 10.47.255.251
2026-04-25 02:16:35,782 - DEBUG - Pod ctest-pod-95201736 has vmi c3750c36-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:35,782 - INFO - Verified pod ctest-pod-95201736 in contrail-api
2026-04-25 02:16:35,793 - DEBUG - VMI c3750c36-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:35,793 - INFO - Verified Pod ctest-pod-95201736 in agent 10.0.0.249
2026-04-25 02:16:35,793 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5061146e-efd4-41b4-9175-1437112aa544
2026-04-25 02:16:35,798 - INFO - Pod ctest-pod-95201736 with uuid 5061146e-efd4-41b4-9175-1437112aa544 found in kube manager
2026-04-25 02:16:35,798 - INFO - Pod ctest-pod-95201736 verification passed
2026-04-25 02:16:35,804 - DEBUG - Pod ctest-pod-75158952 not in running state.Currently in Pending
2026-04-25 02:16:40,812 - INFO - Pod ctest-pod-75158952 is in running state.Got IP 10.47.255.250
2026-04-25 02:16:40,825 - DEBUG - Pod ctest-pod-75158952 has vmi c3f3ccf6-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:40,825 - INFO - Verified pod ctest-pod-75158952 in contrail-api
2026-04-25 02:16:40,837 - DEBUG - VMI c3f3ccf6-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:40,837 - INFO - Verified Pod ctest-pod-75158952 in agent 10.0.0.249
2026-04-25 02:16:40,837 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=49c0606f-4a80-47de-9dcf-30b3bd33755d
2026-04-25 02:16:40,841 - INFO - Pod ctest-pod-75158952 with uuid 49c0606f-4a80-47de-9dcf-30b3bd33755d found in kube manager
2026-04-25 02:16:40,841 - INFO - Pod ctest-pod-75158952 verification passed
2026-04-25 02:16:40,848 - INFO - Pod ctest-pod-89299704 is in running state.Got IP 10.47.255.249
2026-04-25 02:16:40,861 - DEBUG - Pod ctest-pod-89299704 has vmi c483d508-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:40,861 - INFO - Verified pod ctest-pod-89299704 in contrail-api
2026-04-25 02:16:40,874 - DEBUG - VMI c483d508-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:40,874 - INFO - Verified Pod ctest-pod-89299704 in agent 10.0.0.249
2026-04-25 02:16:40,874 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=8843e12f-fb3e-4455-ad67-94ad1422d6d7
2026-04-25 02:16:40,879 - INFO - Pod ctest-pod-89299704 with uuid 8843e12f-fb3e-4455-ad67-94ad1422d6d7 found in kube manager
2026-04-25 02:16:40,879 - INFO - Pod ctest-pod-89299704 verification passed
2026-04-25 02:16:40,885 - INFO - Pod ctest-pod-47256910 is in running state.Got IP 10.47.255.248
2026-04-25 02:16:40,938 - DEBUG - Pod ctest-pod-47256910 has vmi c4f5be16-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:40,938 - INFO - Verified pod ctest-pod-47256910 in contrail-api
2026-04-25 02:16:40,950 - DEBUG - VMI c4f5be16-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:40,950 - INFO - Verified Pod ctest-pod-47256910 in agent 10.0.0.249
2026-04-25 02:16:40,950 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=768b3fba-3d2a-4ba4-a143-cd2b6970fb51
2026-04-25 02:16:40,955 - INFO - Pod ctest-pod-47256910 with uuid 768b3fba-3d2a-4ba4-a143-cd2b6970fb51 found in kube manager
2026-04-25 02:16:40,956 - INFO - Pod ctest-pod-47256910 verification passed
2026-04-25 02:16:40,964 - DEBUG - Pod ctest-pod-01777663 not in running state.Currently in Pending
2026-04-25 02:16:45,974 - INFO - Pod ctest-pod-01777663 is in running state.Got IP 10.47.255.247
2026-04-25 02:16:45,986 - DEBUG - Pod ctest-pod-01777663 has vmi c5801e8a-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:45,986 - INFO - Verified pod ctest-pod-01777663 in contrail-api
2026-04-25 02:16:45,997 - DEBUG - VMI c5801e8a-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:45,997 - INFO - Verified Pod ctest-pod-01777663 in agent 10.0.0.249
2026-04-25 02:16:45,997 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=989ff733-c498-49ea-bdfd-ca41d6f3b38e
2026-04-25 02:16:46,002 - INFO - Pod ctest-pod-01777663 with uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e found in kube manager
2026-04-25 02:16:46,002 - INFO - Pod ctest-pod-01777663 verification passed
2026-04-25 02:16:46,026 - INFO - Pod ctest-pod-17371400 is in running state.Got IP 10.47.255.245
2026-04-25 02:16:46,038 - DEBUG - Pod ctest-pod-17371400 has vmi c66737d4-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:46,038 - INFO - Verified pod ctest-pod-17371400 in contrail-api
2026-04-25 02:16:46,049 - DEBUG - VMI c66737d4-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:46,050 - INFO - Verified Pod ctest-pod-17371400 in agent 10.0.0.249
2026-04-25 02:16:46,050 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=73b6eb67-58d5-409b-a09a-76d039cfb627
2026-04-25 02:16:46,055 - INFO - Pod ctest-pod-17371400 with uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 found in kube manager
2026-04-25 02:16:46,055 - INFO - Pod ctest-pod-17371400 verification passed
2026-04-25 02:16:46,062 - INFO - Pod ctest-pod-22299563 is in running state.Got IP 10.47.255.246
2026-04-25 02:16:46,118 - DEBUG - Pod ctest-pod-22299563 has vmi c5f4e9cc-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:46,118 - INFO - Verified pod ctest-pod-22299563 in contrail-api
2026-04-25 02:16:46,130 - DEBUG - VMI c5f4e9cc-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:46,130 - INFO - Verified Pod ctest-pod-22299563 in agent 10.0.0.249
2026-04-25 02:16:46,130 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=c8d7bf1f-bda2-43aa-bb35-f17e7f538f63
2026-04-25 02:16:46,149 - INFO - Pod ctest-pod-22299563 with uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 found in kube manager
2026-04-25 02:16:46,149 - INFO - Pod ctest-pod-22299563 verification passed
2026-04-25 02:16:46,157 - INFO - Pod ctest-pod-19265372 is in running state.Got IP 10.47.255.244
2026-04-25 02:16:46,171 - DEBUG - Pod ctest-pod-19265372 has vmi c6de6638-404c-11f1-80a3-fa163edc6947
2026-04-25 02:16:46,172 - INFO - Verified pod ctest-pod-19265372 in contrail-api
2026-04-25 02:16:46,183 - DEBUG - VMI c6de6638-404c-11f1-80a3-fa163edc6947 is active in agent 10.0.0.249
2026-04-25 02:16:46,183 - INFO - Verified Pod ctest-pod-19265372 in agent 10.0.0.249
2026-04-25 02:16:46,183 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=4954fc4a-30ff-4250-9ced-b839422a78b9
2026-04-25 02:16:46,187 - INFO - Pod ctest-pod-19265372 with uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 found in kube manager
2026-04-25 02:16:46,187 - INFO - Pod ctest-pod-19265372 verification passed
2026-04-25 02:16:46,187 - INFO - ================================================================================
2026-04-25 02:16:46,187 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2026-04-25 02:16:46,187 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2026-04-25 02:16:46,432 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.0.0.33': '0'}} with
2026-04-25 02:16:46,432 - INFO - Initial checks done. Running the testcase now
2026-04-25 02:16:46,432 - INFO -
2026-04-25 02:16:46,492 - DEBUG - [Pod ctest-pod-95201736] Cmd: echo ctest-pod-95201736 > /usr/share/nginx/html/index.html, Output:
2026-04-25 02:16:46,551 - DEBUG - [Pod ctest-pod-75158952] Cmd: echo ctest-pod-75158952 > /usr/share/nginx/html/index.html, Output:
2026-04-25 02:16:46,613 - DEBUG - [Pod ctest-pod-89299704] Cmd: echo ctest-pod-89299704 > /usr/share/nginx/html/index.html, Output:
2026-04-25 02:16:46,655 - DEBUG - [Pod ctest-pod-47256910] Cmd: echo ctest-pod-47256910 > /usr/share/nginx/html/index.html, Output:
2026-04-25 02:16:46,658 - DEBUG - Service ctest-nginx-svc-25298435 not present
2026-04-25 02:16:46,659 - INFO - Creating service ctest-nginx-svc-25298435
2026-04-25 02:16:46,686 - INFO - Created Service ctest-nginx-svc-25298435
2026-04-25 02:16:46,691 - WARNING - Service UUID 7cb1ef91-21a2-46f9-bcb3-0aa992390667 not yet found in contrail-api
2026-04-25 02:16:47,699 - INFO - Validated that Service ctest-nginx-svc-25298435 is seen in contrail-api
2026-04-25 02:16:47,699 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=7cb1ef91-21a2-46f9-bcb3-0aa992390667
2026-04-25 02:16:47,706 - INFO - Service ctest-nginx-svc-25298435 with uuid 7cb1ef91-21a2-46f9-bcb3-0aa992390667 found in kube manager
2026-04-25 02:16:47,706 - INFO - Service ctest-nginx-svc-25298435 verification passed
2026-04-25 02:16:48,777 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95201736
2026-04-25 02:16:48,777 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:16:48,777 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95201736
2026-04-25 02:16:48,844 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:16:48,844 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:16:48,844 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:16:48,844 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95201736': 1, 'ctest-pod-75158952': 1}
2026-04-25 02:16:48,923 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:16:48,923 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:16:48,923 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:16:48,997 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:16:48,997 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:16:48,997 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:16:48,997 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95201736': 1, 'ctest-pod-75158952': 1}
2026-04-25 02:16:49,006 - DEBUG - Network policy ingress-on-service not present
2026-04-25 02:16:49,007 - INFO - Creating Network Policy ingress-on-service
2026-04-25 02:16:49,033 - INFO - Network policy found in k8s
2026-04-25 02:16:49,033 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5f4d159d-347a-46d8-bb94-5b81e0ea96ad
2026-04-25 02:16:49,051 - INFO - Network Policy ingress-on-service with uuid 5f4d159d-347a-46d8-bb94-5b81e0ea96ad found in kube manager
2026-04-25 02:16:49,085 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2026-04-25 02:16:49,086 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2026-04-25 02:16:49,086 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5f4d159d-347a-46d8-bb94-5b81e0ea96ad
2026-04-25 02:16:49,122 - WARNING - Network policy with name ingress-on-service not found in agent
2026-04-25 02:16:51,124 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5f4d159d-347a-46d8-bb94-5b81e0ea96ad
2026-04-25 02:16:51,150 - INFO - Network policy with name ingress-on-service found in agent
2026-04-25 02:16:51,150 - INFO - Network Policy ingress-on-service verification passed
2026-04-25 02:16:56,205 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:16:56,205 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:16:56,205 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:01,254 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:01,254 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:01,254 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:06,307 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:06,307 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:06,307 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:11,356 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:11,356 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:11,356 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:16,413 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:16,413 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:16,413 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:21,461 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:21,461 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:21,461 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:26,513 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:26,514 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:26,514 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:31,561 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:31,561 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:31,561 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:36,616 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:36,617 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:36,617 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:41,668 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:41,668 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:41,668 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:41,668 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95201736': 0, 'ctest-pod-75158952': 0}
2026-04-25 02:17:41,734 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:17:41,734 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:17:41,734 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:17:41,790 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:17:41,790 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:17:41,790 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:17:41,790 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95201736': 1, 'ctest-pod-75158952': 1}
2026-04-25 02:17:46,848 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:46,849 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:46,849 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:51,897 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:51,897 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:51,897 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:56,960 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:17:56,960 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:17:56,960 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:02,014 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:02,014 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:02,014 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:07,074 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:07,074 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:07,074 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:11,714 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2026-04-25 02:18:21,770 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:21,770 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:21,770 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:26,821 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:26,821 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:26,821 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:31,889 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:31,889 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:31,889 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:36,952 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:36,952 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:36,952 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:42,007 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:42,007 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:18:42,007 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:18:42,007 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95201736': 0, 'ctest-pod-75158952': 0}
2026-04-25 02:18:44,061 - DEBUG - [Pod ctest-pod-22299563] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.699 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.099 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.099/0.299/0.699 ms
2026-04-25 02:18:44,061 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-22299563 with expectation True passed
2026-04-25 02:18:46,109 - DEBUG - [Pod ctest-pod-01777663] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.641 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.127 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.283/0.641 ms
2026-04-25 02:18:46,109 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01777663 with expectation True passed
2026-04-25 02:18:48,157 - DEBUG - [Pod ctest-pod-17371400] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.743 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.295/0.743 ms
2026-04-25 02:18:48,157 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17371400 with expectation True passed
2026-04-25 02:18:48,210 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:18:48,210 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-04-25 02:18:48,210 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: ctest-pod-95201736
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:18:48,210 - INFO - wget check of of http://10.47.255.251 from ctest-pod-22299563 passed
2026-04-25 02:18:48,261 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-75158952
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:18:48,261 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-04-25 02:18:48,261 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: ctest-pod-75158952
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:18:48,261 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22299563 passed
2026-04-25 02:18:53,317 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-04-25 02:18:53,317 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-04-25 02:18:53,317 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-04-25 02:18:53,317 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01777663 passed
2026-04-25 02:18:58,364 - DEBUG - [Pod ctest-pod-19265372] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-04-25 02:18:58,364 - DEBUG - [Pod Pod ctest-pod-19265372] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed.
2026-04-25 02:18:58,364 - DEBUG - [Pod Pod ctest-pod-19265372] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-04-25 02:18:58,364 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19265372 passed
2026-04-25 02:18:58,383 - INFO - Updating Network Policy ingress-on-service
2026-04-25 02:19:03,449 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:03,449 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:03,449 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:08,501 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:08,501 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:08,501 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:13,545 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:13,545 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:13,545 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:18,598 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:18,598 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:18,598 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:23,655 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:23,655 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:23,655 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:28,707 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:28,707 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:28,707 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:33,756 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:33,756 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:33,756 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:38,810 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:38,810 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:38,810 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:43,857 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:43,858 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:43,858 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:48,912 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:48,912 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 failed.
2026-04-25 02:19:48,912 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
wget: download timed out
2026-04-25 02:19:48,912 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95201736': 0, 'ctest-pod-75158952': 0}
2026-04-25 02:19:48,968 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-75158952
2026-04-25 02:19:48,968 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:19:48,968 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-75158952
2026-04-25 02:19:49,022 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95201736
2026-04-25 02:19:49,023 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:19:49,023 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95201736
2026-04-25 02:19:49,023 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95201736': 1, 'ctest-pod-75158952': 1}
2026-04-25 02:19:49,070 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,070 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:19:49,070 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,124 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,124 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:19:49,125 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,180 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,181 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:19:49,181 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: ctest-pod-95201736
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,234 - DEBUG - [Pod ctest-pod-17371400] Cmd: wget http://10.100.248.196:80/ -O - -T 5 -t 1 , Output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,234 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd wget http://10.100.248.196:80/ -O - -T 5 -t 1 passed
2026-04-25 02:19:49,234 - DEBUG - [Pod Pod ctest-pod-17371400] Cmd output: ctest-pod-75158952
Connecting to 10.100.248.196:80 (10.100.248.196:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:49,234 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95201736': 3, 'ctest-pod-75158952': 1}
2026-04-25 02:19:51,285 - DEBUG - [Pod ctest-pod-22299563] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.377 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.098 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.185/0.377 ms
2026-04-25 02:19:51,285 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-22299563 with expectation True passed
2026-04-25 02:19:53,337 - DEBUG - [Pod ctest-pod-01777663] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.796 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.113 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.333/0.796 ms
2026-04-25 02:19:53,338 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01777663 with expectation True passed
2026-04-25 02:19:55,394 - DEBUG - [Pod ctest-pod-17371400] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.909 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.118 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.112 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.112/0.379/0.909 ms
2026-04-25 02:19:55,394 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17371400 with expectation True passed
2026-04-25 02:19:55,450 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:55,450 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-04-25 02:19:55,450 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: ctest-pod-95201736
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:19:55,450 - INFO - wget check of of http://10.47.255.251 from ctest-pod-22299563 passed
2026-04-25 02:19:55,491 - DEBUG - [Pod ctest-pod-22299563] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-75158952
2026-04-25 02:19:55,491 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-04-25 02:19:55,491 - DEBUG - [Pod Pod ctest-pod-22299563] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-75158952
2026-04-25 02:19:55,491 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22299563 passed
2026-04-25 02:20:00,534 - DEBUG - [Pod ctest-pod-01777663] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-04-25 02:20:00,534 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-04-25 02:20:00,534 - DEBUG - [Pod Pod ctest-pod-01777663] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-04-25 02:20:00,534 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01777663 passed
2026-04-25 02:20:00,599 - DEBUG - [Pod ctest-pod-19265372] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-95201736
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:20:00,599 - DEBUG - [Pod Pod ctest-pod-19265372] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-04-25 02:20:00,599 - DEBUG - [Pod Pod ctest-pod-19265372] Cmd output: ctest-pod-95201736
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-04-25 02:20:00,599 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19265372 passed
2026-04-25 02:20:00,599 - INFO - Deleting Network Policy : ingress-on-service
2026-04-25 02:20:00,602 - INFO - Deleting service : ctest-nginx-svc-25298435
2026-04-25 02:20:00,900 - DEBUG - No XMPP flaps were noticed during the test
2026-04-25 02:20:00,900 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2026-04-25 02:20:00,900 - INFO - --------------------------------------------------------------------------------
2026-04-25 02:20:00,907 - INFO - Deleting pod ctest-new-default-15335820:ctest-pod-95201736
2026-04-25 02:20:00,908 - INFO - Deleting pod ctest-new-default-15335820:ctest-pod-75158952
2026-04-25 02:20:00,909 - INFO - Deleting pod ctest-non-default-87476462:ctest-pod-89299704
2026-04-25 02:20:00,909 - INFO - Deleting pod ctest-non-default-87476462:ctest-pod-47256910
2026-04-25 02:20:00,910 - INFO - Deleting pod ctest-new-default-15335820:ctest-pod-01777663
2026-04-25 02:20:00,910 - INFO - Deleting pod ctest-new-default-15335820:ctest-pod-22299563
2026-04-25 02:20:00,911 - INFO - Deleting pod ctest-non-default-87476462:ctest-pod-17371400
2026-04-25 02:20:00,911 - INFO - Deleting pod ctest-non-default-87476462:ctest-pod-19265372
2026-04-25 02:20:01,101 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,102 - WARNING - Pod uuid 5061146e-efd4-41b4-9175-1437112aa544 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,108 - WARNING - Pod uuid 49c0606f-4a80-47de-9dcf-30b3bd33755d is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,110 - WARNING - Pod uuid 768b3fba-3d2a-4ba4-a143-cd2b6970fb51 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,141 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,144 - WARNING - Pod uuid 8843e12f-fb3e-4455-ad67-94ad1422d6d7 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,144 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:01,145 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:06,118 - DEBUG - Pod 49c0606f-4a80-47de-9dcf-30b3bd33755d is not in agent 10.0.0.249 VM list
2026-04-25 02:20:06,120 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:06,121 - DEBUG - Pod 5061146e-efd4-41b4-9175-1437112aa544 is not in agent 10.0.0.249 VM list
2026-04-25 02:20:06,123 - DEBUG - Pod 768b3fba-3d2a-4ba4-a143-cd2b6970fb51 is not in agent 10.0.0.249 VM list
2026-04-25 02:20:06,131 - DEBUG - VMI c3750c36-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:06,131 - INFO - Verified that pod ctest-pod-95201736 is removed in agent
2026-04-25 02:20:06,132 - DEBUG - VMI c4f5be16-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:06,132 - INFO - Verified that pod ctest-pod-47256910 is removed in agent
2026-04-25 02:20:06,132 - DEBUG - VMI c3f3ccf6-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:06,132 - INFO - Verified that pod ctest-pod-75158952 is removed in agent
2026-04-25 02:20:06,151 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:06,160 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:06,160 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:06,161 - DEBUG - Pod 8843e12f-fb3e-4455-ad67-94ad1422d6d7 is not in agent 10.0.0.249 VM list
2026-04-25 02:20:06,168 - DEBUG - VMI c483d508-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:06,168 - INFO - Verified that pod ctest-pod-89299704 is removed in agent
2026-04-25 02:20:11,128 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:11,159 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:11,171 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:11,171 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:16,136 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:16,169 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:16,181 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:16,182 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:21,144 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:21,176 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:21,192 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:21,193 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:26,152 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:26,183 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:26,202 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:26,203 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:31,170 - WARNING - Pod uuid c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:31,191 - WARNING - Pod uuid 989ff733-c498-49ea-bdfd-ca41d6f3b38e is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:31,214 - WARNING - Pod uuid 4954fc4a-30ff-4250-9ced-b839422a78b9 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:31,215 - WARNING - Pod uuid 73b6eb67-58d5-409b-a09a-76d039cfb627 is still seen in agent 10.0.0.249 VM list
2026-04-25 02:20:36,177 - DEBUG - Pod c8d7bf1f-bda2-43aa-bb35-f17e7f538f63 is not in agent 10.0.0.249 VM list
2026-04-25 02:20:36,183 - DEBUG - VMI c5f4e9cc-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:36,183 - INFO - Verified that pod ctest-pod-22299563 is removed in agent
2026-04-25 02:20:36,199 - DEBUG - Pod 989ff733-c498-49ea-bdfd-ca41d6f3b38e is not in agent 10.0.0.249 VM list
2026-04-25 02:20:36,205 - DEBUG - VMI c5801e8a-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:36,205 - INFO - Verified that pod ctest-pod-01777663 is removed in agent
2026-04-25 02:20:36,225 - DEBUG - Pod 4954fc4a-30ff-4250-9ced-b839422a78b9 is not in agent 10.0.0.249 VM list
2026-04-25 02:20:36,228 - DEBUG - Pod 73b6eb67-58d5-409b-a09a-76d039cfb627 is not in agent 10.0.0.249 VM list
2026-04-25 02:20:36,235 - DEBUG - VMI c6de6638-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:36,235 - INFO - Verified that pod ctest-pod-19265372 is removed in agent
2026-04-25 02:20:36,237 - DEBUG - VMI c66737d4-404c-11f1-80a3-fa163edc6947 is removed from agent 10.0.0.249
2026-04-25 02:20:36,237 - INFO - Verified that pod ctest-pod-17371400 is removed in agent
2026-04-25 02:20:36,237 - INFO - Deleting namespace ctest-non-default-87476462
2026-04-25 02:20:36,250 - DEBUG - Namespace ctest-non-default-87476462 still in k8s
2026-04-25 02:20:38,256 - DEBUG - Namespace ctest-non-default-87476462 still in k8s
2026-04-25 02:20:40,261 - DEBUG - Namespace ctest-non-default-87476462 still in k8s
2026-04-25 02:20:42,265 - DEBUG - Namespace ctest-non-default-87476462 is not in k8s
2026-04-25 02:20:42,265 - DEBUG - No need to check project deletion in contrail-api
2026-04-25 02:20:42,265 - INFO - Deleting namespace ctest-new-default-15335820
2026-04-25 02:20:42,278 - DEBUG - Namespace ctest-new-default-15335820 still in k8s
2026-04-25 02:20:44,282 - DEBUG - Namespace ctest-new-default-15335820 still in k8s
2026-04-25 02:20:46,287 - DEBUG - Namespace ctest-new-default-15335820 still in k8s
2026-04-25 02:20:48,292 - DEBUG - Namespace ctest-new-default-15335820 is not in k8s
2026-04-25 02:20:48,292 - DEBUG - No need to check project deletion in contrail-api