2025-10-21 22:00:04,654 - INFO - Using existing project ['default-domain', 'k8s-default'](bb8f1a18-c7b5-4e52-b469-e2790d8e2c6f)
2025-10-21 22:00:04,677 - DEBUG - Namespace ctest-new-default-84664823 not present
2025-10-21 22:00:04,684 - INFO - Created namespace ctest-new-default-84664823
2025-10-21 22:00:07,688 - DEBUG - Namespace ctest-non-default-59617929 not present
2025-10-21 22:00:07,700 - INFO - Created namespace ctest-non-default-59617929
2025-10-21 22:00:10,722 - DEBUG - Pod ctest-pod-99082580 not present
2025-10-21 22:00:10,722 - INFO - Creating Pod ctest-pod-99082580
2025-10-21 22:00:10,772 - DEBUG - Pod : ctest-pod-99082580 UUID is f9e6f0bc-be0f-4d53-ad6a-ebaaa24c489c
2025-10-21 22:00:10,775 - DEBUG - Pod ctest-pod-52052712 not present
2025-10-21 22:00:10,776 - INFO - Creating Pod ctest-pod-52052712
2025-10-21 22:00:10,828 - DEBUG - Pod : ctest-pod-52052712 UUID is 3e376422-79fe-49f6-a4fc-057008a4d600
2025-10-21 22:00:10,833 - DEBUG - Pod ctest-pod-03747977 not present
2025-10-21 22:00:10,834 - INFO - Creating Pod ctest-pod-03747977
2025-10-21 22:00:10,864 - DEBUG - Pod : ctest-pod-03747977 UUID is aab38349-fcc9-4993-8915-ec93a86680e2
2025-10-21 22:00:10,869 - DEBUG - Pod ctest-pod-74907637 not present
2025-10-21 22:00:10,870 - INFO - Creating Pod ctest-pod-74907637
2025-10-21 22:00:10,895 - DEBUG - Pod : ctest-pod-74907637 UUID is 42a90da1-b207-458b-94cf-e25209dc11a7
2025-10-21 22:00:10,897 - DEBUG - Pod ctest-pod-30900238 not present
2025-10-21 22:00:10,898 - INFO - Creating Pod ctest-pod-30900238
2025-10-21 22:00:10,920 - DEBUG - Pod : ctest-pod-30900238 UUID is 43a5b2d7-b062-40b9-a5b5-79a1565d6e07
2025-10-21 22:00:10,922 - DEBUG - Pod ctest-pod-55432356 not present
2025-10-21 22:00:10,922 - INFO - Creating Pod ctest-pod-55432356
2025-10-21 22:00:10,943 - DEBUG - Pod : ctest-pod-55432356 UUID is 130a7e5b-50d9-4f0c-8002-ffe09e99719f
2025-10-21 22:00:10,946 - DEBUG - Pod ctest-pod-11824026 not present
2025-10-21 22:00:10,948 - INFO - Creating Pod ctest-pod-11824026
2025-10-21 22:00:10,981 - DEBUG - Pod : ctest-pod-11824026 UUID is bd2e98b7-8fcf-4af2-8df8-78c3dfac09db
2025-10-21 22:00:10,985 - DEBUG - Pod ctest-pod-62318997 not present
2025-10-21 22:00:10,985 - INFO - Creating Pod ctest-pod-62318997
2025-10-21 22:00:11,008 - DEBUG - Pod : ctest-pod-62318997 UUID is 369645a2-8f4d-409e-9bf4-3eb2ea31536c
2025-10-21 22:00:11,269 - INFO - Project default-domain:k8s-ctest-new-default-84664823 for Namespace ctest-new-default-84664823 is seen in contrail-api
2025-10-21 22:00:11,269 - DEBUG - Project uuid in Contrail is f8307d25-84b3-465e-8e8a-9bfad50c8014
2025-10-21 22:00:11,458 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_NamespaceDatabaseList?namespace_uuid=202f220f-e58a-4e1b-948a-712f25fcd29a
2025-10-21 22:00:11,462 - INFO - Namespace ctest-new-default-84664823 with uuid 202f220f-e58a-4e1b-948a-712f25fcd29a found in kube manager
2025-10-21 22:00:11,462 - INFO - Namespace ctest-new-default-84664823 verification passed
2025-10-21 22:00:11,780 - INFO - Project default-domain:k8s-ctest-non-default-59617929 for Namespace ctest-non-default-59617929 is seen in contrail-api
2025-10-21 22:00:11,781 - DEBUG - Project uuid in Contrail is 9b5c500c-05e3-4941-9190-a638aa02f965
2025-10-21 22:00:11,781 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_NamespaceDatabaseList?namespace_uuid=6fb23f63-7959-44ee-88e7-a5f61a57d501
2025-10-21 22:00:11,785 - INFO - Namespace ctest-non-default-59617929 with uuid 6fb23f63-7959-44ee-88e7-a5f61a57d501 found in kube manager
2025-10-21 22:00:11,785 - INFO - Namespace ctest-non-default-59617929 verification passed
2025-10-21 22:00:11,790 - DEBUG - Pod ctest-pod-99082580 not in running state.Currently in Pending
2025-10-21 22:00:16,808 - DEBUG - Pod ctest-pod-99082580 not in running state.Currently in Pending
2025-10-21 22:00:21,817 - DEBUG - Pod ctest-pod-99082580 not in running state.Currently in Pending
2025-10-21 22:00:26,824 - INFO - Pod ctest-pod-99082580 is in running state.Got IP 10.47.255.251
2025-10-21 22:00:26,879 - DEBUG - Pod ctest-pod-99082580 has vmi 5143219e-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:26,879 - INFO - Verified pod ctest-pod-99082580 in contrail-api
2025-10-21 22:00:26,891 - DEBUG - VMI 5143219e-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:26,892 - INFO - Verified Pod ctest-pod-99082580 in agent 10.0.0.146
2025-10-21 22:00:26,892 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=f9e6f0bc-be0f-4d53-ad6a-ebaaa24c489c
2025-10-21 22:00:26,896 - INFO - Pod ctest-pod-99082580 with uuid f9e6f0bc-be0f-4d53-ad6a-ebaaa24c489c found in kube manager
2025-10-21 22:00:26,896 - INFO - Pod ctest-pod-99082580 verification passed
2025-10-21 22:00:26,902 - INFO - Pod ctest-pod-52052712 is in running state.Got IP 10.47.255.250
2025-10-21 22:00:26,914 - DEBUG - Pod ctest-pod-52052712 has vmi 51becf4c-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:26,914 - INFO - Verified pod ctest-pod-52052712 in contrail-api
2025-10-21 22:00:26,929 - DEBUG - VMI 51becf4c-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:26,929 - INFO - Verified Pod ctest-pod-52052712 in agent 10.0.0.146
2025-10-21 22:00:26,929 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=3e376422-79fe-49f6-a4fc-057008a4d600
2025-10-21 22:00:26,933 - INFO - Pod ctest-pod-52052712 with uuid 3e376422-79fe-49f6-a4fc-057008a4d600 found in kube manager
2025-10-21 22:00:26,933 - INFO - Pod ctest-pod-52052712 verification passed
2025-10-21 22:00:26,939 - INFO - Pod ctest-pod-03747977 is in running state.Got IP 10.47.255.249
2025-10-21 22:00:26,995 - DEBUG - Pod ctest-pod-03747977 has vmi 5253dec0-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:26,995 - INFO - Verified pod ctest-pod-03747977 in contrail-api
2025-10-21 22:00:27,007 - DEBUG - VMI 5253dec0-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:27,007 - INFO - Verified Pod ctest-pod-03747977 in agent 10.0.0.146
2025-10-21 22:00:27,007 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=aab38349-fcc9-4993-8915-ec93a86680e2
2025-10-21 22:00:27,011 - INFO - Pod ctest-pod-03747977 with uuid aab38349-fcc9-4993-8915-ec93a86680e2 found in kube manager
2025-10-21 22:00:27,011 - INFO - Pod ctest-pod-03747977 verification passed
2025-10-21 22:00:27,017 - INFO - Pod ctest-pod-74907637 is in running state.Got IP 10.47.255.248
2025-10-21 22:00:27,030 - DEBUG - Pod ctest-pod-74907637 has vmi 52c9a3f8-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:27,030 - INFO - Verified pod ctest-pod-74907637 in contrail-api
2025-10-21 22:00:27,041 - DEBUG - VMI 52c9a3f8-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:27,041 - INFO - Verified Pod ctest-pod-74907637 in agent 10.0.0.146
2025-10-21 22:00:27,041 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=42a90da1-b207-458b-94cf-e25209dc11a7
2025-10-21 22:00:27,045 - INFO - Pod ctest-pod-74907637 with uuid 42a90da1-b207-458b-94cf-e25209dc11a7 found in kube manager
2025-10-21 22:00:27,045 - INFO - Pod ctest-pod-74907637 verification passed
2025-10-21 22:00:27,051 - DEBUG - Pod ctest-pod-30900238 not in running state.Currently in Pending
2025-10-21 22:00:32,061 - INFO - Pod ctest-pod-30900238 is in running state.Got IP 10.47.255.247
2025-10-21 22:00:32,119 - DEBUG - Pod ctest-pod-30900238 has vmi 533cd83c-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:32,119 - INFO - Verified pod ctest-pod-30900238 in contrail-api
2025-10-21 22:00:32,130 - DEBUG - VMI 533cd83c-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:32,130 - INFO - Verified Pod ctest-pod-30900238 in agent 10.0.0.146
2025-10-21 22:00:32,130 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=43a5b2d7-b062-40b9-a5b5-79a1565d6e07
2025-10-21 22:00:32,134 - INFO - Pod ctest-pod-30900238 with uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 found in kube manager
2025-10-21 22:00:32,134 - INFO - Pod ctest-pod-30900238 verification passed
2025-10-21 22:00:32,141 - INFO - Pod ctest-pod-11824026 is in running state.Got IP 10.47.255.245
2025-10-21 22:00:32,156 - DEBUG - Pod ctest-pod-11824026 has vmi 5428c5b2-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:32,156 - INFO - Verified pod ctest-pod-11824026 in contrail-api
2025-10-21 22:00:32,169 - DEBUG - VMI 5428c5b2-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:32,169 - INFO - Verified Pod ctest-pod-11824026 in agent 10.0.0.146
2025-10-21 22:00:32,169 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=bd2e98b7-8fcf-4af2-8df8-78c3dfac09db
2025-10-21 22:00:32,173 - INFO - Pod ctest-pod-11824026 with uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db found in kube manager
2025-10-21 22:00:32,173 - INFO - Pod ctest-pod-11824026 verification passed
2025-10-21 22:00:32,180 - INFO - Pod ctest-pod-55432356 is in running state.Got IP 10.47.255.246
2025-10-21 22:00:32,235 - DEBUG - Pod ctest-pod-55432356 has vmi 53b1f914-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:32,237 - INFO - Verified pod ctest-pod-55432356 in contrail-api
2025-10-21 22:00:32,250 - DEBUG - VMI 53b1f914-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:32,250 - INFO - Verified Pod ctest-pod-55432356 in agent 10.0.0.146
2025-10-21 22:00:32,250 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=130a7e5b-50d9-4f0c-8002-ffe09e99719f
2025-10-21 22:00:32,254 - INFO - Pod ctest-pod-55432356 with uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f found in kube manager
2025-10-21 22:00:32,254 - INFO - Pod ctest-pod-55432356 verification passed
2025-10-21 22:00:32,260 - INFO - Pod ctest-pod-62318997 is in running state.Got IP 10.47.255.244
2025-10-21 22:00:32,270 - DEBUG - Pod ctest-pod-62318997 has vmi 5494da22-aec9-11f0-891b-fa163e28f79f
2025-10-21 22:00:32,270 - INFO - Verified pod ctest-pod-62318997 in contrail-api
2025-10-21 22:00:32,282 - DEBUG - VMI 5494da22-aec9-11f0-891b-fa163e28f79f is active in agent 10.0.0.146
2025-10-21 22:00:32,282 - INFO - Verified Pod ctest-pod-62318997 in agent 10.0.0.146
2025-10-21 22:00:32,282 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_VirtualMachineDatabaseList?x=369645a2-8f4d-409e-9bf4-3eb2ea31536c
2025-10-21 22:00:32,286 - INFO - Pod ctest-pod-62318997 with uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c found in kube manager
2025-10-21 22:00:32,286 - INFO - Pod ctest-pod-62318997 verification passed
2025-10-21 22:00:32,286 - INFO - ================================================================================
2025-10-21 22:00:32,286 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-21 22:00:32,286 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-21 22:00:32,543 - DEBUG - Nothing to compare xmpp stats {'10.0.0.146': {'10.0.0.130': '0'}} with
2025-10-21 22:00:32,543 - INFO - Initial checks done. Running the testcase now
2025-10-21 22:00:32,544 - INFO -
2025-10-21 22:00:32,609 - DEBUG - [Pod ctest-pod-99082580] Cmd: echo ctest-pod-99082580 > /usr/share/nginx/html/index.html, Output:
2025-10-21 22:00:32,668 - DEBUG - [Pod ctest-pod-52052712] Cmd: echo ctest-pod-52052712 > /usr/share/nginx/html/index.html, Output:
2025-10-21 22:00:32,727 - DEBUG - [Pod ctest-pod-03747977] Cmd: echo ctest-pod-03747977 > /usr/share/nginx/html/index.html, Output:
2025-10-21 22:00:32,782 - DEBUG - [Pod ctest-pod-74907637] Cmd: echo ctest-pod-74907637 > /usr/share/nginx/html/index.html, Output:
2025-10-21 22:00:32,785 - DEBUG - Service ctest-nginx-svc-51370020 not present
2025-10-21 22:00:32,786 - INFO - Creating service ctest-nginx-svc-51370020
2025-10-21 22:00:32,809 - INFO - Created Service ctest-nginx-svc-51370020
2025-10-21 22:00:32,815 - WARNING - Service UUID 85dc8fb7-6049-4a51-b863-7e5449357151 not yet found in contrail-api
2025-10-21 22:00:33,830 - INFO - Validated that Service ctest-nginx-svc-51370020 is seen in contrail-api
2025-10-21 22:00:33,830 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_LoadbalancerDatabaseList?x=85dc8fb7-6049-4a51-b863-7e5449357151
2025-10-21 22:00:33,835 - INFO - Service ctest-nginx-svc-51370020 with uuid 85dc8fb7-6049-4a51-b863-7e5449357151 found in kube manager
2025-10-21 22:00:33,835 - INFO - Service ctest-nginx-svc-51370020 verification passed
2025-10-21 22:00:34,911 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99082580
2025-10-21 22:00:34,911 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:00:34,911 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99082580
2025-10-21 22:00:34,965 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:00:34,965 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:00:34,965 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:00:35,027 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:00:35,027 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:00:35,027 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:00:35,027 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99082580': 2, 'ctest-pod-52052712': 1}
2025-10-21 22:00:35,086 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:00:35,086 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:00:35,086 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:00:35,139 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99082580
2025-10-21 22:00:35,139 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:00:35,139 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99082580
2025-10-21 22:00:35,139 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99082580': 1, 'ctest-pod-52052712': 1}
2025-10-21 22:00:35,143 - DEBUG - Network policy ingress-on-service not present
2025-10-21 22:00:35,143 - INFO - Creating Network Policy ingress-on-service
2025-10-21 22:00:35,169 - INFO - Network policy found in k8s
2025-10-21 22:00:35,170 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cf2e1b32-5b20-4a39-9259-ad214b103d88
2025-10-21 22:00:35,175 - INFO - Network Policy ingress-on-service with uuid cf2e1b32-5b20-4a39-9259-ad214b103d88 found in kube manager
2025-10-21 22:00:35,204 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-21 22:00:35,204 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-21 22:00:35,205 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cf2e1b32-5b20-4a39-9259-ad214b103d88
2025-10-21 22:00:35,230 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-21 22:00:37,230 - DEBUG - Requesting: http://10.0.0.130:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cf2e1b32-5b20-4a39-9259-ad214b103d88
2025-10-21 22:00:37,262 - INFO - Network policy with name ingress-on-service found in agent
2025-10-21 22:00:37,262 - INFO - Network Policy ingress-on-service verification passed
2025-10-21 22:00:42,317 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:42,317 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:42,317 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:47,373 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:47,373 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:47,373 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:52,422 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:52,422 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:52,422 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:57,490 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:57,490 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:00:57,490 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:02,538 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:02,538 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:02,538 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:07,581 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:07,581 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:07,582 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:12,638 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:12,638 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:12,638 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:17,689 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:17,689 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:17,689 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:22,741 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:22,741 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:22,741 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:27,800 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:27,800 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:27,800 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:27,800 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99082580': 0, 'ctest-pod-52052712': 0}
2025-10-21 22:01:27,863 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:01:27,863 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:01:27,863 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:01:27,920 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52052712
2025-10-21 22:01:27,920 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:01:27,920 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52052712
2025-10-21 22:01:27,982 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99082580
2025-10-21 22:01:27,982 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:01:27,982 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99082580
2025-10-21 22:01:27,982 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99082580': 1, 'ctest-pod-52052712': 2}
2025-10-21 22:01:33,034 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:33,034 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:33,034 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:38,080 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:38,080 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:38,081 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:43,133 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:43,133 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:43,133 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:48,186 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:48,186 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:48,186 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:53,241 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:53,241 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:53,241 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:58,301 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:58,301 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:01:58,301 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:03,349 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:03,349 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:03,349 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:03,479 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-21 22:02:13,861 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:13,861 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:13,861 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:18,914 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:18,914 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:18,914 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:23,966 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:23,966 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:23,966 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:23,966 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99082580': 0, 'ctest-pod-52052712': 0}
2025-10-21 22:02:26,015 - DEBUG - [Pod ctest-pod-55432356] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.886 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.352/0.886 ms
2025-10-21 22:02:26,015 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55432356 with expectation True passed
2025-10-21 22:02:28,065 - DEBUG - [Pod ctest-pod-30900238] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.854 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.346/0.854 ms
2025-10-21 22:02:28,066 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30900238 with expectation True passed
2025-10-21 22:02:30,120 - DEBUG - [Pod ctest-pod-11824026] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.479 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.219/0.479 ms
2025-10-21 22:02:30,120 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11824026 with expectation True passed
2025-10-21 22:02:30,184 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:02:30,185 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-21 22:02:30,185 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:02:30,185 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55432356 passed
2025-10-21 22:02:30,234 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:02:30,234 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-21 22:02:30,234 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:02:30,234 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55432356 passed
2025-10-21 22:02:35,285 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-21 22:02:35,285 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-21 22:02:35,285 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-21 22:02:35,285 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30900238 passed
2025-10-21 22:02:40,339 - DEBUG - [Pod ctest-pod-62318997] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-21 22:02:40,339 - DEBUG - [Pod Pod ctest-pod-62318997] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-21 22:02:40,339 - DEBUG - [Pod Pod ctest-pod-62318997] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-21 22:02:40,339 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62318997 passed
2025-10-21 22:02:40,349 - INFO - Updating Network Policy ingress-on-service
2025-10-21 22:02:45,414 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:45,414 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:45,414 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:50,460 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:50,461 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:50,461 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:55,513 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:55,513 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:02:55,513 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:00,575 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:00,575 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:00,575 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:05,630 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:05,630 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:05,630 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:10,682 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:10,682 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:10,682 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:15,733 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:15,733 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:15,733 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:20,781 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:20,781 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:20,781 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:25,833 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:25,833 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:25,833 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:30,886 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:30,886 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:30,886 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.108.130.127:80 (10.108.130.127:80)
wget: download timed out
2025-10-21 22:03:30,886 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99082580': 0, 'ctest-pod-52052712': 0}
2025-10-21 22:03:30,938 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:30,938 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:30,938 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,014 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,014 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,014 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,070 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,070 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,070 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,120 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,120 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,120 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,120 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99082580': 1, 'ctest-pod-52052712': 3}
2025-10-21 22:03:31,175 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,175 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,175 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,227 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,227 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,227 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,278 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,279 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,279 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: ctest-pod-99082580
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,327 - DEBUG - [Pod ctest-pod-11824026] Cmd: wget http://10.108.130.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,327 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd wget http://10.108.130.127:80/ -O - -T 5 -t 1 passed
2025-10-21 22:03:31,327 - DEBUG - [Pod Pod ctest-pod-11824026] Cmd output: ctest-pod-52052712
Connecting to 10.108.130.127:80 (10.108.130.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-21 22:03:31,327 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99082580': 3, 'ctest-pod-52052712': 1}
2025-10-21 22:03:33,381 - DEBUG - [Pod ctest-pod-55432356] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.289 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.097/0.494/1.289 ms
2025-10-21 22:03:33,381 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55432356 with expectation True passed
2025-10-21 22:03:35,435 - DEBUG - [Pod ctest-pod-30900238] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.450 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.119 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.107/0.225/0.450 ms
2025-10-21 22:03:35,435 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30900238 with expectation True passed
2025-10-21 22:03:37,486 - DEBUG - [Pod ctest-pod-11824026] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.465 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.214/0.465 ms
2025-10-21 22:03:37,486 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11824026 with expectation True passed
2025-10-21 22:03:37,538 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:03:37,539 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-21 22:03:37,539 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:03:37,539 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55432356 passed
2025-10-21 22:03:37,590 - DEBUG - [Pod ctest-pod-55432356] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:03:37,591 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-21 22:03:37,591 - DEBUG - [Pod Pod ctest-pod-55432356] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:03:37,591 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55432356 passed
2025-10-21 22:03:42,644 - DEBUG - [Pod ctest-pod-30900238] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-21 22:03:42,644 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-21 22:03:42,644 - DEBUG - [Pod Pod ctest-pod-30900238] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-21 22:03:42,644 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30900238 passed
2025-10-21 22:03:42,699 - DEBUG - [Pod ctest-pod-62318997] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:03:42,699 - DEBUG - [Pod Pod ctest-pod-62318997] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-21 22:03:42,699 - DEBUG - [Pod Pod ctest-pod-62318997] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-21 22:03:42,699 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62318997 passed
2025-10-21 22:03:42,700 - INFO - Deleting Network Policy : ingress-on-service
2025-10-21 22:03:42,700 - INFO - Deleting service : ctest-nginx-svc-51370020
2025-10-21 22:03:42,954 - DEBUG - No XMPP flaps were noticed during the test
2025-10-21 22:03:42,954 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-10-21 22:03:42,955 - INFO - --------------------------------------------------------------------------------
2025-10-21 22:03:42,960 - INFO - Deleting pod ctest-new-default-84664823:ctest-pod-99082580
2025-10-21 22:03:42,960 - INFO - Deleting pod ctest-new-default-84664823:ctest-pod-52052712
2025-10-21 22:03:42,961 - INFO - Deleting pod ctest-non-default-59617929:ctest-pod-03747977
2025-10-21 22:03:42,961 - INFO - Deleting pod ctest-non-default-59617929:ctest-pod-74907637
2025-10-21 22:03:42,962 - INFO - Deleting pod ctest-new-default-84664823:ctest-pod-30900238
2025-10-21 22:03:42,962 - INFO - Deleting pod ctest-new-default-84664823:ctest-pod-55432356
2025-10-21 22:03:42,963 - INFO - Deleting pod ctest-non-default-59617929:ctest-pod-11824026
2025-10-21 22:03:42,963 - INFO - Deleting pod ctest-non-default-59617929:ctest-pod-62318997
2025-10-21 22:03:43,091 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,092 - WARNING - Pod uuid aab38349-fcc9-4993-8915-ec93a86680e2 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,092 - WARNING - Pod uuid 3e376422-79fe-49f6-a4fc-057008a4d600 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,092 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,093 - WARNING - Pod uuid 42a90da1-b207-458b-94cf-e25209dc11a7 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,093 - WARNING - Pod uuid f9e6f0bc-be0f-4d53-ad6a-ebaaa24c489c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,094 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:43,104 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:48,119 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:48,120 - DEBUG - Pod 42a90da1-b207-458b-94cf-e25209dc11a7 is not in agent 10.0.0.146 VM list
2025-10-21 22:03:48,121 - DEBUG - Pod aab38349-fcc9-4993-8915-ec93a86680e2 is not in agent 10.0.0.146 VM list
2025-10-21 22:03:48,122 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:48,122 - DEBUG - Pod 3e376422-79fe-49f6-a4fc-057008a4d600 is not in agent 10.0.0.146 VM list
2025-10-21 22:03:48,125 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:48,125 - DEBUG - Pod f9e6f0bc-be0f-4d53-ad6a-ebaaa24c489c is not in agent 10.0.0.146 VM list
2025-10-21 22:03:48,126 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:48,136 - DEBUG - VMI 52c9a3f8-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:03:48,136 - INFO - Verified that pod ctest-pod-74907637 is removed in agent
2025-10-21 22:03:48,137 - DEBUG - VMI 5143219e-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:03:48,137 - INFO - Verified that pod ctest-pod-99082580 is removed in agent
2025-10-21 22:03:48,138 - DEBUG - VMI 51becf4c-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:03:48,138 - INFO - Verified that pod ctest-pod-52052712 is removed in agent
2025-10-21 22:03:48,138 - DEBUG - VMI 5253dec0-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:03:48,138 - INFO - Verified that pod ctest-pod-03747977 is removed in agent
2025-10-21 22:03:53,129 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:53,130 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:53,133 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:53,133 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:58,142 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:58,143 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:58,144 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:03:58,144 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:03,156 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:03,157 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:03,157 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:03,157 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:08,176 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:08,177 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:08,177 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:08,178 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:13,192 - WARNING - Pod uuid bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:13,193 - WARNING - Pod uuid 130a7e5b-50d9-4f0c-8002-ffe09e99719f is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:13,194 - WARNING - Pod uuid 369645a2-8f4d-409e-9bf4-3eb2ea31536c is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:13,195 - WARNING - Pod uuid 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is still seen in agent 10.0.0.146 VM list
2025-10-21 22:04:18,208 - DEBUG - Pod bd2e98b7-8fcf-4af2-8df8-78c3dfac09db is not in agent 10.0.0.146 VM list
2025-10-21 22:04:18,213 - DEBUG - Pod 369645a2-8f4d-409e-9bf4-3eb2ea31536c is not in agent 10.0.0.146 VM list
2025-10-21 22:04:18,214 - DEBUG - Pod 43a5b2d7-b062-40b9-a5b5-79a1565d6e07 is not in agent 10.0.0.146 VM list
2025-10-21 22:04:18,215 - DEBUG - Pod 130a7e5b-50d9-4f0c-8002-ffe09e99719f is not in agent 10.0.0.146 VM list
2025-10-21 22:04:18,219 - DEBUG - VMI 5428c5b2-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:04:18,219 - INFO - Verified that pod ctest-pod-11824026 is removed in agent
2025-10-21 22:04:18,226 - DEBUG - VMI 5494da22-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:04:18,226 - INFO - Verified that pod ctest-pod-62318997 is removed in agent
2025-10-21 22:04:18,228 - DEBUG - VMI 53b1f914-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:04:18,228 - INFO - Verified that pod ctest-pod-55432356 is removed in agent
2025-10-21 22:04:18,228 - DEBUG - VMI 533cd83c-aec9-11f0-891b-fa163e28f79f is removed from agent 10.0.0.146
2025-10-21 22:04:18,228 - INFO - Verified that pod ctest-pod-30900238 is removed in agent
2025-10-21 22:04:18,228 - INFO - Deleting namespace ctest-non-default-59617929
2025-10-21 22:04:18,245 - DEBUG - Namespace ctest-non-default-59617929 still in k8s
2025-10-21 22:04:20,249 - DEBUG - Namespace ctest-non-default-59617929 still in k8s
2025-10-21 22:04:22,257 - DEBUG - Namespace ctest-non-default-59617929 still in k8s
2025-10-21 22:04:24,260 - DEBUG - Namespace ctest-non-default-59617929 is not in k8s
2025-10-21 22:04:24,260 - DEBUG - No need to check project deletion in contrail-api
2025-10-21 22:04:24,260 - INFO - Deleting namespace ctest-new-default-84664823
2025-10-21 22:04:24,268 - DEBUG - Namespace ctest-new-default-84664823 still in k8s
2025-10-21 22:04:26,273 - DEBUG - Namespace ctest-new-default-84664823 still in k8s
2025-10-21 22:04:28,277 - DEBUG - Namespace ctest-new-default-84664823 still in k8s
2025-10-21 22:04:30,281 - DEBUG - Namespace ctest-new-default-84664823 is not in k8s
2025-10-21 22:04:30,282 - DEBUG - No need to check project deletion in contrail-api