2025-04-21 02:04:26,706 - INFO - Using existing project ['default-domain', 'k8s-default'](e909b88a-adec-4671-a168-f9867eb1dfd3)
2025-04-21 02:04:26,736 - DEBUG - Namespace ctest-new-default-30028832 not present
2025-04-21 02:04:26,745 - INFO - Created namespace ctest-new-default-30028832
2025-04-21 02:04:29,749 - DEBUG - Namespace ctest-non-default-49963468 not present
2025-04-21 02:04:29,769 - INFO - Created namespace ctest-non-default-49963468
2025-04-21 02:04:32,790 - DEBUG - Pod ctest-pod-28818254 not present
2025-04-21 02:04:32,791 - INFO - Creating Pod ctest-pod-28818254
2025-04-21 02:04:32,848 - DEBUG - Pod : ctest-pod-28818254 UUID is 57f822f0-6f2f-4fe0-bf4b-c9d971e2ad95
2025-04-21 02:04:32,859 - DEBUG - Pod ctest-pod-27572771 not present
2025-04-21 02:04:32,859 - INFO - Creating Pod ctest-pod-27572771
2025-04-21 02:04:32,888 - DEBUG - Pod : ctest-pod-27572771 UUID is 72f5267e-baaa-41f6-944c-b8d23e3581b7
2025-04-21 02:04:32,895 - DEBUG - Pod ctest-pod-41445158 not present
2025-04-21 02:04:32,896 - INFO - Creating Pod ctest-pod-41445158
2025-04-21 02:04:32,972 - DEBUG - Pod : ctest-pod-41445158 UUID is c701f1a7-8b6e-4e9f-bbfb-b3baa05f116a
2025-04-21 02:04:32,980 - DEBUG - Pod ctest-pod-70683530 not present
2025-04-21 02:04:32,981 - INFO - Creating Pod ctest-pod-70683530
2025-04-21 02:04:33,002 - DEBUG - Node for Pod ctest-pod-70683530 not yet populated
2025-04-21 02:04:36,010 - DEBUG - Pod : ctest-pod-70683530 UUID is 0263771a-9ab8-4ae1-8713-e98ca5d8c6fd
2025-04-21 02:04:36,013 - DEBUG - Pod ctest-pod-18842369 not present
2025-04-21 02:04:36,014 - INFO - Creating Pod ctest-pod-18842369
2025-04-21 02:04:36,046 - DEBUG - Pod : ctest-pod-18842369 UUID is a2834c1e-ecb0-463c-937d-4fc0cf445ad9
2025-04-21 02:04:36,057 - DEBUG - Pod ctest-pod-93692788 not present
2025-04-21 02:04:36,057 - INFO - Creating Pod ctest-pod-93692788
2025-04-21 02:04:36,092 - DEBUG - Pod : ctest-pod-93692788 UUID is b4d304e3-7368-4d00-be5a-f01f069a842d
2025-04-21 02:04:36,095 - DEBUG - Pod ctest-pod-11182554 not present
2025-04-21 02:04:36,096 - INFO - Creating Pod ctest-pod-11182554
2025-04-21 02:04:36,123 - DEBUG - Pod : ctest-pod-11182554 UUID is fcfa3e9b-938b-497d-b304-70139d104f9e
2025-04-21 02:04:36,135 - DEBUG - Pod ctest-pod-10872627 not present
2025-04-21 02:04:36,136 - INFO - Creating Pod ctest-pod-10872627
2025-04-21 02:04:36,161 - DEBUG - Pod : ctest-pod-10872627 UUID is 57c5ee10-fd02-4d59-9591-ece492c3972d
2025-04-21 02:04:36,369 - INFO - Project default-domain:k8s-ctest-new-default-30028832 for Namespace ctest-new-default-30028832 is seen in contrail-api
2025-04-21 02:04:36,369 - DEBUG - Project uuid in Contrail is d4eba1e8-ef45-4245-9561-f37bacb0dbd8
2025-04-21 02:04:36,540 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=ed59cdab-45e6-4b44-99d3-3b4d6312f49c
2025-04-21 02:04:36,545 - INFO - Namespace ctest-new-default-30028832 with uuid ed59cdab-45e6-4b44-99d3-3b4d6312f49c found in kube manager
2025-04-21 02:04:36,546 - INFO - Namespace ctest-new-default-30028832 verification passed
2025-04-21 02:04:36,792 - INFO - Project default-domain:k8s-ctest-non-default-49963468 for Namespace ctest-non-default-49963468 is seen in contrail-api
2025-04-21 02:04:36,792 - DEBUG - Project uuid in Contrail is be5f9ebc-8f51-41c2-aec1-2d9e6333442b
2025-04-21 02:04:36,793 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=90b83cb3-5c77-4245-9894-818eb0d75817
2025-04-21 02:04:36,801 - INFO - Namespace ctest-non-default-49963468 with uuid 90b83cb3-5c77-4245-9894-818eb0d75817 found in kube manager
2025-04-21 02:04:36,802 - INFO - Namespace ctest-non-default-49963468 verification passed
2025-04-21 02:04:36,815 - DEBUG - Pod ctest-pod-28818254 not in running state.Currently in Pending
2025-04-21 02:04:41,824 - DEBUG - Pod ctest-pod-28818254 not in running state.Currently in Pending
2025-04-21 02:04:46,831 - INFO - Pod ctest-pod-28818254 is in running state.Got IP 10.47.255.251
2025-04-21 02:04:46,896 - DEBUG - Pod ctest-pod-28818254 has vmi f8bc5eaa-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:46,896 - INFO - Verified pod ctest-pod-28818254 in contrail-api
2025-04-21 02:04:46,922 - DEBUG - VMI f8bc5eaa-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:46,923 - INFO - Verified Pod ctest-pod-28818254 in agent 10.0.0.56
2025-04-21 02:04:46,923 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=57f822f0-6f2f-4fe0-bf4b-c9d971e2ad95
2025-04-21 02:04:46,928 - INFO - Pod ctest-pod-28818254 with uuid 57f822f0-6f2f-4fe0-bf4b-c9d971e2ad95 found in kube manager
2025-04-21 02:04:46,928 - INFO - Pod ctest-pod-28818254 verification passed
2025-04-21 02:04:46,935 - INFO - Pod ctest-pod-27572771 is in running state.Got IP 10.47.255.250
2025-04-21 02:04:46,955 - DEBUG - Pod ctest-pod-27572771 has vmi f9438cc2-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:46,955 - INFO - Verified pod ctest-pod-27572771 in contrail-api
2025-04-21 02:04:46,969 - DEBUG - VMI f9438cc2-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:46,970 - INFO - Verified Pod ctest-pod-27572771 in agent 10.0.0.56
2025-04-21 02:04:46,970 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=72f5267e-baaa-41f6-944c-b8d23e3581b7
2025-04-21 02:04:46,975 - INFO - Pod ctest-pod-27572771 with uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 found in kube manager
2025-04-21 02:04:46,975 - INFO - Pod ctest-pod-27572771 verification passed
2025-04-21 02:04:46,981 - INFO - Pod ctest-pod-41445158 is in running state.Got IP 10.47.255.249
2025-04-21 02:04:47,040 - DEBUG - Pod ctest-pod-41445158 has vmi fa1e620c-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:47,040 - INFO - Verified pod ctest-pod-41445158 in contrail-api
2025-04-21 02:04:47,056 - DEBUG - VMI fa1e620c-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:47,056 - INFO - Verified Pod ctest-pod-41445158 in agent 10.0.0.56
2025-04-21 02:04:47,056 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=c701f1a7-8b6e-4e9f-bbfb-b3baa05f116a
2025-04-21 02:04:47,062 - INFO - Pod ctest-pod-41445158 with uuid c701f1a7-8b6e-4e9f-bbfb-b3baa05f116a found in kube manager
2025-04-21 02:04:47,062 - INFO - Pod ctest-pod-41445158 verification passed
2025-04-21 02:04:47,069 - INFO - Pod ctest-pod-70683530 is in running state.Got IP 10.47.255.248
2025-04-21 02:04:47,087 - DEBUG - Pod ctest-pod-70683530 has vmi faaf99d4-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:47,087 - INFO - Verified pod ctest-pod-70683530 in contrail-api
2025-04-21 02:04:47,102 - DEBUG - VMI faaf99d4-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:47,103 - INFO - Verified Pod ctest-pod-70683530 in agent 10.0.0.56
2025-04-21 02:04:47,103 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=0263771a-9ab8-4ae1-8713-e98ca5d8c6fd
2025-04-21 02:04:47,110 - INFO - Pod ctest-pod-70683530 with uuid 0263771a-9ab8-4ae1-8713-e98ca5d8c6fd found in kube manager
2025-04-21 02:04:47,110 - INFO - Pod ctest-pod-70683530 verification passed
2025-04-21 02:04:47,116 - DEBUG - Pod ctest-pod-18842369 not in running state.Currently in Pending
2025-04-21 02:04:52,124 - INFO - Pod ctest-pod-18842369 is in running state.Got IP 10.47.255.247
2025-04-21 02:04:52,180 - DEBUG - Pod ctest-pod-18842369 has vmi fb561e9e-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:52,180 - INFO - Verified pod ctest-pod-18842369 in contrail-api
2025-04-21 02:04:52,194 - DEBUG - VMI fb561e9e-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:52,195 - INFO - Verified Pod ctest-pod-18842369 in agent 10.0.0.56
2025-04-21 02:04:52,195 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=a2834c1e-ecb0-463c-937d-4fc0cf445ad9
2025-04-21 02:04:52,199 - INFO - Pod ctest-pod-18842369 with uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 found in kube manager
2025-04-21 02:04:52,200 - INFO - Pod ctest-pod-18842369 verification passed
2025-04-21 02:04:52,206 - INFO - Pod ctest-pod-11182554 is in running state.Got IP 10.47.255.245
2025-04-21 02:04:52,226 - DEBUG - Pod ctest-pod-11182554 has vmi fc82416c-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:52,226 - INFO - Verified pod ctest-pod-11182554 in contrail-api
2025-04-21 02:04:52,244 - DEBUG - VMI fc82416c-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:52,244 - INFO - Verified Pod ctest-pod-11182554 in agent 10.0.0.56
2025-04-21 02:04:52,245 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=fcfa3e9b-938b-497d-b304-70139d104f9e
2025-04-21 02:04:52,251 - INFO - Pod ctest-pod-11182554 with uuid fcfa3e9b-938b-497d-b304-70139d104f9e found in kube manager
2025-04-21 02:04:52,251 - INFO - Pod ctest-pod-11182554 verification passed
2025-04-21 02:04:52,259 - INFO - Pod ctest-pod-93692788 is in running state.Got IP 10.47.255.246
2025-04-21 02:04:52,317 - DEBUG - Pod ctest-pod-93692788 has vmi fbe7db90-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:52,317 - INFO - Verified pod ctest-pod-93692788 in contrail-api
2025-04-21 02:04:52,334 - DEBUG - VMI fbe7db90-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:52,334 - INFO - Verified Pod ctest-pod-93692788 in agent 10.0.0.56
2025-04-21 02:04:52,334 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=b4d304e3-7368-4d00-be5a-f01f069a842d
2025-04-21 02:04:52,340 - INFO - Pod ctest-pod-93692788 with uuid b4d304e3-7368-4d00-be5a-f01f069a842d found in kube manager
2025-04-21 02:04:52,340 - INFO - Pod ctest-pod-93692788 verification passed
2025-04-21 02:04:52,345 - DEBUG - Pod ctest-pod-10872627 not in running state.Currently in Pending
2025-04-21 02:04:57,352 - INFO - Pod ctest-pod-10872627 is in running state.Got IP 10.47.255.244
2025-04-21 02:04:57,369 - DEBUG - Pod ctest-pod-10872627 has vmi fd13f364-1e54-11f0-bc7c-fa163e117d2e
2025-04-21 02:04:57,369 - INFO - Verified pod ctest-pod-10872627 in contrail-api
2025-04-21 02:04:57,389 - DEBUG - VMI fd13f364-1e54-11f0-bc7c-fa163e117d2e is active in agent 10.0.0.56
2025-04-21 02:04:57,389 - INFO - Verified Pod ctest-pod-10872627 in agent 10.0.0.56
2025-04-21 02:04:57,389 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=57c5ee10-fd02-4d59-9591-ece492c3972d
2025-04-21 02:04:57,396 - INFO - Pod ctest-pod-10872627 with uuid 57c5ee10-fd02-4d59-9591-ece492c3972d found in kube manager
2025-04-21 02:04:57,396 - INFO - Pod ctest-pod-10872627 verification passed
2025-04-21 02:04:57,396 - INFO - ================================================================================
2025-04-21 02:04:57,396 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-21 02:04:57,396 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-21 02:04:57,661 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.57': '0'}} with
2025-04-21 02:04:57,661 - INFO - Initial checks done. Running the testcase now
2025-04-21 02:04:57,661 - INFO -
2025-04-21 02:04:57,724 - DEBUG - [Pod ctest-pod-28818254] Cmd: echo ctest-pod-28818254 > /usr/share/nginx/html/index.html, Output:
2025-04-21 02:04:57,784 - DEBUG - [Pod ctest-pod-27572771] Cmd: echo ctest-pod-27572771 > /usr/share/nginx/html/index.html, Output:
2025-04-21 02:04:57,841 - DEBUG - [Pod ctest-pod-41445158] Cmd: echo ctest-pod-41445158 > /usr/share/nginx/html/index.html, Output:
2025-04-21 02:04:57,892 - DEBUG - [Pod ctest-pod-70683530] Cmd: echo ctest-pod-70683530 > /usr/share/nginx/html/index.html, Output:
2025-04-21 02:04:57,896 - DEBUG - Service ctest-nginx-svc-79687461 not present
2025-04-21 02:04:57,896 - INFO - Creating service ctest-nginx-svc-79687461
2025-04-21 02:04:57,925 - INFO - Created Service ctest-nginx-svc-79687461
2025-04-21 02:04:57,940 - WARNING - Service UUID 1acbed57-fab8-4f5d-9c09-dcbf5a9f6ccf not yet found in contrail-api
2025-04-21 02:04:58,948 - INFO - Validated that Service ctest-nginx-svc-79687461 is seen in contrail-api
2025-04-21 02:04:58,948 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=1acbed57-fab8-4f5d-9c09-dcbf5a9f6ccf
2025-04-21 02:04:58,954 - INFO - Service ctest-nginx-svc-79687461 with uuid 1acbed57-fab8-4f5d-9c09-dcbf5a9f6ccf found in kube manager
2025-04-21 02:04:58,954 - INFO - Service ctest-nginx-svc-79687461 verification passed
2025-04-21 02:05:00,030 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
ctest-pod-28818254
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:00,031 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:05:00,031 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
ctest-pod-28818254
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:00,089 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:00,089 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:05:00,089 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:00,089 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28818254': 1, 'ctest-pod-27572771': 1}
2025-04-21 02:05:00,154 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27572771
2025-04-21 02:05:00,154 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:05:00,154 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27572771
2025-04-21 02:05:00,208 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-28818254
2025-04-21 02:05:00,208 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:05:00,208 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-28818254
2025-04-21 02:05:00,208 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28818254': 1, 'ctest-pod-27572771': 1}
2025-04-21 02:05:00,212 - DEBUG - Network policy ingress-on-service not present
2025-04-21 02:05:00,297 - INFO - Creating Network Policy ingress-on-service
2025-04-21 02:05:00,317 - INFO - Network policy found in k8s
2025-04-21 02:05:00,317 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=42c53840-ae50-4dc7-a686-5d23b12aa0a1
2025-04-21 02:05:00,324 - INFO - Network Policy ingress-on-service with uuid 42c53840-ae50-4dc7-a686-5d23b12aa0a1 found in kube manager
2025-04-21 02:05:00,372 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-21 02:05:00,372 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-21 02:05:00,373 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=42c53840-ae50-4dc7-a686-5d23b12aa0a1
2025-04-21 02:05:00,414 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-21 02:05:02,414 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=42c53840-ae50-4dc7-a686-5d23b12aa0a1
2025-04-21 02:05:02,475 - INFO - Network policy with name ingress-on-service found in agent
2025-04-21 02:05:02,476 - INFO - Network Policy ingress-on-service verification passed
2025-04-21 02:05:07,530 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:07,530 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:07,530 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:12,581 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:12,582 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:12,582 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:17,640 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:17,640 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:17,640 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:22,698 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:22,698 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:22,698 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:27,750 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:27,750 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:27,750 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:32,802 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:32,802 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:32,802 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:37,856 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:37,856 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:37,857 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:42,912 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:42,912 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:42,912 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:47,958 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:47,959 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:47,959 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:53,014 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:53,014 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:53,014 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:53,014 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28818254': 0, 'ctest-pod-27572771': 0}
2025-04-21 02:05:53,077 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:53,078 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:05:53,078 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:53,133 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:53,133 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:05:53,133 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:05:53,133 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28818254': 1, 'ctest-pod-27572771': 1}
2025-04-21 02:05:58,182 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:58,182 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:05:58,182 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:03,234 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:03,234 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:03,234 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:08,287 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:08,287 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:08,287 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:13,342 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:13,342 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:13,342 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:18,401 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:18,401 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:18,401 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:23,466 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:23,466 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:23,466 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:28,526 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:28,526 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:28,526 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:33,579 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:33,579 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:33,579 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:38,629 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:38,630 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:38,630 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:43,687 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:43,688 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:43,688 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:06:43,688 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28818254': 0, 'ctest-pod-27572771': 0}
2025-04-21 02:06:45,751 - DEBUG - [Pod ctest-pod-93692788] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.981 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.102 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.384/0.981 ms
2025-04-21 02:06:45,751 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93692788 with expectation True passed
2025-04-21 02:06:47,803 - DEBUG - [Pod ctest-pod-18842369] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.781 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.326/0.781 ms
2025-04-21 02:06:47,803 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18842369 with expectation True passed
2025-04-21 02:06:49,858 - DEBUG - [Pod ctest-pod-11182554] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.351 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.160/0.351 ms
2025-04-21 02:06:49,858 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11182554 with expectation True passed
2025-04-21 02:06:49,913 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:06:49,913 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-21 02:06:49,913 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:06:49,913 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93692788 passed
2025-04-21 02:06:49,980 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:06:49,980 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-21 02:06:49,980 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:06:49,980 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93692788 passed
2025-04-21 02:06:55,034 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-21 02:06:55,034 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-21 02:06:55,034 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-21 02:06:55,034 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18842369 passed
2025-04-21 02:07:00,091 - DEBUG - [Pod ctest-pod-10872627] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-21 02:07:00,091 - DEBUG - [Pod Pod ctest-pod-10872627] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-21 02:07:00,091 - DEBUG - [Pod Pod ctest-pod-10872627] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-21 02:07:00,091 - INFO - wget check of of http://10.47.255.251 from ctest-pod-10872627 passed
2025-04-21 02:07:00,102 - INFO - Updating Network Policy ingress-on-service
2025-04-21 02:07:05,180 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:05,180 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:05,180 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:10,240 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:10,240 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:10,240 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:15,299 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:15,300 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:15,300 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:20,350 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:20,350 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:20,350 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:25,418 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:25,418 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:25,418 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:30,479 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:30,479 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:30,479 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:35,534 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:35,535 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:35,535 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:40,587 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:40,587 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:40,587 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:45,642 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:45,642 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:45,642 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:50,703 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:50,703 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:50,703 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
wget: download timed out
2025-04-21 02:07:50,703 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28818254': 0, 'ctest-pod-27572771': 0}
2025-04-21 02:07:50,760 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,760 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:07:50,760 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,820 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,820 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:07:50,820 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,877 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27572771
2025-04-21 02:07:50,877 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:07:50,877 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27572771
2025-04-21 02:07:50,877 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28818254': 2, 'ctest-pod-27572771': 1}
2025-04-21 02:07:50,933 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,933 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:07:50,934 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,984 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:50,984 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:07:50,984 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: ctest-pod-27572771
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:51,041 - DEBUG - [Pod ctest-pod-11182554] Cmd: wget http://10.110.123.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:51,041 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd wget http://10.110.123.127:80/ -O - -T 5 -t 1 passed
2025-04-21 02:07:51,041 - DEBUG - [Pod Pod ctest-pod-11182554] Cmd output: ctest-pod-28818254
Connecting to 10.110.123.127:80 (10.110.123.127:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-21 02:07:51,041 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28818254': 1, 'ctest-pod-27572771': 2}
2025-04-21 02:07:53,098 - DEBUG - [Pod ctest-pod-93692788] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.549 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.232/0.549 ms
2025-04-21 02:07:53,098 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93692788 with expectation True passed
2025-04-21 02:07:55,151 - DEBUG - [Pod ctest-pod-18842369] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.685 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.122 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.298/0.685 ms
2025-04-21 02:07:55,151 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18842369 with expectation True passed
2025-04-21 02:07:57,202 - DEBUG - [Pod ctest-pod-11182554] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.139 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.434/1.139 ms
2025-04-21 02:07:57,202 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11182554 with expectation True passed
2025-04-21 02:07:57,258 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:07:57,258 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-21 02:07:57,259 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:07:57,259 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93692788 passed
2025-04-21 02:07:57,316 - DEBUG - [Pod ctest-pod-93692788] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:07:57,316 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-21 02:07:57,316 - DEBUG - [Pod Pod ctest-pod-93692788] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:07:57,316 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93692788 passed
2025-04-21 02:08:02,368 - DEBUG - [Pod ctest-pod-18842369] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-21 02:08:02,368 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-21 02:08:02,368 - DEBUG - [Pod Pod ctest-pod-18842369] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-21 02:08:02,368 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18842369 passed
2025-04-21 02:08:02,429 - DEBUG - [Pod ctest-pod-10872627] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:08:02,429 - DEBUG - [Pod Pod ctest-pod-10872627] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-21 02:08:02,429 - DEBUG - [Pod Pod ctest-pod-10872627] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-21 02:08:02,429 - INFO - wget check of of http://10.47.255.251 from ctest-pod-10872627 passed
2025-04-21 02:08:02,429 - INFO - Deleting Network Policy : ingress-on-service
2025-04-21 02:08:02,430 - INFO - Deleting service : ctest-nginx-svc-79687461
2025-04-21 02:08:02,697 - DEBUG - No XMPP flaps were noticed during the test
2025-04-21 02:08:02,698 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05]
2025-04-21 02:08:02,699 - INFO - --------------------------------------------------------------------------------
2025-04-21 02:08:02,707 - INFO - Deleting pod ctest-new-default-30028832:ctest-pod-28818254
2025-04-21 02:08:02,710 - INFO - Deleting pod ctest-new-default-30028832:ctest-pod-27572771
2025-04-21 02:08:02,710 - INFO - Deleting pod ctest-non-default-49963468:ctest-pod-41445158
2025-04-21 02:08:02,711 - INFO - Deleting pod ctest-non-default-49963468:ctest-pod-70683530
2025-04-21 02:08:02,712 - INFO - Deleting pod ctest-new-default-30028832:ctest-pod-18842369
2025-04-21 02:08:02,712 - INFO - Deleting pod ctest-new-default-30028832:ctest-pod-93692788
2025-04-21 02:08:02,713 - INFO - Deleting pod ctest-non-default-49963468:ctest-pod-11182554
2025-04-21 02:08:02,714 - INFO - Deleting pod ctest-non-default-49963468:ctest-pod-10872627
2025-04-21 02:08:02,956 - WARNING - Pod uuid 57f822f0-6f2f-4fe0-bf4b-c9d971e2ad95 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,957 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,960 - WARNING - Pod uuid 0263771a-9ab8-4ae1-8713-e98ca5d8c6fd is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,960 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,960 - WARNING - Pod uuid c701f1a7-8b6e-4e9f-bbfb-b3baa05f116a is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,961 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,961 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:02,961 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:08,004 - DEBUG - Pod 57f822f0-6f2f-4fe0-bf4b-c9d971e2ad95 is not in agent 10.0.0.56 VM list
2025-04-21 02:08:08,009 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:08,009 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:08,009 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:08,010 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:08,010 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:08,010 - DEBUG - Pod c701f1a7-8b6e-4e9f-bbfb-b3baa05f116a is not in agent 10.0.0.56 VM list
2025-04-21 02:08:08,012 - DEBUG - Pod 0263771a-9ab8-4ae1-8713-e98ca5d8c6fd is not in agent 10.0.0.56 VM list
2025-04-21 02:08:08,025 - DEBUG - VMI fa1e620c-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:08,025 - INFO - Verified that pod ctest-pod-41445158 is removed in agent
2025-04-21 02:08:08,025 - DEBUG - VMI faaf99d4-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:08,025 - INFO - Verified that pod ctest-pod-70683530 is removed in agent
2025-04-21 02:08:08,026 - DEBUG - VMI f8bc5eaa-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:08,026 - INFO - Verified that pod ctest-pod-28818254 is removed in agent
2025-04-21 02:08:13,035 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:13,036 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:13,036 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:13,038 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:13,038 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:18,070 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:18,071 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:18,073 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:18,074 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:18,074 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:23,100 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:23,100 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:23,101 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:23,104 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:23,105 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:28,127 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:28,127 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:28,129 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:28,130 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:28,130 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:33,227 - WARNING - Pod uuid b4d304e3-7368-4d00-be5a-f01f069a842d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:33,228 - WARNING - Pod uuid fcfa3e9b-938b-497d-b304-70139d104f9e is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:33,228 - WARNING - Pod uuid 72f5267e-baaa-41f6-944c-b8d23e3581b7 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:33,230 - WARNING - Pod uuid 57c5ee10-fd02-4d59-9591-ece492c3972d is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:33,230 - WARNING - Pod uuid a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is still seen in agent 10.0.0.56 VM list
2025-04-21 02:08:38,252 - DEBUG - Pod 57c5ee10-fd02-4d59-9591-ece492c3972d is not in agent 10.0.0.56 VM list
2025-04-21 02:08:38,255 - DEBUG - Pod fcfa3e9b-938b-497d-b304-70139d104f9e is not in agent 10.0.0.56 VM list
2025-04-21 02:08:38,262 - DEBUG - Pod a2834c1e-ecb0-463c-937d-4fc0cf445ad9 is not in agent 10.0.0.56 VM list
2025-04-21 02:08:38,267 - DEBUG - Pod b4d304e3-7368-4d00-be5a-f01f069a842d is not in agent 10.0.0.56 VM list
2025-04-21 02:08:38,269 - DEBUG - Pod 72f5267e-baaa-41f6-944c-b8d23e3581b7 is not in agent 10.0.0.56 VM list
2025-04-21 02:08:38,288 - DEBUG - VMI fb561e9e-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:38,288 - INFO - Verified that pod ctest-pod-18842369 is removed in agent
2025-04-21 02:08:38,289 - DEBUG - VMI fd13f364-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:38,289 - INFO - Verified that pod ctest-pod-10872627 is removed in agent
2025-04-21 02:08:38,291 - DEBUG - VMI f9438cc2-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:38,292 - INFO - Verified that pod ctest-pod-27572771 is removed in agent
2025-04-21 02:08:38,292 - DEBUG - VMI fbe7db90-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:38,292 - INFO - Verified that pod ctest-pod-93692788 is removed in agent
2025-04-21 02:08:38,293 - DEBUG - VMI fc82416c-1e54-11f0-bc7c-fa163e117d2e is removed from agent 10.0.0.56
2025-04-21 02:08:38,293 - INFO - Verified that pod ctest-pod-11182554 is removed in agent
2025-04-21 02:08:38,293 - INFO - Deleting namespace ctest-non-default-49963468
2025-04-21 02:08:38,313 - DEBUG - Namespace ctest-non-default-49963468 still in k8s
2025-04-21 02:08:40,318 - DEBUG - Namespace ctest-non-default-49963468 still in k8s
2025-04-21 02:08:42,325 - DEBUG - Namespace ctest-non-default-49963468 still in k8s
2025-04-21 02:08:44,332 - DEBUG - Namespace ctest-non-default-49963468 is not in k8s
2025-04-21 02:08:44,332 - DEBUG - No need to check project deletion in contrail-api
2025-04-21 02:08:44,332 - INFO - Deleting namespace ctest-new-default-30028832
2025-04-21 02:08:44,350 - DEBUG - Namespace ctest-new-default-30028832 still in k8s
2025-04-21 02:08:46,355 - DEBUG - Namespace ctest-new-default-30028832 still in k8s
2025-04-21 02:08:48,361 - DEBUG - Namespace ctest-new-default-30028832 still in k8s
2025-04-21 02:08:50,367 - DEBUG - Namespace ctest-new-default-30028832 is not in k8s
2025-04-21 02:08:50,367 - DEBUG - No need to check project deletion in contrail-api