2024-09-04 23:00:00,881 - INFO - Using existing project ['default-domain', 'k8s-default'](d8b42122-de76-4ae7-9527-809a18da0730)
2024-09-04 23:00:00,902 - DEBUG - Namespace ctest-new-default-80208362 not present
2024-09-04 23:00:00,922 - INFO - Created namespace ctest-new-default-80208362
2024-09-04 23:00:03,928 - DEBUG - Namespace ctest-non-default-74078218 not present
2024-09-04 23:00:03,939 - INFO - Created namespace ctest-non-default-74078218
2024-09-04 23:00:06,977 - DEBUG - Pod ctest-pod-79035624 not present
2024-09-04 23:00:06,977 - INFO - Creating Pod ctest-pod-79035624
2024-09-04 23:00:07,008 - DEBUG - Node for Pod ctest-pod-79035624 not yet populated
2024-09-04 23:00:10,025 - DEBUG - Pod : ctest-pod-79035624 UUID is 8a150a59-ff30-478d-a05f-bd701c4448d9
2024-09-04 23:00:10,028 - DEBUG - Pod ctest-pod-64216747 not present
2024-09-04 23:00:10,028 - INFO - Creating Pod ctest-pod-64216747
2024-09-04 23:00:10,044 - DEBUG - Node for Pod ctest-pod-64216747 not yet populated
2024-09-04 23:00:13,051 - DEBUG - Pod : ctest-pod-64216747 UUID is a79e8b64-1f47-4f32-80f5-f030567bf1d3
2024-09-04 23:00:13,054 - DEBUG - Pod ctest-pod-13484490 not present
2024-09-04 23:00:13,054 - INFO - Creating Pod ctest-pod-13484490
2024-09-04 23:00:13,076 - DEBUG - Pod : ctest-pod-13484490 UUID is ae10ab06-e7cf-41b6-ab57-013556c454a3
2024-09-04 23:00:13,086 - DEBUG - Pod ctest-pod-75908837 not present
2024-09-04 23:00:13,091 - INFO - Creating Pod ctest-pod-75908837
2024-09-04 23:00:13,111 - DEBUG - Pod : ctest-pod-75908837 UUID is 050d03bc-3591-4b0f-8c1b-e7df48be5eb8
2024-09-04 23:00:13,114 - DEBUG - Pod ctest-pod-49437407 not present
2024-09-04 23:00:13,114 - INFO - Creating Pod ctest-pod-49437407
2024-09-04 23:00:13,148 - DEBUG - Pod : ctest-pod-49437407 UUID is aab13e72-88ec-47cf-8ea6-cf533d25939f
2024-09-04 23:00:13,152 - DEBUG - Pod ctest-pod-51634415 not present
2024-09-04 23:00:13,153 - INFO - Creating Pod ctest-pod-51634415
2024-09-04 23:00:13,178 - DEBUG - Pod : ctest-pod-51634415 UUID is 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5
2024-09-04 23:00:13,184 - DEBUG - Pod ctest-pod-10868455 not present
2024-09-04 23:00:13,185 - INFO - Creating Pod ctest-pod-10868455
2024-09-04 23:00:13,226 - DEBUG - Pod : ctest-pod-10868455 UUID is ff2fcdec-e290-4b7a-83b1-3d30e343a230
2024-09-04 23:00:13,233 - DEBUG - Pod ctest-pod-88175283 not present
2024-09-04 23:00:13,233 - INFO - Creating Pod ctest-pod-88175283
2024-09-04 23:00:13,260 - DEBUG - Pod : ctest-pod-88175283 UUID is 9f034c14-3bd4-4a8a-a554-10c2a18f5e68
2024-09-04 23:00:13,489 - INFO - Project default-domain:k8s-ctest-new-default-80208362 for Namespace ctest-new-default-80208362 is seen in contrail-api
2024-09-04 23:00:13,489 - DEBUG - Project uuid in Contrail is 9384998a-b65b-46fc-82c0-1c99b4bde23f
2024-09-04 23:00:13,708 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_NamespaceDatabaseList?namespace_uuid=4c4b71bf-fa5a-4c32-80f1-4eccd0d6bd9f
2024-09-04 23:00:13,722 - INFO - Namespace ctest-new-default-80208362 with uuid 4c4b71bf-fa5a-4c32-80f1-4eccd0d6bd9f found in kube manager
2024-09-04 23:00:13,723 - INFO - Namespace ctest-new-default-80208362 verification passed
2024-09-04 23:00:14,054 - INFO - Project default-domain:k8s-ctest-non-default-74078218 for Namespace ctest-non-default-74078218 is seen in contrail-api
2024-09-04 23:00:14,055 - DEBUG - Project uuid in Contrail is 49e39cec-4214-4cea-b671-86c070d137cc
2024-09-04 23:00:14,055 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_NamespaceDatabaseList?namespace_uuid=9e664a6c-6c1c-404d-acb7-14087491a794
2024-09-04 23:00:14,068 - INFO - Namespace ctest-non-default-74078218 with uuid 9e664a6c-6c1c-404d-acb7-14087491a794 found in kube manager
2024-09-04 23:00:14,068 - INFO - Namespace ctest-non-default-74078218 verification passed
2024-09-04 23:00:14,075 - DEBUG - Pod ctest-pod-79035624 not in running state.Currently in Pending
2024-09-04 23:00:19,082 - INFO - Pod ctest-pod-79035624 is in running state.Got IP 10.47.255.251
2024-09-04 23:00:19,094 - DEBUG - Pod ctest-pod-79035624 has vmi 6e9b7680-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:19,094 - INFO - Verified pod ctest-pod-79035624 in contrail-api
2024-09-04 23:00:19,110 - DEBUG - VMI 6e9b7680-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:19,111 - INFO - Verified Pod ctest-pod-79035624 in agent 10.0.0.45
2024-09-04 23:00:19,111 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=8a150a59-ff30-478d-a05f-bd701c4448d9
2024-09-04 23:00:19,119 - INFO - Pod ctest-pod-79035624 with uuid 8a150a59-ff30-478d-a05f-bd701c4448d9 found in kube manager
2024-09-04 23:00:19,119 - INFO - Pod ctest-pod-79035624 verification passed
2024-09-04 23:00:19,124 - DEBUG - Pod ctest-pod-64216747 not in running state.Currently in Pending
2024-09-04 23:00:24,131 - INFO - Pod ctest-pod-64216747 is in running state.Got IP 10.47.255.250
2024-09-04 23:00:24,142 - DEBUG - Pod ctest-pod-64216747 has vmi 6f94166e-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:24,142 - INFO - Verified pod ctest-pod-64216747 in contrail-api
2024-09-04 23:00:24,159 - DEBUG - VMI 6f94166e-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:24,159 - INFO - Verified Pod ctest-pod-64216747 in agent 10.0.0.45
2024-09-04 23:00:24,159 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=a79e8b64-1f47-4f32-80f5-f030567bf1d3
2024-09-04 23:00:24,164 - INFO - Pod ctest-pod-64216747 with uuid a79e8b64-1f47-4f32-80f5-f030567bf1d3 found in kube manager
2024-09-04 23:00:24,164 - INFO - Pod ctest-pod-64216747 verification passed
2024-09-04 23:00:24,170 - DEBUG - Pod ctest-pod-13484490 not in running state.Currently in Pending
2024-09-04 23:00:29,178 - INFO - Pod ctest-pod-13484490 is in running state.Got IP 10.47.255.249
2024-09-04 23:00:29,231 - DEBUG - Pod ctest-pod-13484490 has vmi 71a66a92-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:29,231 - INFO - Verified pod ctest-pod-13484490 in contrail-api
2024-09-04 23:00:29,245 - DEBUG - VMI 71a66a92-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:29,245 - INFO - Verified Pod ctest-pod-13484490 in agent 10.0.0.45
2024-09-04 23:00:29,245 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=ae10ab06-e7cf-41b6-ab57-013556c454a3
2024-09-04 23:00:29,250 - INFO - Pod ctest-pod-13484490 with uuid ae10ab06-e7cf-41b6-ab57-013556c454a3 found in kube manager
2024-09-04 23:00:29,251 - INFO - Pod ctest-pod-13484490 verification passed
2024-09-04 23:00:29,256 - INFO - Pod ctest-pod-75908837 is in running state.Got IP 10.47.255.248
2024-09-04 23:00:29,267 - DEBUG - Pod ctest-pod-75908837 has vmi 723a4ad2-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:29,268 - INFO - Verified pod ctest-pod-75908837 in contrail-api
2024-09-04 23:00:29,280 - DEBUG - VMI 723a4ad2-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:29,280 - INFO - Verified Pod ctest-pod-75908837 in agent 10.0.0.45
2024-09-04 23:00:29,280 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=050d03bc-3591-4b0f-8c1b-e7df48be5eb8
2024-09-04 23:00:29,285 - INFO - Pod ctest-pod-75908837 with uuid 050d03bc-3591-4b0f-8c1b-e7df48be5eb8 found in kube manager
2024-09-04 23:00:29,285 - INFO - Pod ctest-pod-75908837 verification passed
2024-09-04 23:00:29,290 - INFO - Pod ctest-pod-49437407 is in running state.Got IP 10.47.255.247
2024-09-04 23:00:29,343 - DEBUG - Pod ctest-pod-49437407 has vmi 72ed99b6-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:29,343 - INFO - Verified pod ctest-pod-49437407 in contrail-api
2024-09-04 23:00:29,355 - DEBUG - VMI 72ed99b6-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:29,356 - INFO - Verified Pod ctest-pod-49437407 in agent 10.0.0.45
2024-09-04 23:00:29,356 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=aab13e72-88ec-47cf-8ea6-cf533d25939f
2024-09-04 23:00:29,361 - INFO - Pod ctest-pod-49437407 with uuid aab13e72-88ec-47cf-8ea6-cf533d25939f found in kube manager
2024-09-04 23:00:29,361 - INFO - Pod ctest-pod-49437407 verification passed
2024-09-04 23:00:29,369 - INFO - Pod ctest-pod-10868455 is in running state.Got IP 10.47.255.245
2024-09-04 23:00:29,380 - DEBUG - Pod ctest-pod-10868455 has vmi 742014d0-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:29,380 - INFO - Verified pod ctest-pod-10868455 in contrail-api
2024-09-04 23:00:29,393 - DEBUG - VMI 742014d0-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:29,393 - INFO - Verified Pod ctest-pod-10868455 in agent 10.0.0.45
2024-09-04 23:00:29,393 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=ff2fcdec-e290-4b7a-83b1-3d30e343a230
2024-09-04 23:00:29,398 - INFO - Pod ctest-pod-10868455 with uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 found in kube manager
2024-09-04 23:00:29,398 - INFO - Pod ctest-pod-10868455 verification passed
2024-09-04 23:00:29,404 - INFO - Pod ctest-pod-51634415 is in running state.Got IP 10.47.255.246
2024-09-04 23:00:29,461 - DEBUG - Pod ctest-pod-51634415 has vmi 739858f6-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:29,461 - INFO - Verified pod ctest-pod-51634415 in contrail-api
2024-09-04 23:00:29,473 - DEBUG - VMI 739858f6-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:29,474 - INFO - Verified Pod ctest-pod-51634415 in agent 10.0.0.45
2024-09-04 23:00:29,474 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5
2024-09-04 23:00:29,478 - INFO - Pod ctest-pod-51634415 with uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 found in kube manager
2024-09-04 23:00:29,478 - INFO - Pod ctest-pod-51634415 verification passed
2024-09-04 23:00:29,484 - INFO - Pod ctest-pod-88175283 is in running state.Got IP 10.47.255.244
2024-09-04 23:00:29,534 - DEBUG - Pod ctest-pod-88175283 has vmi 7495c50e-6b11-11ef-85a2-fa163ecdd919
2024-09-04 23:00:29,535 - INFO - Verified pod ctest-pod-88175283 in contrail-api
2024-09-04 23:00:29,548 - DEBUG - VMI 7495c50e-6b11-11ef-85a2-fa163ecdd919 is active in agent 10.0.0.45
2024-09-04 23:00:29,548 - INFO - Verified Pod ctest-pod-88175283 in agent 10.0.0.45
2024-09-04 23:00:29,548 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_VirtualMachineDatabaseList?x=9f034c14-3bd4-4a8a-a554-10c2a18f5e68
2024-09-04 23:00:29,553 - INFO - Pod ctest-pod-88175283 with uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 found in kube manager
2024-09-04 23:00:29,553 - INFO - Pod ctest-pod-88175283 verification passed
2024-09-04 23:00:29,553 - INFO - ================================================================================
2024-09-04 23:00:29,553 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-04 23:00:29,553 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-04 23:00:30,064 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.54': '0'}} with
2024-09-04 23:00:30,064 - INFO - Initial checks done. Running the testcase now
2024-09-04 23:00:30,064 - INFO -
2024-09-04 23:00:30,155 - DEBUG - [Pod ctest-pod-79035624] Cmd: echo ctest-pod-79035624 > /usr/share/nginx/html/index.html, Output:
2024-09-04 23:00:30,224 - DEBUG - [Pod ctest-pod-64216747] Cmd: echo ctest-pod-64216747 > /usr/share/nginx/html/index.html, Output:
2024-09-04 23:00:30,297 - DEBUG - [Pod ctest-pod-13484490] Cmd: echo ctest-pod-13484490 > /usr/share/nginx/html/index.html, Output:
2024-09-04 23:00:30,367 - DEBUG - [Pod ctest-pod-75908837] Cmd: echo ctest-pod-75908837 > /usr/share/nginx/html/index.html, Output:
2024-09-04 23:00:30,370 - DEBUG - Service ctest-nginx-svc-66496725 not present
2024-09-04 23:00:30,371 - INFO - Creating service ctest-nginx-svc-66496725
2024-09-04 23:00:30,390 - INFO - Created Service ctest-nginx-svc-66496725
2024-09-04 23:00:30,401 - WARNING - Service UUID e2a8e236-ba53-4a7f-8401-a26313157ec7 not yet found in contrail-api
2024-09-04 23:00:31,419 - INFO - Validated that Service ctest-nginx-svc-66496725 is seen in contrail-api
2024-09-04 23:00:31,419 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_LoadbalancerDatabaseList?x=e2a8e236-ba53-4a7f-8401-a26313157ec7
2024-09-04 23:00:31,425 - INFO - Service ctest-nginx-svc-66496725 with uuid e2a8e236-ba53-4a7f-8401-a26313157ec7 found in kube manager
2024-09-04 23:00:31,426 - INFO - Service ctest-nginx-svc-66496725 verification passed
2024-09-04 23:00:32,511 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64216747
2024-09-04 23:00:32,511 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:00:32,511 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64216747
2024-09-04 23:00:32,569 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64216747
2024-09-04 23:00:32,570 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:00:32,570 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64216747
2024-09-04 23:00:32,646 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:00:32,646 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:00:32,646 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:00:32,646 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79035624': 1, 'ctest-pod-64216747': 2}
2024-09-04 23:00:32,708 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-64216747
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:00:32,709 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:00:32,709 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: ctest-pod-64216747
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:00:32,785 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:00:32,785 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:00:32,785 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:00:32,785 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79035624': 1, 'ctest-pod-64216747': 1}
2024-09-04 23:00:32,789 - DEBUG - Network policy ingress-on-service not present
2024-09-04 23:00:32,790 - INFO - Creating Network Policy ingress-on-service
2024-09-04 23:00:32,802 - INFO - Network policy found in k8s
2024-09-04 23:00:32,803 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6cfa2018-f9e1-49e0-87c7-222018cf8344
2024-09-04 23:00:32,808 - INFO - Network Policy ingress-on-service with uuid 6cfa2018-f9e1-49e0-87c7-222018cf8344 found in kube manager
2024-09-04 23:00:32,845 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-04 23:00:32,845 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-04 23:00:32,845 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6cfa2018-f9e1-49e0-87c7-222018cf8344
2024-09-04 23:00:32,892 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-04 23:00:34,894 - DEBUG - Requesting: http://10.0.0.54:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6cfa2018-f9e1-49e0-87c7-222018cf8344
2024-09-04 23:00:34,928 - INFO - Network policy with name ingress-on-service found in agent
2024-09-04 23:00:34,928 - INFO - Network Policy ingress-on-service verification passed
2024-09-04 23:00:39,992 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:39,992 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:39,993 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:45,061 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:45,061 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:45,061 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:50,137 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:50,137 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:50,137 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:55,218 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:55,219 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:00:55,219 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:00,279 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:00,279 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:00,279 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:05,356 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:05,356 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:05,356 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:10,422 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:10,422 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:10,422 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:15,484 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:15,484 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:15,484 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:20,549 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:20,549 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:20,549 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:25,614 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:25,614 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:25,614 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:25,614 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79035624': 0, 'ctest-pod-64216747': 0}
2024-09-04 23:01:25,672 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:01:25,672 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:01:25,672 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:01:25,724 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
ctest-pod-64216747
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:01:25,724 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:01:25,724 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
ctest-pod-64216747
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:01:25,724 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79035624': 1, 'ctest-pod-64216747': 1}
2024-09-04 23:01:30,777 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:30,777 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:30,777 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:35,839 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:35,839 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:35,839 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:40,892 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:40,892 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:40,892 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:45,969 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:45,970 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:45,970 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:51,049 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:51,049 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:51,049 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:56,122 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:56,122 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:01:56,122 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:01,176 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:01,177 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:01,177 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:06,236 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:06,236 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:06,236 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:11,309 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:11,309 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:11,309 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:16,379 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:16,379 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:16,379 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:16,379 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79035624': 0, 'ctest-pod-64216747': 0}
2024-09-04 23:02:18,440 - DEBUG - [Pod ctest-pod-51634415] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.657 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.270/0.657 ms
2024-09-04 23:02:18,440 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-51634415 with expectation True passed
2024-09-04 23:02:20,507 - DEBUG - [Pod ctest-pod-49437407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.390 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.178/0.390 ms
2024-09-04 23:02:20,507 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49437407 with expectation True passed
2024-09-04 23:02:22,570 - DEBUG - [Pod ctest-pod-10868455] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.669 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.058/0.599/1.669 ms
2024-09-04 23:02:22,571 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10868455 with expectation True passed
2024-09-04 23:02:22,622 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:02:22,622 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 23:02:22,622 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:02:22,622 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51634415 passed
2024-09-04 23:02:22,675 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:02:22,675 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-04 23:02:22,676 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:02:22,676 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51634415 passed
2024-09-04 23:02:27,744 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 23:02:27,744 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 23:02:27,744 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 23:02:27,744 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49437407 passed
2024-09-04 23:02:32,811 - DEBUG - [Pod ctest-pod-88175283] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 23:02:32,811 - DEBUG - [Pod Pod ctest-pod-88175283] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 23:02:32,811 - DEBUG - [Pod Pod ctest-pod-88175283] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 23:02:32,811 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88175283 passed
2024-09-04 23:02:32,819 - INFO - Updating Network Policy ingress-on-service
2024-09-04 23:02:37,892 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:37,892 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:37,892 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:43,047 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:43,047 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:43,047 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:48,119 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:48,120 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:48,120 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:53,190 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:53,190 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:53,190 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:58,257 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:58,257 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:02:58,257 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:03,311 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:03,311 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:03,311 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:08,386 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:08,386 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:08,386 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:13,440 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:13,440 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:13,440 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:18,500 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:18,500 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:18,500 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:23,564 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:23,564 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:23,564 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.108.101.125:80 (10.108.101.125:80)
wget: download timed out
2024-09-04 23:03:23,564 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79035624': 0, 'ctest-pod-64216747': 0}
2024-09-04 23:03:23,637 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-64216747
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,637 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:03:23,637 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: ctest-pod-64216747
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,702 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,702 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:03:23,702 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,702 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79035624': 1, 'ctest-pod-64216747': 1}
2024-09-04 23:03:23,766 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-64216747
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,766 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:03:23,766 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: ctest-pod-64216747
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,836 - DEBUG - [Pod ctest-pod-10868455] Cmd: wget http://10.108.101.125:80/ -O - -T 5 -t 1 , Output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,836 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd wget http://10.108.101.125:80/ -O - -T 5 -t 1 passed
2024-09-04 23:03:23,836 - DEBUG - [Pod Pod ctest-pod-10868455] Cmd output: ctest-pod-79035624
Connecting to 10.108.101.125:80 (10.108.101.125:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 23:03:23,836 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79035624': 1, 'ctest-pod-64216747': 1}
2024-09-04 23:03:25,908 - DEBUG - [Pod ctest-pod-51634415] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.141 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.104 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.441/1.141 ms
2024-09-04 23:03:25,908 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-51634415 with expectation True passed
2024-09-04 23:03:28,000 - DEBUG - [Pod ctest-pod-49437407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.816 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.324/0.816 ms
2024-09-04 23:03:28,000 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49437407 with expectation True passed
2024-09-04 23:03:30,073 - DEBUG - [Pod ctest-pod-10868455] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.208 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.455/1.208 ms
2024-09-04 23:03:30,073 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10868455 with expectation True passed
2024-09-04 23:03:30,146 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:03:30,147 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 23:03:30,147 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:03:30,147 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51634415 passed
2024-09-04 23:03:30,205 - DEBUG - [Pod ctest-pod-51634415] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:03:30,206 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-04 23:03:30,206 - DEBUG - [Pod Pod ctest-pod-51634415] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:03:30,206 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51634415 passed
2024-09-04 23:03:35,266 - DEBUG - [Pod ctest-pod-49437407] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 23:03:35,266 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 23:03:35,266 - DEBUG - [Pod Pod ctest-pod-49437407] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 23:03:35,266 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49437407 passed
2024-09-04 23:03:35,330 - DEBUG - [Pod ctest-pod-88175283] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:03:35,330 - DEBUG - [Pod Pod ctest-pod-88175283] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 23:03:35,330 - DEBUG - [Pod Pod ctest-pod-88175283] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 23:03:35,330 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88175283 passed
2024-09-04 23:03:35,330 - INFO - Deleting Network Policy : ingress-on-service
2024-09-04 23:03:35,331 - INFO - Deleting service : ctest-nginx-svc-66496725
2024-09-04 23:03:35,578 - DEBUG - No XMPP flaps were noticed during the test
2024-09-04 23:03:35,579 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-09-04 23:03:35,579 - INFO - --------------------------------------------------------------------------------
2024-09-04 23:03:35,585 - INFO - Deleting pod ctest-new-default-80208362:ctest-pod-79035624
2024-09-04 23:03:35,585 - INFO - Deleting pod ctest-new-default-80208362:ctest-pod-64216747
2024-09-04 23:03:35,586 - INFO - Deleting pod ctest-non-default-74078218:ctest-pod-13484490
2024-09-04 23:03:35,586 - INFO - Deleting pod ctest-non-default-74078218:ctest-pod-75908837
2024-09-04 23:03:35,586 - INFO - Deleting pod ctest-new-default-80208362:ctest-pod-49437407
2024-09-04 23:03:35,587 - INFO - Deleting pod ctest-new-default-80208362:ctest-pod-51634415
2024-09-04 23:03:35,587 - INFO - Deleting pod ctest-non-default-74078218:ctest-pod-10868455
2024-09-04 23:03:35,588 - INFO - Deleting pod ctest-non-default-74078218:ctest-pod-88175283
2024-09-04 23:03:35,641 - WARNING - Pod uuid 8a150a59-ff30-478d-a05f-bd701c4448d9 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,753 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,755 - WARNING - Pod uuid 050d03bc-3591-4b0f-8c1b-e7df48be5eb8 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,755 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,757 - WARNING - Pod uuid a79e8b64-1f47-4f32-80f5-f030567bf1d3 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,758 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,759 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:35,759 - WARNING - Pod uuid ae10ab06-e7cf-41b6-ab57-013556c454a3 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:40,649 - DEBUG - Pod 8a150a59-ff30-478d-a05f-bd701c4448d9 is not in agent 10.0.0.45 VM list
2024-09-04 23:03:40,655 - DEBUG - VMI 6e9b7680-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:03:40,655 - INFO - Verified that pod ctest-pod-79035624 is removed in agent
2024-09-04 23:03:40,783 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:40,784 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:40,784 - DEBUG - Pod 050d03bc-3591-4b0f-8c1b-e7df48be5eb8 is not in agent 10.0.0.45 VM list
2024-09-04 23:03:40,786 - DEBUG - Pod a79e8b64-1f47-4f32-80f5-f030567bf1d3 is not in agent 10.0.0.45 VM list
2024-09-04 23:03:40,789 - DEBUG - Pod ae10ab06-e7cf-41b6-ab57-013556c454a3 is not in agent 10.0.0.45 VM list
2024-09-04 23:03:40,791 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:40,791 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:40,801 - DEBUG - VMI 723a4ad2-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:03:40,801 - INFO - Verified that pod ctest-pod-75908837 is removed in agent
2024-09-04 23:03:40,803 - DEBUG - VMI 71a66a92-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:03:40,803 - INFO - Verified that pod ctest-pod-13484490 is removed in agent
2024-09-04 23:03:40,804 - DEBUG - VMI 6f94166e-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:03:40,804 - INFO - Verified that pod ctest-pod-64216747 is removed in agent
2024-09-04 23:03:45,802 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:45,803 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:45,804 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:45,805 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:50,824 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:50,826 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:50,827 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:50,827 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:55,842 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:55,844 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:55,844 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:03:55,845 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:00,865 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:00,868 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:00,868 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:00,869 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:05,907 - WARNING - Pod uuid ff2fcdec-e290-4b7a-83b1-3d30e343a230 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:05,910 - WARNING - Pod uuid 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:05,910 - WARNING - Pod uuid aab13e72-88ec-47cf-8ea6-cf533d25939f is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:05,910 - WARNING - Pod uuid 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is still seen in agent 10.0.0.45 VM list
2024-09-04 23:04:10,928 - DEBUG - Pod 7b8c68ac-0fb5-4ef6-adf1-10673b43c6c5 is not in agent 10.0.0.45 VM list
2024-09-04 23:04:10,933 - DEBUG - Pod ff2fcdec-e290-4b7a-83b1-3d30e343a230 is not in agent 10.0.0.45 VM list
2024-09-04 23:04:10,934 - DEBUG - Pod aab13e72-88ec-47cf-8ea6-cf533d25939f is not in agent 10.0.0.45 VM list
2024-09-04 23:04:10,936 - DEBUG - Pod 9f034c14-3bd4-4a8a-a554-10c2a18f5e68 is not in agent 10.0.0.45 VM list
2024-09-04 23:04:10,949 - DEBUG - VMI 739858f6-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:04:10,949 - INFO - Verified that pod ctest-pod-51634415 is removed in agent
2024-09-04 23:04:10,951 - DEBUG - VMI 742014d0-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:04:10,951 - INFO - Verified that pod ctest-pod-10868455 is removed in agent
2024-09-04 23:04:10,952 - DEBUG - VMI 72ed99b6-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:04:10,952 - INFO - Verified that pod ctest-pod-49437407 is removed in agent
2024-09-04 23:04:10,952 - DEBUG - VMI 7495c50e-6b11-11ef-85a2-fa163ecdd919 is removed from agent 10.0.0.45
2024-09-04 23:04:10,952 - INFO - Verified that pod ctest-pod-88175283 is removed in agent
2024-09-04 23:04:10,953 - INFO - Deleting namespace ctest-non-default-74078218
2024-09-04 23:04:10,977 - DEBUG - Namespace ctest-non-default-74078218 still in k8s
2024-09-04 23:04:12,982 - DEBUG - Namespace ctest-non-default-74078218 still in k8s
2024-09-04 23:04:14,986 - DEBUG - Namespace ctest-non-default-74078218 still in k8s
2024-09-04 23:04:16,991 - DEBUG - Namespace ctest-non-default-74078218 is not in k8s
2024-09-04 23:04:16,992 - DEBUG - No need to check project deletion in contrail-api
2024-09-04 23:04:16,992 - INFO - Deleting namespace ctest-new-default-80208362
2024-09-04 23:04:17,003 - DEBUG - Namespace ctest-new-default-80208362 still in k8s
2024-09-04 23:04:19,015 - DEBUG - Namespace ctest-new-default-80208362 still in k8s
2024-09-04 23:04:21,020 - DEBUG - Namespace ctest-new-default-80208362 still in k8s
2024-09-04 23:04:23,027 - DEBUG - Namespace ctest-new-default-80208362 is not in k8s
2024-09-04 23:04:23,027 - DEBUG - No need to check project deletion in contrail-api