2024-09-17 22:34:55,824 - INFO - Using existing project ['default-domain', 'k8s-default'](a2bdbc80-f177-421b-82c0-364592f62a6f)
2024-09-17 22:34:55,854 - DEBUG - Namespace ctest-new-default-16831289 not present
2024-09-17 22:34:55,868 - INFO - Created namespace ctest-new-default-16831289
2024-09-17 22:34:58,873 - DEBUG - Namespace ctest-non-default-21469209 not present
2024-09-17 22:34:58,891 - INFO - Created namespace ctest-non-default-21469209
2024-09-17 22:35:01,941 - DEBUG - Pod ctest-pod-72154375 not present
2024-09-17 22:35:01,942 - INFO - Creating Pod ctest-pod-72154375
2024-09-17 22:35:01,987 - DEBUG - Pod : ctest-pod-72154375 UUID is 99a0f06c-a220-4644-b0e7-aac0f6247d63
2024-09-17 22:35:02,007 - DEBUG - Pod ctest-pod-03983026 not present
2024-09-17 22:35:02,008 - INFO - Creating Pod ctest-pod-03983026
2024-09-17 22:35:02,046 - DEBUG - Pod : ctest-pod-03983026 UUID is 8442a023-d589-45d6-9b2d-a99781b4ad78
2024-09-17 22:35:02,048 - DEBUG - Pod ctest-pod-58518173 not present
2024-09-17 22:35:02,049 - INFO - Creating Pod ctest-pod-58518173
2024-09-17 22:35:02,108 - DEBUG - Pod : ctest-pod-58518173 UUID is 1659c5c0-0574-4a94-bf3c-e4c77e283cf0
2024-09-17 22:35:02,111 - DEBUG - Pod ctest-pod-46757181 not present
2024-09-17 22:35:02,112 - INFO - Creating Pod ctest-pod-46757181
2024-09-17 22:35:02,141 - DEBUG - Pod : ctest-pod-46757181 UUID is b640228c-70ad-4e13-ab51-efe5e30ebc1b
2024-09-17 22:35:02,145 - DEBUG - Pod ctest-pod-71548713 not present
2024-09-17 22:35:02,145 - INFO - Creating Pod ctest-pod-71548713
2024-09-17 22:35:02,167 - DEBUG - Pod : ctest-pod-71548713 UUID is 4102ec13-5903-47da-abcf-68ffa5090fbf
2024-09-17 22:35:02,171 - DEBUG - Pod ctest-pod-80714178 not present
2024-09-17 22:35:02,172 - INFO - Creating Pod ctest-pod-80714178
2024-09-17 22:35:02,210 - DEBUG - Pod : ctest-pod-80714178 UUID is a107dfff-0dd3-4afb-b39b-6997d887b57b
2024-09-17 22:35:02,214 - DEBUG - Pod ctest-pod-10391513 not present
2024-09-17 22:35:02,215 - INFO - Creating Pod ctest-pod-10391513
2024-09-17 22:35:02,262 - DEBUG - Pod : ctest-pod-10391513 UUID is daf76ee6-4cb6-423b-b5fe-b70885ae7515
2024-09-17 22:35:02,265 - DEBUG - Pod ctest-pod-25201953 not present
2024-09-17 22:35:02,265 - INFO - Creating Pod ctest-pod-25201953
2024-09-17 22:35:02,286 - DEBUG - Pod : ctest-pod-25201953 UUID is 2273f5a3-2d33-4752-8335-12ae8de81e72
2024-09-17 22:35:02,633 - INFO - Project default-domain:k8s-ctest-new-default-16831289 for Namespace ctest-new-default-16831289 is seen in contrail-api
2024-09-17 22:35:02,633 - DEBUG - Project uuid in Contrail is 87e4b50a-765f-452d-85d9-1ddfdea7d39f
2024-09-17 22:35:02,828 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_NamespaceDatabaseList?namespace_uuid=ca684397-8da9-4115-95b1-1ad2bd65298b
2024-09-17 22:35:02,833 - INFO - Namespace ctest-new-default-16831289 with uuid ca684397-8da9-4115-95b1-1ad2bd65298b found in kube manager
2024-09-17 22:35:02,833 - INFO - Namespace ctest-new-default-16831289 verification passed
2024-09-17 22:35:03,134 - INFO - Project default-domain:k8s-ctest-non-default-21469209 for Namespace ctest-non-default-21469209 is seen in contrail-api
2024-09-17 22:35:03,134 - DEBUG - Project uuid in Contrail is b5ff8391-8ab2-4aac-859a-4929a4c23b79
2024-09-17 22:35:03,134 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_NamespaceDatabaseList?namespace_uuid=c0d9643f-cfed-42de-8302-3415ff46d0fb
2024-09-17 22:35:03,142 - INFO - Namespace ctest-non-default-21469209 with uuid c0d9643f-cfed-42de-8302-3415ff46d0fb found in kube manager
2024-09-17 22:35:03,142 - INFO - Namespace ctest-non-default-21469209 verification passed
2024-09-17 22:35:03,149 - DEBUG - Pod ctest-pod-72154375 not in running state.Currently in Pending
2024-09-17 22:35:08,155 - DEBUG - Pod ctest-pod-72154375 not in running state.Currently in Pending
2024-09-17 22:35:13,163 - DEBUG - Pod ctest-pod-72154375 not in running state.Currently in Pending
2024-09-17 22:35:18,170 - INFO - Pod ctest-pod-72154375 is in running state.Got IP 10.47.255.251
2024-09-17 22:35:18,192 - DEBUG - Pod ctest-pod-72154375 has vmi 15490aa0-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:18,192 - INFO - Verified pod ctest-pod-72154375 in contrail-api
2024-09-17 22:35:18,207 - DEBUG - VMI 15490aa0-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:18,208 - INFO - Verified Pod ctest-pod-72154375 in agent 10.0.0.66
2024-09-17 22:35:18,208 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=99a0f06c-a220-4644-b0e7-aac0f6247d63
2024-09-17 22:35:18,212 - INFO - Pod ctest-pod-72154375 with uuid 99a0f06c-a220-4644-b0e7-aac0f6247d63 found in kube manager
2024-09-17 22:35:18,212 - INFO - Pod ctest-pod-72154375 verification passed
2024-09-17 22:35:18,217 - INFO - Pod ctest-pod-03983026 is in running state.Got IP 10.47.255.250
2024-09-17 22:35:18,278 - DEBUG - Pod ctest-pod-03983026 has vmi 15d6bbf2-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:18,278 - INFO - Verified pod ctest-pod-03983026 in contrail-api
2024-09-17 22:35:18,292 - DEBUG - VMI 15d6bbf2-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:18,292 - INFO - Verified Pod ctest-pod-03983026 in agent 10.0.0.66
2024-09-17 22:35:18,292 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=8442a023-d589-45d6-9b2d-a99781b4ad78
2024-09-17 22:35:18,297 - INFO - Pod ctest-pod-03983026 with uuid 8442a023-d589-45d6-9b2d-a99781b4ad78 found in kube manager
2024-09-17 22:35:18,297 - INFO - Pod ctest-pod-03983026 verification passed
2024-09-17 22:35:18,303 - INFO - Pod ctest-pod-58518173 is in running state.Got IP 10.47.255.249
2024-09-17 22:35:18,329 - DEBUG - Pod ctest-pod-58518173 has vmi 168824be-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:18,329 - INFO - Verified pod ctest-pod-58518173 in contrail-api
2024-09-17 22:35:18,345 - DEBUG - VMI 168824be-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:18,346 - INFO - Verified Pod ctest-pod-58518173 in agent 10.0.0.66
2024-09-17 22:35:18,346 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=1659c5c0-0574-4a94-bf3c-e4c77e283cf0
2024-09-17 22:35:18,351 - INFO - Pod ctest-pod-58518173 with uuid 1659c5c0-0574-4a94-bf3c-e4c77e283cf0 found in kube manager
2024-09-17 22:35:18,351 - INFO - Pod ctest-pod-58518173 verification passed
2024-09-17 22:35:18,357 - INFO - Pod ctest-pod-46757181 is in running state.Got IP 10.47.255.248
2024-09-17 22:35:18,419 - DEBUG - Pod ctest-pod-46757181 has vmi 171571e8-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:18,419 - INFO - Verified pod ctest-pod-46757181 in contrail-api
2024-09-17 22:35:18,433 - DEBUG - VMI 171571e8-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:18,434 - INFO - Verified Pod ctest-pod-46757181 in agent 10.0.0.66
2024-09-17 22:35:18,434 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=b640228c-70ad-4e13-ab51-efe5e30ebc1b
2024-09-17 22:35:18,439 - INFO - Pod ctest-pod-46757181 with uuid b640228c-70ad-4e13-ab51-efe5e30ebc1b found in kube manager
2024-09-17 22:35:18,439 - INFO - Pod ctest-pod-46757181 verification passed
2024-09-17 22:35:18,445 - DEBUG - Pod ctest-pod-71548713 not in running state.Currently in Pending
2024-09-17 22:35:23,452 - INFO - Pod ctest-pod-71548713 is in running state.Got IP 10.47.255.247
2024-09-17 22:35:23,471 - DEBUG - Pod ctest-pod-71548713 has vmi 17ba50be-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:23,471 - INFO - Verified pod ctest-pod-71548713 in contrail-api
2024-09-17 22:35:23,486 - DEBUG - VMI 17ba50be-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:23,486 - INFO - Verified Pod ctest-pod-71548713 in agent 10.0.0.66
2024-09-17 22:35:23,486 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=4102ec13-5903-47da-abcf-68ffa5090fbf
2024-09-17 22:35:23,492 - INFO - Pod ctest-pod-71548713 with uuid 4102ec13-5903-47da-abcf-68ffa5090fbf found in kube manager
2024-09-17 22:35:23,492 - INFO - Pod ctest-pod-71548713 verification passed
2024-09-17 22:35:23,498 - INFO - Pod ctest-pod-10391513 is in running state.Got IP 10.47.255.245
2024-09-17 22:35:23,562 - DEBUG - Pod ctest-pod-10391513 has vmi 18c5df0a-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:23,562 - INFO - Verified pod ctest-pod-10391513 in contrail-api
2024-09-17 22:35:23,576 - DEBUG - VMI 18c5df0a-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:23,577 - INFO - Verified Pod ctest-pod-10391513 in agent 10.0.0.66
2024-09-17 22:35:23,577 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=daf76ee6-4cb6-423b-b5fe-b70885ae7515
2024-09-17 22:35:23,582 - INFO - Pod ctest-pod-10391513 with uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 found in kube manager
2024-09-17 22:35:23,582 - INFO - Pod ctest-pod-10391513 verification passed
2024-09-17 22:35:23,588 - INFO - Pod ctest-pod-80714178 is in running state.Got IP 10.47.255.246
2024-09-17 22:35:23,650 - DEBUG - Pod ctest-pod-80714178 has vmi 183ed622-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:23,650 - INFO - Verified pod ctest-pod-80714178 in contrail-api
2024-09-17 22:35:23,664 - DEBUG - VMI 183ed622-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:23,664 - INFO - Verified Pod ctest-pod-80714178 in agent 10.0.0.66
2024-09-17 22:35:23,664 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=a107dfff-0dd3-4afb-b39b-6997d887b57b
2024-09-17 22:35:23,669 - INFO - Pod ctest-pod-80714178 with uuid a107dfff-0dd3-4afb-b39b-6997d887b57b found in kube manager
2024-09-17 22:35:23,669 - INFO - Pod ctest-pod-80714178 verification passed
2024-09-17 22:35:23,674 - INFO - Pod ctest-pod-25201953 is in running state.Got IP 10.47.255.244
2024-09-17 22:35:23,696 - DEBUG - Pod ctest-pod-25201953 has vmi 194a7fd0-7545-11ef-8b82-fa163e4b0f42
2024-09-17 22:35:23,697 - INFO - Verified pod ctest-pod-25201953 in contrail-api
2024-09-17 22:35:23,715 - DEBUG - VMI 194a7fd0-7545-11ef-8b82-fa163e4b0f42 is active in agent 10.0.0.66
2024-09-17 22:35:23,716 - INFO - Verified Pod ctest-pod-25201953 in agent 10.0.0.66
2024-09-17 22:35:23,716 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_VirtualMachineDatabaseList?x=2273f5a3-2d33-4752-8335-12ae8de81e72
2024-09-17 22:35:23,722 - INFO - Pod ctest-pod-25201953 with uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 found in kube manager
2024-09-17 22:35:23,722 - INFO - Pod ctest-pod-25201953 verification passed
2024-09-17 22:35:23,722 - INFO - ================================================================================
2024-09-17 22:35:23,722 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-17 22:35:23,722 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-17 22:35:23,958 - DEBUG - Nothing to compare xmpp stats {'10.0.0.66': {'10.0.0.69': '0'}} with
2024-09-17 22:35:23,958 - INFO - Initial checks done. Running the testcase now
2024-09-17 22:35:23,958 - INFO -
2024-09-17 22:35:24,026 - DEBUG - [Pod ctest-pod-72154375] Cmd: echo ctest-pod-72154375 > /usr/share/nginx/html/index.html, Output:
2024-09-17 22:35:24,095 - DEBUG - [Pod ctest-pod-03983026] Cmd: echo ctest-pod-03983026 > /usr/share/nginx/html/index.html, Output:
2024-09-17 22:35:24,166 - DEBUG - [Pod ctest-pod-58518173] Cmd: echo ctest-pod-58518173 > /usr/share/nginx/html/index.html, Output:
2024-09-17 22:35:24,242 - DEBUG - [Pod ctest-pod-46757181] Cmd: echo ctest-pod-46757181 > /usr/share/nginx/html/index.html, Output:
2024-09-17 22:35:24,246 - DEBUG - Service ctest-nginx-svc-06332496 not present
2024-09-17 22:35:24,246 - INFO - Creating service ctest-nginx-svc-06332496
2024-09-17 22:35:24,275 - INFO - Created Service ctest-nginx-svc-06332496
2024-09-17 22:35:24,290 - WARNING - Service UUID 33ed975f-3340-4cea-8aef-d659b36a66b8 not yet found in contrail-api
2024-09-17 22:35:25,297 - INFO - Validated that Service ctest-nginx-svc-06332496 is seen in contrail-api
2024-09-17 22:35:25,297 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_LoadbalancerDatabaseList?x=33ed975f-3340-4cea-8aef-d659b36a66b8
2024-09-17 22:35:25,302 - INFO - Service ctest-nginx-svc-06332496 with uuid 33ed975f-3340-4cea-8aef-d659b36a66b8 found in kube manager
2024-09-17 22:35:25,302 - INFO - Service ctest-nginx-svc-06332496 verification passed
2024-09-17 22:35:26,367 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03983026
2024-09-17 22:35:26,367 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:35:26,367 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03983026
2024-09-17 22:35:26,430 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:35:26,430 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:35:26,430 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:35:26,430 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72154375': 1, 'ctest-pod-03983026': 1}
2024-09-17 22:35:26,495 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:35:26,495 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:35:26,495 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:35:26,546 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:35:26,546 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:35:26,546 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:35:26,546 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72154375': 1, 'ctest-pod-03983026': 1}
2024-09-17 22:35:26,549 - DEBUG - Network policy ingress-on-service not present
2024-09-17 22:35:26,550 - INFO - Creating Network Policy ingress-on-service
2024-09-17 22:35:26,567 - INFO - Network policy found in k8s
2024-09-17 22:35:26,567 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=92a2588d-7043-40fd-a925-4eeaabde3315
2024-09-17 22:35:26,575 - INFO - Network Policy ingress-on-service with uuid 92a2588d-7043-40fd-a925-4eeaabde3315 found in kube manager
2024-09-17 22:35:26,609 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-17 22:35:26,609 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-17 22:35:26,609 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=92a2588d-7043-40fd-a925-4eeaabde3315
2024-09-17 22:35:26,652 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-17 22:35:28,652 - DEBUG - Requesting: http://10.0.0.69:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=92a2588d-7043-40fd-a925-4eeaabde3315
2024-09-17 22:35:28,685 - INFO - Network policy with name ingress-on-service found in agent
2024-09-17 22:35:28,685 - INFO - Network Policy ingress-on-service verification passed
2024-09-17 22:35:33,769 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:33,769 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:33,769 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:38,850 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:38,850 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:38,850 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:43,925 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:43,925 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:43,925 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:48,980 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:48,980 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:48,980 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:54,073 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:54,073 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:54,073 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:59,144 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:59,144 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:35:59,144 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:04,206 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:04,206 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:04,206 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:09,268 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:09,269 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:09,269 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:14,320 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:14,320 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:14,320 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:19,377 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:19,377 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:19,377 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:19,378 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72154375': 0, 'ctest-pod-03983026': 0}
2024-09-17 22:36:19,440 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:36:19,440 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:36:19,440 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:36:19,494 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:36:19,494 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:36:19,494 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:36:19,550 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:36:19,550 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:36:19,550 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:36:19,550 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72154375': 1, 'ctest-pod-03983026': 2}
2024-09-17 22:36:24,599 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:24,599 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:24,600 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:29,646 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:29,646 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:29,646 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:34,698 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:34,698 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:34,698 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:39,767 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:39,767 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:39,767 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:44,840 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:44,840 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:44,840 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:49,904 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:49,904 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:49,904 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:54,982 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:54,982 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:36:54,982 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:00,057 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:00,057 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:00,057 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:05,122 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:05,122 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:05,122 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:10,192 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:10,192 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:10,192 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:10,193 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72154375': 0, 'ctest-pod-03983026': 0}
2024-09-17 22:37:12,244 - DEBUG - [Pod ctest-pod-80714178] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.682 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.278/0.682 ms
2024-09-17 22:37:12,245 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-80714178 with expectation True passed
2024-09-17 22:37:14,293 - DEBUG - [Pod ctest-pod-71548713] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.080 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.406/1.080 ms
2024-09-17 22:37:14,293 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71548713 with expectation True passed
2024-09-17 22:37:16,348 - DEBUG - [Pod ctest-pod-10391513] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.567 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.239/0.567 ms
2024-09-17 22:37:16,348 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10391513 with expectation True passed
2024-09-17 22:37:16,397 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:37:16,397 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-17 22:37:16,397 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:37:16,397 - INFO - wget check of of http://10.47.255.251 from ctest-pod-80714178 passed
2024-09-17 22:37:16,464 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:37:16,465 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-17 22:37:16,465 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:37:16,465 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80714178 passed
2024-09-17 22:37:21,512 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 22:37:21,512 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 22:37:21,512 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 22:37:21,512 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71548713 passed
2024-09-17 22:37:26,575 - DEBUG - [Pod ctest-pod-25201953] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-17 22:37:26,576 - DEBUG - [Pod Pod ctest-pod-25201953] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-17 22:37:26,576 - DEBUG - [Pod Pod ctest-pod-25201953] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-17 22:37:26,576 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25201953 passed
2024-09-17 22:37:26,584 - INFO - Updating Network Policy ingress-on-service
2024-09-17 22:37:31,656 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:31,656 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:31,656 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:36,733 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:36,733 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:36,733 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:41,801 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:41,801 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:41,801 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:46,860 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:46,860 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:46,860 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:51,933 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:51,933 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:51,933 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:56,989 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:56,989 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:37:56,989 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:02,045 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:02,045 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:02,045 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:07,114 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:07,114 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:07,114 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:12,203 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:12,203 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:12,203 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:17,264 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:17,264 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:17,264 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
wget: download timed out
2024-09-17 22:38:17,264 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72154375': 0, 'ctest-pod-03983026': 0}
2024-09-17 22:38:17,326 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03983026
2024-09-17 22:38:17,326 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:38:17,326 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03983026
2024-09-17 22:38:17,385 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:38:17,386 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:38:17,386 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:38:17,465 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:38:17,465 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:38:17,465 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: ctest-pod-72154375
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:38:17,465 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72154375': 1, 'ctest-pod-03983026': 2}
2024-09-17 22:38:17,540 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72154375
2024-09-17 22:38:17,540 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:38:17,540 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72154375
2024-09-17 22:38:17,599 - DEBUG - [Pod ctest-pod-10391513] Cmd: wget http://10.101.3.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:38:17,599 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd wget http://10.101.3.138:80/ -O - -T 5 -t 1 passed
2024-09-17 22:38:17,599 - DEBUG - [Pod Pod ctest-pod-10391513] Cmd output: ctest-pod-03983026
Connecting to 10.101.3.138:80 (10.101.3.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 22:38:17,600 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72154375': 1, 'ctest-pod-03983026': 1}
2024-09-17 22:38:19,656 - DEBUG - [Pod ctest-pod-80714178] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.687 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.278/0.687 ms
2024-09-17 22:38:19,656 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-80714178 with expectation True passed
2024-09-17 22:38:21,719 - DEBUG - [Pod ctest-pod-71548713] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.353 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.172/0.353 ms
2024-09-17 22:38:21,719 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71548713 with expectation True passed
2024-09-17 22:38:23,785 - DEBUG - [Pod ctest-pod-10391513] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.779 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.312/0.779 ms
2024-09-17 22:38:23,785 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10391513 with expectation True passed
2024-09-17 22:38:23,854 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:38:23,854 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-17 22:38:23,854 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:38:23,854 - INFO - wget check of of http://10.47.255.251 from ctest-pod-80714178 passed
2024-09-17 22:38:23,921 - DEBUG - [Pod ctest-pod-80714178] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:38:23,921 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-17 22:38:23,921 - DEBUG - [Pod Pod ctest-pod-80714178] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:38:23,921 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80714178 passed
2024-09-17 22:38:28,993 - DEBUG - [Pod ctest-pod-71548713] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 22:38:28,993 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 22:38:28,993 - DEBUG - [Pod Pod ctest-pod-71548713] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 22:38:28,993 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71548713 passed
2024-09-17 22:38:29,069 - DEBUG - [Pod ctest-pod-25201953] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:38:29,070 - DEBUG - [Pod Pod ctest-pod-25201953] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-17 22:38:29,070 - DEBUG - [Pod Pod ctest-pod-25201953] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 22:38:29,070 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25201953 passed
2024-09-17 22:38:29,070 - INFO - Deleting Network Policy : ingress-on-service
2024-09-17 22:38:29,070 - INFO - Deleting service : ctest-nginx-svc-06332496
2024-09-17 22:38:29,308 - DEBUG - No XMPP flaps were noticed during the test
2024-09-17 22:38:29,308 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-09-17 22:38:29,309 - INFO - --------------------------------------------------------------------------------
2024-09-17 22:38:29,314 - INFO - Deleting pod ctest-new-default-16831289:ctest-pod-72154375
2024-09-17 22:38:29,315 - INFO - Deleting pod ctest-new-default-16831289:ctest-pod-03983026
2024-09-17 22:38:29,315 - INFO - Deleting pod ctest-non-default-21469209:ctest-pod-58518173
2024-09-17 22:38:29,315 - INFO - Deleting pod ctest-non-default-21469209:ctest-pod-46757181
2024-09-17 22:38:29,316 - INFO - Deleting pod ctest-new-default-16831289:ctest-pod-71548713
2024-09-17 22:38:29,316 - INFO - Deleting pod ctest-new-default-16831289:ctest-pod-80714178
2024-09-17 22:38:29,316 - INFO - Deleting pod ctest-non-default-21469209:ctest-pod-10391513
2024-09-17 22:38:29,317 - INFO - Deleting pod ctest-non-default-21469209:ctest-pod-25201953
2024-09-17 22:38:29,410 - WARNING - Pod uuid 99a0f06c-a220-4644-b0e7-aac0f6247d63 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,462 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,464 - WARNING - Pod uuid 8442a023-d589-45d6-9b2d-a99781b4ad78 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,464 - WARNING - Pod uuid 1659c5c0-0574-4a94-bf3c-e4c77e283cf0 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,464 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,465 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,465 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:29,465 - WARNING - Pod uuid b640228c-70ad-4e13-ab51-efe5e30ebc1b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:34,419 - DEBUG - Pod 99a0f06c-a220-4644-b0e7-aac0f6247d63 is not in agent 10.0.0.66 VM list
2024-09-17 22:38:34,425 - DEBUG - VMI 15490aa0-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:38:34,425 - INFO - Verified that pod ctest-pod-72154375 is removed in agent
2024-09-17 22:38:34,496 - DEBUG - Pod 8442a023-d589-45d6-9b2d-a99781b4ad78 is not in agent 10.0.0.66 VM list
2024-09-17 22:38:34,502 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:34,502 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:34,503 - DEBUG - Pod b640228c-70ad-4e13-ab51-efe5e30ebc1b is not in agent 10.0.0.66 VM list
2024-09-17 22:38:34,505 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:34,505 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:34,506 - DEBUG - Pod 1659c5c0-0574-4a94-bf3c-e4c77e283cf0 is not in agent 10.0.0.66 VM list
2024-09-17 22:38:34,519 - DEBUG - VMI 15d6bbf2-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:38:34,519 - INFO - Verified that pod ctest-pod-03983026 is removed in agent
2024-09-17 22:38:34,520 - DEBUG - VMI 168824be-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:38:34,520 - INFO - Verified that pod ctest-pod-58518173 is removed in agent
2024-09-17 22:38:34,521 - DEBUG - VMI 171571e8-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:38:34,521 - INFO - Verified that pod ctest-pod-46757181 is removed in agent
2024-09-17 22:38:39,522 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:39,523 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:39,523 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:39,524 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:44,544 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:44,546 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:44,547 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:44,547 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:49,563 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:49,565 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:49,566 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:49,566 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:54,583 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:54,583 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:54,584 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:54,585 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:59,604 - WARNING - Pod uuid 2273f5a3-2d33-4752-8335-12ae8de81e72 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:59,606 - WARNING - Pod uuid daf76ee6-4cb6-423b-b5fe-b70885ae7515 is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:59,606 - WARNING - Pod uuid 4102ec13-5903-47da-abcf-68ffa5090fbf is still seen in agent 10.0.0.66 VM list
2024-09-17 22:38:59,607 - WARNING - Pod uuid a107dfff-0dd3-4afb-b39b-6997d887b57b is still seen in agent 10.0.0.66 VM list
2024-09-17 22:39:04,623 - DEBUG - Pod a107dfff-0dd3-4afb-b39b-6997d887b57b is not in agent 10.0.0.66 VM list
2024-09-17 22:39:04,627 - DEBUG - Pod daf76ee6-4cb6-423b-b5fe-b70885ae7515 is not in agent 10.0.0.66 VM list
2024-09-17 22:39:04,628 - DEBUG - Pod 2273f5a3-2d33-4752-8335-12ae8de81e72 is not in agent 10.0.0.66 VM list
2024-09-17 22:39:04,630 - DEBUG - Pod 4102ec13-5903-47da-abcf-68ffa5090fbf is not in agent 10.0.0.66 VM list
2024-09-17 22:39:04,644 - DEBUG - VMI 183ed622-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:39:04,644 - INFO - Verified that pod ctest-pod-80714178 is removed in agent
2024-09-17 22:39:04,647 - DEBUG - VMI 18c5df0a-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:39:04,647 - INFO - Verified that pod ctest-pod-10391513 is removed in agent
2024-09-17 22:39:04,647 - DEBUG - VMI 194a7fd0-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:39:04,647 - INFO - Verified that pod ctest-pod-25201953 is removed in agent
2024-09-17 22:39:04,648 - DEBUG - VMI 17ba50be-7545-11ef-8b82-fa163e4b0f42 is removed from agent 10.0.0.66
2024-09-17 22:39:04,648 - INFO - Verified that pod ctest-pod-71548713 is removed in agent
2024-09-17 22:39:04,648 - INFO - Deleting namespace ctest-non-default-21469209
2024-09-17 22:39:04,670 - DEBUG - Namespace ctest-non-default-21469209 still in k8s
2024-09-17 22:39:06,675 - DEBUG - Namespace ctest-non-default-21469209 still in k8s
2024-09-17 22:39:08,681 - DEBUG - Namespace ctest-non-default-21469209 still in k8s
2024-09-17 22:39:10,685 - DEBUG - Namespace ctest-non-default-21469209 is not in k8s
2024-09-17 22:39:10,686 - DEBUG - No need to check project deletion in contrail-api
2024-09-17 22:39:10,686 - INFO - Deleting namespace ctest-new-default-16831289
2024-09-17 22:39:10,695 - DEBUG - Namespace ctest-new-default-16831289 still in k8s
2024-09-17 22:39:12,701 - DEBUG - Namespace ctest-new-default-16831289 still in k8s
2024-09-17 22:39:14,708 - DEBUG - Namespace ctest-new-default-16831289 still in k8s
2024-09-17 22:39:16,712 - DEBUG - Namespace ctest-new-default-16831289 is not in k8s
2024-09-17 22:39:16,712 - DEBUG - No need to check project deletion in contrail-api