2025-01-13 11:27:19,557 - INFO - Using existing project ['default-domain', 'k8s-default'](c5c843e9-916b-4f1d-870e-0b30a5dfc3c0)
2025-01-13 11:27:19,577 - DEBUG - Namespace ctest-new-default-30864374 not present
2025-01-13 11:27:19,589 - INFO - Created namespace ctest-new-default-30864374
2025-01-13 11:27:22,593 - DEBUG - Namespace ctest-non-default-32433409 not present
2025-01-13 11:27:22,603 - INFO - Created namespace ctest-non-default-32433409
2025-01-13 11:27:25,626 - DEBUG - Pod ctest-pod-94929543 not present
2025-01-13 11:27:25,627 - INFO - Creating Pod ctest-pod-94929543
2025-01-13 11:27:25,652 - DEBUG - Pod : ctest-pod-94929543 UUID is e79696e1-5e89-440d-b946-a6cbc2e3fe49
2025-01-13 11:27:25,657 - DEBUG - Pod ctest-pod-70254344 not present
2025-01-13 11:27:25,658 - INFO - Creating Pod ctest-pod-70254344
2025-01-13 11:27:25,680 - DEBUG - Pod : ctest-pod-70254344 UUID is bff3a124-3019-4a6c-903f-e159600e6e64
2025-01-13 11:27:25,687 - DEBUG - Pod ctest-pod-14726679 not present
2025-01-13 11:27:25,688 - INFO - Creating Pod ctest-pod-14726679
2025-01-13 11:27:25,711 - DEBUG - Pod : ctest-pod-14726679 UUID is 7bbeb630-23c0-4d7e-a4f8-9bf5e23191b9
2025-01-13 11:27:25,717 - DEBUG - Pod ctest-pod-54994917 not present
2025-01-13 11:27:25,717 - INFO - Creating Pod ctest-pod-54994917
2025-01-13 11:27:25,752 - DEBUG - Pod : ctest-pod-54994917 UUID is b316facc-39b2-4937-aa09-afab4d2ead52
2025-01-13 11:27:25,755 - DEBUG - Pod ctest-pod-41841641 not present
2025-01-13 11:27:25,755 - INFO - Creating Pod ctest-pod-41841641
2025-01-13 11:27:25,778 - DEBUG - Pod : ctest-pod-41841641 UUID is 1a831752-e424-4807-98d7-53068033bae3
2025-01-13 11:27:25,781 - DEBUG - Pod ctest-pod-48451338 not present
2025-01-13 11:27:25,782 - INFO - Creating Pod ctest-pod-48451338
2025-01-13 11:27:25,815 - DEBUG - Pod : ctest-pod-48451338 UUID is 417a9f48-aec9-49d6-acb0-4179a75b540b
2025-01-13 11:27:25,819 - DEBUG - Pod ctest-pod-32130726 not present
2025-01-13 11:27:25,819 - INFO - Creating Pod ctest-pod-32130726
2025-01-13 11:27:25,853 - DEBUG - Pod : ctest-pod-32130726 UUID is 20897dcb-367b-470e-9a3a-fc4deaa740a9
2025-01-13 11:27:25,861 - DEBUG - Pod ctest-pod-99581471 not present
2025-01-13 11:27:25,861 - INFO - Creating Pod ctest-pod-99581471
2025-01-13 11:27:25,884 - DEBUG - Pod : ctest-pod-99581471 UUID is a5a80434-f033-4c48-9678-05c333b1c77e
2025-01-13 11:27:26,109 - INFO - Project default-domain:k8s-ctest-new-default-30864374 for Namespace ctest-new-default-30864374 is seen in contrail-api
2025-01-13 11:27:26,110 - DEBUG - Project uuid in Contrail is ec4ca75f-6cd8-4fbb-949a-8f392c46f3fc
2025-01-13 11:27:26,377 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_NamespaceDatabaseList?namespace_uuid=7d59fdf4-9601-415b-aa52-8ac886074495
2025-01-13 11:27:26,385 - INFO - Namespace ctest-new-default-30864374 with uuid 7d59fdf4-9601-415b-aa52-8ac886074495 found in kube manager
2025-01-13 11:27:26,385 - INFO - Namespace ctest-new-default-30864374 verification passed
2025-01-13 11:27:26,603 - INFO - Project default-domain:k8s-ctest-non-default-32433409 for Namespace ctest-non-default-32433409 is seen in contrail-api
2025-01-13 11:27:26,603 - DEBUG - Project uuid in Contrail is 5e9da5ff-34dc-42ec-b117-3afd6c49bfae
2025-01-13 11:27:26,603 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_NamespaceDatabaseList?namespace_uuid=f2e5de3d-36f8-4628-9ef7-d32d1480bf76
2025-01-13 11:27:26,609 - INFO - Namespace ctest-non-default-32433409 with uuid f2e5de3d-36f8-4628-9ef7-d32d1480bf76 found in kube manager
2025-01-13 11:27:26,610 - INFO - Namespace ctest-non-default-32433409 verification passed
2025-01-13 11:27:26,622 - DEBUG - Pod ctest-pod-94929543 not in running state.Currently in Pending
2025-01-13 11:27:31,632 - DEBUG - Pod ctest-pod-94929543 not in running state.Currently in Pending
2025-01-13 11:27:36,640 - INFO - Pod ctest-pod-94929543 is in running state.Got IP 10.47.255.251
2025-01-13 11:27:36,697 - DEBUG - Pod ctest-pod-94929543 has vmi 5e9b5948-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:36,698 - INFO - Verified pod ctest-pod-94929543 in contrail-api
2025-01-13 11:27:36,712 - DEBUG - VMI 5e9b5948-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:36,713 - INFO - Verified Pod ctest-pod-94929543 in agent 10.0.0.27
2025-01-13 11:27:36,713 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=e79696e1-5e89-440d-b946-a6cbc2e3fe49
2025-01-13 11:27:36,729 - INFO - Pod ctest-pod-94929543 with uuid e79696e1-5e89-440d-b946-a6cbc2e3fe49 found in kube manager
2025-01-13 11:27:36,729 - INFO - Pod ctest-pod-94929543 verification passed
2025-01-13 11:27:36,736 - DEBUG - Pod ctest-pod-70254344 not in running state.Currently in Pending
2025-01-13 11:27:41,745 - INFO - Pod ctest-pod-70254344 is in running state.Got IP 10.47.255.250
2025-01-13 11:27:41,776 - DEBUG - Pod ctest-pod-70254344 has vmi 5f313328-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:41,776 - INFO - Verified pod ctest-pod-70254344 in contrail-api
2025-01-13 11:27:41,794 - DEBUG - VMI 5f313328-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:41,794 - INFO - Verified Pod ctest-pod-70254344 in agent 10.0.0.27
2025-01-13 11:27:41,794 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=bff3a124-3019-4a6c-903f-e159600e6e64
2025-01-13 11:27:41,799 - INFO - Pod ctest-pod-70254344 with uuid bff3a124-3019-4a6c-903f-e159600e6e64 found in kube manager
2025-01-13 11:27:41,799 - INFO - Pod ctest-pod-70254344 verification passed
2025-01-13 11:27:41,807 - INFO - Pod ctest-pod-14726679 is in running state.Got IP 10.47.255.249
2025-01-13 11:27:41,869 - DEBUG - Pod ctest-pod-14726679 has vmi 5fe46a9c-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:41,869 - INFO - Verified pod ctest-pod-14726679 in contrail-api
2025-01-13 11:27:41,886 - DEBUG - VMI 5fe46a9c-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:41,886 - INFO - Verified Pod ctest-pod-14726679 in agent 10.0.0.27
2025-01-13 11:27:41,886 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=7bbeb630-23c0-4d7e-a4f8-9bf5e23191b9
2025-01-13 11:27:41,893 - INFO - Pod ctest-pod-14726679 with uuid 7bbeb630-23c0-4d7e-a4f8-9bf5e23191b9 found in kube manager
2025-01-13 11:27:41,894 - INFO - Pod ctest-pod-14726679 verification passed
2025-01-13 11:27:41,907 - INFO - Pod ctest-pod-54994917 is in running state.Got IP 10.47.255.248
2025-01-13 11:27:41,924 - DEBUG - Pod ctest-pod-54994917 has vmi 6070b51a-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:41,924 - INFO - Verified pod ctest-pod-54994917 in contrail-api
2025-01-13 11:27:41,939 - DEBUG - VMI 6070b51a-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:41,939 - INFO - Verified Pod ctest-pod-54994917 in agent 10.0.0.27
2025-01-13 11:27:41,940 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=b316facc-39b2-4937-aa09-afab4d2ead52
2025-01-13 11:27:41,945 - INFO - Pod ctest-pod-54994917 with uuid b316facc-39b2-4937-aa09-afab4d2ead52 found in kube manager
2025-01-13 11:27:41,945 - INFO - Pod ctest-pod-54994917 verification passed
2025-01-13 11:27:41,951 - DEBUG - Pod ctest-pod-41841641 not in running state.Currently in Pending
2025-01-13 11:27:46,959 - INFO - Pod ctest-pod-41841641 is in running state.Got IP 10.47.255.247
2025-01-13 11:27:46,978 - DEBUG - Pod ctest-pod-41841641 has vmi 6116a128-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:46,978 - INFO - Verified pod ctest-pod-41841641 in contrail-api
2025-01-13 11:27:46,993 - DEBUG - VMI 6116a128-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:46,993 - INFO - Verified Pod ctest-pod-41841641 in agent 10.0.0.27
2025-01-13 11:27:46,994 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=1a831752-e424-4807-98d7-53068033bae3
2025-01-13 11:27:46,998 - INFO - Pod ctest-pod-41841641 with uuid 1a831752-e424-4807-98d7-53068033bae3 found in kube manager
2025-01-13 11:27:46,999 - INFO - Pod ctest-pod-41841641 verification passed
2025-01-13 11:27:47,006 - INFO - Pod ctest-pod-32130726 is in running state.Got IP 10.47.255.245
2025-01-13 11:27:47,067 - DEBUG - Pod ctest-pod-32130726 has vmi 622f0eec-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:47,067 - INFO - Verified pod ctest-pod-32130726 in contrail-api
2025-01-13 11:27:47,082 - DEBUG - VMI 622f0eec-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:47,083 - INFO - Verified Pod ctest-pod-32130726 in agent 10.0.0.27
2025-01-13 11:27:47,083 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=20897dcb-367b-470e-9a3a-fc4deaa740a9
2025-01-13 11:27:47,089 - INFO - Pod ctest-pod-32130726 with uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 found in kube manager
2025-01-13 11:27:47,089 - INFO - Pod ctest-pod-32130726 verification passed
2025-01-13 11:27:47,094 - INFO - Pod ctest-pod-48451338 is in running state.Got IP 10.47.255.246
2025-01-13 11:27:47,153 - DEBUG - Pod ctest-pod-48451338 has vmi 619e035c-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:47,153 - INFO - Verified pod ctest-pod-48451338 in contrail-api
2025-01-13 11:27:47,169 - DEBUG - VMI 619e035c-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:47,169 - INFO - Verified Pod ctest-pod-48451338 in agent 10.0.0.27
2025-01-13 11:27:47,169 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=417a9f48-aec9-49d6-acb0-4179a75b540b
2025-01-13 11:27:47,175 - INFO - Pod ctest-pod-48451338 with uuid 417a9f48-aec9-49d6-acb0-4179a75b540b found in kube manager
2025-01-13 11:27:47,175 - INFO - Pod ctest-pod-48451338 verification passed
2025-01-13 11:27:47,182 - INFO - Pod ctest-pod-99581471 is in running state.Got IP 10.47.255.244
2025-01-13 11:27:47,200 - DEBUG - Pod ctest-pod-99581471 has vmi 62b8878a-d1a1-11ef-a922-fa163eca5e3b
2025-01-13 11:27:47,200 - INFO - Verified pod ctest-pod-99581471 in contrail-api
2025-01-13 11:27:47,216 - DEBUG - VMI 62b8878a-d1a1-11ef-a922-fa163eca5e3b is active in agent 10.0.0.27
2025-01-13 11:27:47,217 - INFO - Verified Pod ctest-pod-99581471 in agent 10.0.0.27
2025-01-13 11:27:47,217 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_VirtualMachineDatabaseList?x=a5a80434-f033-4c48-9678-05c333b1c77e
2025-01-13 11:27:47,223 - INFO - Pod ctest-pod-99581471 with uuid a5a80434-f033-4c48-9678-05c333b1c77e found in kube manager
2025-01-13 11:27:47,223 - INFO - Pod ctest-pod-99581471 verification passed
2025-01-13 11:27:47,223 - INFO - ================================================================================
2025-01-13 11:27:47,223 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-13 11:27:47,223 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-13 11:27:47,450 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.43': '0'}} with
2025-01-13 11:27:47,450 - INFO - Initial checks done. Running the testcase now
2025-01-13 11:27:47,450 - INFO -
2025-01-13 11:27:47,501 - DEBUG - [Pod ctest-pod-94929543] Cmd: echo ctest-pod-94929543 > /usr/share/nginx/html/index.html, Output:
2025-01-13 11:27:47,572 - DEBUG - [Pod ctest-pod-70254344] Cmd: echo ctest-pod-70254344 > /usr/share/nginx/html/index.html, Output:
2025-01-13 11:27:47,646 - DEBUG - [Pod ctest-pod-14726679] Cmd: echo ctest-pod-14726679 > /usr/share/nginx/html/index.html, Output:
2025-01-13 11:27:47,728 - DEBUG - [Pod ctest-pod-54994917] Cmd: echo ctest-pod-54994917 > /usr/share/nginx/html/index.html, Output:
2025-01-13 11:27:47,733 - DEBUG - Service ctest-nginx-svc-32461501 not present
2025-01-13 11:27:47,733 - INFO - Creating service ctest-nginx-svc-32461501
2025-01-13 11:27:47,748 - INFO - Created Service ctest-nginx-svc-32461501
2025-01-13 11:27:47,765 - WARNING - Service UUID 4952f355-5a5b-4bd6-8360-d3073924fdf6 not yet found in contrail-api
2025-01-13 11:27:48,783 - INFO - Validated that Service ctest-nginx-svc-32461501 is seen in contrail-api
2025-01-13 11:27:48,783 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_LoadbalancerDatabaseList?x=4952f355-5a5b-4bd6-8360-d3073924fdf6
2025-01-13 11:27:48,788 - INFO - Service ctest-nginx-svc-32461501 with uuid 4952f355-5a5b-4bd6-8360-d3073924fdf6 found in kube manager
2025-01-13 11:27:48,788 - INFO - Service ctest-nginx-svc-32461501 verification passed
2025-01-13 11:27:49,869 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
ctest-pod-70254344
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:27:49,869 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:27:49,869 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
ctest-pod-70254344
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:27:49,944 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:27:49,945 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:27:49,945 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:27:49,945 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94929543': 1, 'ctest-pod-70254344': 1}
2025-01-13 11:27:50,024 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:27:50,024 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:27:50,024 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:27:50,081 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-70254344
2025-01-13 11:27:50,082 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:27:50,082 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-70254344
2025-01-13 11:27:50,082 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94929543': 1, 'ctest-pod-70254344': 1}
2025-01-13 11:27:50,085 - DEBUG - Network policy ingress-on-service not present
2025-01-13 11:27:50,166 - INFO - Creating Network Policy ingress-on-service
2025-01-13 11:27:50,183 - INFO - Network policy found in k8s
2025-01-13 11:27:50,184 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2cf9289e-055a-44cf-8b68-5beb89b5d5e3
2025-01-13 11:27:50,192 - INFO - Network Policy ingress-on-service with uuid 2cf9289e-055a-44cf-8b68-5beb89b5d5e3 found in kube manager
2025-01-13 11:27:50,233 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-13 11:27:50,233 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-13 11:27:50,233 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2cf9289e-055a-44cf-8b68-5beb89b5d5e3
2025-01-13 11:27:50,271 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-13 11:27:52,272 - DEBUG - Requesting: http://10.0.0.43:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2cf9289e-055a-44cf-8b68-5beb89b5d5e3
2025-01-13 11:27:52,306 - INFO - Network policy with name ingress-on-service found in agent
2025-01-13 11:27:52,307 - INFO - Network Policy ingress-on-service verification passed
2025-01-13 11:27:57,355 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:27:57,355 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:27:57,355 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:02,429 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:02,429 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:02,429 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:07,501 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:07,501 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:07,501 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:12,566 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:12,566 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:12,566 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:17,725 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:17,725 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:17,725 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:22,784 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:22,784 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:22,784 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:27,841 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:27,841 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:27,841 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:32,898 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:32,898 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:32,898 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:37,952 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:37,953 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:37,953 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:43,012 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:43,013 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:43,013 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:43,013 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94929543': 0, 'ctest-pod-70254344': 0}
2025-01-13 11:28:43,097 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:28:43,097 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:28:43,097 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:28:43,155 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-70254344
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:28:43,155 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:28:43,155 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: ctest-pod-70254344
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:28:43,155 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94929543': 1, 'ctest-pod-70254344': 1}
2025-01-13 11:28:48,221 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:48,221 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:48,222 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:53,274 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:53,275 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:53,275 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:58,337 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:58,337 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:28:58,337 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:03,392 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:03,392 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:03,392 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:08,446 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:08,447 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:08,447 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:13,500 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:13,501 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:13,501 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:18,589 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:18,590 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:18,590 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:23,653 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:23,653 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:23,653 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:28,726 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:28,726 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:28,726 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:33,781 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:33,781 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:33,781 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:29:33,781 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94929543': 0, 'ctest-pod-70254344': 0}
2025-01-13 11:29:35,856 - DEBUG - [Pod ctest-pod-48451338] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.205 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.057 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.057/0.447/1.205 ms
2025-01-13 11:29:35,857 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-48451338 with expectation True passed
2025-01-13 11:29:37,753 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-01-13 11:29:44,836 - DEBUG - [Pod ctest-pod-41841641] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.287 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.060/0.481/1.287 ms
2025-01-13 11:29:44,836 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-41841641 with expectation True passed
2025-01-13 11:29:46,896 - DEBUG - [Pod ctest-pod-32130726] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.024 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.398/1.024 ms
2025-01-13 11:29:46,896 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-32130726 with expectation True passed
2025-01-13 11:29:46,961 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:29:46,961 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-13 11:29:46,961 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:29:46,962 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48451338 passed
2025-01-13 11:29:47,014 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:29:47,014 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-13 11:29:47,014 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:29:47,014 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48451338 passed
2025-01-13 11:29:52,080 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-13 11:29:52,080 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-13 11:29:52,080 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-13 11:29:52,080 - INFO - wget check of of http://10.47.255.250 from ctest-pod-41841641 passed
2025-01-13 11:29:57,148 - DEBUG - [Pod ctest-pod-99581471] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-13 11:29:57,148 - DEBUG - [Pod Pod ctest-pod-99581471] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-13 11:29:57,148 - DEBUG - [Pod Pod ctest-pod-99581471] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-13 11:29:57,148 - INFO - wget check of of http://10.47.255.251 from ctest-pod-99581471 passed
2025-01-13 11:29:57,156 - INFO - Updating Network Policy ingress-on-service
2025-01-13 11:30:02,240 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:02,240 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:02,240 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:07,315 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:07,315 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:07,315 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:12,373 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:12,373 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:12,373 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:17,432 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:17,432 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:17,432 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:22,502 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:22,502 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:22,502 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:27,580 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:27,580 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:27,580 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:32,649 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:32,649 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:32,649 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:37,710 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:37,710 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:37,710 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:42,777 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:42,777 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:42,777 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:47,839 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:47,839 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:47,839 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
wget: download timed out
2025-01-13 11:30:47,840 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94929543': 0, 'ctest-pod-70254344': 0}
2025-01-13 11:30:47,909 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:47,909 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:47,909 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:47,966 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:47,967 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:47,967 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,030 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
ctest-pod-70254344
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,030 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:48,030 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
ctest-pod-70254344
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,030 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94929543': 2, 'ctest-pod-70254344': 1}
2025-01-13 11:30:48,097 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-70254344
2025-01-13 11:30:48,097 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:48,097 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-70254344
2025-01-13 11:30:48,165 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-70254344
2025-01-13 11:30:48,165 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:48,165 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-70254344
2025-01-13 11:30:48,222 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-70254344
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,222 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:48,222 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: ctest-pod-70254344
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,300 - DEBUG - [Pod ctest-pod-32130726] Cmd: wget http://10.98.132.195:80/ -O - -T 5 -t 1 , Output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,300 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd wget http://10.98.132.195:80/ -O - -T 5 -t 1 passed
2025-01-13 11:30:48,300 - DEBUG - [Pod Pod ctest-pod-32130726] Cmd output: ctest-pod-94929543
Connecting to 10.98.132.195:80 (10.98.132.195:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-13 11:30:48,300 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94929543': 1, 'ctest-pod-70254344': 3}
2025-01-13 11:30:50,375 - DEBUG - [Pod ctest-pod-48451338] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.284 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.147/0.284 ms
2025-01-13 11:30:50,375 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-48451338 with expectation True passed
2025-01-13 11:30:52,437 - DEBUG - [Pod ctest-pod-41841641] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.220 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.456/1.220 ms
2025-01-13 11:30:52,437 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-41841641 with expectation True passed
2025-01-13 11:30:54,501 - DEBUG - [Pod ctest-pod-32130726] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.661 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.602/1.661 ms
2025-01-13 11:30:54,501 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-32130726 with expectation True passed
2025-01-13 11:30:54,734 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:30:54,735 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-13 11:30:54,735 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:30:54,735 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48451338 passed
2025-01-13 11:30:54,792 - DEBUG - [Pod ctest-pod-48451338] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:30:54,792 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-13 11:30:54,792 - DEBUG - [Pod Pod ctest-pod-48451338] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:30:54,792 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48451338 passed
2025-01-13 11:30:59,862 - DEBUG - [Pod ctest-pod-41841641] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-13 11:30:59,863 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-13 11:30:59,863 - DEBUG - [Pod Pod ctest-pod-41841641] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-13 11:30:59,863 - INFO - wget check of of http://10.47.255.250 from ctest-pod-41841641 passed
2025-01-13 11:30:59,920 - DEBUG - [Pod ctest-pod-99581471] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:30:59,920 - DEBUG - [Pod Pod ctest-pod-99581471] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-13 11:30:59,921 - DEBUG - [Pod Pod ctest-pod-99581471] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-13 11:30:59,921 - INFO - wget check of of http://10.47.255.251 from ctest-pod-99581471 passed
2025-01-13 11:30:59,921 - INFO - Deleting Network Policy : ingress-on-service
2025-01-13 11:30:59,922 - INFO - Deleting service : ctest-nginx-svc-32461501
2025-01-13 11:31:00,173 - DEBUG - No XMPP flaps were noticed during the test
2025-01-13 11:31:00,173 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-01-13 11:31:00,173 - INFO - --------------------------------------------------------------------------------
2025-01-13 11:31:00,180 - INFO - Deleting pod ctest-new-default-30864374:ctest-pod-94929543
2025-01-13 11:31:00,181 - INFO - Deleting pod ctest-new-default-30864374:ctest-pod-70254344
2025-01-13 11:31:00,182 - INFO - Deleting pod ctest-non-default-32433409:ctest-pod-14726679
2025-01-13 11:31:00,182 - INFO - Deleting pod ctest-non-default-32433409:ctest-pod-54994917
2025-01-13 11:31:00,183 - INFO - Deleting pod ctest-new-default-30864374:ctest-pod-41841641
2025-01-13 11:31:00,183 - INFO - Deleting pod ctest-new-default-30864374:ctest-pod-48451338
2025-01-13 11:31:00,183 - INFO - Deleting pod ctest-non-default-32433409:ctest-pod-32130726
2025-01-13 11:31:00,183 - INFO - Deleting pod ctest-non-default-32433409:ctest-pod-99581471
2025-01-13 11:31:00,229 - WARNING - Pod uuid e79696e1-5e89-440d-b946-a6cbc2e3fe49 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,337 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,365 - WARNING - Pod uuid b316facc-39b2-4937-aa09-afab4d2ead52 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,366 - WARNING - Pod uuid bff3a124-3019-4a6c-903f-e159600e6e64 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,367 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,367 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,368 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:00,368 - WARNING - Pod uuid 7bbeb630-23c0-4d7e-a4f8-9bf5e23191b9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:05,237 - DEBUG - Pod e79696e1-5e89-440d-b946-a6cbc2e3fe49 is not in agent 10.0.0.27 VM list
2025-01-13 11:31:05,244 - DEBUG - VMI 5e9b5948-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:05,244 - INFO - Verified that pod ctest-pod-94929543 is removed in agent
2025-01-13 11:31:05,346 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:05,398 - DEBUG - Pod 7bbeb630-23c0-4d7e-a4f8-9bf5e23191b9 is not in agent 10.0.0.27 VM list
2025-01-13 11:31:05,403 - DEBUG - Pod b316facc-39b2-4937-aa09-afab4d2ead52 is not in agent 10.0.0.27 VM list
2025-01-13 11:31:05,404 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:05,405 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:05,406 - DEBUG - Pod bff3a124-3019-4a6c-903f-e159600e6e64 is not in agent 10.0.0.27 VM list
2025-01-13 11:31:05,407 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:05,416 - DEBUG - VMI 5fe46a9c-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:05,417 - INFO - Verified that pod ctest-pod-14726679 is removed in agent
2025-01-13 11:31:05,418 - DEBUG - VMI 5f313328-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:05,418 - INFO - Verified that pod ctest-pod-70254344 is removed in agent
2025-01-13 11:31:05,419 - DEBUG - VMI 6070b51a-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:05,419 - INFO - Verified that pod ctest-pod-54994917 is removed in agent
2025-01-13 11:31:10,355 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:10,430 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:10,430 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:10,432 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:15,363 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:15,447 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:15,448 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:15,449 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:20,371 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:20,463 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:20,467 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:20,467 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:25,382 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:25,474 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:25,482 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:25,483 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:30,392 - WARNING - Pod uuid 1a831752-e424-4807-98d7-53068033bae3 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:30,491 - WARNING - Pod uuid 20897dcb-367b-470e-9a3a-fc4deaa740a9 is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:30,502 - WARNING - Pod uuid a5a80434-f033-4c48-9678-05c333b1c77e is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:30,504 - WARNING - Pod uuid 417a9f48-aec9-49d6-acb0-4179a75b540b is still seen in agent 10.0.0.27 VM list
2025-01-13 11:31:35,401 - DEBUG - Pod 1a831752-e424-4807-98d7-53068033bae3 is not in agent 10.0.0.27 VM list
2025-01-13 11:31:35,408 - DEBUG - VMI 6116a128-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:35,408 - INFO - Verified that pod ctest-pod-41841641 is removed in agent
2025-01-13 11:31:35,501 - DEBUG - Pod 20897dcb-367b-470e-9a3a-fc4deaa740a9 is not in agent 10.0.0.27 VM list
2025-01-13 11:31:35,517 - DEBUG - Pod a5a80434-f033-4c48-9678-05c333b1c77e is not in agent 10.0.0.27 VM list
2025-01-13 11:31:35,520 - DEBUG - VMI 622f0eec-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:35,520 - INFO - Verified that pod ctest-pod-32130726 is removed in agent
2025-01-13 11:31:35,521 - DEBUG - Pod 417a9f48-aec9-49d6-acb0-4179a75b540b is not in agent 10.0.0.27 VM list
2025-01-13 11:31:35,531 - DEBUG - VMI 62b8878a-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:35,531 - INFO - Verified that pod ctest-pod-99581471 is removed in agent
2025-01-13 11:31:35,533 - DEBUG - VMI 619e035c-d1a1-11ef-a922-fa163eca5e3b is removed from agent 10.0.0.27
2025-01-13 11:31:35,533 - INFO - Verified that pod ctest-pod-48451338 is removed in agent
2025-01-13 11:31:35,533 - INFO - Deleting namespace ctest-non-default-32433409
2025-01-13 11:31:35,555 - DEBUG - Namespace ctest-non-default-32433409 still in k8s
2025-01-13 11:31:37,560 - DEBUG - Namespace ctest-non-default-32433409 still in k8s
2025-01-13 11:31:39,566 - DEBUG - Namespace ctest-non-default-32433409 still in k8s
2025-01-13 11:31:41,573 - DEBUG - Namespace ctest-non-default-32433409 is not in k8s
2025-01-13 11:31:41,573 - DEBUG - No need to check project deletion in contrail-api
2025-01-13 11:31:41,573 - INFO - Deleting namespace ctest-new-default-30864374
2025-01-13 11:31:41,595 - DEBUG - Namespace ctest-new-default-30864374 still in k8s
2025-01-13 11:31:43,608 - DEBUG - Namespace ctest-new-default-30864374 still in k8s
2025-01-13 11:31:45,613 - DEBUG - Namespace ctest-new-default-30864374 still in k8s
2025-01-13 11:31:47,618 - DEBUG - Namespace ctest-new-default-30864374 is not in k8s
2025-01-13 11:31:47,618 - DEBUG - No need to check project deletion in contrail-api