2025-01-07 11:32:03,586 - INFO - Using existing project ['default-domain', 'k8s-default'](0f916082-800a-448f-9201-34496beecede)
2025-01-07 11:32:03,604 - DEBUG - Namespace ctest-new-default-44253877 not present
2025-01-07 11:32:03,612 - INFO - Created namespace ctest-new-default-44253877
2025-01-07 11:32:06,616 - DEBUG - Namespace ctest-non-default-73307876 not present
2025-01-07 11:32:06,622 - INFO - Created namespace ctest-non-default-73307876
2025-01-07 11:32:09,651 - DEBUG - Pod ctest-pod-12140548 not present
2025-01-07 11:32:09,652 - INFO - Creating Pod ctest-pod-12140548
2025-01-07 11:32:09,705 - DEBUG - Node for Pod ctest-pod-12140548 not yet populated
2025-01-07 11:32:12,714 - DEBUG - Pod : ctest-pod-12140548 UUID is 05d2af51-7ad9-43bd-b707-bcf778999ddf
2025-01-07 11:32:12,716 - DEBUG - Pod ctest-pod-58290331 not present
2025-01-07 11:32:12,716 - INFO - Creating Pod ctest-pod-58290331
2025-01-07 11:32:12,750 - DEBUG - Pod : ctest-pod-58290331 UUID is 84ac7c67-6122-42ff-99f8-b56c6086cb50
2025-01-07 11:32:12,753 - DEBUG - Pod ctest-pod-42653419 not present
2025-01-07 11:32:12,753 - INFO - Creating Pod ctest-pod-42653419
2025-01-07 11:32:12,780 - DEBUG - Pod : ctest-pod-42653419 UUID is c3ced579-58a6-42fc-89e1-3ff8d57117b0
2025-01-07 11:32:12,791 - DEBUG - Pod ctest-pod-00865821 not present
2025-01-07 11:32:12,792 - INFO - Creating Pod ctest-pod-00865821
2025-01-07 11:32:12,813 - DEBUG - Pod : ctest-pod-00865821 UUID is eb75fcac-e95d-4949-b93f-0a19acf09b69
2025-01-07 11:32:12,818 - DEBUG - Pod ctest-pod-76498836 not present
2025-01-07 11:32:12,818 - INFO - Creating Pod ctest-pod-76498836
2025-01-07 11:32:12,845 - DEBUG - Pod : ctest-pod-76498836 UUID is 437ecf08-bd5d-42dc-bc79-15d799670bc0
2025-01-07 11:32:12,850 - DEBUG - Pod ctest-pod-35872034 not present
2025-01-07 11:32:12,850 - INFO - Creating Pod ctest-pod-35872034
2025-01-07 11:32:12,883 - DEBUG - Pod : ctest-pod-35872034 UUID is e82d1658-badc-40db-8dba-c8668f33fe1b
2025-01-07 11:32:12,887 - DEBUG - Pod ctest-pod-99856328 not present
2025-01-07 11:32:12,887 - INFO - Creating Pod ctest-pod-99856328
2025-01-07 11:32:12,912 - DEBUG - Pod : ctest-pod-99856328 UUID is dd3154b9-d068-4d91-86f4-937c56a79cdf
2025-01-07 11:32:12,915 - DEBUG - Pod ctest-pod-41048104 not present
2025-01-07 11:32:12,915 - INFO - Creating Pod ctest-pod-41048104
2025-01-07 11:32:12,968 - DEBUG - Pod : ctest-pod-41048104 UUID is 5b687597-e118-4f94-92f2-9a2fd6bbf940
2025-01-07 11:32:13,152 - INFO - Project default-domain:k8s-ctest-new-default-44253877 for Namespace ctest-new-default-44253877 is seen in contrail-api
2025-01-07 11:32:13,152 - DEBUG - Project uuid in Contrail is c70a666a-9af3-48c6-bf95-3d45762cb330
2025-01-07 11:32:13,365 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=5a2950b4-be9e-4b3f-bb38-45987ff6bcec
2025-01-07 11:32:13,370 - INFO - Namespace ctest-new-default-44253877 with uuid 5a2950b4-be9e-4b3f-bb38-45987ff6bcec found in kube manager
2025-01-07 11:32:13,370 - INFO - Namespace ctest-new-default-44253877 verification passed
2025-01-07 11:32:13,622 - INFO - Project default-domain:k8s-ctest-non-default-73307876 for Namespace ctest-non-default-73307876 is seen in contrail-api
2025-01-07 11:32:13,622 - DEBUG - Project uuid in Contrail is 5ad8a779-8eee-4125-9516-fb664fefc017
2025-01-07 11:32:13,622 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=965b3b33-b071-41f2-bc61-ac6331844e3a
2025-01-07 11:32:13,627 - INFO - Namespace ctest-non-default-73307876 with uuid 965b3b33-b071-41f2-bc61-ac6331844e3a found in kube manager
2025-01-07 11:32:13,627 - INFO - Namespace ctest-non-default-73307876 verification passed
2025-01-07 11:32:13,636 - DEBUG - Pod ctest-pod-12140548 not in running state.Currently in Pending
2025-01-07 11:32:18,642 - INFO - Pod ctest-pod-12140548 is in running state.Got IP 10.47.255.251
2025-01-07 11:32:18,722 - DEBUG - Pod ctest-pod-12140548 has vmi 0924ef70-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:18,722 - INFO - Verified pod ctest-pod-12140548 in contrail-api
2025-01-07 11:32:18,735 - DEBUG - VMI 0924ef70-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:18,735 - INFO - Verified Pod ctest-pod-12140548 in agent 10.0.0.27
2025-01-07 11:32:18,735 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=05d2af51-7ad9-43bd-b707-bcf778999ddf
2025-01-07 11:32:18,740 - INFO - Pod ctest-pod-12140548 with uuid 05d2af51-7ad9-43bd-b707-bcf778999ddf found in kube manager
2025-01-07 11:32:18,741 - INFO - Pod ctest-pod-12140548 verification passed
2025-01-07 11:32:18,745 - DEBUG - Pod ctest-pod-58290331 not in running state.Currently in Pending
2025-01-07 11:32:23,751 - INFO - Pod ctest-pod-58290331 is in running state.Got IP 10.47.255.250
2025-01-07 11:32:23,765 - DEBUG - Pod ctest-pod-58290331 has vmi 0a0a09e8-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:23,765 - INFO - Verified pod ctest-pod-58290331 in contrail-api
2025-01-07 11:32:23,779 - DEBUG - VMI 0a0a09e8-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:23,780 - INFO - Verified Pod ctest-pod-58290331 in agent 10.0.0.27
2025-01-07 11:32:23,780 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=84ac7c67-6122-42ff-99f8-b56c6086cb50
2025-01-07 11:32:23,784 - INFO - Pod ctest-pod-58290331 with uuid 84ac7c67-6122-42ff-99f8-b56c6086cb50 found in kube manager
2025-01-07 11:32:23,784 - INFO - Pod ctest-pod-58290331 verification passed
2025-01-07 11:32:23,791 - DEBUG - Pod ctest-pod-42653419 not in running state.Currently in Pending
2025-01-07 11:32:28,799 - INFO - Pod ctest-pod-42653419 is in running state.Got IP 10.47.255.249
2025-01-07 11:32:28,817 - DEBUG - Pod ctest-pod-42653419 has vmi 0abe5f38-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:28,817 - INFO - Verified pod ctest-pod-42653419 in contrail-api
2025-01-07 11:32:28,832 - DEBUG - VMI 0abe5f38-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:28,832 - INFO - Verified Pod ctest-pod-42653419 in agent 10.0.0.27
2025-01-07 11:32:28,833 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c3ced579-58a6-42fc-89e1-3ff8d57117b0
2025-01-07 11:32:28,839 - INFO - Pod ctest-pod-42653419 with uuid c3ced579-58a6-42fc-89e1-3ff8d57117b0 found in kube manager
2025-01-07 11:32:28,840 - INFO - Pod ctest-pod-42653419 verification passed
2025-01-07 11:32:28,847 - INFO - Pod ctest-pod-00865821 is in running state.Got IP 10.47.255.248
2025-01-07 11:32:28,902 - DEBUG - Pod ctest-pod-00865821 has vmi 0b5e1ad2-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:28,902 - INFO - Verified pod ctest-pod-00865821 in contrail-api
2025-01-07 11:32:28,917 - DEBUG - VMI 0b5e1ad2-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:28,917 - INFO - Verified Pod ctest-pod-00865821 in agent 10.0.0.27
2025-01-07 11:32:28,918 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=eb75fcac-e95d-4949-b93f-0a19acf09b69
2025-01-07 11:32:28,922 - INFO - Pod ctest-pod-00865821 with uuid eb75fcac-e95d-4949-b93f-0a19acf09b69 found in kube manager
2025-01-07 11:32:28,922 - INFO - Pod ctest-pod-00865821 verification passed
2025-01-07 11:32:28,927 - INFO - Pod ctest-pod-76498836 is in running state.Got IP 10.47.255.247
2025-01-07 11:32:28,982 - DEBUG - Pod ctest-pod-76498836 has vmi 0bfce4b4-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:28,982 - INFO - Verified pod ctest-pod-76498836 in contrail-api
2025-01-07 11:32:28,996 - DEBUG - VMI 0bfce4b4-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:28,996 - INFO - Verified Pod ctest-pod-76498836 in agent 10.0.0.27
2025-01-07 11:32:28,996 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=437ecf08-bd5d-42dc-bc79-15d799670bc0
2025-01-07 11:32:29,000 - INFO - Pod ctest-pod-76498836 with uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 found in kube manager
2025-01-07 11:32:29,000 - INFO - Pod ctest-pod-76498836 verification passed
2025-01-07 11:32:29,006 - INFO - Pod ctest-pod-99856328 is in running state.Got IP 10.47.255.245
2025-01-07 11:32:29,021 - DEBUG - Pod ctest-pod-99856328 has vmi 0cf83ff8-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:29,021 - INFO - Verified pod ctest-pod-99856328 in contrail-api
2025-01-07 11:32:29,034 - DEBUG - VMI 0cf83ff8-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:29,034 - INFO - Verified Pod ctest-pod-99856328 in agent 10.0.0.27
2025-01-07 11:32:29,034 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=dd3154b9-d068-4d91-86f4-937c56a79cdf
2025-01-07 11:32:29,038 - INFO - Pod ctest-pod-99856328 with uuid dd3154b9-d068-4d91-86f4-937c56a79cdf found in kube manager
2025-01-07 11:32:29,038 - INFO - Pod ctest-pod-99856328 verification passed
2025-01-07 11:32:29,043 - INFO - Pod ctest-pod-35872034 is in running state.Got IP 10.47.255.246
2025-01-07 11:32:29,101 - DEBUG - Pod ctest-pod-35872034 has vmi 0c8550d8-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:29,101 - INFO - Verified pod ctest-pod-35872034 in contrail-api
2025-01-07 11:32:29,116 - DEBUG - VMI 0c8550d8-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:29,116 - INFO - Verified Pod ctest-pod-35872034 in agent 10.0.0.27
2025-01-07 11:32:29,116 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=e82d1658-badc-40db-8dba-c8668f33fe1b
2025-01-07 11:32:29,120 - INFO - Pod ctest-pod-35872034 with uuid e82d1658-badc-40db-8dba-c8668f33fe1b found in kube manager
2025-01-07 11:32:29,120 - INFO - Pod ctest-pod-35872034 verification passed
2025-01-07 11:32:29,124 - INFO - Pod ctest-pod-41048104 is in running state.Got IP 10.47.255.244
2025-01-07 11:32:29,182 - DEBUG - Pod ctest-pod-41048104 has vmi 0d7152b2-cceb-11ef-ad30-fa163e2f646d
2025-01-07 11:32:29,182 - INFO - Verified pod ctest-pod-41048104 in contrail-api
2025-01-07 11:32:29,194 - DEBUG - VMI 0d7152b2-cceb-11ef-ad30-fa163e2f646d is active in agent 10.0.0.27
2025-01-07 11:32:29,194 - INFO - Verified Pod ctest-pod-41048104 in agent 10.0.0.27
2025-01-07 11:32:29,195 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=5b687597-e118-4f94-92f2-9a2fd6bbf940
2025-01-07 11:32:29,199 - INFO - Pod ctest-pod-41048104 with uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 found in kube manager
2025-01-07 11:32:29,199 - INFO - Pod ctest-pod-41048104 verification passed
2025-01-07 11:32:29,199 - INFO - ================================================================================
2025-01-07 11:32:29,199 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-07 11:32:29,199 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-07 11:32:29,427 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.22': '0'}} with
2025-01-07 11:32:29,427 - INFO - Initial checks done. Running the testcase now
2025-01-07 11:32:29,427 - INFO -
2025-01-07 11:32:29,636 - DEBUG - [Pod ctest-pod-12140548] Cmd: echo ctest-pod-12140548 > /usr/share/nginx/html/index.html, Output:
2025-01-07 11:32:29,726 - DEBUG - [Pod ctest-pod-58290331] Cmd: echo ctest-pod-58290331 > /usr/share/nginx/html/index.html, Output:
2025-01-07 11:32:29,781 - DEBUG - [Pod ctest-pod-42653419] Cmd: echo ctest-pod-42653419 > /usr/share/nginx/html/index.html, Output:
2025-01-07 11:32:29,836 - DEBUG - [Pod ctest-pod-00865821] Cmd: echo ctest-pod-00865821 > /usr/share/nginx/html/index.html, Output:
2025-01-07 11:32:29,840 - DEBUG - Service ctest-nginx-svc-25841952 not present
2025-01-07 11:32:29,840 - INFO - Creating service ctest-nginx-svc-25841952
2025-01-07 11:32:29,867 - INFO - Created Service ctest-nginx-svc-25841952
2025-01-07 11:32:29,879 - WARNING - Service UUID daf5a202-2c38-4272-98d1-7af5c0a98f1f not yet found in contrail-api
2025-01-07 11:32:30,897 - INFO - Validated that Service ctest-nginx-svc-25841952 is seen in contrail-api
2025-01-07 11:32:30,897 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=daf5a202-2c38-4272-98d1-7af5c0a98f1f
2025-01-07 11:32:30,907 - INFO - Service ctest-nginx-svc-25841952 with uuid daf5a202-2c38-4272-98d1-7af5c0a98f1f found in kube manager
2025-01-07 11:32:30,907 - INFO - Service ctest-nginx-svc-25841952 verification passed
2025-01-07 11:32:32,003 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
ctest-pod-58290331
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,003 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:32:32,003 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
ctest-pod-58290331
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,053 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-58290331
2025-01-07 11:32:32,054 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:32:32,054 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-58290331
2025-01-07 11:32:32,137 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-58290331
2025-01-07 11:32:32,137 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:32:32,137 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-58290331
2025-01-07 11:32:32,210 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,210 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:32:32,210 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,210 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12140548': 1, 'ctest-pod-58290331': 3}
2025-01-07 11:32:32,272 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,272 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:32:32,272 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,337 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,337 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:32:32,337 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:32:32,338 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12140548': 1, 'ctest-pod-58290331': 1}
2025-01-07 11:32:32,341 - DEBUG - Network policy ingress-on-service not present
2025-01-07 11:32:32,341 - INFO - Creating Network Policy ingress-on-service
2025-01-07 11:32:32,352 - INFO - Network policy found in k8s
2025-01-07 11:32:32,353 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ae91662-eba4-4239-8ace-4aa84f342ef9
2025-01-07 11:32:32,361 - INFO - Network Policy ingress-on-service with uuid 8ae91662-eba4-4239-8ace-4aa84f342ef9 found in kube manager
2025-01-07 11:32:32,408 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-07 11:32:32,408 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-07 11:32:32,409 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ae91662-eba4-4239-8ace-4aa84f342ef9
2025-01-07 11:32:32,445 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-07 11:32:34,446 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ae91662-eba4-4239-8ace-4aa84f342ef9
2025-01-07 11:32:34,481 - INFO - Network policy with name ingress-on-service found in agent
2025-01-07 11:32:34,481 - INFO - Network Policy ingress-on-service verification passed
2025-01-07 11:32:39,549 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:39,549 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:39,549 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:44,604 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:44,604 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:44,604 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:49,667 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:49,667 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:49,667 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:54,719 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:54,719 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:54,719 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:59,783 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:59,783 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:32:59,783 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:04,852 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:04,852 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:04,852 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:09,904 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:09,904 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:09,904 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:14,965 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:14,965 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:14,965 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:20,059 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:20,059 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:20,059 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:25,127 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:25,127 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:25,127 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:25,127 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-12140548': 0, 'ctest-pod-58290331': 0}
2025-01-07 11:33:25,199 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12140548
2025-01-07 11:33:25,199 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,199 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12140548
2025-01-07 11:33:25,268 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,268 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,268 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,326 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,326 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,326 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,385 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,385 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,385 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,473 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,473 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,473 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,544 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12140548
2025-01-07 11:33:25,544 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,544 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12140548
2025-01-07 11:33:25,608 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,608 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:33:25,608 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:33:25,608 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12140548': 6, 'ctest-pod-58290331': 1}
2025-01-07 11:33:30,660 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:30,660 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:30,660 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:35,730 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:35,730 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:35,730 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:40,805 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:40,805 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:40,805 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:45,876 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:45,876 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:45,876 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:50,931 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:50,931 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:50,931 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:55,993 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:55,993 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:33:55,993 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:01,067 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:01,067 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:01,067 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:06,123 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:06,123 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:06,123 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:11,187 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:11,187 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:11,187 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:16,233 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:16,233 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:16,233 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:16,233 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-12140548': 0, 'ctest-pod-58290331': 0}
2025-01-07 11:34:18,318 - DEBUG - [Pod ctest-pod-35872034] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.782 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.313/0.782 ms
2025-01-07 11:34:18,318 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-35872034 with expectation True passed
2025-01-07 11:34:20,382 - DEBUG - [Pod ctest-pod-76498836] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.804 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.315/0.804 ms
2025-01-07 11:34:20,382 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76498836 with expectation True passed
2025-01-07 11:34:22,447 - DEBUG - [Pod ctest-pod-99856328] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.274 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.478/1.274 ms
2025-01-07 11:34:22,447 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99856328 with expectation True passed
2025-01-07 11:34:22,513 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:34:22,513 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-07 11:34:22,513 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:34:22,513 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35872034 passed
2025-01-07 11:34:22,581 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:34:22,581 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-07 11:34:22,581 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:34:22,581 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35872034 passed
2025-01-07 11:34:27,645 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-07 11:34:27,645 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-07 11:34:27,645 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-07 11:34:27,645 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76498836 passed
2025-01-07 11:34:32,708 - DEBUG - [Pod ctest-pod-41048104] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-07 11:34:32,708 - DEBUG - [Pod Pod ctest-pod-41048104] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-07 11:34:32,708 - DEBUG - [Pod Pod ctest-pod-41048104] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-07 11:34:32,708 - INFO - wget check of of http://10.47.255.251 from ctest-pod-41048104 passed
2025-01-07 11:34:32,716 - INFO - Updating Network Policy ingress-on-service
2025-01-07 11:34:37,786 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:37,786 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:37,786 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:42,832 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:42,832 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:42,832 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:47,899 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:47,899 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:47,899 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:52,951 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:52,951 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:52,952 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:58,011 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:58,012 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:34:58,012 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:03,088 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:03,088 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:03,088 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:08,148 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:08,148 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:08,148 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:13,199 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:13,199 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:13,199 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:18,268 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:18,268 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:18,268 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:23,324 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:23,325 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:23,325 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.107.105.154:80 (10.107.105.154:80)
wget: download timed out
2025-01-07 11:35:23,325 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-12140548': 0, 'ctest-pod-58290331': 0}
2025-01-07 11:35:23,394 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,394 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:35:23,394 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,468 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,468 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:35:23,468 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,468 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12140548': 1, 'ctest-pod-58290331': 1}
2025-01-07 11:35:23,520 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,520 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:35:23,520 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,569 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,570 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:35:23,570 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,620 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,620 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:35:23,620 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: ctest-pod-12140548
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,674 - DEBUG - [Pod ctest-pod-99856328] Cmd: wget http://10.107.105.154:80/ -O - -T 5 -t 1 , Output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,674 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd wget http://10.107.105.154:80/ -O - -T 5 -t 1 passed
2025-01-07 11:35:23,675 - DEBUG - [Pod Pod ctest-pod-99856328] Cmd output: ctest-pod-58290331
Connecting to 10.107.105.154:80 (10.107.105.154:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-07 11:35:23,675 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12140548': 3, 'ctest-pod-58290331': 1}
2025-01-07 11:35:25,727 - DEBUG - [Pod ctest-pod-35872034] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.380 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.174/0.380 ms
2025-01-07 11:35:25,728 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-35872034 with expectation True passed
2025-01-07 11:35:27,788 - DEBUG - [Pod ctest-pod-76498836] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.978 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.060/0.377/0.978 ms
2025-01-07 11:35:27,789 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76498836 with expectation True passed
2025-01-07 11:35:29,867 - DEBUG - [Pod ctest-pod-99856328] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.002 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.381/1.002 ms
2025-01-07 11:35:29,867 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99856328 with expectation True passed
2025-01-07 11:35:29,929 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:35:29,929 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-07 11:35:29,929 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:35:29,929 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35872034 passed
2025-01-07 11:35:29,993 - DEBUG - [Pod ctest-pod-35872034] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:35:29,993 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-07 11:35:29,993 - DEBUG - [Pod Pod ctest-pod-35872034] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:35:29,993 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35872034 passed
2025-01-07 11:35:35,041 - DEBUG - [Pod ctest-pod-76498836] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-07 11:35:35,041 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-07 11:35:35,042 - DEBUG - [Pod Pod ctest-pod-76498836] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-07 11:35:35,042 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76498836 passed
2025-01-07 11:35:35,109 - DEBUG - [Pod ctest-pod-41048104] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:35:35,109 - DEBUG - [Pod Pod ctest-pod-41048104] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-07 11:35:35,109 - DEBUG - [Pod Pod ctest-pod-41048104] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-07 11:35:35,109 - INFO - wget check of of http://10.47.255.251 from ctest-pod-41048104 passed
2025-01-07 11:35:35,110 - INFO - Deleting Network Policy : ingress-on-service
2025-01-07 11:35:35,111 - INFO - Deleting service : ctest-nginx-svc-25841952
2025-01-07 11:35:35,349 - DEBUG - No XMPP flaps were noticed during the test
2025-01-07 11:35:35,349 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-01-07 11:35:35,349 - INFO - --------------------------------------------------------------------------------
2025-01-07 11:35:35,354 - INFO - Deleting pod ctest-new-default-44253877:ctest-pod-12140548
2025-01-07 11:35:35,355 - INFO - Deleting pod ctest-new-default-44253877:ctest-pod-58290331
2025-01-07 11:35:35,355 - INFO - Deleting pod ctest-non-default-73307876:ctest-pod-42653419
2025-01-07 11:35:35,355 - INFO - Deleting pod ctest-non-default-73307876:ctest-pod-00865821
2025-01-07 11:35:35,356 - INFO - Deleting pod ctest-new-default-44253877:ctest-pod-76498836
2025-01-07 11:35:35,356 - INFO - Deleting pod ctest-new-default-44253877:ctest-pod-35872034
2025-01-07 11:35:35,356 - INFO - Deleting pod ctest-non-default-73307876:ctest-pod-99856328
2025-01-07 11:35:35,357 - INFO - Deleting pod ctest-non-default-73307876:ctest-pod-41048104
2025-01-07 11:35:35,468 - WARNING - Pod uuid 05d2af51-7ad9-43bd-b707-bcf778999ddf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,515 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,517 - WARNING - Pod uuid 84ac7c67-6122-42ff-99f8-b56c6086cb50 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,517 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,517 - WARNING - Pod uuid eb75fcac-e95d-4949-b93f-0a19acf09b69 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,518 - WARNING - Pod uuid c3ced579-58a6-42fc-89e1-3ff8d57117b0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,518 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:35,518 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:40,480 - DEBUG - Pod 05d2af51-7ad9-43bd-b707-bcf778999ddf is not in agent 10.0.0.27 VM list
2025-01-07 11:35:40,485 - DEBUG - VMI 0924ef70-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:35:40,485 - INFO - Verified that pod ctest-pod-12140548 is removed in agent
2025-01-07 11:35:40,544 - DEBUG - Pod c3ced579-58a6-42fc-89e1-3ff8d57117b0 is not in agent 10.0.0.27 VM list
2025-01-07 11:35:40,548 - DEBUG - Pod eb75fcac-e95d-4949-b93f-0a19acf09b69 is not in agent 10.0.0.27 VM list
2025-01-07 11:35:40,549 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:40,550 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:40,550 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:40,551 - DEBUG - Pod 84ac7c67-6122-42ff-99f8-b56c6086cb50 is not in agent 10.0.0.27 VM list
2025-01-07 11:35:40,552 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:40,561 - DEBUG - VMI 0abe5f38-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:35:40,561 - INFO - Verified that pod ctest-pod-42653419 is removed in agent
2025-01-07 11:35:40,563 - DEBUG - VMI 0b5e1ad2-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:35:40,563 - INFO - Verified that pod ctest-pod-00865821 is removed in agent
2025-01-07 11:35:40,563 - DEBUG - VMI 0a0a09e8-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:35:40,563 - INFO - Verified that pod ctest-pod-58290331 is removed in agent
2025-01-07 11:35:45,570 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:45,572 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:45,572 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:45,572 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:50,588 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:50,591 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:50,591 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:50,592 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:55,609 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:55,610 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:55,611 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:35:55,611 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:00,630 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:00,632 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:00,632 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:00,633 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:05,648 - WARNING - Pod uuid dd3154b9-d068-4d91-86f4-937c56a79cdf is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:05,649 - WARNING - Pod uuid e82d1658-badc-40db-8dba-c8668f33fe1b is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:05,650 - WARNING - Pod uuid 5b687597-e118-4f94-92f2-9a2fd6bbf940 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:05,650 - WARNING - Pod uuid 437ecf08-bd5d-42dc-bc79-15d799670bc0 is still seen in agent 10.0.0.27 VM list
2025-01-07 11:36:10,667 - DEBUG - Pod e82d1658-badc-40db-8dba-c8668f33fe1b is not in agent 10.0.0.27 VM list
2025-01-07 11:36:10,669 - DEBUG - Pod dd3154b9-d068-4d91-86f4-937c56a79cdf is not in agent 10.0.0.27 VM list
2025-01-07 11:36:10,672 - DEBUG - Pod 437ecf08-bd5d-42dc-bc79-15d799670bc0 is not in agent 10.0.0.27 VM list
2025-01-07 11:36:10,674 - DEBUG - Pod 5b687597-e118-4f94-92f2-9a2fd6bbf940 is not in agent 10.0.0.27 VM list
2025-01-07 11:36:10,691 - DEBUG - VMI 0bfce4b4-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:36:10,691 - INFO - Verified that pod ctest-pod-76498836 is removed in agent
2025-01-07 11:36:10,691 - DEBUG - VMI 0cf83ff8-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:36:10,691 - INFO - Verified that pod ctest-pod-99856328 is removed in agent
2025-01-07 11:36:10,692 - DEBUG - VMI 0d7152b2-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:36:10,692 - INFO - Verified that pod ctest-pod-41048104 is removed in agent
2025-01-07 11:36:10,693 - DEBUG - VMI 0c8550d8-cceb-11ef-ad30-fa163e2f646d is removed from agent 10.0.0.27
2025-01-07 11:36:10,693 - INFO - Verified that pod ctest-pod-35872034 is removed in agent
2025-01-07 11:36:10,693 - INFO - Deleting namespace ctest-non-default-73307876
2025-01-07 11:36:10,708 - DEBUG - Namespace ctest-non-default-73307876 still in k8s
2025-01-07 11:36:12,713 - DEBUG - Namespace ctest-non-default-73307876 still in k8s
2025-01-07 11:36:14,717 - DEBUG - Namespace ctest-non-default-73307876 still in k8s
2025-01-07 11:36:16,721 - DEBUG - Namespace ctest-non-default-73307876 is not in k8s
2025-01-07 11:36:16,721 - DEBUG - No need to check project deletion in contrail-api
2025-01-07 11:36:16,721 - INFO - Deleting namespace ctest-new-default-44253877
2025-01-07 11:36:16,731 - DEBUG - Namespace ctest-new-default-44253877 still in k8s
2025-01-07 11:36:18,736 - DEBUG - Namespace ctest-new-default-44253877 still in k8s
2025-01-07 11:36:20,740 - DEBUG - Namespace ctest-new-default-44253877 still in k8s
2025-01-07 11:36:22,745 - DEBUG - Namespace ctest-new-default-44253877 is not in k8s
2025-01-07 11:36:22,745 - DEBUG - No need to check project deletion in contrail-api