2024-10-19 17:45:10,664 - INFO - Using existing project ['default-domain', 'k8s-default'](063700e9-e1cd-4288-8123-14613a0f31df)
2024-10-19 17:45:10,685 - DEBUG - Namespace ctest-new-default-60332994 not present
2024-10-19 17:45:10,694 - INFO - Created namespace ctest-new-default-60332994
2024-10-19 17:45:13,698 - DEBUG - Namespace ctest-non-default-64796336 not present
2024-10-19 17:45:13,709 - INFO - Created namespace ctest-non-default-64796336
2024-10-19 17:45:16,730 - DEBUG - Pod ctest-pod-62429560 not present
2024-10-19 17:45:16,731 - INFO - Creating Pod ctest-pod-62429560
2024-10-19 17:45:16,764 - DEBUG - Pod : ctest-pod-62429560 UUID is 3c836726-fa62-449d-a091-df0aa3e7dd32
2024-10-19 17:45:16,768 - DEBUG - Pod ctest-pod-57184717 not present
2024-10-19 17:45:16,769 - INFO - Creating Pod ctest-pod-57184717
2024-10-19 17:45:16,804 - DEBUG - Pod : ctest-pod-57184717 UUID is c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d
2024-10-19 17:45:16,807 - DEBUG - Pod ctest-pod-01638984 not present
2024-10-19 17:45:16,807 - INFO - Creating Pod ctest-pod-01638984
2024-10-19 17:45:16,832 - DEBUG - Pod : ctest-pod-01638984 UUID is fc0d6b2b-a844-409f-83ac-279df42a194b
2024-10-19 17:45:16,836 - DEBUG - Pod ctest-pod-13400935 not present
2024-10-19 17:45:16,837 - INFO - Creating Pod ctest-pod-13400935
2024-10-19 17:45:16,876 - DEBUG - Pod : ctest-pod-13400935 UUID is 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c
2024-10-19 17:45:16,879 - DEBUG - Pod ctest-pod-83177514 not present
2024-10-19 17:45:16,879 - INFO - Creating Pod ctest-pod-83177514
2024-10-19 17:45:16,897 - DEBUG - Pod : ctest-pod-83177514 UUID is 95695d9f-4f03-470b-836c-e8f55b097150
2024-10-19 17:45:16,899 - DEBUG - Pod ctest-pod-27399550 not present
2024-10-19 17:45:16,899 - INFO - Creating Pod ctest-pod-27399550
2024-10-19 17:45:16,918 - DEBUG - Pod : ctest-pod-27399550 UUID is dafc9cf3-0785-464c-b29e-a1cc779f71db
2024-10-19 17:45:16,920 - DEBUG - Pod ctest-pod-67973534 not present
2024-10-19 17:45:16,920 - INFO - Creating Pod ctest-pod-67973534
2024-10-19 17:45:16,938 - DEBUG - Pod : ctest-pod-67973534 UUID is 897bbe83-56f3-4702-a487-8004c641f15f
2024-10-19 17:45:16,940 - DEBUG - Pod ctest-pod-61678341 not present
2024-10-19 17:45:16,940 - INFO - Creating Pod ctest-pod-61678341
2024-10-19 17:45:16,957 - DEBUG - Pod : ctest-pod-61678341 UUID is 8eb38753-9d19-47b9-880a-31259b521f96
2024-10-19 17:45:17,182 - INFO - Project default-domain:k8s-ctest-new-default-60332994 for Namespace ctest-new-default-60332994 is seen in contrail-api
2024-10-19 17:45:17,182 - DEBUG - Project uuid in Contrail is 12b4cc53-3b89-4f89-8e80-044e74aecb9b
2024-10-19 17:45:17,376 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=42037d91-3c38-4255-8b2b-2f9738dd3d92
2024-10-19 17:45:17,398 - INFO - Namespace ctest-new-default-60332994 with uuid 42037d91-3c38-4255-8b2b-2f9738dd3d92 found in kube manager
2024-10-19 17:45:17,398 - INFO - Namespace ctest-new-default-60332994 verification passed
2024-10-19 17:45:17,614 - INFO - Project default-domain:k8s-ctest-non-default-64796336 for Namespace ctest-non-default-64796336 is seen in contrail-api
2024-10-19 17:45:17,615 - DEBUG - Project uuid in Contrail is c8e2f6cf-ca4f-49c9-9aa0-7bd8786fe80c
2024-10-19 17:45:17,615 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=32277304-320a-4480-a6c3-2092b71c91f3
2024-10-19 17:45:17,620 - INFO - Namespace ctest-non-default-64796336 with uuid 32277304-320a-4480-a6c3-2092b71c91f3 found in kube manager
2024-10-19 17:45:17,620 - INFO - Namespace ctest-non-default-64796336 verification passed
2024-10-19 17:45:17,626 - DEBUG - Pod ctest-pod-62429560 not in running state.Currently in Pending
2024-10-19 17:45:22,634 - DEBUG - Pod ctest-pod-62429560 not in running state.Currently in Pending
2024-10-19 17:45:27,641 - INFO - Pod ctest-pod-62429560 is in running state.Got IP 10.47.255.251
2024-10-19 17:45:27,712 - DEBUG - Pod ctest-pod-62429560 has vmi e7fb4a52-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:27,712 - INFO - Verified pod ctest-pod-62429560 in contrail-api
2024-10-19 17:45:27,725 - DEBUG - VMI e7fb4a52-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:27,726 - INFO - Verified Pod ctest-pod-62429560 in agent 10.0.0.29
2024-10-19 17:45:27,726 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=3c836726-fa62-449d-a091-df0aa3e7dd32
2024-10-19 17:45:27,732 - INFO - Pod ctest-pod-62429560 with uuid 3c836726-fa62-449d-a091-df0aa3e7dd32 found in kube manager
2024-10-19 17:45:27,732 - INFO - Pod ctest-pod-62429560 verification passed
2024-10-19 17:45:27,745 - DEBUG - Pod ctest-pod-57184717 not in running state.Currently in Pending
2024-10-19 17:45:32,754 - INFO - Pod ctest-pod-57184717 is in running state.Got IP 10.47.255.250
2024-10-19 17:45:32,781 - DEBUG - Pod ctest-pod-57184717 has vmi e892d124-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:32,781 - INFO - Verified pod ctest-pod-57184717 in contrail-api
2024-10-19 17:45:32,795 - DEBUG - VMI e892d124-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:32,796 - INFO - Verified Pod ctest-pod-57184717 in agent 10.0.0.29
2024-10-19 17:45:32,796 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d
2024-10-19 17:45:32,804 - INFO - Pod ctest-pod-57184717 with uuid c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d found in kube manager
2024-10-19 17:45:32,804 - INFO - Pod ctest-pod-57184717 verification passed
2024-10-19 17:45:32,813 - DEBUG - Pod ctest-pod-01638984 not in running state.Currently in Pending
2024-10-19 17:45:37,819 - INFO - Pod ctest-pod-01638984 is in running state.Got IP 10.47.255.249
2024-10-19 17:45:37,841 - DEBUG - Pod ctest-pod-01638984 has vmi e9581b0a-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:37,841 - INFO - Verified pod ctest-pod-01638984 in contrail-api
2024-10-19 17:45:37,855 - DEBUG - VMI e9581b0a-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:37,855 - INFO - Verified Pod ctest-pod-01638984 in agent 10.0.0.29
2024-10-19 17:45:37,855 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=fc0d6b2b-a844-409f-83ac-279df42a194b
2024-10-19 17:45:37,861 - INFO - Pod ctest-pod-01638984 with uuid fc0d6b2b-a844-409f-83ac-279df42a194b found in kube manager
2024-10-19 17:45:37,861 - INFO - Pod ctest-pod-01638984 verification passed
2024-10-19 17:45:37,866 - INFO - Pod ctest-pod-13400935 is in running state.Got IP 10.47.255.248
2024-10-19 17:45:37,929 - DEBUG - Pod ctest-pod-13400935 has vmi e9e7f5e0-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:37,929 - INFO - Verified pod ctest-pod-13400935 in contrail-api
2024-10-19 17:45:37,944 - DEBUG - VMI e9e7f5e0-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:37,944 - INFO - Verified Pod ctest-pod-13400935 in agent 10.0.0.29
2024-10-19 17:45:37,944 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c
2024-10-19 17:45:37,950 - INFO - Pod ctest-pod-13400935 with uuid 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c found in kube manager
2024-10-19 17:45:37,950 - INFO - Pod ctest-pod-13400935 verification passed
2024-10-19 17:45:37,956 - INFO - Pod ctest-pod-83177514 is in running state.Got IP 10.47.255.247
2024-10-19 17:45:38,020 - DEBUG - Pod ctest-pod-83177514 has vmi ea86be1e-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:38,020 - INFO - Verified pod ctest-pod-83177514 in contrail-api
2024-10-19 17:45:38,036 - DEBUG - VMI ea86be1e-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:38,037 - INFO - Verified Pod ctest-pod-83177514 in agent 10.0.0.29
2024-10-19 17:45:38,037 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=95695d9f-4f03-470b-836c-e8f55b097150
2024-10-19 17:45:38,042 - INFO - Pod ctest-pod-83177514 with uuid 95695d9f-4f03-470b-836c-e8f55b097150 found in kube manager
2024-10-19 17:45:38,042 - INFO - Pod ctest-pod-83177514 verification passed
2024-10-19 17:45:38,048 - INFO - Pod ctest-pod-67973534 is in running state.Got IP 10.47.255.245
2024-10-19 17:45:38,082 - DEBUG - Pod ctest-pod-67973534 has vmi eb91216e-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:38,082 - INFO - Verified pod ctest-pod-67973534 in contrail-api
2024-10-19 17:45:38,098 - DEBUG - VMI eb91216e-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:38,099 - INFO - Verified Pod ctest-pod-67973534 in agent 10.0.0.29
2024-10-19 17:45:38,099 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=897bbe83-56f3-4702-a487-8004c641f15f
2024-10-19 17:45:38,106 - INFO - Pod ctest-pod-67973534 with uuid 897bbe83-56f3-4702-a487-8004c641f15f found in kube manager
2024-10-19 17:45:38,107 - INFO - Pod ctest-pod-67973534 verification passed
2024-10-19 17:45:38,114 - INFO - Pod ctest-pod-27399550 is in running state.Got IP 10.47.255.246
2024-10-19 17:45:38,178 - DEBUG - Pod ctest-pod-27399550 has vmi eb0a7aec-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:38,178 - INFO - Verified pod ctest-pod-27399550 in contrail-api
2024-10-19 17:45:38,193 - DEBUG - VMI eb0a7aec-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:38,193 - INFO - Verified Pod ctest-pod-27399550 in agent 10.0.0.29
2024-10-19 17:45:38,193 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=dafc9cf3-0785-464c-b29e-a1cc779f71db
2024-10-19 17:45:38,198 - INFO - Pod ctest-pod-27399550 with uuid dafc9cf3-0785-464c-b29e-a1cc779f71db found in kube manager
2024-10-19 17:45:38,199 - INFO - Pod ctest-pod-27399550 verification passed
2024-10-19 17:45:38,205 - INFO - Pod ctest-pod-61678341 is in running state.Got IP 10.47.255.244
2024-10-19 17:45:38,268 - DEBUG - Pod ctest-pod-61678341 has vmi ec119c2c-8e41-11ef-8d05-fa163e118063
2024-10-19 17:45:38,268 - INFO - Verified pod ctest-pod-61678341 in contrail-api
2024-10-19 17:45:38,283 - DEBUG - VMI ec119c2c-8e41-11ef-8d05-fa163e118063 is active in agent 10.0.0.29
2024-10-19 17:45:38,283 - INFO - Verified Pod ctest-pod-61678341 in agent 10.0.0.29
2024-10-19 17:45:38,283 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=8eb38753-9d19-47b9-880a-31259b521f96
2024-10-19 17:45:38,288 - INFO - Pod ctest-pod-61678341 with uuid 8eb38753-9d19-47b9-880a-31259b521f96 found in kube manager
2024-10-19 17:45:38,288 - INFO - Pod ctest-pod-61678341 verification passed
2024-10-19 17:45:38,289 - INFO - ================================================================================
2024-10-19 17:45:38,289 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-10-19 17:45:38,289 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-10-19 17:45:38,507 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.0.0.49': '0'}} with
2024-10-19 17:45:38,507 - INFO - Initial checks done. Running the testcase now
2024-10-19 17:45:38,507 - INFO -
2024-10-19 17:45:38,561 - DEBUG - [Pod ctest-pod-62429560] Cmd: echo ctest-pod-62429560 > /usr/share/nginx/html/index.html, Output:
2024-10-19 17:45:38,637 - DEBUG - [Pod ctest-pod-57184717] Cmd: echo ctest-pod-57184717 > /usr/share/nginx/html/index.html, Output:
2024-10-19 17:45:38,699 - DEBUG - [Pod ctest-pod-01638984] Cmd: echo ctest-pod-01638984 > /usr/share/nginx/html/index.html, Output:
2024-10-19 17:45:38,774 - DEBUG - [Pod ctest-pod-13400935] Cmd: echo ctest-pod-13400935 > /usr/share/nginx/html/index.html, Output:
2024-10-19 17:45:38,777 - DEBUG - Service ctest-nginx-svc-07663218 not present
2024-10-19 17:45:38,778 - INFO - Creating service ctest-nginx-svc-07663218
2024-10-19 17:45:38,800 - INFO - Created Service ctest-nginx-svc-07663218
2024-10-19 17:45:38,814 - WARNING - Service UUID 6f35216a-14a4-48fb-b26e-00e1980eb4ee not yet found in contrail-api
2024-10-19 17:45:39,822 - INFO - Validated that Service ctest-nginx-svc-07663218 is seen in contrail-api
2024-10-19 17:45:39,822 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=6f35216a-14a4-48fb-b26e-00e1980eb4ee
2024-10-19 17:45:39,828 - INFO - Service ctest-nginx-svc-07663218 with uuid 6f35216a-14a4-48fb-b26e-00e1980eb4ee found in kube manager
2024-10-19 17:45:39,828 - INFO - Service ctest-nginx-svc-07663218 verification passed
2024-10-19 17:45:40,916 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62429560
2024-10-19 17:45:40,916 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:45:40,917 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62429560
2024-10-19 17:45:40,981 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:45:40,981 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:45:40,981 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:45:40,981 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1}
2024-10-19 17:45:41,039 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62429560
2024-10-19 17:45:41,040 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:45:41,040 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62429560
2024-10-19 17:45:41,110 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:45:41,110 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:45:41,110 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:45:41,110 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1}
2024-10-19 17:45:41,114 - DEBUG - Network policy ingress-on-service not present
2024-10-19 17:45:41,114 - INFO - Creating Network Policy ingress-on-service
2024-10-19 17:45:41,130 - INFO - Network policy found in k8s
2024-10-19 17:45:41,130 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fdd00b2e-a69e-4538-b630-c67ffe226d2a
2024-10-19 17:45:41,151 - INFO - Network Policy ingress-on-service with uuid fdd00b2e-a69e-4538-b630-c67ffe226d2a found in kube manager
2024-10-19 17:45:41,202 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-10-19 17:45:41,203 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-10-19 17:45:41,203 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fdd00b2e-a69e-4538-b630-c67ffe226d2a
2024-10-19 17:45:41,238 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-19 17:45:43,239 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fdd00b2e-a69e-4538-b630-c67ffe226d2a
2024-10-19 17:45:43,274 - INFO - Network policy with name ingress-on-service found in agent
2024-10-19 17:45:43,274 - INFO - Network Policy ingress-on-service verification passed
2024-10-19 17:45:48,337 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:48,337 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:48,337 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:53,456 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:53,456 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:53,456 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:58,525 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:58,525 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:45:58,526 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:03,584 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:03,584 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:03,584 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:08,642 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:08,643 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:08,643 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:13,731 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:13,732 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:13,732 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:18,812 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:18,812 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:18,813 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:23,877 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:23,877 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:23,877 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:28,938 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:28,938 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:28,938 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:34,011 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:34,011 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:34,011 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:34,011 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62429560': 0, 'ctest-pod-57184717': 0}
2024-10-19 17:46:34,079 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-62429560
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:46:34,079 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:46:34,079 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-62429560
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:46:34,138 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:46:34,138 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:46:34,138 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:46:34,138 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1}
2024-10-19 17:46:39,201 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:39,201 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:39,201 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:44,267 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:44,268 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:44,268 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:49,329 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:49,329 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:49,329 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:54,393 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:54,393 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:54,393 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:59,471 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:59,471 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:46:59,471 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:04,523 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:04,523 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:04,523 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:09,596 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:09,596 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:09,596 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:14,654 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:14,655 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:14,655 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:19,712 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:19,712 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:19,712 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:24,778 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:24,778 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:24,778 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:24,778 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62429560': 0, 'ctest-pod-57184717': 0}
2024-10-19 17:47:26,839 - DEBUG - [Pod ctest-pod-27399550] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.832 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.338/0.832 ms
2024-10-19 17:47:26,839 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-27399550 with expectation True passed
2024-10-19 17:47:28,899 - DEBUG - [Pod ctest-pod-83177514] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.551 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.240/0.551 ms
2024-10-19 17:47:28,900 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83177514 with expectation True passed
2024-10-19 17:47:30,969 - DEBUG - [Pod ctest-pod-67973534] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.664 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.268/0.664 ms
2024-10-19 17:47:30,969 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67973534 with expectation True passed
2024-10-19 17:47:31,030 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:47:31,030 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-19 17:47:31,030 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:47:31,030 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27399550 passed
2024-10-19 17:47:31,093 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:47:31,093 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-19 17:47:31,093 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:47:31,093 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27399550 passed
2024-10-19 17:47:36,153 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-19 17:47:36,154 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-19 17:47:36,154 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-19 17:47:36,154 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83177514 passed
2024-10-19 17:47:41,223 - DEBUG - [Pod ctest-pod-61678341] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-19 17:47:41,223 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-19 17:47:41,224 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-19 17:47:41,224 - INFO - wget check of of http://10.47.255.251 from ctest-pod-61678341 passed
2024-10-19 17:47:41,238 - INFO - Updating Network Policy ingress-on-service
2024-10-19 17:47:46,322 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:46,322 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:46,322 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:51,383 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:51,383 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:51,383 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:56,450 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:56,450 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:47:56,450 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:01,519 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:01,520 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:01,520 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:06,587 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:06,587 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:06,587 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:11,646 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:11,646 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:11,646 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:16,715 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:16,716 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:16,716 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:21,774 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:21,774 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:21,774 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:26,824 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:26,824 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:26,824 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:31,900 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:31,900 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:31,900 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
wget: download timed out
2024-10-19 17:48:31,900 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62429560': 0, 'ctest-pod-57184717': 0}
2024-10-19 17:48:31,972 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:31,972 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:31,972 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,057 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-62429560
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,057 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,057 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: ctest-pod-62429560
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,057 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 1}
2024-10-19 17:48:32,111 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:48:32,112 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,112 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:48:32,169 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,170 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,170 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,217 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,218 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,218 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,264 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,264 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,264 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,314 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,314 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,314 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: ctest-pod-57184717
Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-19 17:48:32,365 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:48:32,365 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,365 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-57184717
2024-10-19 17:48:32,412 - DEBUG - [Pod ctest-pod-67973534] Cmd: wget http://10.101.158.67:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62429560
2024-10-19 17:48:32,412 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd wget http://10.101.158.67:80/ -O - -T 5 -t 1 passed
2024-10-19 17:48:32,412 - DEBUG - [Pod Pod ctest-pod-67973534] Cmd output: Connecting to 10.101.158.67:80 (10.101.158.67:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62429560
2024-10-19 17:48:32,412 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62429560': 1, 'ctest-pod-57184717': 6}
2024-10-19 17:48:34,477 - DEBUG - [Pod ctest-pod-27399550] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.797 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.327/0.797 ms
2024-10-19 17:48:34,477 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-27399550 with expectation True passed
2024-10-19 17:48:36,548 - DEBUG - [Pod ctest-pod-83177514] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.927 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.065 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.354/0.927 ms
2024-10-19 17:48:36,548 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83177514 with expectation True passed
2024-10-19 17:48:38,629 - DEBUG - [Pod ctest-pod-67973534] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.268 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.064 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.064/0.469/1.268 ms
2024-10-19 17:48:38,629 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67973534 with expectation True passed
2024-10-19 17:48:38,689 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:48:38,690 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-19 17:48:38,690 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:48:38,690 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27399550 passed
2024-10-19 17:48:38,766 - DEBUG - [Pod ctest-pod-27399550] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:48:38,767 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-19 17:48:38,767 - DEBUG - [Pod Pod ctest-pod-27399550] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:48:38,767 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27399550 passed
2024-10-19 17:48:43,828 - DEBUG - [Pod ctest-pod-83177514] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-19 17:48:43,828 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-19 17:48:43,828 - DEBUG - [Pod Pod ctest-pod-83177514] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-19 17:48:43,828 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83177514 passed
2024-10-19 17:48:43,896 - DEBUG - [Pod ctest-pod-61678341] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:48:43,896 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-19 17:48:43,897 - DEBUG - [Pod Pod ctest-pod-61678341] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-19 17:48:43,897 - INFO - wget check of of http://10.47.255.251 from ctest-pod-61678341 passed
2024-10-19 17:48:43,897 - INFO - Deleting Network Policy : ingress-on-service
2024-10-19 17:48:43,897 - INFO - Deleting service : ctest-nginx-svc-07663218
2024-10-19 17:48:44,062 - DEBUG - No XMPP flaps were noticed during the test
2024-10-19 17:48:44,063 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-10-19 17:48:44,063 - INFO - --------------------------------------------------------------------------------
2024-10-19 17:48:44,071 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-62429560
2024-10-19 17:48:44,073 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-57184717
2024-10-19 17:48:44,073 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-01638984
2024-10-19 17:48:44,074 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-13400935
2024-10-19 17:48:44,074 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-83177514
2024-10-19 17:48:44,075 - INFO - Deleting pod ctest-new-default-60332994:ctest-pod-27399550
2024-10-19 17:48:44,075 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-67973534
2024-10-19 17:48:44,076 - INFO - Deleting pod ctest-non-default-64796336:ctest-pod-61678341
2024-10-19 17:48:44,183 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,184 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,184 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,186 - WARNING - Pod uuid 3c836726-fa62-449d-a091-df0aa3e7dd32 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,200 - WARNING - Pod uuid c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,201 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,202 - WARNING - Pod uuid 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:44,202 - WARNING - Pod uuid fc0d6b2b-a844-409f-83ac-279df42a194b is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:49,198 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:49,211 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:49,211 - DEBUG - Pod 3c836726-fa62-449d-a091-df0aa3e7dd32 is not in agent 10.0.0.29 VM list
2024-10-19 17:48:49,213 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:49,226 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:49,227 - DEBUG - VMI e7fb4a52-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:48:49,227 - INFO - Verified that pod ctest-pod-62429560 is removed in agent
2024-10-19 17:48:49,229 - DEBUG - Pod 9fa54612-a9b7-42a3-9f9c-9f74a8d49f6c is not in agent 10.0.0.29 VM list
2024-10-19 17:48:49,230 - DEBUG - Pod fc0d6b2b-a844-409f-83ac-279df42a194b is not in agent 10.0.0.29 VM list
2024-10-19 17:48:49,232 - DEBUG - Pod c277a3d1-2b39-4f58-aa84-60f5bc0c5a2d is not in agent 10.0.0.29 VM list
2024-10-19 17:48:49,244 - DEBUG - VMI e9e7f5e0-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:48:49,244 - INFO - Verified that pod ctest-pod-13400935 is removed in agent
2024-10-19 17:48:49,246 - DEBUG - VMI e9581b0a-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:48:49,246 - INFO - Verified that pod ctest-pod-01638984 is removed in agent
2024-10-19 17:48:49,247 - DEBUG - VMI e892d124-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:48:49,247 - INFO - Verified that pod ctest-pod-57184717 is removed in agent
2024-10-19 17:48:54,207 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:54,221 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:54,234 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:54,454 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:59,216 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:59,229 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:59,241 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:48:59,464 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:04,225 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:04,238 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:04,249 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:04,473 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:09,233 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:09,245 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:09,257 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:09,483 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:14,249 - WARNING - Pod uuid dafc9cf3-0785-464c-b29e-a1cc779f71db is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:14,256 - WARNING - Pod uuid 8eb38753-9d19-47b9-880a-31259b521f96 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:14,264 - WARNING - Pod uuid 95695d9f-4f03-470b-836c-e8f55b097150 is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:14,492 - WARNING - Pod uuid 897bbe83-56f3-4702-a487-8004c641f15f is still seen in agent 10.0.0.29 VM list
2024-10-19 17:49:19,259 - DEBUG - Pod dafc9cf3-0785-464c-b29e-a1cc779f71db is not in agent 10.0.0.29 VM list
2024-10-19 17:49:19,270 - DEBUG - Pod 95695d9f-4f03-470b-836c-e8f55b097150 is not in agent 10.0.0.29 VM list
2024-10-19 17:49:19,273 - DEBUG - Pod 8eb38753-9d19-47b9-880a-31259b521f96 is not in agent 10.0.0.29 VM list
2024-10-19 17:49:19,274 - DEBUG - VMI eb0a7aec-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:49:19,274 - INFO - Verified that pod ctest-pod-27399550 is removed in agent
2024-10-19 17:49:19,281 - DEBUG - VMI ea86be1e-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:49:19,281 - INFO - Verified that pod ctest-pod-83177514 is removed in agent
2024-10-19 17:49:19,283 - DEBUG - VMI ec119c2c-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:49:19,283 - INFO - Verified that pod ctest-pod-61678341 is removed in agent
2024-10-19 17:49:19,500 - DEBUG - Pod 897bbe83-56f3-4702-a487-8004c641f15f is not in agent 10.0.0.29 VM list
2024-10-19 17:49:19,507 - DEBUG - VMI eb91216e-8e41-11ef-8d05-fa163e118063 is removed from agent 10.0.0.29
2024-10-19 17:49:19,507 - INFO - Verified that pod ctest-pod-67973534 is removed in agent
2024-10-19 17:49:19,508 - INFO - Deleting namespace ctest-non-default-64796336
2024-10-19 17:49:19,528 - DEBUG - Namespace ctest-non-default-64796336 still in k8s
2024-10-19 17:49:21,534 - DEBUG - Namespace ctest-non-default-64796336 still in k8s
2024-10-19 17:49:23,539 - DEBUG - Namespace ctest-non-default-64796336 still in k8s
2024-10-19 17:49:25,544 - DEBUG - Namespace ctest-non-default-64796336 is not in k8s
2024-10-19 17:49:25,544 - DEBUG - No need to check project deletion in contrail-api
2024-10-19 17:49:25,544 - INFO - Deleting namespace ctest-new-default-60332994
2024-10-19 17:49:25,553 - DEBUG - Namespace ctest-new-default-60332994 still in k8s
2024-10-19 17:49:27,558 - DEBUG - Namespace ctest-new-default-60332994 still in k8s
2024-10-19 17:49:29,562 - DEBUG - Namespace ctest-new-default-60332994 still in k8s
2024-10-19 17:49:31,566 - DEBUG - Namespace ctest-new-default-60332994 is not in k8s
2024-10-19 17:49:31,567 - DEBUG - No need to check project deletion in contrail-api