2024-09-14 02:49:51,536 - INFO - Using existing project ['default-domain', 'k8s-default'](e8fcd4a3-f346-4def-8421-6fbc846989e3) 2024-09-14 02:49:51,558 - DEBUG - Namespace ctest-new-default-38444029 not present 2024-09-14 02:49:51,567 - INFO - Created namespace ctest-new-default-38444029 2024-09-14 02:49:54,574 - DEBUG - Namespace ctest-non-default-48483200 not present 2024-09-14 02:49:54,597 - INFO - Created namespace ctest-non-default-48483200 2024-09-14 02:49:57,621 - DEBUG - Pod ctest-pod-58139333 not present 2024-09-14 02:49:57,622 - INFO - Creating Pod ctest-pod-58139333 2024-09-14 02:49:57,683 - DEBUG - Pod : ctest-pod-58139333 UUID is 66c3dcb4-c25a-4282-aa50-ccc06756411c 2024-09-14 02:49:57,689 - DEBUG - Pod ctest-pod-63427650 not present 2024-09-14 02:49:57,689 - INFO - Creating Pod ctest-pod-63427650 2024-09-14 02:49:57,706 - DEBUG - Pod : ctest-pod-63427650 UUID is 4d322c7e-ad1c-4d3b-9749-8ec01834744c 2024-09-14 02:49:57,710 - DEBUG - Pod ctest-pod-36791911 not present 2024-09-14 02:49:57,711 - INFO - Creating Pod ctest-pod-36791911 2024-09-14 02:49:57,745 - DEBUG - Pod : ctest-pod-36791911 UUID is b47ea763-eaba-4721-b2d5-ccd06df8cf91 2024-09-14 02:49:57,747 - DEBUG - Pod ctest-pod-40325225 not present 2024-09-14 02:49:57,750 - INFO - Creating Pod ctest-pod-40325225 2024-09-14 02:49:57,780 - DEBUG - Pod : ctest-pod-40325225 UUID is d4e7c547-a5b8-4028-abbf-a30e38e92ac4 2024-09-14 02:49:57,783 - DEBUG - Pod ctest-pod-81327067 not present 2024-09-14 02:49:57,783 - INFO - Creating Pod ctest-pod-81327067 2024-09-14 02:49:57,809 - DEBUG - Pod : ctest-pod-81327067 UUID is 259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:49:57,811 - DEBUG - Pod ctest-pod-37480212 not present 2024-09-14 02:49:57,811 - INFO - Creating Pod ctest-pod-37480212 2024-09-14 02:49:57,832 - DEBUG - Pod : ctest-pod-37480212 UUID is b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:49:57,834 - DEBUG - Pod ctest-pod-52176141 not present 2024-09-14 02:49:57,834 - INFO - Creating Pod ctest-pod-52176141 2024-09-14 02:49:57,855 - DEBUG - Pod : ctest-pod-52176141 UUID is 682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:49:57,857 - DEBUG - Pod ctest-pod-11292998 not present 2024-09-14 02:49:57,858 - INFO - Creating Pod ctest-pod-11292998 2024-09-14 02:49:57,877 - DEBUG - Pod : ctest-pod-11292998 UUID is 5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:49:58,065 - INFO - Project default-domain:k8s-ctest-new-default-38444029 for Namespace ctest-new-default-38444029 is seen in contrail-api 2024-09-14 02:49:58,065 - DEBUG - Project uuid in Contrail is dab4bf10-1bcb-49d2-a5ae-d94a2b2d92da 2024-09-14 02:49:58,237 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=b5916fe6-7335-424b-a922-787d852bff1b 2024-09-14 02:49:58,250 - INFO - Namespace ctest-new-default-38444029 with uuid b5916fe6-7335-424b-a922-787d852bff1b found in kube manager 2024-09-14 02:49:58,251 - INFO - Namespace ctest-new-default-38444029 verification passed 2024-09-14 02:49:58,510 - INFO - Project default-domain:k8s-ctest-non-default-48483200 for Namespace ctest-non-default-48483200 is seen in contrail-api 2024-09-14 02:49:58,511 - DEBUG - Project uuid in Contrail is 5bcdc155-8c62-4786-a583-dbb4537814f7 2024-09-14 02:49:58,511 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=b047dc61-95f0-4292-961d-9e09dc59a547 2024-09-14 02:49:58,516 - INFO - Namespace ctest-non-default-48483200 with uuid b047dc61-95f0-4292-961d-9e09dc59a547 found in kube manager 2024-09-14 02:49:58,517 - INFO - Namespace ctest-non-default-48483200 verification passed 2024-09-14 02:49:58,525 - DEBUG - Pod ctest-pod-58139333 not in running state.Currently in Pending 2024-09-14 02:50:03,546 - DEBUG - Pod ctest-pod-58139333 not in running state.Currently in Pending 2024-09-14 02:50:08,565 - DEBUG - Pod ctest-pod-58139333 not in running state.Currently in Pending 2024-09-14 02:50:13,575 - INFO - Pod ctest-pod-58139333 is in running state.Got IP 10.47.255.251 2024-09-14 02:50:13,642 - DEBUG - Pod ctest-pod-58139333 has vmi 08833b1e-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:13,642 - INFO - Verified pod ctest-pod-58139333 in contrail-api 2024-09-14 02:50:13,666 - DEBUG - VMI 08833b1e-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:13,666 - INFO - Verified Pod ctest-pod-58139333 in agent 10.0.0.23 2024-09-14 02:50:13,666 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=66c3dcb4-c25a-4282-aa50-ccc06756411c 2024-09-14 02:50:13,677 - INFO - Pod ctest-pod-58139333 with uuid 66c3dcb4-c25a-4282-aa50-ccc06756411c found in kube manager 2024-09-14 02:50:13,677 - INFO - Pod ctest-pod-58139333 verification passed 2024-09-14 02:50:13,692 - INFO - Pod ctest-pod-63427650 is in running state.Got IP 10.47.255.250 2024-09-14 02:50:13,748 - DEBUG - Pod ctest-pod-63427650 has vmi 091e1b16-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:13,748 - INFO - Verified pod ctest-pod-63427650 in contrail-api 2024-09-14 02:50:13,769 - DEBUG - VMI 091e1b16-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:13,769 - INFO - Verified Pod ctest-pod-63427650 in agent 10.0.0.23 2024-09-14 02:50:13,769 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=4d322c7e-ad1c-4d3b-9749-8ec01834744c 2024-09-14 02:50:13,778 - INFO - Pod ctest-pod-63427650 with uuid 4d322c7e-ad1c-4d3b-9749-8ec01834744c found in kube manager 2024-09-14 02:50:13,778 - INFO - Pod ctest-pod-63427650 verification passed 2024-09-14 02:50:13,785 - INFO - Pod ctest-pod-36791911 is in running state.Got IP 10.47.255.249 2024-09-14 02:50:13,862 - DEBUG - Pod ctest-pod-36791911 has vmi 09d4e49a-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:13,862 - INFO - Verified pod ctest-pod-36791911 in contrail-api 2024-09-14 02:50:13,882 - DEBUG - VMI 09d4e49a-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:13,882 - INFO - Verified Pod ctest-pod-36791911 in agent 10.0.0.23 2024-09-14 02:50:13,882 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b47ea763-eaba-4721-b2d5-ccd06df8cf91 2024-09-14 02:50:13,890 - INFO - Pod ctest-pod-36791911 with uuid b47ea763-eaba-4721-b2d5-ccd06df8cf91 found in kube manager 2024-09-14 02:50:13,891 - INFO - Pod ctest-pod-36791911 verification passed 2024-09-14 02:50:13,902 - INFO - Pod ctest-pod-40325225 is in running state.Got IP 10.47.255.248 2024-09-14 02:50:13,939 - DEBUG - Pod ctest-pod-40325225 has vmi 0a704840-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:13,939 - INFO - Verified pod ctest-pod-40325225 in contrail-api 2024-09-14 02:50:13,956 - DEBUG - VMI 0a704840-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:13,957 - INFO - Verified Pod ctest-pod-40325225 in agent 10.0.0.23 2024-09-14 02:50:13,957 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d4e7c547-a5b8-4028-abbf-a30e38e92ac4 2024-09-14 02:50:13,962 - INFO - Pod ctest-pod-40325225 with uuid d4e7c547-a5b8-4028-abbf-a30e38e92ac4 found in kube manager 2024-09-14 02:50:13,963 - INFO - Pod ctest-pod-40325225 verification passed 2024-09-14 02:50:13,969 - DEBUG - Pod ctest-pod-81327067 not in running state.Currently in Pending 2024-09-14 02:50:18,975 - INFO - Pod ctest-pod-81327067 is in running state.Got IP 10.47.255.247 2024-09-14 02:50:18,995 - DEBUG - Pod ctest-pod-81327067 has vmi 0b119394-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:18,995 - INFO - Verified pod ctest-pod-81327067 in contrail-api 2024-09-14 02:50:19,011 - DEBUG - VMI 0b119394-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:19,012 - INFO - Verified Pod ctest-pod-81327067 in agent 10.0.0.23 2024-09-14 02:50:19,012 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:50:19,016 - INFO - Pod ctest-pod-81327067 with uuid 259e2391-0485-442d-b1fc-f281c7035630 found in kube manager 2024-09-14 02:50:19,016 - INFO - Pod ctest-pod-81327067 verification passed 2024-09-14 02:50:19,032 - INFO - Pod ctest-pod-52176141 is in running state.Got IP 10.47.255.245 2024-09-14 02:50:19,102 - DEBUG - Pod ctest-pod-52176141 has vmi 0c17556c-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:19,102 - INFO - Verified pod ctest-pod-52176141 in contrail-api 2024-09-14 02:50:19,119 - DEBUG - VMI 0c17556c-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:19,119 - INFO - Verified Pod ctest-pod-52176141 in agent 10.0.0.23 2024-09-14 02:50:19,120 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:50:19,126 - INFO - Pod ctest-pod-52176141 with uuid 682d2460-0565-4c11-91a6-16594539f2c5 found in kube manager 2024-09-14 02:50:19,126 - INFO - Pod ctest-pod-52176141 verification passed 2024-09-14 02:50:19,131 - INFO - Pod ctest-pod-37480212 is in running state.Got IP 10.47.255.246 2024-09-14 02:50:19,154 - DEBUG - Pod ctest-pod-37480212 has vmi 0b9480d8-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:19,154 - INFO - Verified pod ctest-pod-37480212 in contrail-api 2024-09-14 02:50:19,171 - DEBUG - VMI 0b9480d8-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:19,171 - INFO - Verified Pod ctest-pod-37480212 in agent 10.0.0.23 2024-09-14 02:50:19,172 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:50:19,177 - INFO - Pod ctest-pod-37480212 with uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e found in kube manager 2024-09-14 02:50:19,177 - INFO - Pod ctest-pod-37480212 verification passed 2024-09-14 02:50:19,183 - INFO - Pod ctest-pod-11292998 is in running state.Got IP 10.47.255.244 2024-09-14 02:50:19,250 - DEBUG - Pod ctest-pod-11292998 has vmi 0ca0916a-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:50:19,250 - INFO - Verified pod ctest-pod-11292998 in contrail-api 2024-09-14 02:50:19,262 - DEBUG - VMI 0ca0916a-7244-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:50:19,262 - INFO - Verified Pod ctest-pod-11292998 in agent 10.0.0.23 2024-09-14 02:50:19,263 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:50:19,267 - INFO - Pod ctest-pod-11292998 with uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 found in kube manager 2024-09-14 02:50:19,267 - INFO - Pod ctest-pod-11292998 verification passed 2024-09-14 02:50:19,267 - INFO - ================================================================================ 2024-09-14 02:50:19,267 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-14 02:50:19,267 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-14 02:50:19,498 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.27': '0'}} with 2024-09-14 02:50:19,498 - INFO - Initial checks done. Running the testcase now 2024-09-14 02:50:19,498 - INFO - 2024-09-14 02:50:19,568 - DEBUG - [Pod ctest-pod-58139333] Cmd: echo ctest-pod-58139333 > /usr/share/nginx/html/index.html, Output: 2024-09-14 02:50:19,651 - DEBUG - [Pod ctest-pod-63427650] Cmd: echo ctest-pod-63427650 > /usr/share/nginx/html/index.html, Output: 2024-09-14 02:50:19,742 - DEBUG - [Pod ctest-pod-36791911] Cmd: echo ctest-pod-36791911 > /usr/share/nginx/html/index.html, Output: 2024-09-14 02:50:19,807 - DEBUG - [Pod ctest-pod-40325225] Cmd: echo ctest-pod-40325225 > /usr/share/nginx/html/index.html, Output: 2024-09-14 02:50:19,811 - DEBUG - Service ctest-nginx-svc-85707585 not present 2024-09-14 02:50:19,811 - INFO - Creating service ctest-nginx-svc-85707585 2024-09-14 02:50:19,858 - INFO - Created Service ctest-nginx-svc-85707585 2024-09-14 02:50:19,869 - WARNING - Service UUID 9fed6561-3c7d-4600-9ddb-043568abfe36 not yet found in contrail-api 2024-09-14 02:50:20,907 - INFO - Validated that Service ctest-nginx-svc-85707585 is seen in contrail-api 2024-09-14 02:50:20,908 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=9fed6561-3c7d-4600-9ddb-043568abfe36 2024-09-14 02:50:20,931 - INFO - Service ctest-nginx-svc-85707585 with uuid 9fed6561-3c7d-4600-9ddb-043568abfe36 found in kube manager 2024-09-14 02:50:20,933 - INFO - Service ctest-nginx-svc-85707585 verification passed 2024-09-14 02:50:22,069 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-63427650 2024-09-14 02:50:22,070 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,070 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-63427650 2024-09-14 02:50:22,125 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-63427650 2024-09-14 02:50:22,125 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,125 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-63427650 2024-09-14 02:50:22,202 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:50:22,202 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,202 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:50:22,202 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58139333': 1, 'ctest-pod-63427650': 2} 2024-09-14 02:50:22,269 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:50:22,269 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,269 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:50:22,335 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) ctest-pod-63427650 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:50:22,335 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,335 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) ctest-pod-63427650 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:50:22,408 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-63427650 2024-09-14 02:50:22,408 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,408 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-63427650 2024-09-14 02:50:22,462 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58139333 2024-09-14 02:50:22,462 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:50:22,462 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58139333 2024-09-14 02:50:22,462 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58139333': 1, 'ctest-pod-63427650': 3} 2024-09-14 02:50:22,468 - DEBUG - Network policy ingress-on-service not present 2024-09-14 02:50:22,468 - INFO - Creating Network Policy ingress-on-service 2024-09-14 02:50:22,511 - INFO - Network policy found in k8s 2024-09-14 02:50:22,511 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1740eab2-fdfc-4079-8be1-eb8790fd448e 2024-09-14 02:50:22,518 - INFO - Network Policy ingress-on-service with uuid 1740eab2-fdfc-4079-8be1-eb8790fd448e found in kube manager 2024-09-14 02:50:22,606 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-14 02:50:22,606 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-14 02:50:22,607 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1740eab2-fdfc-4079-8be1-eb8790fd448e 2024-09-14 02:50:22,644 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-14 02:50:24,645 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1740eab2-fdfc-4079-8be1-eb8790fd448e 2024-09-14 02:50:24,685 - INFO - Network policy with name ingress-on-service found in agent 2024-09-14 02:50:24,686 - INFO - Network Policy ingress-on-service verification passed 2024-09-14 02:50:29,747 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:29,747 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:29,747 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:34,831 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:34,832 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:34,832 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:39,894 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:39,894 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:39,894 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:44,956 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:44,957 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:44,957 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:50,031 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:50,032 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:50,032 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:55,103 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:55,103 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:50:55,104 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:00,172 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:00,172 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:00,172 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:05,230 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:05,230 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:05,230 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:10,322 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:10,322 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:10,323 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:15,387 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:15,387 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:15,388 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:15,388 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58139333': 0, 'ctest-pod-63427650': 0} 2024-09-14 02:51:15,465 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:51:15,465 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:51:15,466 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:51:15,556 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58139333 2024-09-14 02:51:15,557 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:51:15,557 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58139333 2024-09-14 02:51:15,616 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:51:15,617 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:51:15,617 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:51:15,617 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58139333': 2, 'ctest-pod-63427650': 1} 2024-09-14 02:51:20,690 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:20,690 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:20,691 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:25,746 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:25,746 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:25,746 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:30,813 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:30,813 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:30,813 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:35,890 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:35,890 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:35,891 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:40,965 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:40,965 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:40,965 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:46,038 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:46,038 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:46,038 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:51,113 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:51,113 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:51,113 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:56,180 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:56,180 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:51:56,180 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:01,245 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:01,246 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:01,246 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:06,325 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:06,325 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:06,325 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:06,325 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58139333': 0, 'ctest-pod-63427650': 0} 2024-09-14 02:52:08,393 - DEBUG - [Pod ctest-pod-37480212] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.709 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.072 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.284/0.709 ms 2024-09-14 02:52:08,394 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37480212 with expectation True passed 2024-09-14 02:52:10,457 - DEBUG - [Pod ctest-pod-81327067] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.507 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.223/0.507 ms 2024-09-14 02:52:10,457 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81327067 with expectation True passed 2024-09-14 02:52:12,523 - DEBUG - [Pod ctest-pod-52176141] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.754 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.308/0.754 ms 2024-09-14 02:52:12,523 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-52176141 with expectation True passed 2024-09-14 02:52:12,599 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:52:12,599 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-14 02:52:12,599 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:52:12,599 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37480212 passed 2024-09-14 02:52:12,666 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:52:12,666 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-14 02:52:12,667 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:52:12,667 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37480212 passed 2024-09-14 02:52:17,729 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-14 02:52:17,730 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-14 02:52:17,730 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-14 02:52:17,730 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81327067 passed 2024-09-14 02:52:22,817 - DEBUG - [Pod ctest-pod-11292998] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-14 02:52:22,818 - DEBUG - [Pod Pod ctest-pod-11292998] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-14 02:52:22,818 - DEBUG - [Pod Pod ctest-pod-11292998] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-14 02:52:22,818 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11292998 passed 2024-09-14 02:52:22,840 - INFO - Updating Network Policy ingress-on-service 2024-09-14 02:52:27,926 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:27,927 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:27,927 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:33,022 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:33,023 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:33,023 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:38,102 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:38,102 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:38,102 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:43,185 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:43,185 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:43,185 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:48,254 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:48,254 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:48,254 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:53,321 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:53,321 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:53,321 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:58,384 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:58,385 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:52:58,385 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:03,476 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:03,476 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:03,476 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:08,550 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:08,550 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:08,551 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:13,627 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:13,627 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:13,627 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) wget: download timed out 2024-09-14 02:53:13,627 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58139333': 0, 'ctest-pod-63427650': 0} 2024-09-14 02:53:13,704 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,704 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:13,704 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,788 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,788 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:13,788 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,862 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.75.204:80 (10.108.75.204:80) ctest-pod-58139333 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,862 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:13,862 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: Connecting to 10.108.75.204:80 (10.108.75.204:80) ctest-pod-58139333 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,941 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:13,941 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:13,942 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,042 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,042 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:14,042 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,042 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58139333': 4, 'ctest-pod-63427650': 1} 2024-09-14 02:53:14,131 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,131 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:14,131 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,201 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,202 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:14,202 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,298 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,298 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:14,298 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: ctest-pod-58139333 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,365 - DEBUG - [Pod ctest-pod-52176141] Cmd: wget http://10.108.75.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,366 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd wget http://10.108.75.204:80/ -O - -T 5 -t 1 passed 2024-09-14 02:53:14,366 - DEBUG - [Pod Pod ctest-pod-52176141] Cmd output: ctest-pod-63427650 Connecting to 10.108.75.204:80 (10.108.75.204:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-14 02:53:14,366 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58139333': 3, 'ctest-pod-63427650': 1} 2024-09-14 02:53:16,459 - DEBUG - [Pod ctest-pod-37480212] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.058 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.276 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.473/1.058 ms 2024-09-14 02:53:16,459 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37480212 with expectation True passed 2024-09-14 02:53:18,520 - DEBUG - [Pod ctest-pod-81327067] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.469 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.206/0.469 ms 2024-09-14 02:53:18,520 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81327067 with expectation True passed 2024-09-14 02:53:20,572 - DEBUG - [Pod ctest-pod-52176141] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.370 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.173/0.370 ms 2024-09-14 02:53:20,572 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-52176141 with expectation True passed 2024-09-14 02:53:20,626 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:53:20,627 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-14 02:53:20,627 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:53:20,627 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37480212 passed 2024-09-14 02:53:20,687 - DEBUG - [Pod ctest-pod-37480212] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:53:20,687 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-14 02:53:20,688 - DEBUG - [Pod Pod ctest-pod-37480212] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:53:20,688 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37480212 passed 2024-09-14 02:53:25,745 - DEBUG - [Pod ctest-pod-81327067] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-14 02:53:25,746 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-14 02:53:25,746 - DEBUG - [Pod Pod ctest-pod-81327067] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-14 02:53:25,746 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81327067 passed 2024-09-14 02:53:25,824 - DEBUG - [Pod ctest-pod-11292998] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:53:25,824 - DEBUG - [Pod Pod ctest-pod-11292998] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-14 02:53:25,825 - DEBUG - [Pod Pod ctest-pod-11292998] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-14 02:53:25,825 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11292998 passed 2024-09-14 02:53:25,825 - INFO - Deleting Network Policy : ingress-on-service 2024-09-14 02:53:25,826 - INFO - Deleting service : ctest-nginx-svc-85707585 2024-09-14 02:53:26,186 - DEBUG - No XMPP flaps were noticed during the test 2024-09-14 02:53:26,186 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07] 2024-09-14 02:53:26,186 - INFO - -------------------------------------------------------------------------------- 2024-09-14 02:53:26,216 - INFO - Deleting pod ctest-new-default-38444029:ctest-pod-58139333 2024-09-14 02:53:26,218 - INFO - Deleting pod ctest-new-default-38444029:ctest-pod-63427650 2024-09-14 02:53:26,219 - INFO - Deleting pod ctest-non-default-48483200:ctest-pod-36791911 2024-09-14 02:53:26,220 - INFO - Deleting pod ctest-non-default-48483200:ctest-pod-40325225 2024-09-14 02:53:26,220 - INFO - Deleting pod ctest-new-default-38444029:ctest-pod-81327067 2024-09-14 02:53:26,221 - INFO - Deleting pod ctest-new-default-38444029:ctest-pod-37480212 2024-09-14 02:53:26,222 - INFO - Deleting pod ctest-non-default-48483200:ctest-pod-52176141 2024-09-14 02:53:26,223 - INFO - Deleting pod ctest-non-default-48483200:ctest-pod-11292998 2024-09-14 02:53:26,288 - WARNING - Pod uuid 66c3dcb4-c25a-4282-aa50-ccc06756411c is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,461 - WARNING - Pod uuid 4d322c7e-ad1c-4d3b-9749-8ec01834744c is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,464 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,465 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,465 - WARNING - Pod uuid d4e7c547-a5b8-4028-abbf-a30e38e92ac4 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,467 - WARNING - Pod uuid b47ea763-eaba-4721-b2d5-ccd06df8cf91 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,467 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:26,468 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:31,307 - DEBUG - Pod 66c3dcb4-c25a-4282-aa50-ccc06756411c is not in agent 10.0.0.23 VM list 2024-09-14 02:53:31,327 - DEBUG - VMI 08833b1e-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:53:31,328 - INFO - Verified that pod ctest-pod-58139333 is removed in agent 2024-09-14 02:53:31,519 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:31,521 - DEBUG - Pod b47ea763-eaba-4721-b2d5-ccd06df8cf91 is not in agent 10.0.0.23 VM list 2024-09-14 02:53:31,528 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:31,530 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:31,530 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:31,531 - DEBUG - Pod 4d322c7e-ad1c-4d3b-9749-8ec01834744c is not in agent 10.0.0.23 VM list 2024-09-14 02:53:31,535 - DEBUG - Pod d4e7c547-a5b8-4028-abbf-a30e38e92ac4 is not in agent 10.0.0.23 VM list 2024-09-14 02:53:31,551 - DEBUG - VMI 09d4e49a-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:53:31,551 - INFO - Verified that pod ctest-pod-36791911 is removed in agent 2024-09-14 02:53:31,554 - DEBUG - VMI 0a704840-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:53:31,554 - INFO - Verified that pod ctest-pod-40325225 is removed in agent 2024-09-14 02:53:31,555 - DEBUG - VMI 091e1b16-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:53:31,555 - INFO - Verified that pod ctest-pod-63427650 is removed in agent 2024-09-14 02:53:36,537 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:36,547 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:36,549 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:36,550 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:41,545 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:41,555 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:41,562 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:41,563 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:46,565 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:46,589 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:46,590 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:46,594 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:51,584 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:51,611 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:51,613 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:51,613 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:56,618 - WARNING - Pod uuid b92ac951-1451-41da-9fd9-c9dc01b74d3e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:56,632 - WARNING - Pod uuid 682d2460-0565-4c11-91a6-16594539f2c5 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:56,636 - WARNING - Pod uuid 259e2391-0485-442d-b1fc-f281c7035630 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:53:56,637 - WARNING - Pod uuid 5af3c08b-7222-4bca-9b12-d129a6837d90 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:54:01,626 - DEBUG - Pod b92ac951-1451-41da-9fd9-c9dc01b74d3e is not in agent 10.0.0.23 VM list 2024-09-14 02:54:01,633 - DEBUG - VMI 0b9480d8-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:54:01,633 - INFO - Verified that pod ctest-pod-37480212 is removed in agent 2024-09-14 02:54:01,650 - DEBUG - Pod 682d2460-0565-4c11-91a6-16594539f2c5 is not in agent 10.0.0.23 VM list 2024-09-14 02:54:01,670 - DEBUG - Pod 259e2391-0485-442d-b1fc-f281c7035630 is not in agent 10.0.0.23 VM list 2024-09-14 02:54:01,680 - DEBUG - VMI 0c17556c-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:54:01,680 - INFO - Verified that pod ctest-pod-52176141 is removed in agent 2024-09-14 02:54:01,681 - DEBUG - Pod 5af3c08b-7222-4bca-9b12-d129a6837d90 is not in agent 10.0.0.23 VM list 2024-09-14 02:54:01,701 - DEBUG - VMI 0b119394-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:54:01,701 - INFO - Verified that pod ctest-pod-81327067 is removed in agent 2024-09-14 02:54:01,702 - DEBUG - VMI 0ca0916a-7244-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:54:01,703 - INFO - Verified that pod ctest-pod-11292998 is removed in agent 2024-09-14 02:54:01,703 - INFO - Deleting namespace ctest-non-default-48483200 2024-09-14 02:54:01,754 - DEBUG - Namespace ctest-non-default-48483200 still in k8s 2024-09-14 02:54:03,769 - DEBUG - Namespace ctest-non-default-48483200 still in k8s 2024-09-14 02:54:05,778 - DEBUG - Namespace ctest-non-default-48483200 still in k8s 2024-09-14 02:54:07,782 - DEBUG - Namespace ctest-non-default-48483200 is not in k8s 2024-09-14 02:54:07,782 - DEBUG - No need to check project deletion in contrail-api 2024-09-14 02:54:07,782 - INFO - Deleting namespace ctest-new-default-38444029 2024-09-14 02:54:07,791 - DEBUG - Namespace ctest-new-default-38444029 still in k8s 2024-09-14 02:54:09,807 - DEBUG - Namespace ctest-new-default-38444029 still in k8s 2024-09-14 02:54:11,820 - DEBUG - Namespace ctest-new-default-38444029 still in k8s 2024-09-14 02:54:13,826 - DEBUG - Namespace ctest-new-default-38444029 is not in k8s 2024-09-14 02:54:13,826 - DEBUG - No need to check project deletion in contrail-api