2025-02-13 02:29:48,609 - INFO - Using existing project ['default-domain', 'k8s-default'](097718a4-a687-4c67-95e6-248d1e85d6a4) 2025-02-13 02:29:48,644 - DEBUG - Namespace ctest-new-default-07142277 not present 2025-02-13 02:29:48,656 - INFO - Created namespace ctest-new-default-07142277 2025-02-13 02:29:51,661 - DEBUG - Namespace ctest-non-default-11589220 not present 2025-02-13 02:29:51,677 - INFO - Created namespace ctest-non-default-11589220 2025-02-13 02:29:54,700 - DEBUG - Pod ctest-pod-89490330 not present 2025-02-13 02:29:54,700 - INFO - Creating Pod ctest-pod-89490330 2025-02-13 02:29:54,727 - DEBUG - Pod : ctest-pod-89490330 UUID is c11f914b-6eae-465e-a53e-6cef64bdda5b 2025-02-13 02:29:54,731 - DEBUG - Pod ctest-pod-99037828 not present 2025-02-13 02:29:54,734 - INFO - Creating Pod ctest-pod-99037828 2025-02-13 02:29:54,767 - DEBUG - Pod : ctest-pod-99037828 UUID is 902b3a0c-5b64-4810-8b95-c6c155e33e8d 2025-02-13 02:29:54,769 - DEBUG - Pod ctest-pod-85028829 not present 2025-02-13 02:29:54,769 - INFO - Creating Pod ctest-pod-85028829 2025-02-13 02:29:54,814 - DEBUG - Pod : ctest-pod-85028829 UUID is 6f70f21b-c03b-496f-9d5c-de1fe4f829f1 2025-02-13 02:29:54,817 - DEBUG - Pod ctest-pod-44404852 not present 2025-02-13 02:29:54,817 - INFO - Creating Pod ctest-pod-44404852 2025-02-13 02:29:54,839 - DEBUG - Pod : ctest-pod-44404852 UUID is 4205ccc3-08a0-427e-aaca-15244a7cdfaa 2025-02-13 02:29:54,841 - DEBUG - Pod ctest-pod-62624053 not present 2025-02-13 02:29:54,841 - INFO - Creating Pod ctest-pod-62624053 2025-02-13 02:29:54,861 - DEBUG - Pod : ctest-pod-62624053 UUID is 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 2025-02-13 02:29:54,864 - DEBUG - Pod ctest-pod-58394900 not present 2025-02-13 02:29:54,864 - INFO - Creating Pod ctest-pod-58394900 2025-02-13 02:29:54,885 - DEBUG - Pod : ctest-pod-58394900 UUID is 06195e04-3a83-4936-8bff-2f343edde464 2025-02-13 02:29:54,887 - DEBUG - Pod ctest-pod-28729628 not present 2025-02-13 02:29:54,887 - INFO - Creating Pod ctest-pod-28729628 2025-02-13 02:29:54,905 - DEBUG - Pod : ctest-pod-28729628 UUID is fc41d4bd-21d4-4abf-b43b-1083477f13e9 2025-02-13 02:29:54,907 - DEBUG - Pod ctest-pod-60161855 not present 2025-02-13 02:29:54,907 - INFO - Creating Pod ctest-pod-60161855 2025-02-13 02:29:54,926 - DEBUG - Pod : ctest-pod-60161855 UUID is eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 2025-02-13 02:29:55,119 - INFO - Project default-domain:k8s-ctest-new-default-07142277 for Namespace ctest-new-default-07142277 is seen in contrail-api 2025-02-13 02:29:55,119 - DEBUG - Project uuid in Contrail is 5ea2f4e9-673e-4ac8-a545-67ef77df9fe1 2025-02-13 02:29:55,290 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=c69e07ae-2283-434a-911f-de3ef0b6ca11 2025-02-13 02:29:55,300 - INFO - Namespace ctest-new-default-07142277 with uuid c69e07ae-2283-434a-911f-de3ef0b6ca11 found in kube manager 2025-02-13 02:29:55,300 - INFO - Namespace ctest-new-default-07142277 verification passed 2025-02-13 02:29:55,513 - INFO - Project default-domain:k8s-ctest-non-default-11589220 for Namespace ctest-non-default-11589220 is seen in contrail-api 2025-02-13 02:29:55,514 - DEBUG - Project uuid in Contrail is 44b84874-6ba6-4caf-8237-e3f928dcc9e3 2025-02-13 02:29:55,514 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=50ba8f8a-9b21-4ac8-883d-38256518a704 2025-02-13 02:29:55,519 - INFO - Namespace ctest-non-default-11589220 with uuid 50ba8f8a-9b21-4ac8-883d-38256518a704 found in kube manager 2025-02-13 02:29:55,519 - INFO - Namespace ctest-non-default-11589220 verification passed 2025-02-13 02:29:55,529 - DEBUG - Pod ctest-pod-89490330 not in running state.Currently in Pending 2025-02-13 02:30:00,542 - DEBUG - Pod ctest-pod-89490330 not in running state.Currently in Pending 2025-02-13 02:30:05,549 - INFO - Pod ctest-pod-89490330 is in running state.Got IP 10.47.255.251 2025-02-13 02:30:05,605 - DEBUG - Pod ctest-pod-89490330 has vmi 6a2145ec-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:05,605 - INFO - Verified pod ctest-pod-89490330 in contrail-api 2025-02-13 02:30:05,619 - DEBUG - VMI 6a2145ec-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:05,620 - INFO - Verified Pod ctest-pod-89490330 in agent 10.0.0.27 2025-02-13 02:30:05,620 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c11f914b-6eae-465e-a53e-6cef64bdda5b 2025-02-13 02:30:05,627 - INFO - Pod ctest-pod-89490330 with uuid c11f914b-6eae-465e-a53e-6cef64bdda5b found in kube manager 2025-02-13 02:30:05,627 - INFO - Pod ctest-pod-89490330 verification passed 2025-02-13 02:30:05,633 - DEBUG - Pod ctest-pod-99037828 not in running state.Currently in Pending 2025-02-13 02:30:10,651 - INFO - Pod ctest-pod-99037828 is in running state.Got IP 10.47.255.250 2025-02-13 02:30:10,672 - DEBUG - Pod ctest-pod-99037828 has vmi 6aa3de80-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:10,690 - INFO - Verified pod ctest-pod-99037828 in contrail-api 2025-02-13 02:30:10,717 - DEBUG - VMI 6aa3de80-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:10,718 - INFO - Verified Pod ctest-pod-99037828 in agent 10.0.0.27 2025-02-13 02:30:10,719 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=902b3a0c-5b64-4810-8b95-c6c155e33e8d 2025-02-13 02:30:10,725 - INFO - Pod ctest-pod-99037828 with uuid 902b3a0c-5b64-4810-8b95-c6c155e33e8d found in kube manager 2025-02-13 02:30:10,725 - INFO - Pod ctest-pod-99037828 verification passed 2025-02-13 02:30:10,732 - INFO - Pod ctest-pod-85028829 is in running state.Got IP 10.47.255.249 2025-02-13 02:30:10,751 - DEBUG - Pod ctest-pod-85028829 has vmi 6b53e1b8-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:10,751 - INFO - Verified pod ctest-pod-85028829 in contrail-api 2025-02-13 02:30:10,768 - DEBUG - VMI 6b53e1b8-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:10,769 - INFO - Verified Pod ctest-pod-85028829 in agent 10.0.0.27 2025-02-13 02:30:10,769 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=6f70f21b-c03b-496f-9d5c-de1fe4f829f1 2025-02-13 02:30:10,775 - INFO - Pod ctest-pod-85028829 with uuid 6f70f21b-c03b-496f-9d5c-de1fe4f829f1 found in kube manager 2025-02-13 02:30:10,775 - INFO - Pod ctest-pod-85028829 verification passed 2025-02-13 02:30:10,783 - INFO - Pod ctest-pod-44404852 is in running state.Got IP 10.47.255.248 2025-02-13 02:30:10,842 - DEBUG - Pod ctest-pod-44404852 has vmi 6bd63820-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:10,843 - INFO - Verified pod ctest-pod-44404852 in contrail-api 2025-02-13 02:30:10,858 - DEBUG - VMI 6bd63820-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:10,858 - INFO - Verified Pod ctest-pod-44404852 in agent 10.0.0.27 2025-02-13 02:30:10,858 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=4205ccc3-08a0-427e-aaca-15244a7cdfaa 2025-02-13 02:30:10,864 - INFO - Pod ctest-pod-44404852 with uuid 4205ccc3-08a0-427e-aaca-15244a7cdfaa found in kube manager 2025-02-13 02:30:10,864 - INFO - Pod ctest-pod-44404852 verification passed 2025-02-13 02:30:10,870 - INFO - Pod ctest-pod-62624053 is in running state.Got IP 10.47.255.247 2025-02-13 02:30:10,929 - DEBUG - Pod ctest-pod-62624053 has vmi 6c75782c-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:10,929 - INFO - Verified pod ctest-pod-62624053 in contrail-api 2025-02-13 02:30:10,945 - DEBUG - VMI 6c75782c-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:10,945 - INFO - Verified Pod ctest-pod-62624053 in agent 10.0.0.27 2025-02-13 02:30:10,945 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9e7b2e92-58f7-466f-92c2-cd8a987f93d8 2025-02-13 02:30:10,953 - INFO - Pod ctest-pod-62624053 with uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 found in kube manager 2025-02-13 02:30:10,953 - INFO - Pod ctest-pod-62624053 verification passed 2025-02-13 02:30:10,961 - INFO - Pod ctest-pod-28729628 is in running state.Got IP 10.47.255.245 2025-02-13 02:30:10,986 - DEBUG - Pod ctest-pod-28729628 has vmi 6d71163c-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:10,986 - INFO - Verified pod ctest-pod-28729628 in contrail-api 2025-02-13 02:30:11,004 - DEBUG - VMI 6d71163c-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:11,005 - INFO - Verified Pod ctest-pod-28729628 in agent 10.0.0.27 2025-02-13 02:30:11,005 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=fc41d4bd-21d4-4abf-b43b-1083477f13e9 2025-02-13 02:30:11,013 - INFO - Pod ctest-pod-28729628 with uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 found in kube manager 2025-02-13 02:30:11,014 - INFO - Pod ctest-pod-28729628 verification passed 2025-02-13 02:30:11,112 - INFO - Pod ctest-pod-58394900 is in running state.Got IP 10.47.255.246 2025-02-13 02:30:11,173 - DEBUG - Pod ctest-pod-58394900 has vmi 6cf4ff20-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:11,173 - INFO - Verified pod ctest-pod-58394900 in contrail-api 2025-02-13 02:30:11,190 - DEBUG - VMI 6cf4ff20-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:11,190 - INFO - Verified Pod ctest-pod-58394900 in agent 10.0.0.27 2025-02-13 02:30:11,190 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=06195e04-3a83-4936-8bff-2f343edde464 2025-02-13 02:30:11,196 - INFO - Pod ctest-pod-58394900 with uuid 06195e04-3a83-4936-8bff-2f343edde464 found in kube manager 2025-02-13 02:30:11,196 - INFO - Pod ctest-pod-58394900 verification passed 2025-02-13 02:30:11,203 - DEBUG - Pod ctest-pod-60161855 not in running state.Currently in Pending 2025-02-13 02:30:16,209 - INFO - Pod ctest-pod-60161855 is in running state.Got IP 10.47.255.244 2025-02-13 02:30:16,227 - DEBUG - Pod ctest-pod-60161855 has vmi 6df20c60-e9b2-11ef-9c03-fa163e28b957 2025-02-13 02:30:16,227 - INFO - Verified pod ctest-pod-60161855 in contrail-api 2025-02-13 02:30:16,242 - DEBUG - VMI 6df20c60-e9b2-11ef-9c03-fa163e28b957 is active in agent 10.0.0.27 2025-02-13 02:30:16,242 - INFO - Verified Pod ctest-pod-60161855 in agent 10.0.0.27 2025-02-13 02:30:16,243 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 2025-02-13 02:30:16,248 - INFO - Pod ctest-pod-60161855 with uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 found in kube manager 2025-02-13 02:30:16,249 - INFO - Pod ctest-pod-60161855 verification passed 2025-02-13 02:30:16,249 - INFO - ================================================================================ 2025-02-13 02:30:16,249 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-02-13 02:30:16,249 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-02-13 02:30:16,512 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.22': '0'}} with 2025-02-13 02:30:16,512 - INFO - Initial checks done. Running the testcase now 2025-02-13 02:30:16,512 - INFO - 2025-02-13 02:30:16,581 - DEBUG - [Pod ctest-pod-89490330] Cmd: echo ctest-pod-89490330 > /usr/share/nginx/html/index.html, Output: 2025-02-13 02:30:16,637 - DEBUG - [Pod ctest-pod-99037828] Cmd: echo ctest-pod-99037828 > /usr/share/nginx/html/index.html, Output: 2025-02-13 02:30:16,699 - DEBUG - [Pod ctest-pod-85028829] Cmd: echo ctest-pod-85028829 > /usr/share/nginx/html/index.html, Output: 2025-02-13 02:30:16,768 - DEBUG - [Pod ctest-pod-44404852] Cmd: echo ctest-pod-44404852 > /usr/share/nginx/html/index.html, Output: 2025-02-13 02:30:16,772 - DEBUG - Service ctest-nginx-svc-52580983 not present 2025-02-13 02:30:16,772 - INFO - Creating service ctest-nginx-svc-52580983 2025-02-13 02:30:16,800 - INFO - Created Service ctest-nginx-svc-52580983 2025-02-13 02:30:16,831 - WARNING - Service UUID b0356937-9fcd-40dd-9c8c-cb7c45f43f69 not yet found in contrail-api 2025-02-13 02:30:17,841 - INFO - Validated that Service ctest-nginx-svc-52580983 is seen in contrail-api 2025-02-13 02:30:17,841 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=b0356937-9fcd-40dd-9c8c-cb7c45f43f69 2025-02-13 02:30:17,847 - INFO - Service ctest-nginx-svc-52580983 with uuid b0356937-9fcd-40dd-9c8c-cb7c45f43f69 found in kube manager 2025-02-13 02:30:17,847 - INFO - Service ctest-nginx-svc-52580983 verification passed 2025-02-13 02:30:18,938 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99037828 2025-02-13 02:30:18,939 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:30:18,939 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99037828 2025-02-13 02:30:18,998 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:30:18,998 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:30:18,998 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:30:18,998 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89490330': 1, 'ctest-pod-99037828': 1} 2025-02-13 02:30:19,071 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89490330 2025-02-13 02:30:19,072 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:30:19,072 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89490330 2025-02-13 02:30:19,132 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-99037828 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:30:19,132 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:30:19,132 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: ctest-pod-99037828 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:30:19,132 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89490330': 1, 'ctest-pod-99037828': 1} 2025-02-13 02:30:19,137 - DEBUG - Network policy ingress-on-service not present 2025-02-13 02:30:19,137 - INFO - Creating Network Policy ingress-on-service 2025-02-13 02:30:19,161 - INFO - Network policy found in k8s 2025-02-13 02:30:19,161 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ecfbb3eb-8419-48bf-82a1-9f8922531dc4 2025-02-13 02:30:19,166 - INFO - Network Policy ingress-on-service with uuid ecfbb3eb-8419-48bf-82a1-9f8922531dc4 found in kube manager 2025-02-13 02:30:19,199 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-02-13 02:30:19,200 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-02-13 02:30:19,200 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ecfbb3eb-8419-48bf-82a1-9f8922531dc4 2025-02-13 02:30:19,234 - WARNING - Network policy with name ingress-on-service not found in agent 2025-02-13 02:30:21,236 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ecfbb3eb-8419-48bf-82a1-9f8922531dc4 2025-02-13 02:30:21,274 - INFO - Network policy with name ingress-on-service found in agent 2025-02-13 02:30:21,275 - INFO - Network Policy ingress-on-service verification passed 2025-02-13 02:30:26,339 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:26,339 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:26,339 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:31,400 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:31,401 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:31,401 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:36,469 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:36,469 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:36,469 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:41,551 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:41,551 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:41,551 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:46,606 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:46,606 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:46,606 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:51,669 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:51,669 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:51,669 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:56,743 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:56,743 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:30:56,743 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:01,799 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:01,799 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:01,799 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:06,876 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:06,876 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:06,876 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:11,953 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:11,953 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:11,953 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:11,953 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89490330': 0, 'ctest-pod-99037828': 0} 2025-02-13 02:31:12,025 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-99037828 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:31:12,025 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:31:12,025 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: ctest-pod-99037828 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:31:12,092 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:31:12,092 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:31:12,092 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:31:12,092 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89490330': 1, 'ctest-pod-99037828': 1} 2025-02-13 02:31:17,150 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:17,151 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:17,151 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:22,214 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:22,215 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:22,215 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:27,265 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:27,265 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:27,265 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:32,329 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:32,329 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:32,329 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:37,378 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:37,379 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:37,379 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:42,443 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:42,444 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:42,444 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:47,499 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:47,499 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:47,499 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:52,571 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:52,571 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:52,571 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:57,631 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:57,632 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:31:57,632 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:02,681 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:02,681 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:02,681 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:02,681 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89490330': 0, 'ctest-pod-99037828': 0} 2025-02-13 02:32:04,744 - DEBUG - [Pod ctest-pod-58394900] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.844 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.338/0.844 ms 2025-02-13 02:32:04,744 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-58394900 with expectation True passed 2025-02-13 02:32:06,794 - DEBUG - [Pod ctest-pod-62624053] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.366 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.178/0.366 ms 2025-02-13 02:32:06,794 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62624053 with expectation True passed 2025-02-13 02:32:08,848 - DEBUG - [Pod ctest-pod-28729628] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.988 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.389/0.988 ms 2025-02-13 02:32:08,849 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28729628 with expectation True passed 2025-02-13 02:32:08,911 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:32:08,912 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-13 02:32:08,912 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:32:08,912 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58394900 passed 2025-02-13 02:32:08,966 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:32:08,966 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-13 02:32:08,966 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:32:08,966 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58394900 passed 2025-02-13 02:32:14,018 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-13 02:32:14,018 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-13 02:32:14,018 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-13 02:32:14,018 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62624053 passed 2025-02-13 02:32:19,071 - DEBUG - [Pod ctest-pod-60161855] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-13 02:32:19,072 - DEBUG - [Pod Pod ctest-pod-60161855] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-13 02:32:19,072 - DEBUG - [Pod Pod ctest-pod-60161855] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-13 02:32:19,072 - INFO - wget check of of http://10.47.255.251 from ctest-pod-60161855 passed 2025-02-13 02:32:19,082 - INFO - Updating Network Policy ingress-on-service 2025-02-13 02:32:24,163 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:24,164 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:24,164 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:29,219 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:29,219 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:29,219 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:34,287 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:34,287 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:34,287 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:39,347 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:39,347 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:39,347 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:44,406 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:44,406 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:44,406 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:49,456 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:49,456 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:49,456 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:54,500 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:54,500 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:54,500 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:59,595 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:59,595 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:32:59,595 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:04,652 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:04,652 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:04,652 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:09,720 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:09,720 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:09,720 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) wget: download timed out 2025-02-13 02:33:09,720 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89490330': 0, 'ctest-pod-99037828': 0} 2025-02-13 02:33:09,786 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89490330 2025-02-13 02:33:09,786 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:33:09,786 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89490330 2025-02-13 02:33:09,848 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99037828 2025-02-13 02:33:09,848 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:33:09,848 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99037828 2025-02-13 02:33:09,848 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89490330': 1, 'ctest-pod-99037828': 1} 2025-02-13 02:33:09,925 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:09,926 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:33:09,926 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:09,976 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:09,977 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:33:09,977 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:10,038 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:10,038 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:33:10,038 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: ctest-pod-89490330 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:10,109 - DEBUG - [Pod ctest-pod-28729628] Cmd: wget http://10.100.50.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-99037828 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:10,109 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd wget http://10.100.50.164:80/ -O - -T 5 -t 1 passed 2025-02-13 02:33:10,109 - DEBUG - [Pod Pod ctest-pod-28729628] Cmd output: ctest-pod-99037828 Connecting to 10.100.50.164:80 (10.100.50.164:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-13 02:33:10,109 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89490330': 3, 'ctest-pod-99037828': 1} 2025-02-13 02:33:12,179 - DEBUG - [Pod ctest-pod-58394900] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.473 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.209 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.257/0.473 ms 2025-02-13 02:33:12,180 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-58394900 with expectation True passed 2025-02-13 02:33:14,246 - DEBUG - [Pod ctest-pod-62624053] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.120 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.429/1.120 ms 2025-02-13 02:33:14,246 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62624053 with expectation True passed 2025-02-13 02:33:16,306 - DEBUG - [Pod ctest-pod-28729628] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.573 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.582/1.573 ms 2025-02-13 02:33:16,307 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28729628 with expectation True passed 2025-02-13 02:33:16,368 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:33:16,368 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-13 02:33:16,368 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:33:16,368 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58394900 passed 2025-02-13 02:33:16,443 - DEBUG - [Pod ctest-pod-58394900] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:33:16,443 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-13 02:33:16,443 - DEBUG - [Pod Pod ctest-pod-58394900] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:33:16,443 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58394900 passed 2025-02-13 02:33:21,509 - DEBUG - [Pod ctest-pod-62624053] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-13 02:33:21,509 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-13 02:33:21,509 - DEBUG - [Pod Pod ctest-pod-62624053] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-13 02:33:21,509 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62624053 passed 2025-02-13 02:33:21,580 - DEBUG - [Pod ctest-pod-60161855] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:33:21,580 - DEBUG - [Pod Pod ctest-pod-60161855] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-13 02:33:21,580 - DEBUG - [Pod Pod ctest-pod-60161855] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-13 02:33:21,580 - INFO - wget check of of http://10.47.255.251 from ctest-pod-60161855 passed 2025-02-13 02:33:21,580 - INFO - Deleting Network Policy : ingress-on-service 2025-02-13 02:33:21,581 - INFO - Deleting service : ctest-nginx-svc-52580983 2025-02-13 02:33:21,825 - DEBUG - No XMPP flaps were noticed during the test 2025-02-13 02:33:21,825 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05] 2025-02-13 02:33:21,825 - INFO - -------------------------------------------------------------------------------- 2025-02-13 02:33:21,830 - INFO - Deleting pod ctest-new-default-07142277:ctest-pod-89490330 2025-02-13 02:33:21,831 - INFO - Deleting pod ctest-new-default-07142277:ctest-pod-99037828 2025-02-13 02:33:21,831 - INFO - Deleting pod ctest-non-default-11589220:ctest-pod-85028829 2025-02-13 02:33:21,831 - INFO - Deleting pod ctest-non-default-11589220:ctest-pod-44404852 2025-02-13 02:33:21,832 - INFO - Deleting pod ctest-new-default-07142277:ctest-pod-62624053 2025-02-13 02:33:21,832 - INFO - Deleting pod ctest-new-default-07142277:ctest-pod-58394900 2025-02-13 02:33:21,832 - INFO - Deleting pod ctest-non-default-11589220:ctest-pod-28729628 2025-02-13 02:33:21,833 - INFO - Deleting pod ctest-non-default-11589220:ctest-pod-60161855 2025-02-13 02:33:22,033 - WARNING - Pod uuid 902b3a0c-5b64-4810-8b95-c6c155e33e8d is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,033 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,033 - WARNING - Pod uuid 6f70f21b-c03b-496f-9d5c-de1fe4f829f1 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,034 - WARNING - Pod uuid 4205ccc3-08a0-427e-aaca-15244a7cdfaa is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,034 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,034 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,035 - WARNING - Pod uuid c11f914b-6eae-465e-a53e-6cef64bdda5b is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:22,035 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:27,065 - DEBUG - Pod 4205ccc3-08a0-427e-aaca-15244a7cdfaa is not in agent 10.0.0.27 VM list 2025-02-13 02:33:27,070 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:27,070 - DEBUG - Pod c11f914b-6eae-465e-a53e-6cef64bdda5b is not in agent 10.0.0.27 VM list 2025-02-13 02:33:27,072 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:27,072 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:27,072 - DEBUG - Pod 6f70f21b-c03b-496f-9d5c-de1fe4f829f1 is not in agent 10.0.0.27 VM list 2025-02-13 02:33:27,074 - DEBUG - Pod 902b3a0c-5b64-4810-8b95-c6c155e33e8d is not in agent 10.0.0.27 VM list 2025-02-13 02:33:27,086 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:27,102 - DEBUG - VMI 6bd63820-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:27,102 - INFO - Verified that pod ctest-pod-44404852 is removed in agent 2025-02-13 02:33:27,103 - DEBUG - VMI 6aa3de80-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:27,103 - INFO - Verified that pod ctest-pod-99037828 is removed in agent 2025-02-13 02:33:27,105 - DEBUG - VMI 6b53e1b8-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:27,105 - INFO - Verified that pod ctest-pod-85028829 is removed in agent 2025-02-13 02:33:27,106 - DEBUG - VMI 6a2145ec-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:27,106 - INFO - Verified that pod ctest-pod-89490330 is removed in agent 2025-02-13 02:33:32,086 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:32,091 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:32,092 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:32,098 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:37,097 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:37,102 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:37,105 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:37,106 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:42,108 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:42,118 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:42,120 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:42,121 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:47,117 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:47,133 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:47,135 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:47,135 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:52,285 - WARNING - Pod uuid fc41d4bd-21d4-4abf-b43b-1083477f13e9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:52,286 - WARNING - Pod uuid 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:52,287 - WARNING - Pod uuid eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:52,287 - WARNING - Pod uuid 06195e04-3a83-4936-8bff-2f343edde464 is still seen in agent 10.0.0.27 VM list 2025-02-13 02:33:57,304 - DEBUG - Pod fc41d4bd-21d4-4abf-b43b-1083477f13e9 is not in agent 10.0.0.27 VM list 2025-02-13 02:33:57,305 - DEBUG - Pod 9e7b2e92-58f7-466f-92c2-cd8a987f93d8 is not in agent 10.0.0.27 VM list 2025-02-13 02:33:57,310 - DEBUG - Pod eb0f17e4-35b7-471f-b7e5-477ad9ae97b9 is not in agent 10.0.0.27 VM list 2025-02-13 02:33:57,311 - DEBUG - Pod 06195e04-3a83-4936-8bff-2f343edde464 is not in agent 10.0.0.27 VM list 2025-02-13 02:33:57,326 - DEBUG - VMI 6c75782c-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:57,326 - INFO - Verified that pod ctest-pod-62624053 is removed in agent 2025-02-13 02:33:57,327 - DEBUG - VMI 6d71163c-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:57,327 - INFO - Verified that pod ctest-pod-28729628 is removed in agent 2025-02-13 02:33:57,329 - DEBUG - VMI 6cf4ff20-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:57,329 - INFO - Verified that pod ctest-pod-58394900 is removed in agent 2025-02-13 02:33:57,330 - DEBUG - VMI 6df20c60-e9b2-11ef-9c03-fa163e28b957 is removed from agent 10.0.0.27 2025-02-13 02:33:57,330 - INFO - Verified that pod ctest-pod-60161855 is removed in agent 2025-02-13 02:33:57,330 - INFO - Deleting namespace ctest-non-default-11589220 2025-02-13 02:33:57,343 - DEBUG - Namespace ctest-non-default-11589220 still in k8s 2025-02-13 02:33:59,347 - DEBUG - Namespace ctest-non-default-11589220 still in k8s 2025-02-13 02:34:01,353 - DEBUG - Namespace ctest-non-default-11589220 still in k8s 2025-02-13 02:34:03,361 - DEBUG - Namespace ctest-non-default-11589220 is not in k8s 2025-02-13 02:34:03,362 - DEBUG - No need to check project deletion in contrail-api 2025-02-13 02:34:03,363 - INFO - Deleting namespace ctest-new-default-07142277 2025-02-13 02:34:03,378 - DEBUG - Namespace ctest-new-default-07142277 still in k8s 2025-02-13 02:34:05,383 - DEBUG - Namespace ctest-new-default-07142277 still in k8s 2025-02-13 02:34:07,389 - DEBUG - Namespace ctest-new-default-07142277 still in k8s 2025-02-13 02:34:09,393 - DEBUG - Namespace ctest-new-default-07142277 is not in k8s 2025-02-13 02:34:09,393 - DEBUG - No need to check project deletion in contrail-api