2025-01-07 11:36:14,073 - INFO - Using existing project ['default-domain', 'k8s-default'](ad93aac0-20a2-4c33-83ad-de1ad9031c8e) 2025-01-07 11:36:14,090 - DEBUG - Namespace ctest-new-default-02458326 not present 2025-01-07 11:36:14,102 - INFO - Created namespace ctest-new-default-02458326 2025-01-07 11:36:17,107 - DEBUG - Namespace ctest-non-default-02405900 not present 2025-01-07 11:36:17,120 - INFO - Created namespace ctest-non-default-02405900 2025-01-07 11:36:20,160 - DEBUG - Pod ctest-pod-07488068 not present 2025-01-07 11:36:20,160 - INFO - Creating Pod ctest-pod-07488068 2025-01-07 11:36:20,200 - DEBUG - Pod : ctest-pod-07488068 UUID is 2c8a12da-3cad-4070-9025-81344b8e0825 2025-01-07 11:36:20,207 - DEBUG - Pod ctest-pod-40474959 not present 2025-01-07 11:36:20,208 - INFO - Creating Pod ctest-pod-40474959 2025-01-07 11:36:20,239 - DEBUG - Pod : ctest-pod-40474959 UUID is e2316166-2c1b-4b00-aa39-0b9387b857c7 2025-01-07 11:36:20,242 - DEBUG - Pod ctest-pod-45396107 not present 2025-01-07 11:36:20,242 - INFO - Creating Pod ctest-pod-45396107 2025-01-07 11:36:20,268 - DEBUG - Pod : ctest-pod-45396107 UUID is 6b048e61-7514-4d0f-a909-72f690816770 2025-01-07 11:36:20,269 - DEBUG - Pod ctest-pod-76591251 not present 2025-01-07 11:36:20,270 - INFO - Creating Pod ctest-pod-76591251 2025-01-07 11:36:20,290 - DEBUG - Pod : ctest-pod-76591251 UUID is 9869a19c-a39b-4911-943e-33a7177fcefc 2025-01-07 11:36:20,295 - DEBUG - Pod ctest-pod-86419275 not present 2025-01-07 11:36:20,295 - INFO - Creating Pod ctest-pod-86419275 2025-01-07 11:36:20,311 - DEBUG - Pod : ctest-pod-86419275 UUID is 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 2025-01-07 11:36:20,312 - DEBUG - Pod ctest-pod-80166449 not present 2025-01-07 11:36:20,313 - INFO - Creating Pod ctest-pod-80166449 2025-01-07 11:36:20,330 - DEBUG - Pod : ctest-pod-80166449 UUID is 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 2025-01-07 11:36:20,332 - DEBUG - Pod ctest-pod-49019008 not present 2025-01-07 11:36:20,332 - INFO - Creating Pod ctest-pod-49019008 2025-01-07 11:36:20,352 - DEBUG - Pod : ctest-pod-49019008 UUID is 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 2025-01-07 11:36:20,356 - DEBUG - Pod ctest-pod-92503658 not present 2025-01-07 11:36:20,357 - INFO - Creating Pod ctest-pod-92503658 2025-01-07 11:36:20,379 - DEBUG - Pod : ctest-pod-92503658 UUID is 3f825e1a-36e7-44f7-b113-88465e979b8e 2025-01-07 11:36:20,562 - INFO - Project default-domain:k8s-ctest-new-default-02458326 for Namespace ctest-new-default-02458326 is seen in contrail-api 2025-01-07 11:36:20,562 - DEBUG - Project uuid in Contrail is bd511dc6-1aed-4ef1-959e-2b45726575d2 2025-01-07 11:36:21,086 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=bffd6fe0-136b-4ab4-a40d-819660d038ee 2025-01-07 11:36:21,090 - INFO - Namespace ctest-new-default-02458326 with uuid bffd6fe0-136b-4ab4-a40d-819660d038ee found in kube manager 2025-01-07 11:36:21,090 - INFO - Namespace ctest-new-default-02458326 verification passed 2025-01-07 11:36:21,351 - INFO - Project default-domain:k8s-ctest-non-default-02405900 for Namespace ctest-non-default-02405900 is seen in contrail-api 2025-01-07 11:36:21,351 - DEBUG - Project uuid in Contrail is 8a241b6b-a98f-4ea4-9687-6e758efae2b2 2025-01-07 11:36:21,351 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=07473196-5060-481b-9a8f-f49c0d274658 2025-01-07 11:36:21,356 - INFO - Namespace ctest-non-default-02405900 with uuid 07473196-5060-481b-9a8f-f49c0d274658 found in kube manager 2025-01-07 11:36:21,356 - INFO - Namespace ctest-non-default-02405900 verification passed 2025-01-07 11:36:21,361 - DEBUG - Pod ctest-pod-07488068 not in running state.Currently in Pending 2025-01-07 11:36:26,367 - DEBUG - Pod ctest-pod-07488068 not in running state.Currently in Pending 2025-01-07 11:36:31,374 - DEBUG - Pod ctest-pod-07488068 not in running state.Currently in Pending 2025-01-07 11:36:36,381 - INFO - Pod ctest-pod-07488068 is in running state.Got IP 10.47.255.251 2025-01-07 11:36:36,394 - DEBUG - Pod ctest-pod-07488068 has vmi 9e8b1922-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:36,394 - INFO - Verified pod ctest-pod-07488068 in contrail-api 2025-01-07 11:36:36,409 - DEBUG - VMI 9e8b1922-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:36,409 - INFO - Verified Pod ctest-pod-07488068 in agent 10.0.0.52 2025-01-07 11:36:36,409 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=2c8a12da-3cad-4070-9025-81344b8e0825 2025-01-07 11:36:36,414 - INFO - Pod ctest-pod-07488068 with uuid 2c8a12da-3cad-4070-9025-81344b8e0825 found in kube manager 2025-01-07 11:36:36,415 - INFO - Pod ctest-pod-07488068 verification passed 2025-01-07 11:36:36,420 - INFO - Pod ctest-pod-40474959 is in running state.Got IP 10.47.255.250 2025-01-07 11:36:36,433 - DEBUG - Pod ctest-pod-40474959 has vmi 9f01ce3c-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:36,433 - INFO - Verified pod ctest-pod-40474959 in contrail-api 2025-01-07 11:36:36,446 - DEBUG - VMI 9f01ce3c-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:36,446 - INFO - Verified Pod ctest-pod-40474959 in agent 10.0.0.52 2025-01-07 11:36:36,446 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=e2316166-2c1b-4b00-aa39-0b9387b857c7 2025-01-07 11:36:36,451 - INFO - Pod ctest-pod-40474959 with uuid e2316166-2c1b-4b00-aa39-0b9387b857c7 found in kube manager 2025-01-07 11:36:36,451 - INFO - Pod ctest-pod-40474959 verification passed 2025-01-07 11:36:36,458 - INFO - Pod ctest-pod-45396107 is in running state.Got IP 10.47.255.249 2025-01-07 11:36:36,515 - DEBUG - Pod ctest-pod-45396107 has vmi 9f9fa710-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:36,515 - INFO - Verified pod ctest-pod-45396107 in contrail-api 2025-01-07 11:36:36,530 - DEBUG - VMI 9f9fa710-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:36,530 - INFO - Verified Pod ctest-pod-45396107 in agent 10.0.0.52 2025-01-07 11:36:36,530 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=6b048e61-7514-4d0f-a909-72f690816770 2025-01-07 11:36:36,535 - INFO - Pod ctest-pod-45396107 with uuid 6b048e61-7514-4d0f-a909-72f690816770 found in kube manager 2025-01-07 11:36:36,535 - INFO - Pod ctest-pod-45396107 verification passed 2025-01-07 11:36:36,542 - INFO - Pod ctest-pod-76591251 is in running state.Got IP 10.47.255.248 2025-01-07 11:36:36,607 - DEBUG - Pod ctest-pod-76591251 has vmi a01ac2ba-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:36,607 - INFO - Verified pod ctest-pod-76591251 in contrail-api 2025-01-07 11:36:36,621 - DEBUG - VMI a01ac2ba-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:36,621 - INFO - Verified Pod ctest-pod-76591251 in agent 10.0.0.52 2025-01-07 11:36:36,621 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=9869a19c-a39b-4911-943e-33a7177fcefc 2025-01-07 11:36:36,627 - INFO - Pod ctest-pod-76591251 with uuid 9869a19c-a39b-4911-943e-33a7177fcefc found in kube manager 2025-01-07 11:36:36,627 - INFO - Pod ctest-pod-76591251 verification passed 2025-01-07 11:36:36,633 - DEBUG - Pod ctest-pod-86419275 not in running state.Currently in Pending 2025-01-07 11:36:41,649 - INFO - Pod ctest-pod-86419275 is in running state.Got IP 10.47.255.247 2025-01-07 11:36:41,663 - DEBUG - Pod ctest-pod-86419275 has vmi a0b24b58-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:41,663 - INFO - Verified pod ctest-pod-86419275 in contrail-api 2025-01-07 11:36:41,677 - DEBUG - VMI a0b24b58-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:41,677 - INFO - Verified Pod ctest-pod-86419275 in agent 10.0.0.52 2025-01-07 11:36:41,677 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=5e05b78d-ff12-4adf-b2e2-ff75f9be9674 2025-01-07 11:36:41,682 - INFO - Pod ctest-pod-86419275 with uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 found in kube manager 2025-01-07 11:36:41,683 - INFO - Pod ctest-pod-86419275 verification passed 2025-01-07 11:36:41,687 - INFO - Pod ctest-pod-49019008 is in running state.Got IP 10.47.255.245 2025-01-07 11:36:41,747 - DEBUG - Pod ctest-pod-49019008 has vmi a1a04ca4-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:41,747 - INFO - Verified pod ctest-pod-49019008 in contrail-api 2025-01-07 11:36:41,762 - DEBUG - VMI a1a04ca4-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:41,763 - INFO - Verified Pod ctest-pod-49019008 in agent 10.0.0.52 2025-01-07 11:36:41,763 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=047f7dd5-3a34-45b1-b514-1cfa2af8ef29 2025-01-07 11:36:41,768 - INFO - Pod ctest-pod-49019008 with uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 found in kube manager 2025-01-07 11:36:41,768 - INFO - Pod ctest-pod-49019008 verification passed 2025-01-07 11:36:41,773 - INFO - Pod ctest-pod-80166449 is in running state.Got IP 10.47.255.246 2025-01-07 11:36:41,791 - DEBUG - Pod ctest-pod-80166449 has vmi a129c23c-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:41,791 - INFO - Verified pod ctest-pod-80166449 in contrail-api 2025-01-07 11:36:41,808 - DEBUG - VMI a129c23c-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:41,808 - INFO - Verified Pod ctest-pod-80166449 in agent 10.0.0.52 2025-01-07 11:36:41,808 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 2025-01-07 11:36:41,813 - INFO - Pod ctest-pod-80166449 with uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 found in kube manager 2025-01-07 11:36:41,813 - INFO - Pod ctest-pod-80166449 verification passed 2025-01-07 11:36:41,818 - INFO - Pod ctest-pod-92503658 is in running state.Got IP 10.47.255.244 2025-01-07 11:36:41,876 - DEBUG - Pod ctest-pod-92503658 has vmi a21ccb26-cceb-11ef-8788-fa163eaa6089 2025-01-07 11:36:41,876 - INFO - Verified pod ctest-pod-92503658 in contrail-api 2025-01-07 11:36:41,892 - DEBUG - VMI a21ccb26-cceb-11ef-8788-fa163eaa6089 is active in agent 10.0.0.52 2025-01-07 11:36:41,892 - INFO - Verified Pod ctest-pod-92503658 in agent 10.0.0.52 2025-01-07 11:36:41,892 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=3f825e1a-36e7-44f7-b113-88465e979b8e 2025-01-07 11:36:41,897 - INFO - Pod ctest-pod-92503658 with uuid 3f825e1a-36e7-44f7-b113-88465e979b8e found in kube manager 2025-01-07 11:36:41,897 - INFO - Pod ctest-pod-92503658 verification passed 2025-01-07 11:36:41,898 - INFO - ================================================================================ 2025-01-07 11:36:41,898 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-07 11:36:41,898 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-07 11:36:42,106 - DEBUG - Nothing to compare xmpp stats {'10.0.0.52': {'10.0.0.29': '0'}} with 2025-01-07 11:36:42,106 - INFO - Initial checks done. Running the testcase now 2025-01-07 11:36:42,106 - INFO - 2025-01-07 11:36:42,179 - DEBUG - [Pod ctest-pod-07488068] Cmd: echo ctest-pod-07488068 > /usr/share/nginx/html/index.html, Output: 2025-01-07 11:36:42,256 - DEBUG - [Pod ctest-pod-40474959] Cmd: echo ctest-pod-40474959 > /usr/share/nginx/html/index.html, Output: 2025-01-07 11:36:42,318 - DEBUG - [Pod ctest-pod-45396107] Cmd: echo ctest-pod-45396107 > /usr/share/nginx/html/index.html, Output: 2025-01-07 11:36:42,375 - DEBUG - [Pod ctest-pod-76591251] Cmd: echo ctest-pod-76591251 > /usr/share/nginx/html/index.html, Output: 2025-01-07 11:36:42,377 - DEBUG - Service ctest-nginx-svc-80342512 not present 2025-01-07 11:36:42,377 - INFO - Creating service ctest-nginx-svc-80342512 2025-01-07 11:36:42,395 - INFO - Created Service ctest-nginx-svc-80342512 2025-01-07 11:36:42,404 - WARNING - Service UUID bff5ce53-c7b9-41ce-b9d3-f0537c211e0e not yet found in contrail-api 2025-01-07 11:36:43,419 - INFO - Validated that Service ctest-nginx-svc-80342512 is seen in contrail-api 2025-01-07 11:36:43,420 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=bff5ce53-c7b9-41ce-b9d3-f0537c211e0e 2025-01-07 11:36:43,425 - INFO - Service ctest-nginx-svc-80342512 with uuid bff5ce53-c7b9-41ce-b9d3-f0537c211e0e found in kube manager 2025-01-07 11:36:43,425 - INFO - Service ctest-nginx-svc-80342512 verification passed 2025-01-07 11:36:44,521 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) ctest-pod-07488068 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,521 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,521 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) ctest-pod-07488068 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,600 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:36:44,600 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,600 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:36:44,677 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,677 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,678 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,752 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,752 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,752 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,752 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07488068': 3, 'ctest-pod-40474959': 1} 2025-01-07 11:36:44,823 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,823 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,823 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:44,888 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:36:44,888 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,888 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:36:44,959 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:36:44,959 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:44,959 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:36:45,034 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:45,034 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:36:45,035 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:36:45,035 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07488068': 3, 'ctest-pod-40474959': 1} 2025-01-07 11:36:45,039 - DEBUG - Network policy ingress-on-service not present 2025-01-07 11:36:45,040 - INFO - Creating Network Policy ingress-on-service 2025-01-07 11:36:45,052 - INFO - Network policy found in k8s 2025-01-07 11:36:45,053 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e28b597b-198a-4a42-9ad1-7c7462ae589e 2025-01-07 11:36:45,059 - INFO - Network Policy ingress-on-service with uuid e28b597b-198a-4a42-9ad1-7c7462ae589e found in kube manager 2025-01-07 11:36:45,108 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-07 11:36:45,108 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-07 11:36:45,108 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e28b597b-198a-4a42-9ad1-7c7462ae589e 2025-01-07 11:36:45,141 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-07 11:36:47,142 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e28b597b-198a-4a42-9ad1-7c7462ae589e 2025-01-07 11:36:47,174 - INFO - Network policy with name ingress-on-service found in agent 2025-01-07 11:36:47,174 - INFO - Network Policy ingress-on-service verification passed 2025-01-07 11:36:52,246 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:36:52,246 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:36:52,246 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:36:57,311 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:36:57,311 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:36:57,311 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:02,386 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:02,386 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:02,386 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:07,450 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:07,450 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:07,450 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:12,504 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:12,505 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:12,505 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:17,560 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:17,560 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:17,560 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:20,552 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-07 11:37:30,631 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:30,631 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:30,632 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:35,704 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:35,704 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:35,704 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:40,758 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:40,758 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:40,758 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:45,814 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:45,814 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:45,814 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:45,814 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07488068': 0, 'ctest-pod-40474959': 0} 2025-01-07 11:37:45,879 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40474959 2025-01-07 11:37:45,879 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:37:45,879 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40474959 2025-01-07 11:37:45,953 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:37:45,953 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:37:45,953 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:37:45,953 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07488068': 1, 'ctest-pod-40474959': 1} 2025-01-07 11:37:51,018 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:51,018 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:51,018 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:56,065 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:56,066 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:37:56,066 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:01,118 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:01,118 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:01,118 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:06,173 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:06,173 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:06,174 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:11,235 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:11,235 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:11,235 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:16,287 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:16,287 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:16,287 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:21,342 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:21,342 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:21,342 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:26,403 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:26,403 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:26,403 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:31,474 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:31,474 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:31,475 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:36,546 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:36,546 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:36,546 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:36,546 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07488068': 0, 'ctest-pod-40474959': 0} 2025-01-07 11:38:38,624 - DEBUG - [Pod ctest-pod-80166449] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.375 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.102 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.095/0.524/1.375 ms 2025-01-07 11:38:38,624 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-80166449 with expectation True passed 2025-01-07 11:38:40,691 - DEBUG - [Pod ctest-pod-86419275] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.729 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.300/0.729 ms 2025-01-07 11:38:40,692 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86419275 with expectation True passed 2025-01-07 11:38:42,755 - DEBUG - [Pod ctest-pod-49019008] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.526 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.232/0.526 ms 2025-01-07 11:38:42,755 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49019008 with expectation True passed 2025-01-07 11:38:42,824 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:38:42,824 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-07 11:38:42,824 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:38:42,824 - INFO - wget check of of http://10.47.255.251 from ctest-pod-80166449 passed 2025-01-07 11:38:42,904 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:38:42,905 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-07 11:38:42,905 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:38:42,905 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80166449 passed 2025-01-07 11:38:47,969 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-07 11:38:47,970 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-07 11:38:47,970 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-07 11:38:47,970 - INFO - wget check of of http://10.47.255.250 from ctest-pod-86419275 passed 2025-01-07 11:38:53,049 - DEBUG - [Pod ctest-pod-92503658] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-07 11:38:53,049 - DEBUG - [Pod Pod ctest-pod-92503658] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-07 11:38:53,049 - DEBUG - [Pod Pod ctest-pod-92503658] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-07 11:38:53,049 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92503658 passed 2025-01-07 11:38:53,058 - INFO - Updating Network Policy ingress-on-service 2025-01-07 11:38:58,135 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:58,136 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:38:58,136 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:03,214 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:03,215 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:03,215 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:08,274 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:08,274 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:08,274 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:13,340 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:13,340 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:13,340 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:18,400 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:18,400 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:18,400 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:23,449 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:23,449 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:23,449 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:28,508 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:28,509 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:28,509 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:33,591 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:33,592 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:33,592 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:38,658 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:38,658 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:38,658 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:43,732 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:43,732 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:43,732 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) wget: download timed out 2025-01-07 11:39:43,732 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07488068': 0, 'ctest-pod-40474959': 0} 2025-01-07 11:39:43,806 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:39:43,806 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:39:43,806 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-07488068 2025-01-07 11:39:43,868 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:43,868 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:39:43,868 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:43,927 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:43,927 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:39:43,927 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:43,927 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07488068': 2, 'ctest-pod-40474959': 1} 2025-01-07 11:39:44,004 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:44,004 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:39:44,004 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: ctest-pod-40474959 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:44,056 - DEBUG - [Pod ctest-pod-49019008] Cmd: wget http://10.103.133.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:44,057 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd wget http://10.103.133.87:80/ -O - -T 5 -t 1 passed 2025-01-07 11:39:44,057 - DEBUG - [Pod Pod ctest-pod-49019008] Cmd output: ctest-pod-07488068 Connecting to 10.103.133.87:80 (10.103.133.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-07 11:39:44,057 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07488068': 1, 'ctest-pod-40474959': 1} 2025-01-07 11:39:46,111 - DEBUG - [Pod ctest-pod-80166449] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.789 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.319/0.789 ms 2025-01-07 11:39:46,111 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-80166449 with expectation True passed 2025-01-07 11:39:48,175 - DEBUG - [Pod ctest-pod-86419275] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.847 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.340/0.847 ms 2025-01-07 11:39:48,175 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86419275 with expectation True passed 2025-01-07 11:39:50,234 - DEBUG - [Pod ctest-pod-49019008] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.813 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.282 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.107 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.107/0.400/0.813 ms 2025-01-07 11:39:50,234 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49019008 with expectation True passed 2025-01-07 11:39:50,312 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:39:50,312 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-07 11:39:50,312 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:39:50,312 - INFO - wget check of of http://10.47.255.251 from ctest-pod-80166449 passed 2025-01-07 11:39:50,379 - DEBUG - [Pod ctest-pod-80166449] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:39:50,380 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-07 11:39:50,380 - DEBUG - [Pod Pod ctest-pod-80166449] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:39:50,380 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80166449 passed 2025-01-07 11:39:55,437 - DEBUG - [Pod ctest-pod-86419275] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-07 11:39:55,437 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-07 11:39:55,437 - DEBUG - [Pod Pod ctest-pod-86419275] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-07 11:39:55,437 - INFO - wget check of of http://10.47.255.250 from ctest-pod-86419275 passed 2025-01-07 11:39:55,502 - DEBUG - [Pod ctest-pod-92503658] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:39:55,502 - DEBUG - [Pod Pod ctest-pod-92503658] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-07 11:39:55,502 - DEBUG - [Pod Pod ctest-pod-92503658] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-07 11:39:55,502 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92503658 passed 2025-01-07 11:39:55,503 - INFO - Deleting Network Policy : ingress-on-service 2025-01-07 11:39:55,503 - INFO - Deleting service : ctest-nginx-svc-80342512 2025-01-07 11:39:55,695 - DEBUG - No XMPP flaps were noticed during the test 2025-01-07 11:39:55,695 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14] 2025-01-07 11:39:55,696 - INFO - -------------------------------------------------------------------------------- 2025-01-07 11:39:55,701 - INFO - Deleting pod ctest-new-default-02458326:ctest-pod-07488068 2025-01-07 11:39:55,701 - INFO - Deleting pod ctest-new-default-02458326:ctest-pod-40474959 2025-01-07 11:39:55,702 - INFO - Deleting pod ctest-non-default-02405900:ctest-pod-45396107 2025-01-07 11:39:55,702 - INFO - Deleting pod ctest-non-default-02405900:ctest-pod-76591251 2025-01-07 11:39:55,702 - INFO - Deleting pod ctest-new-default-02458326:ctest-pod-86419275 2025-01-07 11:39:55,703 - INFO - Deleting pod ctest-new-default-02458326:ctest-pod-80166449 2025-01-07 11:39:55,703 - INFO - Deleting pod ctest-non-default-02405900:ctest-pod-49019008 2025-01-07 11:39:55,703 - INFO - Deleting pod ctest-non-default-02405900:ctest-pod-92503658 2025-01-07 11:39:55,800 - WARNING - Pod uuid 2c8a12da-3cad-4070-9025-81344b8e0825 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,802 - WARNING - Pod uuid 6b048e61-7514-4d0f-a909-72f690816770 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,803 - WARNING - Pod uuid e2316166-2c1b-4b00-aa39-0b9387b857c7 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,819 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,821 - WARNING - Pod uuid 9869a19c-a39b-4911-943e-33a7177fcefc is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,821 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,822 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:39:55,822 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:00,815 - DEBUG - Pod 2c8a12da-3cad-4070-9025-81344b8e0825 is not in agent 10.0.0.52 VM list 2025-01-07 11:40:00,818 - DEBUG - Pod e2316166-2c1b-4b00-aa39-0b9387b857c7 is not in agent 10.0.0.52 VM list 2025-01-07 11:40:00,819 - DEBUG - Pod 6b048e61-7514-4d0f-a909-72f690816770 is not in agent 10.0.0.52 VM list 2025-01-07 11:40:00,833 - DEBUG - VMI 9e8b1922-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:00,834 - INFO - Verified that pod ctest-pod-07488068 is removed in agent 2025-01-07 11:40:00,846 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:00,846 - DEBUG - VMI 9f01ce3c-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:00,846 - INFO - Verified that pod ctest-pod-40474959 is removed in agent 2025-01-07 11:40:00,847 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:00,847 - DEBUG - VMI 9f9fa710-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:00,847 - INFO - Verified that pod ctest-pod-45396107 is removed in agent 2025-01-07 11:40:00,849 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:00,849 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:00,850 - DEBUG - Pod 9869a19c-a39b-4911-943e-33a7177fcefc is not in agent 10.0.0.52 VM list 2025-01-07 11:40:00,856 - DEBUG - VMI a01ac2ba-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:00,856 - INFO - Verified that pod ctest-pod-76591251 is removed in agent 2025-01-07 11:40:05,867 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:05,867 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:05,868 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:05,869 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:10,889 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:10,889 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:10,890 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:10,891 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:15,906 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:15,908 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:15,909 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:15,910 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:20,935 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:20,936 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:20,937 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:20,937 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:25,957 - WARNING - Pod uuid 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:25,959 - WARNING - Pod uuid 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:25,960 - WARNING - Pod uuid 3f825e1a-36e7-44f7-b113-88465e979b8e is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:25,960 - WARNING - Pod uuid 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is still seen in agent 10.0.0.52 VM list 2025-01-07 11:40:30,981 - DEBUG - Pod 5e05b78d-ff12-4adf-b2e2-ff75f9be9674 is not in agent 10.0.0.52 VM list 2025-01-07 11:40:30,991 - DEBUG - Pod 047f7dd5-3a34-45b1-b514-1cfa2af8ef29 is not in agent 10.0.0.52 VM list 2025-01-07 11:40:30,992 - DEBUG - Pod 5226ec8a-8314-4b13-b0e9-a7fcd1bc7b81 is not in agent 10.0.0.52 VM list 2025-01-07 11:40:30,994 - DEBUG - Pod 3f825e1a-36e7-44f7-b113-88465e979b8e is not in agent 10.0.0.52 VM list 2025-01-07 11:40:31,007 - DEBUG - VMI a1a04ca4-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:31,007 - INFO - Verified that pod ctest-pod-49019008 is removed in agent 2025-01-07 11:40:31,007 - DEBUG - VMI a0b24b58-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:31,008 - INFO - Verified that pod ctest-pod-86419275 is removed in agent 2025-01-07 11:40:31,009 - DEBUG - VMI a21ccb26-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:31,009 - INFO - Verified that pod ctest-pod-92503658 is removed in agent 2025-01-07 11:40:31,010 - DEBUG - VMI a129c23c-cceb-11ef-8788-fa163eaa6089 is removed from agent 10.0.0.52 2025-01-07 11:40:31,010 - INFO - Verified that pod ctest-pod-80166449 is removed in agent 2025-01-07 11:40:31,010 - INFO - Deleting namespace ctest-non-default-02405900 2025-01-07 11:40:31,029 - DEBUG - Namespace ctest-non-default-02405900 still in k8s 2025-01-07 11:40:33,033 - DEBUG - Namespace ctest-non-default-02405900 still in k8s 2025-01-07 11:40:35,038 - DEBUG - Namespace ctest-non-default-02405900 still in k8s 2025-01-07 11:40:37,044 - DEBUG - Namespace ctest-non-default-02405900 is not in k8s 2025-01-07 11:40:37,044 - DEBUG - No need to check project deletion in contrail-api 2025-01-07 11:40:37,044 - INFO - Deleting namespace ctest-new-default-02458326 2025-01-07 11:40:37,055 - DEBUG - Namespace ctest-new-default-02458326 still in k8s 2025-01-07 11:40:39,059 - DEBUG - Namespace ctest-new-default-02458326 still in k8s 2025-01-07 11:40:41,066 - DEBUG - Namespace ctest-new-default-02458326 still in k8s 2025-01-07 11:40:43,070 - DEBUG - Namespace ctest-new-default-02458326 is not in k8s 2025-01-07 11:40:43,070 - DEBUG - No need to check project deletion in contrail-api