2025-05-26 02:10:00,324 - INFO - Using existing project ['default-domain', 'k8s-default'](674d1a8b-3ef6-478e-ac92-c5913514846a) 2025-05-26 02:10:00,347 - DEBUG - Namespace ctest-new-default-89932579 not present 2025-05-26 02:10:00,357 - INFO - Created namespace ctest-new-default-89932579 2025-05-26 02:10:03,362 - DEBUG - Namespace ctest-non-default-39259713 not present 2025-05-26 02:10:03,369 - INFO - Created namespace ctest-non-default-39259713 2025-05-26 02:10:06,390 - DEBUG - Pod ctest-pod-39605654 not present 2025-05-26 02:10:06,390 - INFO - Creating Pod ctest-pod-39605654 2025-05-26 02:10:06,416 - DEBUG - Pod : ctest-pod-39605654 UUID is 0ae9179a-afcd-4c98-b6f2-48a27531c298 2025-05-26 02:10:06,420 - DEBUG - Pod ctest-pod-76456434 not present 2025-05-26 02:10:06,421 - INFO - Creating Pod ctest-pod-76456434 2025-05-26 02:10:06,474 - DEBUG - Pod : ctest-pod-76456434 UUID is 77c3857a-91b3-4a64-a324-d925b94bb0b4 2025-05-26 02:10:06,479 - DEBUG - Pod ctest-pod-66572915 not present 2025-05-26 02:10:06,480 - INFO - Creating Pod ctest-pod-66572915 2025-05-26 02:10:06,530 - DEBUG - Pod : ctest-pod-66572915 UUID is f1e05e10-3e3f-4df7-bd66-0f3018fd5ee3 2025-05-26 02:10:06,536 - DEBUG - Pod ctest-pod-56054634 not present 2025-05-26 02:10:06,536 - INFO - Creating Pod ctest-pod-56054634 2025-05-26 02:10:06,554 - DEBUG - Pod : ctest-pod-56054634 UUID is 5dba91b8-c7ac-4cc6-ab30-a862d0cabdc4 2025-05-26 02:10:06,559 - DEBUG - Pod ctest-pod-26253770 not present 2025-05-26 02:10:06,559 - INFO - Creating Pod ctest-pod-26253770 2025-05-26 02:10:06,573 - DEBUG - Pod : ctest-pod-26253770 UUID is 0f79ce17-8c34-4641-b797-c8cfbf251c4a 2025-05-26 02:10:06,576 - DEBUG - Pod ctest-pod-82967664 not present 2025-05-26 02:10:06,576 - INFO - Creating Pod ctest-pod-82967664 2025-05-26 02:10:06,598 - DEBUG - Pod : ctest-pod-82967664 UUID is 383ba1a5-7b83-4a19-97d9-1348b369c04c 2025-05-26 02:10:06,600 - DEBUG - Pod ctest-pod-02971187 not present 2025-05-26 02:10:06,600 - INFO - Creating Pod ctest-pod-02971187 2025-05-26 02:10:06,620 - DEBUG - Pod : ctest-pod-02971187 UUID is 77d1ca38-4718-468c-9deb-20c93101e3f0 2025-05-26 02:10:06,622 - DEBUG - Pod ctest-pod-52214985 not present 2025-05-26 02:10:06,623 - INFO - Creating Pod ctest-pod-52214985 2025-05-26 02:10:06,642 - DEBUG - Pod : ctest-pod-52214985 UUID is cbc7529a-d902-4518-99b0-7ba93eb9ee82 2025-05-26 02:10:06,828 - INFO - Project default-domain:k8s-ctest-new-default-89932579 for Namespace ctest-new-default-89932579 is seen in contrail-api 2025-05-26 02:10:06,829 - DEBUG - Project uuid in Contrail is 73dbf00d-3041-49f1-86ac-a2bb5aa5efe2 2025-05-26 02:10:07,021 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=d9eacec3-04da-4d74-9d1c-5a16fc29550d 2025-05-26 02:10:07,029 - INFO - Namespace ctest-new-default-89932579 with uuid d9eacec3-04da-4d74-9d1c-5a16fc29550d found in kube manager 2025-05-26 02:10:07,029 - INFO - Namespace ctest-new-default-89932579 verification passed 2025-05-26 02:10:07,191 - INFO - Project default-domain:k8s-ctest-non-default-39259713 for Namespace ctest-non-default-39259713 is seen in contrail-api 2025-05-26 02:10:07,191 - DEBUG - Project uuid in Contrail is d57464f2-1f42-4c71-a579-d81bd5e2d26e 2025-05-26 02:10:07,192 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=5016ab48-c1a3-42e8-80b9-6ca3fba185df 2025-05-26 02:10:07,197 - INFO - Namespace ctest-non-default-39259713 with uuid 5016ab48-c1a3-42e8-80b9-6ca3fba185df found in kube manager 2025-05-26 02:10:07,197 - INFO - Namespace ctest-non-default-39259713 verification passed 2025-05-26 02:10:07,202 - DEBUG - Pod ctest-pod-39605654 not in running state.Currently in Pending 2025-05-26 02:10:12,208 - DEBUG - Pod ctest-pod-39605654 not in running state.Currently in Pending 2025-05-26 02:10:17,214 - INFO - Pod ctest-pod-39605654 is in running state.Got IP 10.47.255.251 2025-05-26 02:10:17,268 - DEBUG - Pod ctest-pod-39605654 has vmi 8be28d7a-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:17,268 - INFO - Verified pod ctest-pod-39605654 in contrail-api 2025-05-26 02:10:17,281 - DEBUG - VMI 8be28d7a-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:17,281 - INFO - Verified Pod ctest-pod-39605654 in agent 10.0.0.56 2025-05-26 02:10:17,282 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=0ae9179a-afcd-4c98-b6f2-48a27531c298 2025-05-26 02:10:17,285 - INFO - Pod ctest-pod-39605654 with uuid 0ae9179a-afcd-4c98-b6f2-48a27531c298 found in kube manager 2025-05-26 02:10:17,286 - INFO - Pod ctest-pod-39605654 verification passed 2025-05-26 02:10:17,290 - INFO - Pod ctest-pod-76456434 is in running state.Got IP 10.47.255.250 2025-05-26 02:10:17,303 - DEBUG - Pod ctest-pod-76456434 has vmi 8c54b210-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:17,303 - INFO - Verified pod ctest-pod-76456434 in contrail-api 2025-05-26 02:10:17,313 - DEBUG - VMI 8c54b210-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:17,314 - INFO - Verified Pod ctest-pod-76456434 in agent 10.0.0.56 2025-05-26 02:10:17,314 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=77c3857a-91b3-4a64-a324-d925b94bb0b4 2025-05-26 02:10:17,319 - INFO - Pod ctest-pod-76456434 with uuid 77c3857a-91b3-4a64-a324-d925b94bb0b4 found in kube manager 2025-05-26 02:10:17,319 - INFO - Pod ctest-pod-76456434 verification passed 2025-05-26 02:10:17,324 - INFO - Pod ctest-pod-66572915 is in running state.Got IP 10.47.255.249 2025-05-26 02:10:17,380 - DEBUG - Pod ctest-pod-66572915 has vmi 8cf6251e-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:17,380 - INFO - Verified pod ctest-pod-66572915 in contrail-api 2025-05-26 02:10:17,390 - DEBUG - VMI 8cf6251e-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:17,390 - INFO - Verified Pod ctest-pod-66572915 in agent 10.0.0.56 2025-05-26 02:10:17,390 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=f1e05e10-3e3f-4df7-bd66-0f3018fd5ee3 2025-05-26 02:10:17,395 - INFO - Pod ctest-pod-66572915 with uuid f1e05e10-3e3f-4df7-bd66-0f3018fd5ee3 found in kube manager 2025-05-26 02:10:17,395 - INFO - Pod ctest-pod-66572915 verification passed 2025-05-26 02:10:17,400 - INFO - Pod ctest-pod-56054634 is in running state.Got IP 10.47.255.248 2025-05-26 02:10:17,419 - DEBUG - Pod ctest-pod-56054634 has vmi 8d755c94-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:17,419 - INFO - Verified pod ctest-pod-56054634 in contrail-api 2025-05-26 02:10:17,429 - DEBUG - VMI 8d755c94-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:17,429 - INFO - Verified Pod ctest-pod-56054634 in agent 10.0.0.56 2025-05-26 02:10:17,430 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=5dba91b8-c7ac-4cc6-ab30-a862d0cabdc4 2025-05-26 02:10:17,434 - INFO - Pod ctest-pod-56054634 with uuid 5dba91b8-c7ac-4cc6-ab30-a862d0cabdc4 found in kube manager 2025-05-26 02:10:17,434 - INFO - Pod ctest-pod-56054634 verification passed 2025-05-26 02:10:17,439 - DEBUG - Pod ctest-pod-26253770 not in running state.Currently in Pending 2025-05-26 02:10:22,446 - INFO - Pod ctest-pod-26253770 is in running state.Got IP 10.47.255.247 2025-05-26 02:10:22,507 - DEBUG - Pod ctest-pod-26253770 has vmi 8dfda928-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:22,507 - INFO - Verified pod ctest-pod-26253770 in contrail-api 2025-05-26 02:10:22,521 - DEBUG - VMI 8dfda928-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:22,521 - INFO - Verified Pod ctest-pod-26253770 in agent 10.0.0.56 2025-05-26 02:10:22,521 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=0f79ce17-8c34-4641-b797-c8cfbf251c4a 2025-05-26 02:10:22,529 - INFO - Pod ctest-pod-26253770 with uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a found in kube manager 2025-05-26 02:10:22,529 - INFO - Pod ctest-pod-26253770 verification passed 2025-05-26 02:10:22,535 - DEBUG - Pod ctest-pod-02971187 not in running state.Currently in Pending 2025-05-26 02:10:27,542 - INFO - Pod ctest-pod-02971187 is in running state.Got IP 10.47.255.245 2025-05-26 02:10:27,555 - DEBUG - Pod ctest-pod-02971187 has vmi 8eee14a8-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:27,556 - INFO - Verified pod ctest-pod-02971187 in contrail-api 2025-05-26 02:10:27,570 - DEBUG - VMI 8eee14a8-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:27,570 - INFO - Verified Pod ctest-pod-02971187 in agent 10.0.0.56 2025-05-26 02:10:27,570 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=77d1ca38-4718-468c-9deb-20c93101e3f0 2025-05-26 02:10:27,575 - INFO - Pod ctest-pod-02971187 with uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 found in kube manager 2025-05-26 02:10:27,575 - INFO - Pod ctest-pod-02971187 verification passed 2025-05-26 02:10:27,580 - INFO - Pod ctest-pod-82967664 is in running state.Got IP 10.47.255.246 2025-05-26 02:10:27,592 - DEBUG - Pod ctest-pod-82967664 has vmi 8e71964e-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:27,592 - INFO - Verified pod ctest-pod-82967664 in contrail-api 2025-05-26 02:10:27,604 - DEBUG - VMI 8e71964e-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:27,605 - INFO - Verified Pod ctest-pod-82967664 in agent 10.0.0.56 2025-05-26 02:10:27,605 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=383ba1a5-7b83-4a19-97d9-1348b369c04c 2025-05-26 02:10:27,609 - INFO - Pod ctest-pod-82967664 with uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c found in kube manager 2025-05-26 02:10:27,609 - INFO - Pod ctest-pod-82967664 verification passed 2025-05-26 02:10:27,613 - INFO - Pod ctest-pod-52214985 is in running state.Got IP 10.47.255.244 2025-05-26 02:10:27,667 - DEBUG - Pod ctest-pod-52214985 has vmi 8f5e4f16-39d6-11f0-b6c6-fa163e3e8492 2025-05-26 02:10:27,667 - INFO - Verified pod ctest-pod-52214985 in contrail-api 2025-05-26 02:10:27,679 - DEBUG - VMI 8f5e4f16-39d6-11f0-b6c6-fa163e3e8492 is active in agent 10.0.0.56 2025-05-26 02:10:27,679 - INFO - Verified Pod ctest-pod-52214985 in agent 10.0.0.56 2025-05-26 02:10:27,679 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=cbc7529a-d902-4518-99b0-7ba93eb9ee82 2025-05-26 02:10:27,683 - INFO - Pod ctest-pod-52214985 with uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 found in kube manager 2025-05-26 02:10:27,683 - INFO - Pod ctest-pod-52214985 verification passed 2025-05-26 02:10:27,683 - INFO - ================================================================================ 2025-05-26 02:10:27,683 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-26 02:10:27,683 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-26 02:10:27,900 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.65': '0'}} with 2025-05-26 02:10:27,900 - INFO - Initial checks done. Running the testcase now 2025-05-26 02:10:27,900 - INFO - 2025-05-26 02:10:27,951 - DEBUG - [Pod ctest-pod-39605654] Cmd: echo ctest-pod-39605654 > /usr/share/nginx/html/index.html, Output: 2025-05-26 02:10:28,004 - DEBUG - [Pod ctest-pod-76456434] Cmd: echo ctest-pod-76456434 > /usr/share/nginx/html/index.html, Output: 2025-05-26 02:10:28,059 - DEBUG - [Pod ctest-pod-66572915] Cmd: echo ctest-pod-66572915 > /usr/share/nginx/html/index.html, Output: 2025-05-26 02:10:28,107 - DEBUG - [Pod ctest-pod-56054634] Cmd: echo ctest-pod-56054634 > /usr/share/nginx/html/index.html, Output: 2025-05-26 02:10:28,110 - DEBUG - Service ctest-nginx-svc-16660584 not present 2025-05-26 02:10:28,110 - INFO - Creating service ctest-nginx-svc-16660584 2025-05-26 02:10:28,124 - INFO - Created Service ctest-nginx-svc-16660584 2025-05-26 02:10:28,130 - WARNING - Service UUID b2f824fa-b4b3-4d3e-a15e-c03ab7869122 not yet found in contrail-api 2025-05-26 02:10:29,138 - INFO - Validated that Service ctest-nginx-svc-16660584 is seen in contrail-api 2025-05-26 02:10:29,138 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=b2f824fa-b4b3-4d3e-a15e-c03ab7869122 2025-05-26 02:10:29,142 - INFO - Service ctest-nginx-svc-16660584 with uuid b2f824fa-b4b3-4d3e-a15e-c03ab7869122 found in kube manager 2025-05-26 02:10:29,143 - INFO - Service ctest-nginx-svc-16660584 verification passed 2025-05-26 02:10:30,215 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) ctest-pod-39605654 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,215 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:10:30,215 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) ctest-pod-39605654 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,268 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,268 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:10:30,268 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,268 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39605654': 1, 'ctest-pod-76456434': 1} 2025-05-26 02:10:30,322 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-39605654 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,322 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:10:30,322 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: ctest-pod-39605654 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,372 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39605654 2025-05-26 02:10:30,372 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:10:30,372 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39605654 2025-05-26 02:10:30,428 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,428 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:10:30,428 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:10:30,428 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39605654': 2, 'ctest-pod-76456434': 1} 2025-05-26 02:10:30,431 - DEBUG - Network policy ingress-on-service not present 2025-05-26 02:10:30,500 - INFO - Creating Network Policy ingress-on-service 2025-05-26 02:10:30,516 - INFO - Network policy found in k8s 2025-05-26 02:10:30,516 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=27b3bb10-2b62-468f-b123-71e83a583b72 2025-05-26 02:10:30,529 - INFO - Network Policy ingress-on-service with uuid 27b3bb10-2b62-468f-b123-71e83a583b72 found in kube manager 2025-05-26 02:10:30,572 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-26 02:10:30,572 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-26 02:10:30,572 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=27b3bb10-2b62-468f-b123-71e83a583b72 2025-05-26 02:10:30,620 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-26 02:10:32,621 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=27b3bb10-2b62-468f-b123-71e83a583b72 2025-05-26 02:10:32,651 - INFO - Network policy with name ingress-on-service found in agent 2025-05-26 02:10:32,652 - INFO - Network Policy ingress-on-service verification passed 2025-05-26 02:10:37,710 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:37,710 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:37,710 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:42,766 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:42,766 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:42,766 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:47,811 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:47,812 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:47,812 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:52,858 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:52,859 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:52,859 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:57,906 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:57,906 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:10:57,906 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:02,950 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:02,950 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:02,950 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:08,006 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:08,006 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:08,006 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:13,054 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:13,054 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:13,054 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:18,102 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:18,102 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:18,102 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:23,152 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:23,152 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:23,152 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:23,152 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-39605654': 0, 'ctest-pod-76456434': 0} 2025-05-26 02:11:23,217 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76456434 2025-05-26 02:11:23,217 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,217 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76456434 2025-05-26 02:11:23,265 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76456434 2025-05-26 02:11:23,265 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,265 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76456434 2025-05-26 02:11:23,313 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,313 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,313 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,368 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76456434 2025-05-26 02:11:23,368 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,368 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76456434 2025-05-26 02:11:23,428 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,429 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,429 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,481 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,481 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,481 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,528 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-39605654 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,528 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:11:23,528 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: ctest-pod-39605654 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:11:23,528 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39605654': 1, 'ctest-pod-76456434': 6} 2025-05-26 02:11:28,580 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:28,580 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:28,580 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:33,626 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:33,626 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:33,626 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:38,674 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:38,674 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:38,674 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:43,734 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:43,734 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:43,734 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:48,788 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:48,788 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:48,788 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:53,839 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:53,839 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:53,839 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:58,887 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:58,887 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:11:58,887 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:03,938 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:03,939 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:03,939 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:08,980 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:08,980 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:08,980 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:14,032 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:14,032 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:14,032 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:14,032 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-39605654': 0, 'ctest-pod-76456434': 0} 2025-05-26 02:12:14,336 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-05-26 02:12:21,396 - DEBUG - [Pod ctest-pod-82967664] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.875 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.339/0.875 ms 2025-05-26 02:12:21,396 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-82967664 with expectation True passed 2025-05-26 02:12:23,453 - DEBUG - [Pod ctest-pod-26253770] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.528 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.557/1.528 ms 2025-05-26 02:12:23,453 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26253770 with expectation True passed 2025-05-26 02:12:25,503 - DEBUG - [Pod ctest-pod-02971187] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.709 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.288/0.709 ms 2025-05-26 02:12:25,504 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-02971187 with expectation True passed 2025-05-26 02:12:25,551 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:12:25,552 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-26 02:12:25,552 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:12:25,552 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82967664 passed 2025-05-26 02:12:25,587 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:12:25,587 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-26 02:12:25,587 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:12:25,587 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82967664 passed 2025-05-26 02:12:30,639 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-26 02:12:30,639 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-26 02:12:30,639 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-26 02:12:30,639 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26253770 passed 2025-05-26 02:12:35,684 - DEBUG - [Pod ctest-pod-52214985] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-26 02:12:35,684 - DEBUG - [Pod Pod ctest-pod-52214985] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-26 02:12:35,684 - DEBUG - [Pod Pod ctest-pod-52214985] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-26 02:12:35,684 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52214985 passed 2025-05-26 02:12:35,692 - INFO - Updating Network Policy ingress-on-service 2025-05-26 02:12:40,755 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:40,755 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:40,755 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:45,825 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:45,825 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:45,825 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:50,870 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:50,870 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:50,870 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:55,915 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:55,915 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:12:55,915 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:00,967 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:00,967 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:00,967 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:06,019 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:06,019 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:06,019 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:11,070 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:11,070 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:11,070 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:16,121 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:16,121 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:16,121 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:21,168 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:21,168 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:21,168 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:26,223 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:26,223 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:26,223 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) wget: download timed out 2025-05-26 02:13:26,223 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-39605654': 0, 'ctest-pod-76456434': 0} 2025-05-26 02:13:26,283 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39605654 2025-05-26 02:13:26,283 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:13:26,283 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39605654 2025-05-26 02:13:26,328 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:13:26,328 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:13:26,328 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:13:26,328 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39605654': 1, 'ctest-pod-76456434': 1} 2025-05-26 02:13:26,383 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-39605654 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:13:26,383 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:13:26,383 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: ctest-pod-39605654 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:13:26,437 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39605654 2025-05-26 02:13:26,437 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:13:26,437 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39605654 2025-05-26 02:13:26,488 - DEBUG - [Pod ctest-pod-02971187] Cmd: wget http://10.111.154.112:80/ -O - -T 5 -t 1 , Output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:13:26,489 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd wget http://10.111.154.112:80/ -O - -T 5 -t 1 passed 2025-05-26 02:13:26,489 - DEBUG - [Pod Pod ctest-pod-02971187] Cmd output: ctest-pod-76456434 Connecting to 10.111.154.112:80 (10.111.154.112:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-26 02:13:26,489 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39605654': 2, 'ctest-pod-76456434': 1} 2025-05-26 02:13:28,531 - DEBUG - [Pod ctest-pod-82967664] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.707 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.287/0.707 ms 2025-05-26 02:13:28,531 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-82967664 with expectation True passed 2025-05-26 02:13:30,583 - DEBUG - [Pod ctest-pod-26253770] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.579 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.060 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.236/0.579 ms 2025-05-26 02:13:30,583 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26253770 with expectation True passed 2025-05-26 02:13:32,630 - DEBUG - [Pod ctest-pod-02971187] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.459 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.200/0.459 ms 2025-05-26 02:13:32,630 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-02971187 with expectation True passed 2025-05-26 02:13:32,680 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:13:32,681 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-26 02:13:32,681 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:13:32,681 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82967664 passed 2025-05-26 02:13:32,734 - DEBUG - [Pod ctest-pod-82967664] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:13:32,734 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-26 02:13:32,734 - DEBUG - [Pod Pod ctest-pod-82967664] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:13:32,734 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82967664 passed 2025-05-26 02:13:37,786 - DEBUG - [Pod ctest-pod-26253770] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-26 02:13:37,786 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-26 02:13:37,786 - DEBUG - [Pod Pod ctest-pod-26253770] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-26 02:13:37,786 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26253770 passed 2025-05-26 02:13:37,833 - DEBUG - [Pod ctest-pod-52214985] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:13:37,833 - DEBUG - [Pod Pod ctest-pod-52214985] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-26 02:13:37,833 - DEBUG - [Pod Pod ctest-pod-52214985] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-26 02:13:37,833 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52214985 passed 2025-05-26 02:13:37,833 - INFO - Deleting Network Policy : ingress-on-service 2025-05-26 02:13:37,833 - INFO - Deleting service : ctest-nginx-svc-16660584 2025-05-26 02:13:37,987 - DEBUG - No XMPP flaps were noticed during the test 2025-05-26 02:13:37,988 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2025-05-26 02:13:37,988 - INFO - -------------------------------------------------------------------------------- 2025-05-26 02:13:37,994 - INFO - Deleting pod ctest-new-default-89932579:ctest-pod-39605654 2025-05-26 02:13:37,995 - INFO - Deleting pod ctest-new-default-89932579:ctest-pod-76456434 2025-05-26 02:13:37,995 - INFO - Deleting pod ctest-non-default-39259713:ctest-pod-66572915 2025-05-26 02:13:37,996 - INFO - Deleting pod ctest-non-default-39259713:ctest-pod-56054634 2025-05-26 02:13:37,996 - INFO - Deleting pod ctest-new-default-89932579:ctest-pod-26253770 2025-05-26 02:13:37,996 - INFO - Deleting pod ctest-new-default-89932579:ctest-pod-82967664 2025-05-26 02:13:37,997 - INFO - Deleting pod ctest-non-default-39259713:ctest-pod-02971187 2025-05-26 02:13:37,997 - INFO - Deleting pod ctest-non-default-39259713:ctest-pod-52214985 2025-05-26 02:13:38,048 - WARNING - Pod uuid 0ae9179a-afcd-4c98-b6f2-48a27531c298 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,157 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,159 - WARNING - Pod uuid f1e05e10-3e3f-4df7-bd66-0f3018fd5ee3 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,159 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,160 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,160 - WARNING - Pod uuid 5dba91b8-c7ac-4cc6-ab30-a862d0cabdc4 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,163 - WARNING - Pod uuid 77c3857a-91b3-4a64-a324-d925b94bb0b4 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:38,164 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:43,056 - DEBUG - Pod 0ae9179a-afcd-4c98-b6f2-48a27531c298 is not in agent 10.0.0.56 VM list 2025-05-26 02:13:43,062 - DEBUG - VMI 8be28d7a-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:13:43,062 - INFO - Verified that pod ctest-pod-39605654 is removed in agent 2025-05-26 02:13:43,187 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:43,188 - DEBUG - Pod f1e05e10-3e3f-4df7-bd66-0f3018fd5ee3 is not in agent 10.0.0.56 VM list 2025-05-26 02:13:43,192 - DEBUG - Pod 77c3857a-91b3-4a64-a324-d925b94bb0b4 is not in agent 10.0.0.56 VM list 2025-05-26 02:13:43,193 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:43,194 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:43,194 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:43,194 - DEBUG - Pod 5dba91b8-c7ac-4cc6-ab30-a862d0cabdc4 is not in agent 10.0.0.56 VM list 2025-05-26 02:13:43,204 - DEBUG - VMI 8cf6251e-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:13:43,204 - INFO - Verified that pod ctest-pod-66572915 is removed in agent 2025-05-26 02:13:43,205 - DEBUG - VMI 8d755c94-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:13:43,205 - INFO - Verified that pod ctest-pod-56054634 is removed in agent 2025-05-26 02:13:43,205 - DEBUG - VMI 8c54b210-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:13:43,205 - INFO - Verified that pod ctest-pod-76456434 is removed in agent 2025-05-26 02:13:48,202 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:48,211 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:48,213 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:48,213 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:53,210 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:53,225 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:53,226 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:53,227 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:58,218 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:58,239 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:58,240 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:13:58,241 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:03,226 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:03,252 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:03,254 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:03,254 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:08,242 - WARNING - Pod uuid 383ba1a5-7b83-4a19-97d9-1348b369c04c is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:08,266 - WARNING - Pod uuid cbc7529a-d902-4518-99b0-7ba93eb9ee82 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:08,268 - WARNING - Pod uuid 0f79ce17-8c34-4641-b797-c8cfbf251c4a is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:08,268 - WARNING - Pod uuid 77d1ca38-4718-468c-9deb-20c93101e3f0 is still seen in agent 10.0.0.56 VM list 2025-05-26 02:14:13,250 - DEBUG - Pod 383ba1a5-7b83-4a19-97d9-1348b369c04c is not in agent 10.0.0.56 VM list 2025-05-26 02:14:13,257 - DEBUG - VMI 8e71964e-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:14:13,257 - INFO - Verified that pod ctest-pod-82967664 is removed in agent 2025-05-26 02:14:13,283 - DEBUG - Pod cbc7529a-d902-4518-99b0-7ba93eb9ee82 is not in agent 10.0.0.56 VM list 2025-05-26 02:14:13,285 - DEBUG - Pod 77d1ca38-4718-468c-9deb-20c93101e3f0 is not in agent 10.0.0.56 VM list 2025-05-26 02:14:13,287 - DEBUG - Pod 0f79ce17-8c34-4641-b797-c8cfbf251c4a is not in agent 10.0.0.56 VM list 2025-05-26 02:14:13,296 - DEBUG - VMI 8f5e4f16-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:14:13,297 - INFO - Verified that pod ctest-pod-52214985 is removed in agent 2025-05-26 02:14:13,298 - DEBUG - VMI 8eee14a8-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:14:13,298 - INFO - Verified that pod ctest-pod-02971187 is removed in agent 2025-05-26 02:14:13,299 - DEBUG - VMI 8dfda928-39d6-11f0-b6c6-fa163e3e8492 is removed from agent 10.0.0.56 2025-05-26 02:14:13,299 - INFO - Verified that pod ctest-pod-26253770 is removed in agent 2025-05-26 02:14:13,299 - INFO - Deleting namespace ctest-non-default-39259713 2025-05-26 02:14:13,316 - DEBUG - Namespace ctest-non-default-39259713 still in k8s 2025-05-26 02:14:15,320 - DEBUG - Namespace ctest-non-default-39259713 still in k8s 2025-05-26 02:14:17,325 - DEBUG - Namespace ctest-non-default-39259713 still in k8s 2025-05-26 02:14:19,328 - DEBUG - Namespace ctest-non-default-39259713 is not in k8s 2025-05-26 02:14:19,328 - DEBUG - No need to check project deletion in contrail-api 2025-05-26 02:14:19,328 - INFO - Deleting namespace ctest-new-default-89932579 2025-05-26 02:14:19,339 - DEBUG - Namespace ctest-new-default-89932579 still in k8s 2025-05-26 02:14:21,344 - DEBUG - Namespace ctest-new-default-89932579 still in k8s 2025-05-26 02:14:23,349 - DEBUG - Namespace ctest-new-default-89932579 still in k8s 2025-05-26 02:14:25,353 - DEBUG - Namespace ctest-new-default-89932579 is not in k8s 2025-05-26 02:14:25,354 - DEBUG - No need to check project deletion in contrail-api