2025-04-27 16:44:11,158 - INFO - Using existing project ['default-domain', 'k8s-default'](cd88049b-2848-4d66-84d2-c0cba1f0f9cc) 2025-04-27 16:44:11,172 - DEBUG - Namespace ctest-new-default-97800478 not present 2025-04-27 16:44:11,183 - INFO - Created namespace ctest-new-default-97800478 2025-04-27 16:44:14,194 - DEBUG - Namespace ctest-non-default-52319948 not present 2025-04-27 16:44:14,200 - INFO - Created namespace ctest-non-default-52319948 2025-04-27 16:44:17,219 - DEBUG - Pod ctest-pod-75250234 not present 2025-04-27 16:44:17,220 - INFO - Creating Pod ctest-pod-75250234 2025-04-27 16:44:17,245 - DEBUG - Pod : ctest-pod-75250234 UUID is 9e56249e-a250-4276-96f0-23af7bd02d01 2025-04-27 16:44:17,252 - DEBUG - Pod ctest-pod-19232641 not present 2025-04-27 16:44:17,252 - INFO - Creating Pod ctest-pod-19232641 2025-04-27 16:44:17,266 - DEBUG - Pod : ctest-pod-19232641 UUID is cdca11a9-31ae-4b9e-8e75-0d5aee9cc501 2025-04-27 16:44:17,269 - DEBUG - Pod ctest-pod-31790296 not present 2025-04-27 16:44:17,269 - INFO - Creating Pod ctest-pod-31790296 2025-04-27 16:44:17,284 - DEBUG - Pod : ctest-pod-31790296 UUID is ff4cab2b-98c7-44af-9d1f-90cdc8dba8b9 2025-04-27 16:44:17,286 - DEBUG - Pod ctest-pod-77357932 not present 2025-04-27 16:44:17,286 - INFO - Creating Pod ctest-pod-77357932 2025-04-27 16:44:17,312 - DEBUG - Pod : ctest-pod-77357932 UUID is 8a9b29fb-7ac6-4140-9689-61de615b2e03 2025-04-27 16:44:17,315 - DEBUG - Pod ctest-pod-51474380 not present 2025-04-27 16:44:17,316 - INFO - Creating Pod ctest-pod-51474380 2025-04-27 16:44:17,339 - DEBUG - Pod : ctest-pod-51474380 UUID is 92f1535a-4c2e-4190-91b8-3e22ff4c0209 2025-04-27 16:44:17,340 - DEBUG - Pod ctest-pod-10667639 not present 2025-04-27 16:44:17,341 - INFO - Creating Pod ctest-pod-10667639 2025-04-27 16:44:17,352 - DEBUG - Pod : ctest-pod-10667639 UUID is 5191d7c9-8306-49fe-ad1f-0d3e999a6322 2025-04-27 16:44:17,354 - DEBUG - Pod ctest-pod-80689219 not present 2025-04-27 16:44:17,354 - INFO - Creating Pod ctest-pod-80689219 2025-04-27 16:44:17,367 - DEBUG - Pod : ctest-pod-80689219 UUID is b98a2006-4cd7-4853-97d7-1ff06543c818 2025-04-27 16:44:17,368 - DEBUG - Pod ctest-pod-96271638 not present 2025-04-27 16:44:17,368 - INFO - Creating Pod ctest-pod-96271638 2025-04-27 16:44:17,381 - DEBUG - Pod : ctest-pod-96271638 UUID is 946f9df6-3f8a-43fd-a488-810e90f0829a 2025-04-27 16:44:17,551 - INFO - Project default-domain:k8s-ctest-new-default-97800478 for Namespace ctest-new-default-97800478 is seen in contrail-api 2025-04-27 16:44:17,551 - DEBUG - Project uuid in Contrail is 480310b8-b09e-4408-8e22-76fe2281e877 2025-04-27 16:44:17,718 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=0a42103a-966f-4897-ad1e-9c1d36840481 2025-04-27 16:44:17,722 - INFO - Namespace ctest-new-default-97800478 with uuid 0a42103a-966f-4897-ad1e-9c1d36840481 found in kube manager 2025-04-27 16:44:17,722 - INFO - Namespace ctest-new-default-97800478 verification passed 2025-04-27 16:44:17,909 - INFO - Project default-domain:k8s-ctest-non-default-52319948 for Namespace ctest-non-default-52319948 is seen in contrail-api 2025-04-27 16:44:17,909 - DEBUG - Project uuid in Contrail is 9ed5ea86-e486-4bf1-9e58-57412123347f 2025-04-27 16:44:17,909 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=735d9396-a1a8-4357-b940-0dc07da6f09e 2025-04-27 16:44:17,913 - INFO - Namespace ctest-non-default-52319948 with uuid 735d9396-a1a8-4357-b940-0dc07da6f09e found in kube manager 2025-04-27 16:44:17,913 - INFO - Namespace ctest-non-default-52319948 verification passed 2025-04-27 16:44:17,918 - DEBUG - Pod ctest-pod-75250234 not in running state.Currently in Pending 2025-04-27 16:44:22,925 - DEBUG - Pod ctest-pod-75250234 not in running state.Currently in Pending 2025-04-27 16:44:27,932 - INFO - Pod ctest-pod-75250234 is in running state.Got IP 10.47.255.251 2025-04-27 16:44:27,984 - DEBUG - Pod ctest-pod-75250234 has vmi dce4d536-2386-11f0-a436-fa163effa430 2025-04-27 16:44:27,984 - INFO - Verified pod ctest-pod-75250234 in contrail-api 2025-04-27 16:44:27,996 - DEBUG - VMI dce4d536-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:27,996 - INFO - Verified Pod ctest-pod-75250234 in agent 10.0.0.22 2025-04-27 16:44:27,996 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=9e56249e-a250-4276-96f0-23af7bd02d01 2025-04-27 16:44:28,000 - INFO - Pod ctest-pod-75250234 with uuid 9e56249e-a250-4276-96f0-23af7bd02d01 found in kube manager 2025-04-27 16:44:28,000 - INFO - Pod ctest-pod-75250234 verification passed 2025-04-27 16:44:28,006 - INFO - Pod ctest-pod-19232641 is in running state.Got IP 10.47.255.250 2025-04-27 16:44:28,015 - DEBUG - Pod ctest-pod-19232641 has vmi dd475d5a-2386-11f0-a436-fa163effa430 2025-04-27 16:44:28,015 - INFO - Verified pod ctest-pod-19232641 in contrail-api 2025-04-27 16:44:28,024 - DEBUG - VMI dd475d5a-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:28,024 - INFO - Verified Pod ctest-pod-19232641 in agent 10.0.0.22 2025-04-27 16:44:28,024 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=cdca11a9-31ae-4b9e-8e75-0d5aee9cc501 2025-04-27 16:44:28,028 - INFO - Pod ctest-pod-19232641 with uuid cdca11a9-31ae-4b9e-8e75-0d5aee9cc501 found in kube manager 2025-04-27 16:44:28,028 - INFO - Pod ctest-pod-19232641 verification passed 2025-04-27 16:44:28,032 - DEBUG - Pod ctest-pod-31790296 not in running state.Currently in Pending 2025-04-27 16:44:33,038 - INFO - Pod ctest-pod-31790296 is in running state.Got IP 10.47.255.249 2025-04-27 16:44:33,049 - DEBUG - Pod ctest-pod-31790296 has vmi ddd9140c-2386-11f0-a436-fa163effa430 2025-04-27 16:44:33,049 - INFO - Verified pod ctest-pod-31790296 in contrail-api 2025-04-27 16:44:33,061 - DEBUG - VMI ddd9140c-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:33,061 - INFO - Verified Pod ctest-pod-31790296 in agent 10.0.0.22 2025-04-27 16:44:33,061 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ff4cab2b-98c7-44af-9d1f-90cdc8dba8b9 2025-04-27 16:44:33,065 - INFO - Pod ctest-pod-31790296 with uuid ff4cab2b-98c7-44af-9d1f-90cdc8dba8b9 found in kube manager 2025-04-27 16:44:33,065 - INFO - Pod ctest-pod-31790296 verification passed 2025-04-27 16:44:33,069 - INFO - Pod ctest-pod-77357932 is in running state.Got IP 10.47.255.248 2025-04-27 16:44:33,121 - DEBUG - Pod ctest-pod-77357932 has vmi de514a26-2386-11f0-a436-fa163effa430 2025-04-27 16:44:33,121 - INFO - Verified pod ctest-pod-77357932 in contrail-api 2025-04-27 16:44:33,132 - DEBUG - VMI de514a26-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:33,132 - INFO - Verified Pod ctest-pod-77357932 in agent 10.0.0.22 2025-04-27 16:44:33,132 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=8a9b29fb-7ac6-4140-9689-61de615b2e03 2025-04-27 16:44:33,135 - INFO - Pod ctest-pod-77357932 with uuid 8a9b29fb-7ac6-4140-9689-61de615b2e03 found in kube manager 2025-04-27 16:44:33,135 - INFO - Pod ctest-pod-77357932 verification passed 2025-04-27 16:44:33,139 - INFO - Pod ctest-pod-51474380 is in running state.Got IP 10.47.255.247 2025-04-27 16:44:33,149 - DEBUG - Pod ctest-pod-51474380 has vmi ded5dade-2386-11f0-a436-fa163effa430 2025-04-27 16:44:33,149 - INFO - Verified pod ctest-pod-51474380 in contrail-api 2025-04-27 16:44:33,159 - DEBUG - VMI ded5dade-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:33,160 - INFO - Verified Pod ctest-pod-51474380 in agent 10.0.0.22 2025-04-27 16:44:33,160 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=92f1535a-4c2e-4190-91b8-3e22ff4c0209 2025-04-27 16:44:33,163 - INFO - Pod ctest-pod-51474380 with uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 found in kube manager 2025-04-27 16:44:33,163 - INFO - Pod ctest-pod-51474380 verification passed 2025-04-27 16:44:33,168 - DEBUG - Pod ctest-pod-80689219 not in running state.Currently in Pending 2025-04-27 16:44:38,173 - INFO - Pod ctest-pod-80689219 is in running state.Got IP 10.47.255.245 2025-04-27 16:44:38,224 - DEBUG - Pod ctest-pod-80689219 has vmi df9eb09e-2386-11f0-a436-fa163effa430 2025-04-27 16:44:38,224 - INFO - Verified pod ctest-pod-80689219 in contrail-api 2025-04-27 16:44:38,235 - DEBUG - VMI df9eb09e-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:38,235 - INFO - Verified Pod ctest-pod-80689219 in agent 10.0.0.22 2025-04-27 16:44:38,235 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b98a2006-4cd7-4853-97d7-1ff06543c818 2025-04-27 16:44:38,239 - INFO - Pod ctest-pod-80689219 with uuid b98a2006-4cd7-4853-97d7-1ff06543c818 found in kube manager 2025-04-27 16:44:38,239 - INFO - Pod ctest-pod-80689219 verification passed 2025-04-27 16:44:38,243 - INFO - Pod ctest-pod-10667639 is in running state.Got IP 10.47.255.246 2025-04-27 16:44:38,252 - DEBUG - Pod ctest-pod-10667639 has vmi df3eec90-2386-11f0-a436-fa163effa430 2025-04-27 16:44:38,252 - INFO - Verified pod ctest-pod-10667639 in contrail-api 2025-04-27 16:44:38,262 - DEBUG - VMI df3eec90-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:38,263 - INFO - Verified Pod ctest-pod-10667639 in agent 10.0.0.22 2025-04-27 16:44:38,263 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5191d7c9-8306-49fe-ad1f-0d3e999a6322 2025-04-27 16:44:38,266 - INFO - Pod ctest-pod-10667639 with uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 found in kube manager 2025-04-27 16:44:38,266 - INFO - Pod ctest-pod-10667639 verification passed 2025-04-27 16:44:38,270 - INFO - Pod ctest-pod-96271638 is in running state.Got IP 10.47.255.244 2025-04-27 16:44:38,320 - DEBUG - Pod ctest-pod-96271638 has vmi e00ccb24-2386-11f0-a436-fa163effa430 2025-04-27 16:44:38,320 - INFO - Verified pod ctest-pod-96271638 in contrail-api 2025-04-27 16:44:38,330 - DEBUG - VMI e00ccb24-2386-11f0-a436-fa163effa430 is active in agent 10.0.0.22 2025-04-27 16:44:38,330 - INFO - Verified Pod ctest-pod-96271638 in agent 10.0.0.22 2025-04-27 16:44:38,330 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=946f9df6-3f8a-43fd-a488-810e90f0829a 2025-04-27 16:44:38,333 - INFO - Pod ctest-pod-96271638 with uuid 946f9df6-3f8a-43fd-a488-810e90f0829a found in kube manager 2025-04-27 16:44:38,333 - INFO - Pod ctest-pod-96271638 verification passed 2025-04-27 16:44:38,334 - INFO - ================================================================================ 2025-04-27 16:44:38,334 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-27 16:44:38,334 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-27 16:44:38,557 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with 2025-04-27 16:44:38,557 - INFO - Initial checks done. Running the testcase now 2025-04-27 16:44:38,557 - INFO - 2025-04-27 16:44:38,603 - DEBUG - [Pod ctest-pod-75250234] Cmd: echo ctest-pod-75250234 > /usr/share/nginx/html/index.html, Output: 2025-04-27 16:44:38,651 - DEBUG - [Pod ctest-pod-19232641] Cmd: echo ctest-pod-19232641 > /usr/share/nginx/html/index.html, Output: 2025-04-27 16:44:38,704 - DEBUG - [Pod ctest-pod-31790296] Cmd: echo ctest-pod-31790296 > /usr/share/nginx/html/index.html, Output: 2025-04-27 16:44:38,757 - DEBUG - [Pod ctest-pod-77357932] Cmd: echo ctest-pod-77357932 > /usr/share/nginx/html/index.html, Output: 2025-04-27 16:44:38,761 - DEBUG - Service ctest-nginx-svc-02561065 not present 2025-04-27 16:44:38,761 - INFO - Creating service ctest-nginx-svc-02561065 2025-04-27 16:44:38,784 - INFO - Created Service ctest-nginx-svc-02561065 2025-04-27 16:44:38,795 - WARNING - Service UUID 628a75b1-2cb6-452a-8800-1b320de59b3b not yet found in contrail-api 2025-04-27 16:44:39,822 - INFO - Validated that Service ctest-nginx-svc-02561065 is seen in contrail-api 2025-04-27 16:44:39,822 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=628a75b1-2cb6-452a-8800-1b320de59b3b 2025-04-27 16:44:39,826 - INFO - Service ctest-nginx-svc-02561065 with uuid 628a75b1-2cb6-452a-8800-1b320de59b3b found in kube manager 2025-04-27 16:44:39,826 - INFO - Service ctest-nginx-svc-02561065 verification passed 2025-04-27 16:44:39,906 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:44:39,906 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:39,906 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:44:39,958 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:39,958 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:39,958 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,031 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:44:40,031 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:40,032 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:44:40,086 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,086 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:40,086 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,086 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75250234': 3, 'ctest-pod-19232641': 1} 2025-04-27 16:44:40,144 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,144 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:40,144 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,212 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,212 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:40,212 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:44:40,260 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:44:40,260 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:44:40,260 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:44:40,260 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75250234': 1, 'ctest-pod-19232641': 2} 2025-04-27 16:44:40,263 - DEBUG - Network policy ingress-on-service not present 2025-04-27 16:44:40,263 - INFO - Creating Network Policy ingress-on-service 2025-04-27 16:44:40,273 - INFO - Network policy found in k8s 2025-04-27 16:44:40,274 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=096c95b8-202b-4069-aeca-c3dc894d36f0 2025-04-27 16:44:40,278 - INFO - Network Policy ingress-on-service with uuid 096c95b8-202b-4069-aeca-c3dc894d36f0 found in kube manager 2025-04-27 16:44:40,306 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-27 16:44:40,307 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-27 16:44:40,307 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=096c95b8-202b-4069-aeca-c3dc894d36f0 2025-04-27 16:44:40,330 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-27 16:44:42,331 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=096c95b8-202b-4069-aeca-c3dc894d36f0 2025-04-27 16:44:42,362 - INFO - Network policy with name ingress-on-service found in agent 2025-04-27 16:44:42,363 - INFO - Network Policy ingress-on-service verification passed 2025-04-27 16:44:47,415 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:47,416 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:47,416 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:52,464 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:52,464 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:52,464 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:57,512 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:57,513 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:44:57,513 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:02,565 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:02,565 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:02,565 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:07,620 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:07,620 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:07,620 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:10,592 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-04-27 16:45:20,643 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:20,643 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:20,643 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:25,695 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:25,695 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:25,695 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:30,748 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:30,748 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:30,748 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:35,803 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:35,803 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:35,803 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:40,853 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:40,853 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:40,853 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:40,853 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-75250234': 0, 'ctest-pod-19232641': 0} 2025-04-27 16:45:40,904 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:40,904 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:45:40,904 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:40,948 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:40,949 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:45:40,949 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,008 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,008 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:45:41,008 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,057 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,057 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:45:41,057 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-75250234 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,106 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,106 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:45:41,106 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:45:41,106 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75250234': 4, 'ctest-pod-19232641': 1} 2025-04-27 16:45:46,151 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:46,151 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:46,151 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:51,200 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:51,200 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:51,201 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:56,243 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:56,243 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:45:56,243 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:01,287 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:01,287 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:01,287 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:06,336 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:06,336 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:06,336 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:11,408 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:11,408 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:11,408 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:16,453 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:16,453 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:16,453 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:21,504 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:21,504 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:21,504 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:26,547 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:26,548 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:26,548 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:31,591 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:31,591 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:31,591 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:31,591 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-75250234': 0, 'ctest-pod-19232641': 0} 2025-04-27 16:46:33,635 - DEBUG - [Pod ctest-pod-10667639] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.506 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.219/0.506 ms 2025-04-27 16:46:33,635 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-10667639 with expectation True passed 2025-04-27 16:46:35,679 - DEBUG - [Pod ctest-pod-51474380] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.590 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.249/0.590 ms 2025-04-27 16:46:35,679 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51474380 with expectation True passed 2025-04-27 16:46:37,727 - DEBUG - [Pod ctest-pod-80689219] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.597 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.256/0.597 ms 2025-04-27 16:46:37,727 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80689219 with expectation True passed 2025-04-27 16:46:37,774 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:46:37,774 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-27 16:46:37,774 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:46:37,775 - INFO - wget check of of http://10.47.255.251 from ctest-pod-10667639 passed 2025-04-27 16:46:37,821 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:46:37,821 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-27 16:46:37,821 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:46:37,821 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10667639 passed 2025-04-27 16:46:42,871 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 16:46:42,871 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 16:46:42,871 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 16:46:42,871 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51474380 passed 2025-04-27 16:46:47,923 - DEBUG - [Pod ctest-pod-96271638] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-27 16:46:47,923 - DEBUG - [Pod Pod ctest-pod-96271638] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-27 16:46:47,923 - DEBUG - [Pod Pod ctest-pod-96271638] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-27 16:46:47,923 - INFO - wget check of of http://10.47.255.251 from ctest-pod-96271638 passed 2025-04-27 16:46:47,930 - INFO - Updating Network Policy ingress-on-service 2025-04-27 16:46:52,987 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:52,987 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:52,987 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:58,035 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:58,035 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:46:58,035 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:03,083 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:03,083 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:03,083 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:08,123 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:08,123 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:08,123 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:13,176 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:13,176 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:13,176 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:18,223 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:18,223 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:18,223 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:23,280 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:23,280 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:23,280 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:28,327 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:28,327 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:28,327 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:33,370 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:33,370 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:33,370 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:38,419 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:38,419 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:38,419 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) wget: download timed out 2025-04-27 16:47:38,419 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-75250234': 0, 'ctest-pod-19232641': 0} 2025-04-27 16:47:38,468 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,468 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,468 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,520 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,520 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,520 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,566 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:47:38,566 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,566 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:47:38,566 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75250234': 1, 'ctest-pod-19232641': 2} 2025-04-27 16:47:38,612 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,612 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,613 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,656 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,656 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,656 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,701 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,702 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,702 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: ctest-pod-19232641 Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-27 16:47:38,748 - DEBUG - [Pod ctest-pod-80689219] Cmd: wget http://10.106.135.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:47:38,748 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd wget http://10.106.135.170:80/ -O - -T 5 -t 1 passed 2025-04-27 16:47:38,748 - DEBUG - [Pod Pod ctest-pod-80689219] Cmd output: Connecting to 10.106.135.170:80 (10.106.135.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75250234 2025-04-27 16:47:38,748 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-75250234': 1, 'ctest-pod-19232641': 3} 2025-04-27 16:47:40,787 - DEBUG - [Pod ctest-pod-10667639] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.046 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.401/1.046 ms 2025-04-27 16:47:40,787 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-10667639 with expectation True passed 2025-04-27 16:47:42,831 - DEBUG - [Pod ctest-pod-51474380] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.308 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.155/0.308 ms 2025-04-27 16:47:42,831 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51474380 with expectation True passed 2025-04-27 16:47:44,887 - DEBUG - [Pod ctest-pod-80689219] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.871 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.343/0.871 ms 2025-04-27 16:47:44,888 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80689219 with expectation True passed 2025-04-27 16:47:44,938 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:47:44,938 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-27 16:47:44,938 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:47:44,938 - INFO - wget check of of http://10.47.255.251 from ctest-pod-10667639 passed 2025-04-27 16:47:44,968 - DEBUG - [Pod ctest-pod-10667639] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:47:44,968 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-27 16:47:44,968 - DEBUG - [Pod Pod ctest-pod-10667639] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:47:44,968 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10667639 passed 2025-04-27 16:47:50,014 - DEBUG - [Pod ctest-pod-51474380] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 16:47:50,014 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 16:47:50,014 - DEBUG - [Pod Pod ctest-pod-51474380] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-27 16:47:50,014 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51474380 passed 2025-04-27 16:47:50,061 - DEBUG - [Pod ctest-pod-96271638] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:47:50,061 - DEBUG - [Pod Pod ctest-pod-96271638] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-27 16:47:50,061 - DEBUG - [Pod Pod ctest-pod-96271638] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-27 16:47:50,061 - INFO - wget check of of http://10.47.255.251 from ctest-pod-96271638 passed 2025-04-27 16:47:50,061 - INFO - Deleting Network Policy : ingress-on-service 2025-04-27 16:47:50,062 - INFO - Deleting service : ctest-nginx-svc-02561065 2025-04-27 16:47:50,285 - DEBUG - No XMPP flaps were noticed during the test 2025-04-27 16:47:50,285 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2025-04-27 16:47:50,285 - INFO - -------------------------------------------------------------------------------- 2025-04-27 16:47:50,289 - INFO - Deleting pod ctest-new-default-97800478:ctest-pod-75250234 2025-04-27 16:47:50,290 - INFO - Deleting pod ctest-new-default-97800478:ctest-pod-19232641 2025-04-27 16:47:50,290 - INFO - Deleting pod ctest-non-default-52319948:ctest-pod-31790296 2025-04-27 16:47:50,290 - INFO - Deleting pod ctest-non-default-52319948:ctest-pod-77357932 2025-04-27 16:47:50,291 - INFO - Deleting pod ctest-new-default-97800478:ctest-pod-51474380 2025-04-27 16:47:50,291 - INFO - Deleting pod ctest-new-default-97800478:ctest-pod-10667639 2025-04-27 16:47:50,291 - INFO - Deleting pod ctest-non-default-52319948:ctest-pod-80689219 2025-04-27 16:47:50,292 - INFO - Deleting pod ctest-non-default-52319948:ctest-pod-96271638 2025-04-27 16:47:50,316 - WARNING - Pod uuid 9e56249e-a250-4276-96f0-23af7bd02d01 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,489 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,489 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,492 - WARNING - Pod uuid 8a9b29fb-7ac6-4140-9689-61de615b2e03 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,493 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,493 - WARNING - Pod uuid cdca11a9-31ae-4b9e-8e75-0d5aee9cc501 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,493 - WARNING - Pod uuid ff4cab2b-98c7-44af-9d1f-90cdc8dba8b9 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:50,494 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:55,329 - DEBUG - Pod 9e56249e-a250-4276-96f0-23af7bd02d01 is not in agent 10.0.0.22 VM list 2025-04-27 16:47:55,336 - DEBUG - VMI dce4d536-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:47:55,336 - INFO - Verified that pod ctest-pod-75250234 is removed in agent 2025-04-27 16:47:55,518 - DEBUG - Pod ff4cab2b-98c7-44af-9d1f-90cdc8dba8b9 is not in agent 10.0.0.22 VM list 2025-04-27 16:47:55,519 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:55,520 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:55,520 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:55,520 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:47:55,521 - DEBUG - Pod cdca11a9-31ae-4b9e-8e75-0d5aee9cc501 is not in agent 10.0.0.22 VM list 2025-04-27 16:47:55,523 - DEBUG - Pod 8a9b29fb-7ac6-4140-9689-61de615b2e03 is not in agent 10.0.0.22 VM list 2025-04-27 16:47:55,532 - DEBUG - VMI ddd9140c-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:47:55,532 - INFO - Verified that pod ctest-pod-31790296 is removed in agent 2025-04-27 16:47:55,533 - DEBUG - VMI de514a26-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:47:55,533 - INFO - Verified that pod ctest-pod-77357932 is removed in agent 2025-04-27 16:47:55,534 - DEBUG - VMI dd475d5a-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:47:55,534 - INFO - Verified that pod ctest-pod-19232641 is removed in agent 2025-04-27 16:48:00,537 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:00,537 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:00,538 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:00,538 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:05,553 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:05,553 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:05,554 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:05,555 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:10,571 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:10,571 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:10,572 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:10,573 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:15,587 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:15,587 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:15,589 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:15,589 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:20,604 - WARNING - Pod uuid 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:20,604 - WARNING - Pod uuid 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:20,606 - WARNING - Pod uuid b98a2006-4cd7-4853-97d7-1ff06543c818 is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:20,606 - WARNING - Pod uuid 946f9df6-3f8a-43fd-a488-810e90f0829a is still seen in agent 10.0.0.22 VM list 2025-04-27 16:48:25,622 - DEBUG - Pod 92f1535a-4c2e-4190-91b8-3e22ff4c0209 is not in agent 10.0.0.22 VM list 2025-04-27 16:48:25,625 - DEBUG - Pod 946f9df6-3f8a-43fd-a488-810e90f0829a is not in agent 10.0.0.22 VM list 2025-04-27 16:48:25,627 - DEBUG - Pod b98a2006-4cd7-4853-97d7-1ff06543c818 is not in agent 10.0.0.22 VM list 2025-04-27 16:48:25,628 - DEBUG - Pod 5191d7c9-8306-49fe-ad1f-0d3e999a6322 is not in agent 10.0.0.22 VM list 2025-04-27 16:48:25,640 - DEBUG - VMI ded5dade-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:48:25,640 - INFO - Verified that pod ctest-pod-51474380 is removed in agent 2025-04-27 16:48:25,642 - DEBUG - VMI e00ccb24-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:48:25,642 - INFO - Verified that pod ctest-pod-96271638 is removed in agent 2025-04-27 16:48:25,643 - DEBUG - VMI df9eb09e-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:48:25,643 - INFO - Verified that pod ctest-pod-80689219 is removed in agent 2025-04-27 16:48:25,644 - DEBUG - VMI df3eec90-2386-11f0-a436-fa163effa430 is removed from agent 10.0.0.22 2025-04-27 16:48:25,644 - INFO - Verified that pod ctest-pod-10667639 is removed in agent 2025-04-27 16:48:25,644 - INFO - Deleting namespace ctest-non-default-52319948 2025-04-27 16:48:25,663 - DEBUG - Namespace ctest-non-default-52319948 still in k8s 2025-04-27 16:48:27,668 - DEBUG - Namespace ctest-non-default-52319948 still in k8s 2025-04-27 16:48:29,672 - DEBUG - Namespace ctest-non-default-52319948 still in k8s 2025-04-27 16:48:31,676 - DEBUG - Namespace ctest-non-default-52319948 is not in k8s 2025-04-27 16:48:31,676 - DEBUG - No need to check project deletion in contrail-api 2025-04-27 16:48:31,676 - INFO - Deleting namespace ctest-new-default-97800478 2025-04-27 16:48:31,686 - DEBUG - Namespace ctest-new-default-97800478 still in k8s 2025-04-27 16:48:33,691 - DEBUG - Namespace ctest-new-default-97800478 still in k8s 2025-04-27 16:48:35,695 - DEBUG - Namespace ctest-new-default-97800478 still in k8s 2025-04-27 16:48:37,699 - DEBUG - Namespace ctest-new-default-97800478 is not in k8s 2025-04-27 16:48:37,699 - DEBUG - No need to check project deletion in contrail-api