2025-06-10 23:23:07,248 - INFO - Using existing project ['default-domain', 'k8s-default'](0e0e2323-4e50-4501-b744-ef77dc127c43) 2025-06-10 23:23:07,266 - DEBUG - Namespace ctest-new-default-51273651 not present 2025-06-10 23:23:07,272 - INFO - Created namespace ctest-new-default-51273651 2025-06-10 23:23:10,276 - DEBUG - Namespace ctest-non-default-71635691 not present 2025-06-10 23:23:10,288 - INFO - Created namespace ctest-non-default-71635691 2025-06-10 23:23:13,328 - DEBUG - Pod ctest-pod-42521990 not present 2025-06-10 23:23:13,329 - INFO - Creating Pod ctest-pod-42521990 2025-06-10 23:23:13,363 - DEBUG - Pod : ctest-pod-42521990 UUID is cac4a2e3-e2cf-4734-8a56-4e2497b8ab6b 2025-06-10 23:23:13,366 - DEBUG - Pod ctest-pod-92031237 not present 2025-06-10 23:23:13,366 - INFO - Creating Pod ctest-pod-92031237 2025-06-10 23:23:13,410 - DEBUG - Pod : ctest-pod-92031237 UUID is c6ecf1c2-6990-471f-b621-ce61bc74302e 2025-06-10 23:23:13,415 - DEBUG - Pod ctest-pod-76125530 not present 2025-06-10 23:23:13,416 - INFO - Creating Pod ctest-pod-76125530 2025-06-10 23:23:13,446 - DEBUG - Pod : ctest-pod-76125530 UUID is 26fb2476-bca7-453a-a927-b2f3ca0d34fe 2025-06-10 23:23:13,450 - DEBUG - Pod ctest-pod-72297378 not present 2025-06-10 23:23:13,451 - INFO - Creating Pod ctest-pod-72297378 2025-06-10 23:23:13,485 - DEBUG - Pod : ctest-pod-72297378 UUID is 5241ce9a-53a1-4939-9430-dd33667e2f4e 2025-06-10 23:23:13,490 - DEBUG - Pod ctest-pod-30702119 not present 2025-06-10 23:23:13,490 - INFO - Creating Pod ctest-pod-30702119 2025-06-10 23:23:13,508 - DEBUG - Pod : ctest-pod-30702119 UUID is b8f1ac6a-3946-4836-baec-cd470013a54c 2025-06-10 23:23:13,510 - DEBUG - Pod ctest-pod-53094503 not present 2025-06-10 23:23:13,511 - INFO - Creating Pod ctest-pod-53094503 2025-06-10 23:23:13,565 - DEBUG - Pod : ctest-pod-53094503 UUID is d25baefb-b270-4e86-a9b5-d131fb5fc88d 2025-06-10 23:23:13,568 - DEBUG - Pod ctest-pod-64855443 not present 2025-06-10 23:23:13,568 - INFO - Creating Pod ctest-pod-64855443 2025-06-10 23:23:13,586 - DEBUG - Pod : ctest-pod-64855443 UUID is 58b901d5-2183-4a3b-831c-1bf5b3311910 2025-06-10 23:23:13,588 - DEBUG - Pod ctest-pod-02164454 not present 2025-06-10 23:23:13,588 - INFO - Creating Pod ctest-pod-02164454 2025-06-10 23:23:13,604 - DEBUG - Pod : ctest-pod-02164454 UUID is 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 2025-06-10 23:23:13,832 - INFO - Project default-domain:k8s-ctest-new-default-51273651 for Namespace ctest-new-default-51273651 is seen in contrail-api 2025-06-10 23:23:13,833 - DEBUG - Project uuid in Contrail is be30f8a3-fd99-4857-82a3-aa580c7090ce 2025-06-10 23:23:13,993 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_NamespaceDatabaseList?namespace_uuid=a98c9405-e3ee-441d-8b68-826c3cd71334 2025-06-10 23:23:14,000 - INFO - Namespace ctest-new-default-51273651 with uuid a98c9405-e3ee-441d-8b68-826c3cd71334 found in kube manager 2025-06-10 23:23:14,000 - INFO - Namespace ctest-new-default-51273651 verification passed 2025-06-10 23:23:14,170 - INFO - Project default-domain:k8s-ctest-non-default-71635691 for Namespace ctest-non-default-71635691 is seen in contrail-api 2025-06-10 23:23:14,170 - DEBUG - Project uuid in Contrail is e9e01412-4e90-49e7-b462-3e06153f2090 2025-06-10 23:23:14,170 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_NamespaceDatabaseList?namespace_uuid=6e0fd0f6-b029-45f1-9975-6d8a00b87b11 2025-06-10 23:23:14,174 - INFO - Namespace ctest-non-default-71635691 with uuid 6e0fd0f6-b029-45f1-9975-6d8a00b87b11 found in kube manager 2025-06-10 23:23:14,175 - INFO - Namespace ctest-non-default-71635691 verification passed 2025-06-10 23:23:14,180 - DEBUG - Pod ctest-pod-42521990 not in running state.Currently in Pending 2025-06-10 23:23:19,186 - DEBUG - Pod ctest-pod-42521990 not in running state.Currently in Pending 2025-06-10 23:23:24,192 - DEBUG - Pod ctest-pod-42521990 not in running state.Currently in Pending 2025-06-10 23:23:29,199 - INFO - Pod ctest-pod-42521990 is in running state.Got IP 10.47.255.251 2025-06-10 23:23:29,254 - DEBUG - Pod ctest-pod-42521990 has vmi e2315292-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:29,254 - INFO - Verified pod ctest-pod-42521990 in contrail-api 2025-06-10 23:23:29,270 - DEBUG - VMI e2315292-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:29,270 - INFO - Verified Pod ctest-pod-42521990 in agent 10.0.0.241 2025-06-10 23:23:29,270 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=cac4a2e3-e2cf-4734-8a56-4e2497b8ab6b 2025-06-10 23:23:29,274 - INFO - Pod ctest-pod-42521990 with uuid cac4a2e3-e2cf-4734-8a56-4e2497b8ab6b found in kube manager 2025-06-10 23:23:29,274 - INFO - Pod ctest-pod-42521990 verification passed 2025-06-10 23:23:29,279 - INFO - Pod ctest-pod-92031237 is in running state.Got IP 10.47.255.250 2025-06-10 23:23:29,291 - DEBUG - Pod ctest-pod-92031237 has vmi e2a284d0-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:29,291 - INFO - Verified pod ctest-pod-92031237 in contrail-api 2025-06-10 23:23:29,304 - DEBUG - VMI e2a284d0-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:29,304 - INFO - Verified Pod ctest-pod-92031237 in agent 10.0.0.241 2025-06-10 23:23:29,304 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=c6ecf1c2-6990-471f-b621-ce61bc74302e 2025-06-10 23:23:29,308 - INFO - Pod ctest-pod-92031237 with uuid c6ecf1c2-6990-471f-b621-ce61bc74302e found in kube manager 2025-06-10 23:23:29,308 - INFO - Pod ctest-pod-92031237 verification passed 2025-06-10 23:23:29,313 - INFO - Pod ctest-pod-76125530 is in running state.Got IP 10.47.255.249 2025-06-10 23:23:29,369 - DEBUG - Pod ctest-pod-76125530 has vmi e343f892-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:29,370 - INFO - Verified pod ctest-pod-76125530 in contrail-api 2025-06-10 23:23:29,385 - DEBUG - VMI e343f892-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:29,385 - INFO - Verified Pod ctest-pod-76125530 in agent 10.0.0.241 2025-06-10 23:23:29,385 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=26fb2476-bca7-453a-a927-b2f3ca0d34fe 2025-06-10 23:23:29,389 - INFO - Pod ctest-pod-76125530 with uuid 26fb2476-bca7-453a-a927-b2f3ca0d34fe found in kube manager 2025-06-10 23:23:29,389 - INFO - Pod ctest-pod-76125530 verification passed 2025-06-10 23:23:29,460 - INFO - Pod ctest-pod-72297378 is in running state.Got IP 10.47.255.248 2025-06-10 23:23:29,474 - DEBUG - Pod ctest-pod-72297378 has vmi e3b1e438-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:29,474 - INFO - Verified pod ctest-pod-72297378 in contrail-api 2025-06-10 23:23:29,489 - DEBUG - VMI e3b1e438-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:29,489 - INFO - Verified Pod ctest-pod-72297378 in agent 10.0.0.241 2025-06-10 23:23:29,489 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=5241ce9a-53a1-4939-9430-dd33667e2f4e 2025-06-10 23:23:29,493 - INFO - Pod ctest-pod-72297378 with uuid 5241ce9a-53a1-4939-9430-dd33667e2f4e found in kube manager 2025-06-10 23:23:29,493 - INFO - Pod ctest-pod-72297378 verification passed 2025-06-10 23:23:29,498 - INFO - Pod ctest-pod-30702119 is in running state.Got IP 10.47.255.247 2025-06-10 23:23:29,553 - DEBUG - Pod ctest-pod-30702119 has vmi e4368774-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:29,553 - INFO - Verified pod ctest-pod-30702119 in contrail-api 2025-06-10 23:23:29,570 - DEBUG - VMI e4368774-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:29,570 - INFO - Verified Pod ctest-pod-30702119 in agent 10.0.0.241 2025-06-10 23:23:29,570 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=b8f1ac6a-3946-4836-baec-cd470013a54c 2025-06-10 23:23:29,574 - INFO - Pod ctest-pod-30702119 with uuid b8f1ac6a-3946-4836-baec-cd470013a54c found in kube manager 2025-06-10 23:23:29,574 - INFO - Pod ctest-pod-30702119 verification passed 2025-06-10 23:23:29,579 - DEBUG - Pod ctest-pod-64855443 not in running state.Currently in Pending 2025-06-10 23:23:34,588 - INFO - Pod ctest-pod-64855443 is in running state.Got IP 10.47.255.245 2025-06-10 23:23:34,606 - DEBUG - Pod ctest-pod-64855443 has vmi e56c6ffa-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:34,606 - INFO - Verified pod ctest-pod-64855443 in contrail-api 2025-06-10 23:23:34,620 - DEBUG - VMI e56c6ffa-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:34,620 - INFO - Verified Pod ctest-pod-64855443 in agent 10.0.0.241 2025-06-10 23:23:34,620 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=58b901d5-2183-4a3b-831c-1bf5b3311910 2025-06-10 23:23:34,625 - INFO - Pod ctest-pod-64855443 with uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 found in kube manager 2025-06-10 23:23:34,625 - INFO - Pod ctest-pod-64855443 verification passed 2025-06-10 23:23:34,630 - INFO - Pod ctest-pod-53094503 is in running state.Got IP 10.47.255.246 2025-06-10 23:23:34,689 - DEBUG - Pod ctest-pod-53094503 has vmi e4ceb8f0-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:34,690 - INFO - Verified pod ctest-pod-53094503 in contrail-api 2025-06-10 23:23:34,702 - DEBUG - VMI e4ceb8f0-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:34,702 - INFO - Verified Pod ctest-pod-53094503 in agent 10.0.0.241 2025-06-10 23:23:34,702 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=d25baefb-b270-4e86-a9b5-d131fb5fc88d 2025-06-10 23:23:34,706 - INFO - Pod ctest-pod-53094503 with uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d found in kube manager 2025-06-10 23:23:34,706 - INFO - Pod ctest-pod-53094503 verification passed 2025-06-10 23:23:34,711 - INFO - Pod ctest-pod-02164454 is in running state.Got IP 10.47.255.244 2025-06-10 23:23:34,762 - DEBUG - Pod ctest-pod-02164454 has vmi e5f8ef2a-4651-11f0-aa80-fa163e56af72 2025-06-10 23:23:34,762 - INFO - Verified pod ctest-pod-02164454 in contrail-api 2025-06-10 23:23:34,774 - DEBUG - VMI e5f8ef2a-4651-11f0-aa80-fa163e56af72 is active in agent 10.0.0.241 2025-06-10 23:23:34,775 - INFO - Verified Pod ctest-pod-02164454 in agent 10.0.0.241 2025-06-10 23:23:34,775 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_VirtualMachineDatabaseList?x=1803e9ce-8f0e-44bb-a815-74ad12aebcb3 2025-06-10 23:23:34,779 - INFO - Pod ctest-pod-02164454 with uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 found in kube manager 2025-06-10 23:23:34,779 - INFO - Pod ctest-pod-02164454 verification passed 2025-06-10 23:23:34,779 - INFO - ================================================================================ 2025-06-10 23:23:34,779 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-10 23:23:34,779 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-10 23:23:34,928 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.131': '0'}} with 2025-06-10 23:23:34,928 - INFO - Initial checks done. Running the testcase now 2025-06-10 23:23:34,928 - INFO - 2025-06-10 23:23:34,982 - DEBUG - [Pod ctest-pod-42521990] Cmd: echo ctest-pod-42521990 > /usr/share/nginx/html/index.html, Output: 2025-06-10 23:23:35,038 - DEBUG - [Pod ctest-pod-92031237] Cmd: echo ctest-pod-92031237 > /usr/share/nginx/html/index.html, Output: 2025-06-10 23:23:35,098 - DEBUG - [Pod ctest-pod-76125530] Cmd: echo ctest-pod-76125530 > /usr/share/nginx/html/index.html, Output: 2025-06-10 23:23:35,159 - DEBUG - [Pod ctest-pod-72297378] Cmd: echo ctest-pod-72297378 > /usr/share/nginx/html/index.html, Output: 2025-06-10 23:23:35,163 - DEBUG - Service ctest-nginx-svc-03138933 not present 2025-06-10 23:23:35,163 - INFO - Creating service ctest-nginx-svc-03138933 2025-06-10 23:23:35,188 - INFO - Created Service ctest-nginx-svc-03138933 2025-06-10 23:23:35,197 - WARNING - Service UUID 6e772368-e318-4eda-aa56-2d95d14d6162 not yet found in contrail-api 2025-06-10 23:23:36,209 - INFO - Validated that Service ctest-nginx-svc-03138933 is seen in contrail-api 2025-06-10 23:23:36,209 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_LoadbalancerDatabaseList?x=6e772368-e318-4eda-aa56-2d95d14d6162 2025-06-10 23:23:36,214 - INFO - Service ctest-nginx-svc-03138933 with uuid 6e772368-e318-4eda-aa56-2d95d14d6162 found in kube manager 2025-06-10 23:23:36,215 - INFO - Service ctest-nginx-svc-03138933 verification passed 2025-06-10 23:23:37,284 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42521990 2025-06-10 23:23:37,284 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:23:37,284 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42521990 2025-06-10 23:23:37,333 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92031237 2025-06-10 23:23:37,333 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:23:37,333 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92031237 2025-06-10 23:23:37,333 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42521990': 1, 'ctest-pod-92031237': 1} 2025-06-10 23:23:37,369 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:23:37,369 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:23:37,369 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:23:37,421 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:23:37,421 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:23:37,421 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:23:37,421 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42521990': 1, 'ctest-pod-92031237': 1} 2025-06-10 23:23:37,424 - DEBUG - Network policy ingress-on-service not present 2025-06-10 23:23:37,425 - INFO - Creating Network Policy ingress-on-service 2025-06-10 23:23:37,434 - INFO - Network policy found in k8s 2025-06-10 23:23:37,434 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f80d9f12-7a8f-48b7-8fb2-867fa4806461 2025-06-10 23:23:37,443 - INFO - Network Policy ingress-on-service with uuid f80d9f12-7a8f-48b7-8fb2-867fa4806461 found in kube manager 2025-06-10 23:23:37,485 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-10 23:23:37,486 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-10 23:23:37,486 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f80d9f12-7a8f-48b7-8fb2-867fa4806461 2025-06-10 23:23:37,521 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-10 23:23:39,522 - DEBUG - Requesting: http://10.0.0.131:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f80d9f12-7a8f-48b7-8fb2-867fa4806461 2025-06-10 23:23:39,550 - INFO - Network policy with name ingress-on-service found in agent 2025-06-10 23:23:39,551 - INFO - Network Policy ingress-on-service verification passed 2025-06-10 23:23:44,611 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:44,611 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:44,611 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:49,662 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:49,663 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:49,663 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:54,716 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:54,716 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:54,716 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:59,759 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:59,759 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:23:59,759 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:04,812 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:04,812 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:04,812 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:09,863 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:09,863 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:09,863 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:14,915 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:14,915 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:14,915 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:19,960 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:19,960 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:19,960 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:25,011 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:25,011 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:25,011 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:30,063 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:30,063 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:30,063 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:30,063 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42521990': 0, 'ctest-pod-92031237': 0} 2025-06-10 23:24:30,119 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:24:30,120 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:24:30,120 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:24:30,173 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:24:30,173 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:24:30,173 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:24:30,173 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42521990': 1, 'ctest-pod-92031237': 1} 2025-06-10 23:24:35,224 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:35,224 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:35,224 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:40,274 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:40,274 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:40,274 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:45,343 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:45,343 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:45,343 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:50,394 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:50,395 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:50,395 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:55,439 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:55,439 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:24:55,439 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:00,491 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:00,491 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:00,491 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:05,549 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:05,549 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:05,549 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:08,500 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-06-10 23:25:18,835 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:18,836 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:18,836 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:23,887 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:23,887 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:23,887 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:28,939 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:28,939 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:28,939 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:28,939 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42521990': 0, 'ctest-pod-92031237': 0} 2025-06-10 23:25:31,008 - DEBUG - [Pod ctest-pod-53094503] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.936 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.115 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.377/0.936 ms 2025-06-10 23:25:31,008 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-53094503 with expectation True passed 2025-06-10 23:25:33,065 - DEBUG - [Pod ctest-pod-30702119] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.592 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.588/1.592 ms 2025-06-10 23:25:33,065 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30702119 with expectation True passed 2025-06-10 23:25:35,126 - DEBUG - [Pod ctest-pod-64855443] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.258 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/1.141/3.258 ms 2025-06-10 23:25:35,127 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64855443 with expectation True passed 2025-06-10 23:25:35,176 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:25:35,176 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-10 23:25:35,176 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:25:35,176 - INFO - wget check of of http://10.47.255.251 from ctest-pod-53094503 passed 2025-06-10 23:25:35,224 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:25:35,224 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-10 23:25:35,224 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:25:35,224 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53094503 passed 2025-06-10 23:25:40,273 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-10 23:25:40,273 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-10 23:25:40,273 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-10 23:25:40,273 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30702119 passed 2025-06-10 23:25:45,324 - DEBUG - [Pod ctest-pod-02164454] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-10 23:25:45,324 - DEBUG - [Pod Pod ctest-pod-02164454] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-10 23:25:45,324 - DEBUG - [Pod Pod ctest-pod-02164454] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-10 23:25:45,324 - INFO - wget check of of http://10.47.255.251 from ctest-pod-02164454 passed 2025-06-10 23:25:45,338 - INFO - Updating Network Policy ingress-on-service 2025-06-10 23:25:50,390 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:50,390 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:50,390 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:55,443 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:55,443 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:25:55,443 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:00,496 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:00,496 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:00,496 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:05,548 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:05,548 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:05,548 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:10,600 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:10,600 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:10,600 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:15,652 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:15,652 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:15,652 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:20,703 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:20,703 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:20,703 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:25,756 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:25,756 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:25,756 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:30,811 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:30,811 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:30,811 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:35,860 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:35,860 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:35,860 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.109.42.36:80 (10.109.42.36:80) wget: download timed out 2025-06-10 23:26:35,860 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42521990': 0, 'ctest-pod-92031237': 0} 2025-06-10 23:26:35,916 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:35,917 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:35,917 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:35,977 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:35,978 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:35,978 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:35,978 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42521990': 1, 'ctest-pod-92031237': 1} 2025-06-10 23:26:36,037 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,037 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:36,037 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,097 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,097 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:36,097 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,150 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,150 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:36,150 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,201 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,201 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:36,201 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-42521990 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,261 - DEBUG - [Pod ctest-pod-64855443] Cmd: wget http://10.109.42.36:80/ -O - -T 5 -t 1 , Output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,261 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd wget http://10.109.42.36:80/ -O - -T 5 -t 1 passed 2025-06-10 23:26:36,261 - DEBUG - [Pod Pod ctest-pod-64855443] Cmd output: ctest-pod-92031237 Connecting to 10.109.42.36:80 (10.109.42.36:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-10 23:26:36,261 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42521990': 4, 'ctest-pod-92031237': 1} 2025-06-10 23:26:38,311 - DEBUG - [Pod ctest-pod-53094503] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.589 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.583/1.589 ms 2025-06-10 23:26:38,311 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-53094503 with expectation True passed 2025-06-10 23:26:40,364 - DEBUG - [Pod ctest-pod-30702119] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.311 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.487/1.311 ms 2025-06-10 23:26:40,364 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30702119 with expectation True passed 2025-06-10 23:26:42,415 - DEBUG - [Pod ctest-pod-64855443] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.511 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.224/0.511 ms 2025-06-10 23:26:42,415 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64855443 with expectation True passed 2025-06-10 23:26:42,460 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:26:42,460 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-10 23:26:42,460 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:26:42,460 - INFO - wget check of of http://10.47.255.251 from ctest-pod-53094503 passed 2025-06-10 23:26:42,510 - DEBUG - [Pod ctest-pod-53094503] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:26:42,510 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-10 23:26:42,510 - DEBUG - [Pod Pod ctest-pod-53094503] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:26:42,510 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53094503 passed 2025-06-10 23:26:47,567 - DEBUG - [Pod ctest-pod-30702119] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-10 23:26:47,567 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-10 23:26:47,567 - DEBUG - [Pod Pod ctest-pod-30702119] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-10 23:26:47,567 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30702119 passed 2025-06-10 23:26:47,625 - DEBUG - [Pod ctest-pod-02164454] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:26:47,625 - DEBUG - [Pod Pod ctest-pod-02164454] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-10 23:26:47,625 - DEBUG - [Pod Pod ctest-pod-02164454] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-10 23:26:47,626 - INFO - wget check of of http://10.47.255.251 from ctest-pod-02164454 passed 2025-06-10 23:26:47,626 - INFO - Deleting Network Policy : ingress-on-service 2025-06-10 23:26:47,626 - INFO - Deleting service : ctest-nginx-svc-03138933 2025-06-10 23:26:47,775 - DEBUG - No XMPP flaps were noticed during the test
2025-06-10 23:26:47,775 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-06-10 23:26:47,775 - INFO - -------------------------------------------------------------------------------- 2025-06-10 23:26:47,780 - INFO - Deleting pod ctest-new-default-51273651:ctest-pod-42521990 2025-06-10 23:26:47,780 - INFO - Deleting pod ctest-new-default-51273651:ctest-pod-92031237 2025-06-10 23:26:47,781 - INFO - Deleting pod ctest-non-default-71635691:ctest-pod-76125530 2025-06-10 23:26:47,781 - INFO - Deleting pod ctest-non-default-71635691:ctest-pod-72297378 2025-06-10 23:26:47,781 - INFO - Deleting pod ctest-new-default-51273651:ctest-pod-30702119 2025-06-10 23:26:47,782 - INFO - Deleting pod ctest-new-default-51273651:ctest-pod-53094503 2025-06-10 23:26:47,782 - INFO - Deleting pod ctest-non-default-71635691:ctest-pod-64855443 2025-06-10 23:26:47,782 - INFO - Deleting pod ctest-non-default-71635691:ctest-pod-02164454 2025-06-10 23:26:47,930 - WARNING - Pod uuid 5241ce9a-53a1-4939-9430-dd33667e2f4e is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,930 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,930 - WARNING - Pod uuid cac4a2e3-e2cf-4734-8a56-4e2497b8ab6b is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,932 - WARNING - Pod uuid c6ecf1c2-6990-471f-b621-ce61bc74302e is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,932 - WARNING - Pod uuid 26fb2476-bca7-453a-a927-b2f3ca0d34fe is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,932 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,932 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:47,933 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:52,959 - DEBUG - Pod c6ecf1c2-6990-471f-b621-ce61bc74302e is not in agent 10.0.0.241 VM list 2025-06-10 23:26:52,963 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:52,964 - DEBUG - Pod 26fb2476-bca7-453a-a927-b2f3ca0d34fe is not in agent 10.0.0.241 VM list 2025-06-10 23:26:52,965 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:52,965 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:52,966 - DEBUG - Pod cac4a2e3-e2cf-4734-8a56-4e2497b8ab6b is not in agent 10.0.0.241 VM list 2025-06-10 23:26:52,967 - DEBUG - Pod 5241ce9a-53a1-4939-9430-dd33667e2f4e is not in agent 10.0.0.241 VM list 2025-06-10 23:26:52,968 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:52,980 - DEBUG - VMI e2a284d0-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:26:52,980 - INFO - Verified that pod ctest-pod-92031237 is removed in agent 2025-06-10 23:26:52,982 - DEBUG - VMI e2315292-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:26:52,982 - INFO - Verified that pod ctest-pod-42521990 is removed in agent 2025-06-10 23:26:52,982 - DEBUG - VMI e343f892-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:26:52,982 - INFO - Verified that pod ctest-pod-76125530 is removed in agent 2025-06-10 23:26:52,983 - DEBUG - VMI e3b1e438-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:26:52,983 - INFO - Verified that pod ctest-pod-72297378 is removed in agent 2025-06-10 23:26:57,983 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:57,983 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:57,984 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:26:57,985 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:03,001 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:03,003 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:03,003 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:03,004 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:08,019 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:08,019 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:08,020 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:08,021 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:13,037 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:13,039 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:13,039 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:13,040 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:18,064 - WARNING - Pod uuid 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:18,066 - WARNING - Pod uuid 58b901d5-2183-4a3b-831c-1bf5b3311910 is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:18,066 - WARNING - Pod uuid d25baefb-b270-4e86-a9b5-d131fb5fc88d is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:18,066 - WARNING - Pod uuid b8f1ac6a-3946-4836-baec-cd470013a54c is still seen in agent 10.0.0.241 VM list 2025-06-10 23:27:23,100 - DEBUG - Pod 58b901d5-2183-4a3b-831c-1bf5b3311910 is not in agent 10.0.0.241 VM list 2025-06-10 23:27:23,102 - DEBUG - Pod 1803e9ce-8f0e-44bb-a815-74ad12aebcb3 is not in agent 10.0.0.241 VM list 2025-06-10 23:27:23,106 - DEBUG - Pod b8f1ac6a-3946-4836-baec-cd470013a54c is not in agent 10.0.0.241 VM list 2025-06-10 23:27:23,108 - DEBUG - Pod d25baefb-b270-4e86-a9b5-d131fb5fc88d is not in agent 10.0.0.241 VM list 2025-06-10 23:27:23,120 - DEBUG - VMI e56c6ffa-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:27:23,120 - INFO - Verified that pod ctest-pod-64855443 is removed in agent 2025-06-10 23:27:23,122 - DEBUG - VMI e4368774-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:27:23,122 - INFO - Verified that pod ctest-pod-30702119 is removed in agent 2025-06-10 23:27:23,122 - DEBUG - VMI e4ceb8f0-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:27:23,123 - INFO - Verified that pod ctest-pod-53094503 is removed in agent 2025-06-10 23:27:23,123 - DEBUG - VMI e5f8ef2a-4651-11f0-aa80-fa163e56af72 is removed from agent 10.0.0.241 2025-06-10 23:27:23,123 - INFO - Verified that pod ctest-pod-02164454 is removed in agent 2025-06-10 23:27:23,123 - INFO - Deleting namespace ctest-non-default-71635691 2025-06-10 23:27:23,139 - DEBUG - Namespace ctest-non-default-71635691 still in k8s 2025-06-10 23:27:25,145 - DEBUG - Namespace ctest-non-default-71635691 still in k8s 2025-06-10 23:27:27,149 - DEBUG - Namespace ctest-non-default-71635691 still in k8s 2025-06-10 23:27:29,153 - DEBUG - Namespace ctest-non-default-71635691 is not in k8s 2025-06-10 23:27:29,153 - DEBUG - No need to check project deletion in contrail-api 2025-06-10 23:27:29,153 - INFO - Deleting namespace ctest-new-default-51273651 2025-06-10 23:27:29,162 - DEBUG - Namespace ctest-new-default-51273651 still in k8s 2025-06-10 23:27:31,166 - DEBUG - Namespace ctest-new-default-51273651 still in k8s 2025-06-10 23:27:33,170 - DEBUG - Namespace ctest-new-default-51273651 still in k8s 2025-06-10 23:27:35,174 - DEBUG - Namespace ctest-new-default-51273651 is not in k8s 2025-06-10 23:27:35,174 - DEBUG - No need to check project deletion in contrail-api