2025-10-30 02:01:26,213 - INFO - Using existing project ['default-domain', 'k8s-default'](b0fe02d0-1d35-472a-92fe-20fac5b5bf82) 2025-10-30 02:01:26,229 - DEBUG - Namespace ctest-new-default-20776787 not present 2025-10-30 02:01:26,236 - INFO - Created namespace ctest-new-default-20776787 2025-10-30 02:01:29,241 - DEBUG - Namespace ctest-non-default-20009921 not present 2025-10-30 02:01:29,248 - INFO - Created namespace ctest-non-default-20009921 2025-10-30 02:01:32,269 - DEBUG - Pod ctest-pod-45019549 not present 2025-10-30 02:01:32,270 - INFO - Creating Pod ctest-pod-45019549 2025-10-30 02:01:32,306 - DEBUG - Pod : ctest-pod-45019549 UUID is aad22c09-07e1-46b0-aac9-32ab2216fbb5 2025-10-30 02:01:32,311 - DEBUG - Pod ctest-pod-88199227 not present 2025-10-30 02:01:32,311 - INFO - Creating Pod ctest-pod-88199227 2025-10-30 02:01:32,346 - DEBUG - Pod : ctest-pod-88199227 UUID is d071881c-e0d5-4299-9ca5-570d7ca1b042 2025-10-30 02:01:32,349 - DEBUG - Pod ctest-pod-21247348 not present 2025-10-30 02:01:32,350 - INFO - Creating Pod ctest-pod-21247348 2025-10-30 02:01:32,383 - DEBUG - Pod : ctest-pod-21247348 UUID is 0b75147b-5772-4492-9bec-10a643b37032 2025-10-30 02:01:32,386 - DEBUG - Pod ctest-pod-09491734 not present 2025-10-30 02:01:32,387 - INFO - Creating Pod ctest-pod-09491734 2025-10-30 02:01:32,415 - DEBUG - Pod : ctest-pod-09491734 UUID is 31ac4134-9fa4-4e86-9fd1-c20c9977cf82 2025-10-30 02:01:32,417 - DEBUG - Pod ctest-pod-47223448 not present 2025-10-30 02:01:32,418 - INFO - Creating Pod ctest-pod-47223448 2025-10-30 02:01:32,442 - DEBUG - Pod : ctest-pod-47223448 UUID is 46b804fa-e6bc-4c34-95f5-4009365c1479 2025-10-30 02:01:32,445 - DEBUG - Pod ctest-pod-46581793 not present 2025-10-30 02:01:32,445 - INFO - Creating Pod ctest-pod-46581793 2025-10-30 02:01:32,481 - DEBUG - Pod : ctest-pod-46581793 UUID is 573af8c9-a160-4bf7-82a6-75527ccacb89 2025-10-30 02:01:32,486 - DEBUG - Pod ctest-pod-69052700 not present 2025-10-30 02:01:32,486 - INFO - Creating Pod ctest-pod-69052700 2025-10-30 02:01:32,511 - DEBUG - Pod : ctest-pod-69052700 UUID is f7e59374-a959-45b5-95b8-8dd72919e589 2025-10-30 02:01:32,513 - DEBUG - Pod ctest-pod-03712981 not present 2025-10-30 02:01:32,514 - INFO - Creating Pod ctest-pod-03712981 2025-10-30 02:01:32,537 - DEBUG - Pod : ctest-pod-03712981 UUID is 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 2025-10-30 02:01:32,736 - INFO - Project default-domain:k8s-ctest-new-default-20776787 for Namespace ctest-new-default-20776787 is seen in contrail-api 2025-10-30 02:01:32,736 - DEBUG - Project uuid in Contrail is 6028c20e-1288-4091-be7d-737e956797f5 2025-10-30 02:01:32,889 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=e48552e1-6b51-45a3-854b-2f25fbcc994a 2025-10-30 02:01:32,908 - INFO - Namespace ctest-new-default-20776787 with uuid e48552e1-6b51-45a3-854b-2f25fbcc994a found in kube manager 2025-10-30 02:01:32,908 - INFO - Namespace ctest-new-default-20776787 verification passed 2025-10-30 02:01:33,098 - INFO - Project default-domain:k8s-ctest-non-default-20009921 for Namespace ctest-non-default-20009921 is seen in contrail-api 2025-10-30 02:01:33,099 - DEBUG - Project uuid in Contrail is ae1ad00b-88b3-4721-bfec-f12651bd1b71 2025-10-30 02:01:33,099 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=5119b81a-eb83-4d30-bef4-10dd56e72510 2025-10-30 02:01:33,102 - INFO - Namespace ctest-non-default-20009921 with uuid 5119b81a-eb83-4d30-bef4-10dd56e72510 found in kube manager 2025-10-30 02:01:33,102 - INFO - Namespace ctest-non-default-20009921 verification passed 2025-10-30 02:01:33,108 - DEBUG - Pod ctest-pod-45019549 not in running state.Currently in Pending 2025-10-30 02:01:38,117 - DEBUG - Pod ctest-pod-45019549 not in running state.Currently in Pending 2025-10-30 02:01:43,134 - INFO - Pod ctest-pod-45019549 is in running state.Got IP 10.47.255.251 2025-10-30 02:01:43,193 - DEBUG - Pod ctest-pod-45019549 has vmi 5c381200-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:43,193 - INFO - Verified pod ctest-pod-45019549 in contrail-api 2025-10-30 02:01:43,204 - DEBUG - VMI 5c381200-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:43,204 - INFO - Verified Pod ctest-pod-45019549 in agent 10.0.0.23 2025-10-30 02:01:43,204 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=aad22c09-07e1-46b0-aac9-32ab2216fbb5 2025-10-30 02:01:43,215 - INFO - Pod ctest-pod-45019549 with uuid aad22c09-07e1-46b0-aac9-32ab2216fbb5 found in kube manager 2025-10-30 02:01:43,216 - INFO - Pod ctest-pod-45019549 verification passed 2025-10-30 02:01:43,222 - DEBUG - Pod ctest-pod-88199227 not in running state.Currently in Pending 2025-10-30 02:01:48,230 - INFO - Pod ctest-pod-88199227 is in running state.Got IP 10.47.255.250 2025-10-30 02:01:48,240 - DEBUG - Pod ctest-pod-88199227 has vmi 5cae2a80-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:48,240 - INFO - Verified pod ctest-pod-88199227 in contrail-api 2025-10-30 02:01:48,252 - DEBUG - VMI 5cae2a80-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:48,252 - INFO - Verified Pod ctest-pod-88199227 in agent 10.0.0.23 2025-10-30 02:01:48,252 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=d071881c-e0d5-4299-9ca5-570d7ca1b042 2025-10-30 02:01:48,255 - INFO - Pod ctest-pod-88199227 with uuid d071881c-e0d5-4299-9ca5-570d7ca1b042 found in kube manager 2025-10-30 02:01:48,255 - INFO - Pod ctest-pod-88199227 verification passed 2025-10-30 02:01:48,261 - INFO - Pod ctest-pod-21247348 is in running state.Got IP 10.47.255.249 2025-10-30 02:01:48,313 - DEBUG - Pod ctest-pod-21247348 has vmi 5d3c19e4-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:48,313 - INFO - Verified pod ctest-pod-21247348 in contrail-api 2025-10-30 02:01:48,325 - DEBUG - VMI 5d3c19e4-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:48,325 - INFO - Verified Pod ctest-pod-21247348 in agent 10.0.0.23 2025-10-30 02:01:48,326 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=0b75147b-5772-4492-9bec-10a643b37032 2025-10-30 02:01:48,330 - INFO - Pod ctest-pod-21247348 with uuid 0b75147b-5772-4492-9bec-10a643b37032 found in kube manager 2025-10-30 02:01:48,330 - INFO - Pod ctest-pod-21247348 verification passed 2025-10-30 02:01:48,339 - INFO - Pod ctest-pod-09491734 is in running state.Got IP 10.47.255.248 2025-10-30 02:01:48,360 - DEBUG - Pod ctest-pod-09491734 has vmi 5db1f04c-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:48,360 - INFO - Verified pod ctest-pod-09491734 in contrail-api 2025-10-30 02:01:48,373 - DEBUG - VMI 5db1f04c-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:48,373 - INFO - Verified Pod ctest-pod-09491734 in agent 10.0.0.23 2025-10-30 02:01:48,373 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=31ac4134-9fa4-4e86-9fd1-c20c9977cf82 2025-10-30 02:01:48,378 - INFO - Pod ctest-pod-09491734 with uuid 31ac4134-9fa4-4e86-9fd1-c20c9977cf82 found in kube manager 2025-10-30 02:01:48,378 - INFO - Pod ctest-pod-09491734 verification passed 2025-10-30 02:01:48,386 - INFO - Pod ctest-pod-47223448 is in running state.Got IP 10.47.255.247 2025-10-30 02:01:48,440 - DEBUG - Pod ctest-pod-47223448 has vmi 5e3273e8-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:48,440 - INFO - Verified pod ctest-pod-47223448 in contrail-api 2025-10-30 02:01:48,451 - DEBUG - VMI 5e3273e8-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:48,451 - INFO - Verified Pod ctest-pod-47223448 in agent 10.0.0.23 2025-10-30 02:01:48,451 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=46b804fa-e6bc-4c34-95f5-4009365c1479 2025-10-30 02:01:48,455 - INFO - Pod ctest-pod-47223448 with uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 found in kube manager 2025-10-30 02:01:48,455 - INFO - Pod ctest-pod-47223448 verification passed 2025-10-30 02:01:48,461 - DEBUG - Pod ctest-pod-69052700 not in running state.Currently in Pending 2025-10-30 02:01:53,468 - INFO - Pod ctest-pod-69052700 is in running state.Got IP 10.47.255.245 2025-10-30 02:01:53,479 - DEBUG - Pod ctest-pod-69052700 has vmi 5f020c0c-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:53,479 - INFO - Verified pod ctest-pod-69052700 in contrail-api 2025-10-30 02:01:53,492 - DEBUG - VMI 5f020c0c-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:53,492 - INFO - Verified Pod ctest-pod-69052700 in agent 10.0.0.23 2025-10-30 02:01:53,492 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f7e59374-a959-45b5-95b8-8dd72919e589 2025-10-30 02:01:53,496 - INFO - Pod ctest-pod-69052700 with uuid f7e59374-a959-45b5-95b8-8dd72919e589 found in kube manager 2025-10-30 02:01:53,496 - INFO - Pod ctest-pod-69052700 verification passed 2025-10-30 02:01:53,502 - INFO - Pod ctest-pod-46581793 is in running state.Got IP 10.47.255.246 2025-10-30 02:01:53,556 - DEBUG - Pod ctest-pod-46581793 has vmi 5e9b5142-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:53,556 - INFO - Verified pod ctest-pod-46581793 in contrail-api 2025-10-30 02:01:53,567 - DEBUG - VMI 5e9b5142-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:53,567 - INFO - Verified Pod ctest-pod-46581793 in agent 10.0.0.23 2025-10-30 02:01:53,567 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=573af8c9-a160-4bf7-82a6-75527ccacb89 2025-10-30 02:01:53,571 - INFO - Pod ctest-pod-46581793 with uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 found in kube manager 2025-10-30 02:01:53,571 - INFO - Pod ctest-pod-46581793 verification passed 2025-10-30 02:01:53,577 - INFO - Pod ctest-pod-03712981 is in running state.Got IP 10.47.255.244 2025-10-30 02:01:53,629 - DEBUG - Pod ctest-pod-03712981 has vmi 5f6f16d0-b534-11f0-83b9-fa163ec7a9ec 2025-10-30 02:01:53,629 - INFO - Verified pod ctest-pod-03712981 in contrail-api 2025-10-30 02:01:53,640 - DEBUG - VMI 5f6f16d0-b534-11f0-83b9-fa163ec7a9ec is active in agent 10.0.0.23 2025-10-30 02:01:53,640 - INFO - Verified Pod ctest-pod-03712981 in agent 10.0.0.23 2025-10-30 02:01:53,640 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=1353ca6b-a8b5-4e3f-b512-7490760d8ef4 2025-10-30 02:01:53,644 - INFO - Pod ctest-pod-03712981 with uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 found in kube manager 2025-10-30 02:01:53,644 - INFO - Pod ctest-pod-03712981 verification passed 2025-10-30 02:01:53,645 - INFO - ================================================================================ 2025-10-30 02:01:53,645 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-10-30 02:01:53,645 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-10-30 02:01:53,847 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.41': '0'}} with 2025-10-30 02:01:53,847 - INFO - Initial checks done. Running the testcase now 2025-10-30 02:01:53,847 - INFO - 2025-10-30 02:01:53,904 - DEBUG - [Pod ctest-pod-45019549] Cmd: echo ctest-pod-45019549 > /usr/share/nginx/html/index.html, Output: 2025-10-30 02:01:53,953 - DEBUG - [Pod ctest-pod-88199227] Cmd: echo ctest-pod-88199227 > /usr/share/nginx/html/index.html, Output: 2025-10-30 02:01:54,001 - DEBUG - [Pod ctest-pod-21247348] Cmd: echo ctest-pod-21247348 > /usr/share/nginx/html/index.html, Output: 2025-10-30 02:01:54,055 - DEBUG - [Pod ctest-pod-09491734] Cmd: echo ctest-pod-09491734 > /usr/share/nginx/html/index.html, Output: 2025-10-30 02:01:54,059 - DEBUG - Service ctest-nginx-svc-80307578 not present 2025-10-30 02:01:54,059 - INFO - Creating service ctest-nginx-svc-80307578 2025-10-30 02:01:54,075 - INFO - Created Service ctest-nginx-svc-80307578 2025-10-30 02:01:54,085 - WARNING - Service UUID 101c80b0-3d13-4097-a627-50b5272be3fe not yet found in contrail-api 2025-10-30 02:01:55,096 - INFO - Validated that Service ctest-nginx-svc-80307578 is seen in contrail-api 2025-10-30 02:01:55,097 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=101c80b0-3d13-4097-a627-50b5272be3fe 2025-10-30 02:01:55,103 - INFO - Service ctest-nginx-svc-80307578 with uuid 101c80b0-3d13-4097-a627-50b5272be3fe found in kube manager 2025-10-30 02:01:55,103 - INFO - Service ctest-nginx-svc-80307578 verification passed 2025-10-30 02:01:55,163 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,163 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,163 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,215 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,216 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,216 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,274 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88199227 2025-10-30 02:01:55,274 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,275 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88199227 2025-10-30 02:01:55,336 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,337 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,337 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,387 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88199227 2025-10-30 02:01:55,387 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,387 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88199227 2025-10-30 02:01:55,421 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,423 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,423 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,492 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45019549 2025-10-30 02:01:55,492 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,492 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45019549 2025-10-30 02:01:55,492 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45019549': 1, 'ctest-pod-88199227': 6} 2025-10-30 02:01:55,550 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,551 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,551 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,598 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-45019549 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,598 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:01:55,598 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: ctest-pod-45019549 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:01:55,598 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45019549': 1, 'ctest-pod-88199227': 1} 2025-10-30 02:01:55,602 - DEBUG - Network policy ingress-on-service not present 2025-10-30 02:01:55,603 - INFO - Creating Network Policy ingress-on-service 2025-10-30 02:01:55,613 - INFO - Network policy found in k8s 2025-10-30 02:01:55,614 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cb4114bb-ea02-4d96-89bf-a11164f49185 2025-10-30 02:01:55,629 - INFO - Network Policy ingress-on-service with uuid cb4114bb-ea02-4d96-89bf-a11164f49185 found in kube manager 2025-10-30 02:01:55,653 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-10-30 02:01:55,654 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-10-30 02:01:55,654 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cb4114bb-ea02-4d96-89bf-a11164f49185 2025-10-30 02:01:55,675 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-30 02:01:57,676 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cb4114bb-ea02-4d96-89bf-a11164f49185 2025-10-30 02:01:57,707 - INFO - Network policy with name ingress-on-service found in agent 2025-10-30 02:01:57,707 - INFO - Network Policy ingress-on-service verification passed 2025-10-30 02:02:02,764 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:02,764 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:02,764 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:07,822 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:07,822 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:07,822 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:12,873 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:12,873 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:12,874 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:17,933 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:17,934 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:17,934 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:22,990 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:22,990 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:22,990 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:28,042 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:28,042 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:28,042 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:33,096 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:33,096 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:33,096 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:35,935 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-10-30 02:02:45,995 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:45,995 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:45,995 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:51,047 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:51,047 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:51,047 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:56,095 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:56,095 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:56,095 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:02:56,095 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-45019549': 0, 'ctest-pod-88199227': 0} 2025-10-30 02:02:56,150 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45019549 2025-10-30 02:02:56,150 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:02:56,150 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45019549 2025-10-30 02:02:56,205 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88199227 2025-10-30 02:02:56,205 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:02:56,205 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88199227 2025-10-30 02:02:56,205 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45019549': 1, 'ctest-pod-88199227': 1} 2025-10-30 02:03:01,258 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:01,258 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:01,258 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:06,314 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:06,314 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:06,314 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:11,374 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:11,374 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:11,374 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:16,427 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:16,427 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:16,428 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:21,483 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:21,483 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:21,483 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:26,530 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:26,530 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:26,530 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:31,589 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:31,589 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:31,589 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:36,633 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:36,633 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:36,633 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:41,688 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:41,688 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:41,688 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:46,738 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:46,738 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:46,738 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:03:46,738 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-45019549': 0, 'ctest-pod-88199227': 0} 2025-10-30 02:03:48,798 - DEBUG - [Pod ctest-pod-46581793] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.929 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.071 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.359/0.929 ms 2025-10-30 02:03:48,798 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-46581793 with expectation True passed 2025-10-30 02:03:50,850 - DEBUG - [Pod ctest-pod-47223448] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.506 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.110 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.230/0.506 ms 2025-10-30 02:03:50,850 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-47223448 with expectation True passed 2025-10-30 02:03:52,899 - DEBUG - [Pod ctest-pod-69052700] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.065 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.408/1.065 ms 2025-10-30 02:03:52,899 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69052700 with expectation True passed 2025-10-30 02:03:52,961 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:03:52,961 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-30 02:03:52,961 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:03:52,961 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46581793 passed 2025-10-30 02:03:53,015 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:03:53,016 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-30 02:03:53,016 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:03:53,016 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46581793 passed 2025-10-30 02:03:58,071 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-30 02:03:58,071 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-30 02:03:58,071 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-30 02:03:58,071 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47223448 passed 2025-10-30 02:04:03,127 - DEBUG - [Pod ctest-pod-03712981] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-30 02:04:03,127 - DEBUG - [Pod Pod ctest-pod-03712981] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-30 02:04:03,127 - DEBUG - [Pod Pod ctest-pod-03712981] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-30 02:04:03,127 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03712981 passed 2025-10-30 02:04:03,135 - INFO - Updating Network Policy ingress-on-service 2025-10-30 02:04:08,194 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:08,194 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:08,194 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:13,251 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:13,251 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:13,251 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:18,303 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:18,303 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:18,303 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:23,354 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:23,354 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:23,354 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:28,407 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:28,407 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:28,407 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:33,459 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:33,460 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:33,460 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:38,502 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:38,502 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:38,502 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:43,567 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:43,567 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:43,567 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:48,622 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:48,622 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:48,622 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:53,671 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:53,671 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:53,671 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) wget: download timed out 2025-10-30 02:04:53,671 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-45019549': 0, 'ctest-pod-88199227': 0} 2025-10-30 02:04:53,730 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-45019549 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,730 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:04:53,730 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: ctest-pod-45019549 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,792 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-45019549 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,792 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:04:53,792 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: ctest-pod-45019549 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,826 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,826 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:04:53,826 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,826 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45019549': 2, 'ctest-pod-88199227': 1} 2025-10-30 02:04:53,884 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45019549 2025-10-30 02:04:53,887 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:04:53,887 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45019549 2025-10-30 02:04:53,936 - DEBUG - [Pod ctest-pod-69052700] Cmd: wget http://10.107.49.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,936 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd wget http://10.107.49.24:80/ -O - -T 5 -t 1 passed 2025-10-30 02:04:53,936 - DEBUG - [Pod Pod ctest-pod-69052700] Cmd output: ctest-pod-88199227 Connecting to 10.107.49.24:80 (10.107.49.24:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-30 02:04:53,936 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45019549': 1, 'ctest-pod-88199227': 1} 2025-10-30 02:04:55,978 - DEBUG - [Pod ctest-pod-46581793] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.819 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.329/0.819 ms 2025-10-30 02:04:55,978 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-46581793 with expectation True passed 2025-10-30 02:04:58,040 - DEBUG - [Pod ctest-pod-47223448] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.557 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.573/1.557 ms 2025-10-30 02:04:58,040 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-47223448 with expectation True passed 2025-10-30 02:05:00,085 - DEBUG - [Pod ctest-pod-69052700] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.629 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.120 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.613/1.629 ms 2025-10-30 02:05:00,085 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69052700 with expectation True passed 2025-10-30 02:05:00,136 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:05:00,136 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-30 02:05:00,136 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:05:00,136 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46581793 passed 2025-10-30 02:05:00,202 - DEBUG - [Pod ctest-pod-46581793] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:05:00,202 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-30 02:05:00,202 - DEBUG - [Pod Pod ctest-pod-46581793] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:05:00,202 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46581793 passed 2025-10-30 02:05:05,256 - DEBUG - [Pod ctest-pod-47223448] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-30 02:05:05,256 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-30 02:05:05,256 - DEBUG - [Pod Pod ctest-pod-47223448] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-30 02:05:05,256 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47223448 passed 2025-10-30 02:05:05,309 - DEBUG - [Pod ctest-pod-03712981] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:05:05,309 - DEBUG - [Pod Pod ctest-pod-03712981] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-30 02:05:05,309 - DEBUG - [Pod Pod ctest-pod-03712981] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-30 02:05:05,309 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03712981 passed 2025-10-30 02:05:05,309 - INFO - Deleting Network Policy : ingress-on-service 2025-10-30 02:05:05,310 - INFO - Deleting service : ctest-nginx-svc-80307578 2025-10-30 02:05:05,513 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 02:05:05,513 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2025-10-30 02:05:05,513 - INFO - -------------------------------------------------------------------------------- 2025-10-30 02:05:05,517 - INFO - Deleting pod ctest-new-default-20776787:ctest-pod-45019549 2025-10-30 02:05:05,518 - INFO - Deleting pod ctest-new-default-20776787:ctest-pod-88199227 2025-10-30 02:05:05,518 - INFO - Deleting pod ctest-non-default-20009921:ctest-pod-21247348 2025-10-30 02:05:05,519 - INFO - Deleting pod ctest-non-default-20009921:ctest-pod-09491734 2025-10-30 02:05:05,519 - INFO - Deleting pod ctest-new-default-20776787:ctest-pod-47223448 2025-10-30 02:05:05,519 - INFO - Deleting pod ctest-new-default-20776787:ctest-pod-46581793 2025-10-30 02:05:05,520 - INFO - Deleting pod ctest-non-default-20009921:ctest-pod-69052700 2025-10-30 02:05:05,520 - INFO - Deleting pod ctest-non-default-20009921:ctest-pod-03712981 2025-10-30 02:05:05,714 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,716 - WARNING - Pod uuid 31ac4134-9fa4-4e86-9fd1-c20c9977cf82 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,717 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,717 - WARNING - Pod uuid d071881c-e0d5-4299-9ca5-570d7ca1b042 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,717 - WARNING - Pod uuid aad22c09-07e1-46b0-aac9-32ab2216fbb5 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,833 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,835 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:05,836 - WARNING - Pod uuid 0b75147b-5772-4492-9bec-10a643b37032 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:10,734 - DEBUG - Pod 31ac4134-9fa4-4e86-9fd1-c20c9977cf82 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:10,735 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:10,737 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:10,738 - DEBUG - Pod d071881c-e0d5-4299-9ca5-570d7ca1b042 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:10,739 - DEBUG - Pod aad22c09-07e1-46b0-aac9-32ab2216fbb5 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:10,748 - DEBUG - VMI 5db1f04c-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:10,748 - INFO - Verified that pod ctest-pod-09491734 is removed in agent 2025-10-30 02:05:10,749 - DEBUG - VMI 5c381200-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:10,749 - INFO - Verified that pod ctest-pod-45019549 is removed in agent 2025-10-30 02:05:10,749 - DEBUG - VMI 5cae2a80-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:10,750 - INFO - Verified that pod ctest-pod-88199227 is removed in agent 2025-10-30 02:05:10,847 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:10,848 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:10,848 - DEBUG - Pod 0b75147b-5772-4492-9bec-10a643b37032 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:10,854 - DEBUG - VMI 5d3c19e4-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:10,854 - INFO - Verified that pod ctest-pod-21247348 is removed in agent 2025-10-30 02:05:15,744 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:15,749 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:15,871 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:15,872 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:20,753 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:20,756 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:20,883 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:20,884 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:25,761 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:25,763 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:25,893 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:25,894 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:30,771 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:30,773 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:30,903 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:30,903 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:35,782 - WARNING - Pod uuid 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:35,782 - WARNING - Pod uuid 46b804fa-e6bc-4c34-95f5-4009365c1479 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:35,913 - WARNING - Pod uuid f7e59374-a959-45b5-95b8-8dd72919e589 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:35,913 - WARNING - Pod uuid 573af8c9-a160-4bf7-82a6-75527ccacb89 is still seen in agent 10.0.0.23 VM list 2025-10-30 02:05:40,792 - DEBUG - Pod 46b804fa-e6bc-4c34-95f5-4009365c1479 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:40,794 - DEBUG - Pod 1353ca6b-a8b5-4e3f-b512-7490760d8ef4 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:40,800 - DEBUG - VMI 5e3273e8-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:40,800 - INFO - Verified that pod ctest-pod-47223448 is removed in agent 2025-10-30 02:05:40,801 - DEBUG - VMI 5f6f16d0-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:40,801 - INFO - Verified that pod ctest-pod-03712981 is removed in agent 2025-10-30 02:05:40,922 - DEBUG - Pod 573af8c9-a160-4bf7-82a6-75527ccacb89 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:40,923 - DEBUG - Pod f7e59374-a959-45b5-95b8-8dd72919e589 is not in agent 10.0.0.23 VM list 2025-10-30 02:05:40,931 - DEBUG - VMI 5f020c0c-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:40,931 - INFO - Verified that pod ctest-pod-69052700 is removed in agent 2025-10-30 02:05:40,931 - DEBUG - VMI 5e9b5142-b534-11f0-83b9-fa163ec7a9ec is removed from agent 10.0.0.23 2025-10-30 02:05:40,931 - INFO - Verified that pod ctest-pod-46581793 is removed in agent 2025-10-30 02:05:40,931 - INFO - Deleting namespace ctest-non-default-20009921 2025-10-30 02:05:40,942 - DEBUG - Namespace ctest-non-default-20009921 still in k8s 2025-10-30 02:05:42,947 - DEBUG - Namespace ctest-non-default-20009921 still in k8s 2025-10-30 02:05:44,952 - DEBUG - Namespace ctest-non-default-20009921 still in k8s 2025-10-30 02:05:46,955 - DEBUG - Namespace ctest-non-default-20009921 is not in k8s 2025-10-30 02:05:46,955 - DEBUG - No need to check project deletion in contrail-api 2025-10-30 02:05:46,955 - INFO - Deleting namespace ctest-new-default-20776787 2025-10-30 02:05:46,967 - DEBUG - Namespace ctest-new-default-20776787 still in k8s 2025-10-30 02:05:48,971 - DEBUG - Namespace ctest-new-default-20776787 still in k8s 2025-10-30 02:05:50,976 - DEBUG - Namespace ctest-new-default-20776787 still in k8s 2025-10-30 02:05:52,980 - DEBUG - Namespace ctest-new-default-20776787 is not in k8s 2025-10-30 02:05:52,980 - DEBUG - No need to check project deletion in contrail-api