2025-03-30 13:05:09,936 - INFO - Using existing project ['default-domain', 'k8s-default'](bd895ae5-0df2-4608-918d-3ba03a4dcef8) 2025-03-30 13:05:09,956 - DEBUG - Namespace ctest-new-default-36272959 not present 2025-03-30 13:05:09,965 - INFO - Created namespace ctest-new-default-36272959 2025-03-30 13:05:12,972 - DEBUG - Namespace ctest-non-default-42702433 not present 2025-03-30 13:05:12,981 - INFO - Created namespace ctest-non-default-42702433 2025-03-30 13:05:16,019 - DEBUG - Pod ctest-pod-31015287 not present 2025-03-30 13:05:16,020 - INFO - Creating Pod ctest-pod-31015287 2025-03-30 13:05:16,062 - DEBUG - Node for Pod ctest-pod-31015287 not yet populated 2025-03-30 13:05:19,068 - DEBUG - Pod : ctest-pod-31015287 UUID is 63fadd97-f77b-4c4f-943b-e564b68ef6bd 2025-03-30 13:05:19,070 - DEBUG - Pod ctest-pod-89089429 not present 2025-03-30 13:05:19,071 - INFO - Creating Pod ctest-pod-89089429 2025-03-30 13:05:19,095 - DEBUG - Pod : ctest-pod-89089429 UUID is 42a8f519-0047-407c-8d36-667eb73d1ccb 2025-03-30 13:05:19,099 - DEBUG - Pod ctest-pod-06391572 not present 2025-03-30 13:05:19,099 - INFO - Creating Pod ctest-pod-06391572 2025-03-30 13:05:19,123 - DEBUG - Pod : ctest-pod-06391572 UUID is 64716ef1-9f16-4219-87b8-bb75f1c2bcd3 2025-03-30 13:05:19,128 - DEBUG - Pod ctest-pod-23279516 not present 2025-03-30 13:05:19,128 - INFO - Creating Pod ctest-pod-23279516 2025-03-30 13:05:19,148 - DEBUG - Pod : ctest-pod-23279516 UUID is 59f2d036-ca16-44ad-84ef-8c9b345463a5 2025-03-30 13:05:19,152 - DEBUG - Pod ctest-pod-10588255 not present 2025-03-30 13:05:19,152 - INFO - Creating Pod ctest-pod-10588255 2025-03-30 13:05:19,174 - DEBUG - Pod : ctest-pod-10588255 UUID is 30f8af77-b035-4c40-b9e9-2eefe200b86c 2025-03-30 13:05:19,180 - DEBUG - Pod ctest-pod-26713342 not present 2025-03-30 13:05:19,180 - INFO - Creating Pod ctest-pod-26713342 2025-03-30 13:05:19,222 - DEBUG - Pod : ctest-pod-26713342 UUID is 809cf566-4330-4cfc-b7b1-a90b65015205 2025-03-30 13:05:19,227 - DEBUG - Pod ctest-pod-41531705 not present 2025-03-30 13:05:19,227 - INFO - Creating Pod ctest-pod-41531705 2025-03-30 13:05:19,261 - DEBUG - Pod : ctest-pod-41531705 UUID is 02e87f01-c172-4e4d-99d3-a0066dccb9ba 2025-03-30 13:05:19,267 - DEBUG - Pod ctest-pod-51277229 not present 2025-03-30 13:05:19,267 - INFO - Creating Pod ctest-pod-51277229 2025-03-30 13:05:19,300 - DEBUG - Pod : ctest-pod-51277229 UUID is cc9e3fb5-bd19-4d7a-acbf-182268185f0e 2025-03-30 13:05:19,592 - INFO - Project default-domain:k8s-ctest-new-default-36272959 for Namespace ctest-new-default-36272959 is seen in contrail-api 2025-03-30 13:05:19,593 - DEBUG - Project uuid in Contrail is c3a83748-ebe7-4ae2-abb8-91848010c602 2025-03-30 13:05:19,807 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=f419dd28-6080-4ccb-9cd4-495c3230d290 2025-03-30 13:05:19,811 - INFO - Namespace ctest-new-default-36272959 with uuid f419dd28-6080-4ccb-9cd4-495c3230d290 found in kube manager 2025-03-30 13:05:19,811 - INFO - Namespace ctest-new-default-36272959 verification passed 2025-03-30 13:05:20,084 - INFO - Project default-domain:k8s-ctest-non-default-42702433 for Namespace ctest-non-default-42702433 is seen in contrail-api 2025-03-30 13:05:20,085 - DEBUG - Project uuid in Contrail is fd1ad5c2-769b-4a7e-97c8-44cf66ab8701 2025-03-30 13:05:20,085 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=31b7e4f1-b34a-4768-9e8e-84d3a9e41ce5 2025-03-30 13:05:20,104 - INFO - Namespace ctest-non-default-42702433 with uuid 31b7e4f1-b34a-4768-9e8e-84d3a9e41ce5 found in kube manager 2025-03-30 13:05:20,104 - INFO - Namespace ctest-non-default-42702433 verification passed 2025-03-30 13:05:20,117 - DEBUG - Pod ctest-pod-31015287 not in running state.Currently in Pending 2025-03-30 13:05:25,124 - INFO - Pod ctest-pod-31015287 is in running state.Got IP 10.47.255.251 2025-03-30 13:05:25,140 - DEBUG - Pod ctest-pod-31015287 has vmi a0dd462a-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:25,140 - INFO - Verified pod ctest-pod-31015287 in contrail-api 2025-03-30 13:05:25,153 - DEBUG - VMI a0dd462a-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:25,154 - INFO - Verified Pod ctest-pod-31015287 in agent 10.0.0.29 2025-03-30 13:05:25,154 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=63fadd97-f77b-4c4f-943b-e564b68ef6bd 2025-03-30 13:05:25,159 - INFO - Pod ctest-pod-31015287 with uuid 63fadd97-f77b-4c4f-943b-e564b68ef6bd found in kube manager 2025-03-30 13:05:25,159 - INFO - Pod ctest-pod-31015287 verification passed 2025-03-30 13:05:25,165 - DEBUG - Pod ctest-pod-89089429 not in running state.Currently in Pending 2025-03-30 13:05:30,178 - DEBUG - Pod ctest-pod-89089429 not in running state.Currently in Pending 2025-03-30 13:05:35,185 - INFO - Pod ctest-pod-89089429 is in running state.Got IP 10.47.255.250 2025-03-30 13:05:35,200 - DEBUG - Pod ctest-pod-89089429 has vmi a1a3059a-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,200 - INFO - Verified pod ctest-pod-89089429 in contrail-api 2025-03-30 13:05:35,217 - DEBUG - VMI a1a3059a-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,217 - INFO - Verified Pod ctest-pod-89089429 in agent 10.0.0.29 2025-03-30 13:05:35,217 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=42a8f519-0047-407c-8d36-667eb73d1ccb 2025-03-30 13:05:35,224 - INFO - Pod ctest-pod-89089429 with uuid 42a8f519-0047-407c-8d36-667eb73d1ccb found in kube manager 2025-03-30 13:05:35,224 - INFO - Pod ctest-pod-89089429 verification passed 2025-03-30 13:05:35,231 - INFO - Pod ctest-pod-06391572 is in running state.Got IP 10.47.255.249 2025-03-30 13:05:35,293 - DEBUG - Pod ctest-pod-06391572 has vmi a27012c4-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,293 - INFO - Verified pod ctest-pod-06391572 in contrail-api 2025-03-30 13:05:35,310 - DEBUG - VMI a27012c4-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,311 - INFO - Verified Pod ctest-pod-06391572 in agent 10.0.0.29 2025-03-30 13:05:35,311 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=64716ef1-9f16-4219-87b8-bb75f1c2bcd3 2025-03-30 13:05:35,316 - INFO - Pod ctest-pod-06391572 with uuid 64716ef1-9f16-4219-87b8-bb75f1c2bcd3 found in kube manager 2025-03-30 13:05:35,316 - INFO - Pod ctest-pod-06391572 verification passed 2025-03-30 13:05:35,322 - INFO - Pod ctest-pod-23279516 is in running state.Got IP 10.47.255.248 2025-03-30 13:05:35,380 - DEBUG - Pod ctest-pod-23279516 has vmi a2fc6d64-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,381 - INFO - Verified pod ctest-pod-23279516 in contrail-api 2025-03-30 13:05:35,398 - DEBUG - VMI a2fc6d64-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,398 - INFO - Verified Pod ctest-pod-23279516 in agent 10.0.0.29 2025-03-30 13:05:35,398 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=59f2d036-ca16-44ad-84ef-8c9b345463a5 2025-03-30 13:05:35,403 - INFO - Pod ctest-pod-23279516 with uuid 59f2d036-ca16-44ad-84ef-8c9b345463a5 found in kube manager 2025-03-30 13:05:35,403 - INFO - Pod ctest-pod-23279516 verification passed 2025-03-30 13:05:35,408 - INFO - Pod ctest-pod-10588255 is in running state.Got IP 10.47.255.247 2025-03-30 13:05:35,424 - DEBUG - Pod ctest-pod-10588255 has vmi a39387e4-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,424 - INFO - Verified pod ctest-pod-10588255 in contrail-api 2025-03-30 13:05:35,440 - DEBUG - VMI a39387e4-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,440 - INFO - Verified Pod ctest-pod-10588255 in agent 10.0.0.29 2025-03-30 13:05:35,440 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=30f8af77-b035-4c40-b9e9-2eefe200b86c 2025-03-30 13:05:35,445 - INFO - Pod ctest-pod-10588255 with uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c found in kube manager 2025-03-30 13:05:35,445 - INFO - Pod ctest-pod-10588255 verification passed 2025-03-30 13:05:35,451 - INFO - Pod ctest-pod-41531705 is in running state.Got IP 10.47.255.245 2025-03-30 13:05:35,510 - DEBUG - Pod ctest-pod-41531705 has vmi a4a9d660-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,510 - INFO - Verified pod ctest-pod-41531705 in contrail-api 2025-03-30 13:05:35,527 - DEBUG - VMI a4a9d660-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,528 - INFO - Verified Pod ctest-pod-41531705 in agent 10.0.0.29 2025-03-30 13:05:35,528 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=02e87f01-c172-4e4d-99d3-a0066dccb9ba 2025-03-30 13:05:35,534 - INFO - Pod ctest-pod-41531705 with uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba found in kube manager 2025-03-30 13:05:35,534 - INFO - Pod ctest-pod-41531705 verification passed 2025-03-30 13:05:35,539 - INFO - Pod ctest-pod-26713342 is in running state.Got IP 10.47.255.246 2025-03-30 13:05:35,596 - DEBUG - Pod ctest-pod-26713342 has vmi a42b9552-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,597 - INFO - Verified pod ctest-pod-26713342 in contrail-api 2025-03-30 13:05:35,612 - DEBUG - VMI a42b9552-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,612 - INFO - Verified Pod ctest-pod-26713342 in agent 10.0.0.29 2025-03-30 13:05:35,612 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=809cf566-4330-4cfc-b7b1-a90b65015205 2025-03-30 13:05:35,617 - INFO - Pod ctest-pod-26713342 with uuid 809cf566-4330-4cfc-b7b1-a90b65015205 found in kube manager 2025-03-30 13:05:35,617 - INFO - Pod ctest-pod-26713342 verification passed 2025-03-30 13:05:35,622 - INFO - Pod ctest-pod-51277229 is in running state.Got IP 10.47.255.244 2025-03-30 13:05:35,637 - DEBUG - Pod ctest-pod-51277229 has vmi a528e18a-0d67-11f0-a6dc-fa163eb2d69f 2025-03-30 13:05:35,637 - INFO - Verified pod ctest-pod-51277229 in contrail-api 2025-03-30 13:05:35,654 - DEBUG - VMI a528e18a-0d67-11f0-a6dc-fa163eb2d69f is active in agent 10.0.0.29 2025-03-30 13:05:35,654 - INFO - Verified Pod ctest-pod-51277229 in agent 10.0.0.29 2025-03-30 13:05:35,654 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=cc9e3fb5-bd19-4d7a-acbf-182268185f0e 2025-03-30 13:05:35,659 - INFO - Pod ctest-pod-51277229 with uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e found in kube manager 2025-03-30 13:05:35,659 - INFO - Pod ctest-pod-51277229 verification passed 2025-03-30 13:05:35,659 - INFO - ================================================================================ 2025-03-30 13:05:35,659 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-30 13:05:35,659 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-30 13:05:35,897 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.0.0.22': '0'}} with 2025-03-30 13:05:35,897 - INFO - Initial checks done. Running the testcase now 2025-03-30 13:05:35,898 - INFO - 2025-03-30 13:05:36,219 - DEBUG - [Pod ctest-pod-31015287] Cmd: echo ctest-pod-31015287 > /usr/share/nginx/html/index.html, Output: 2025-03-30 13:05:36,298 - DEBUG - [Pod ctest-pod-89089429] Cmd: echo ctest-pod-89089429 > /usr/share/nginx/html/index.html, Output: 2025-03-30 13:05:36,373 - DEBUG - [Pod ctest-pod-06391572] Cmd: echo ctest-pod-06391572 > /usr/share/nginx/html/index.html, Output: 2025-03-30 13:05:36,448 - DEBUG - [Pod ctest-pod-23279516] Cmd: echo ctest-pod-23279516 > /usr/share/nginx/html/index.html, Output: 2025-03-30 13:05:36,452 - DEBUG - Service ctest-nginx-svc-52354057 not present 2025-03-30 13:05:36,452 - INFO - Creating service ctest-nginx-svc-52354057 2025-03-30 13:05:36,471 - INFO - Created Service ctest-nginx-svc-52354057 2025-03-30 13:05:36,481 - WARNING - Service UUID a102e758-027e-4a3f-beb3-5a90ec49f034 not yet found in contrail-api 2025-03-30 13:05:37,490 - INFO - Validated that Service ctest-nginx-svc-52354057 is seen in contrail-api 2025-03-30 13:05:37,490 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=a102e758-027e-4a3f-beb3-5a90ec49f034 2025-03-30 13:05:37,507 - INFO - Service ctest-nginx-svc-52354057 with uuid a102e758-027e-4a3f-beb3-5a90ec49f034 found in kube manager 2025-03-30 13:05:37,508 - INFO - Service ctest-nginx-svc-52354057 verification passed 2025-03-30 13:05:38,610 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89089429 2025-03-30 13:05:38,610 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:05:38,610 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89089429 2025-03-30 13:05:38,677 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:05:38,678 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:05:38,678 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:05:38,678 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-31015287': 1, 'ctest-pod-89089429': 1} 2025-03-30 13:05:38,751 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-89089429 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:05:38,751 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:05:38,751 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: ctest-pod-89089429 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:05:38,814 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:05:38,814 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:05:38,814 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:05:38,814 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-31015287': 1, 'ctest-pod-89089429': 1} 2025-03-30 13:05:38,818 - DEBUG - Network policy ingress-on-service not present 2025-03-30 13:05:38,899 - INFO - Creating Network Policy ingress-on-service 2025-03-30 13:05:38,909 - INFO - Network policy found in k8s 2025-03-30 13:05:38,909 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7cfd680-0d27-4c31-bfbb-88d7f1423750 2025-03-30 13:05:38,917 - INFO - Network Policy ingress-on-service with uuid d7cfd680-0d27-4c31-bfbb-88d7f1423750 found in kube manager 2025-03-30 13:05:38,967 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-30 13:05:38,967 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-30 13:05:38,967 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7cfd680-0d27-4c31-bfbb-88d7f1423750 2025-03-30 13:05:39,001 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-30 13:05:41,002 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7cfd680-0d27-4c31-bfbb-88d7f1423750 2025-03-30 13:05:41,037 - INFO - Network policy with name ingress-on-service found in agent 2025-03-30 13:05:41,037 - INFO - Network Policy ingress-on-service verification passed 2025-03-30 13:05:46,101 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:46,102 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:46,102 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:51,163 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:51,163 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:51,163 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:56,238 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:56,238 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:05:56,238 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:01,305 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:01,306 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:01,306 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:06,387 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:06,387 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:06,387 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:11,449 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:11,449 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:11,449 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:16,521 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:16,521 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:16,521 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:21,597 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:21,597 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:21,597 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:26,663 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:26,663 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:26,664 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:31,730 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:31,730 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:31,730 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:31,730 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-31015287': 0, 'ctest-pod-89089429': 0} 2025-03-30 13:06:31,817 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31015287 2025-03-30 13:06:31,818 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:06:31,818 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31015287 2025-03-30 13:06:31,882 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:06:31,883 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:06:31,883 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:06:31,960 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89089429 2025-03-30 13:06:31,960 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:06:31,960 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89089429 2025-03-30 13:06:31,960 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-31015287': 2, 'ctest-pod-89089429': 1} 2025-03-30 13:06:37,028 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:37,028 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:37,028 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:42,116 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:42,117 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:42,117 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:43,760 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-03-30 13:06:53,847 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:53,847 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:53,847 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:58,932 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:58,932 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:06:58,932 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:04,010 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:04,010 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:04,010 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:09,077 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:09,077 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:09,077 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:14,210 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:14,210 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:14,210 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:19,263 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:19,264 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:19,264 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:24,329 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:24,329 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:24,329 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:29,410 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:29,410 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:29,411 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:29,411 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-31015287': 0, 'ctest-pod-89089429': 0} 2025-03-30 13:07:31,498 - DEBUG - [Pod ctest-pod-26713342] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.535 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.100 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.574/1.535 ms 2025-03-30 13:07:31,498 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26713342 with expectation True passed 2025-03-30 13:07:33,576 - DEBUG - [Pod ctest-pod-10588255] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.837 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.340/0.837 ms 2025-03-30 13:07:33,577 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10588255 with expectation True passed 2025-03-30 13:07:35,641 - DEBUG - [Pod ctest-pod-41531705] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.642 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.605/1.642 ms 2025-03-30 13:07:35,641 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-41531705 with expectation True passed 2025-03-30 13:07:35,722 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:07:35,722 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-30 13:07:35,722 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:07:35,722 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26713342 passed 2025-03-30 13:07:35,777 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:07:35,777 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-30 13:07:35,777 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:07:35,777 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26713342 passed 2025-03-30 13:07:40,843 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 13:07:40,843 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 13:07:40,843 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 13:07:40,843 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10588255 passed 2025-03-30 13:07:45,921 - DEBUG - [Pod ctest-pod-51277229] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-30 13:07:45,922 - DEBUG - [Pod Pod ctest-pod-51277229] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-30 13:07:45,922 - DEBUG - [Pod Pod ctest-pod-51277229] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-30 13:07:45,922 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51277229 passed 2025-03-30 13:07:45,930 - INFO - Updating Network Policy ingress-on-service 2025-03-30 13:07:51,029 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:51,029 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:51,029 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:56,101 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:56,101 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:07:56,101 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:01,173 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:01,173 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:01,173 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:06,253 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:06,253 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:06,253 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:11,344 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:11,344 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:11,344 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:16,406 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:16,406 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:16,406 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:21,491 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:21,492 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:21,492 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:26,569 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:26,569 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:26,569 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:31,636 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:31,637 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:31,637 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:36,708 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:36,708 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:36,708 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) wget: download timed out 2025-03-30 13:08:36,708 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-31015287': 0, 'ctest-pod-89089429': 0} 2025-03-30 13:08:36,779 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-89089429 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:36,779 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:08:36,779 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: ctest-pod-89089429 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:36,850 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:36,851 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:08:36,851 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:36,851 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-31015287': 1, 'ctest-pod-89089429': 1} 2025-03-30 13:08:36,919 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31015287 2025-03-30 13:08:36,919 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:08:36,919 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31015287 2025-03-30 13:08:37,004 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:37,004 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:08:37,004 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: ctest-pod-31015287 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:37,059 - DEBUG - [Pod ctest-pod-41531705] Cmd: wget http://10.105.7.127:80/ -O - -T 5 -t 1 , Output: ctest-pod-89089429 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:37,059 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd wget http://10.105.7.127:80/ -O - -T 5 -t 1 passed 2025-03-30 13:08:37,059 - DEBUG - [Pod Pod ctest-pod-41531705] Cmd output: ctest-pod-89089429 Connecting to 10.105.7.127:80 (10.105.7.127:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 13:08:37,059 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-31015287': 2, 'ctest-pod-89089429': 1} 2025-03-30 13:08:39,117 - DEBUG - [Pod ctest-pod-26713342] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.147 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.255 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.497/1.147 ms 2025-03-30 13:08:39,117 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26713342 with expectation True passed 2025-03-30 13:08:41,191 - DEBUG - [Pod ctest-pod-10588255] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.474 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.551/1.474 ms 2025-03-30 13:08:41,192 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10588255 with expectation True passed 2025-03-30 13:08:43,260 - DEBUG - [Pod ctest-pod-41531705] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.601 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.097/0.265/0.601 ms 2025-03-30 13:08:43,260 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-41531705 with expectation True passed 2025-03-30 13:08:43,355 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:08:43,355 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-30 13:08:43,355 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:08:43,355 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26713342 passed 2025-03-30 13:08:43,428 - DEBUG - [Pod ctest-pod-26713342] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:08:43,428 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-30 13:08:43,428 - DEBUG - [Pod Pod ctest-pod-26713342] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:08:43,428 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26713342 passed 2025-03-30 13:08:48,506 - DEBUG - [Pod ctest-pod-10588255] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 13:08:48,506 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 13:08:48,506 - DEBUG - [Pod Pod ctest-pod-10588255] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 13:08:48,506 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10588255 passed 2025-03-30 13:08:48,580 - DEBUG - [Pod ctest-pod-51277229] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:08:48,580 - DEBUG - [Pod Pod ctest-pod-51277229] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-30 13:08:48,580 - DEBUG - [Pod Pod ctest-pod-51277229] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 13:08:48,580 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51277229 passed 2025-03-30 13:08:48,581 - INFO - Deleting Network Policy : ingress-on-service 2025-03-30 13:08:48,581 - INFO - Deleting service : ctest-nginx-svc-52354057 2025-03-30 13:08:48,851 - DEBUG - No XMPP flaps were noticed during the test 2025-03-30 13:08:48,851 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13] 2025-03-30 13:08:48,851 - INFO - -------------------------------------------------------------------------------- 2025-03-30 13:08:48,859 - INFO - Deleting pod ctest-new-default-36272959:ctest-pod-31015287 2025-03-30 13:08:48,860 - INFO - Deleting pod ctest-new-default-36272959:ctest-pod-89089429 2025-03-30 13:08:48,861 - INFO - Deleting pod ctest-non-default-42702433:ctest-pod-06391572 2025-03-30 13:08:48,861 - INFO - Deleting pod ctest-non-default-42702433:ctest-pod-23279516 2025-03-30 13:08:48,862 - INFO - Deleting pod ctest-new-default-36272959:ctest-pod-10588255 2025-03-30 13:08:48,862 - INFO - Deleting pod ctest-new-default-36272959:ctest-pod-26713342 2025-03-30 13:08:48,863 - INFO - Deleting pod ctest-non-default-42702433:ctest-pod-41531705 2025-03-30 13:08:48,863 - INFO - Deleting pod ctest-non-default-42702433:ctest-pod-51277229 2025-03-30 13:08:48,925 - WARNING - Pod uuid 63fadd97-f77b-4c4f-943b-e564b68ef6bd is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,030 - WARNING - Pod uuid 42a8f519-0047-407c-8d36-667eb73d1ccb is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,030 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,031 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,032 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,032 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,033 - WARNING - Pod uuid 64716ef1-9f16-4219-87b8-bb75f1c2bcd3 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:49,034 - WARNING - Pod uuid 59f2d036-ca16-44ad-84ef-8c9b345463a5 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:53,934 - DEBUG - Pod 63fadd97-f77b-4c4f-943b-e564b68ef6bd is not in agent 10.0.0.29 VM list 2025-03-30 13:08:53,942 - DEBUG - VMI a0dd462a-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:08:53,942 - INFO - Verified that pod ctest-pod-31015287 is removed in agent 2025-03-30 13:08:54,062 - DEBUG - Pod 59f2d036-ca16-44ad-84ef-8c9b345463a5 is not in agent 10.0.0.29 VM list 2025-03-30 13:08:54,064 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:54,068 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:54,068 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:54,068 - DEBUG - Pod 64716ef1-9f16-4219-87b8-bb75f1c2bcd3 is not in agent 10.0.0.29 VM list 2025-03-30 13:08:54,070 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:54,070 - DEBUG - Pod 42a8f519-0047-407c-8d36-667eb73d1ccb is not in agent 10.0.0.29 VM list 2025-03-30 13:08:54,089 - DEBUG - VMI a2fc6d64-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:08:54,089 - INFO - Verified that pod ctest-pod-23279516 is removed in agent 2025-03-30 13:08:54,090 - DEBUG - VMI a27012c4-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:08:54,090 - INFO - Verified that pod ctest-pod-06391572 is removed in agent 2025-03-30 13:08:54,091 - DEBUG - VMI a1a3059a-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:08:54,091 - INFO - Verified that pod ctest-pod-89089429 is removed in agent 2025-03-30 13:08:59,075 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:59,085 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:59,087 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:08:59,088 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:04,084 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:04,108 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:04,113 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:04,113 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:09,094 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:09,126 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:09,128 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:09,128 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:14,103 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:14,145 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:14,146 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:14,147 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:19,154 - WARNING - Pod uuid cc9e3fb5-bd19-4d7a-acbf-182268185f0e is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:19,170 - WARNING - Pod uuid 02e87f01-c172-4e4d-99d3-a0066dccb9ba is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:19,172 - WARNING - Pod uuid 30f8af77-b035-4c40-b9e9-2eefe200b86c is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:19,172 - WARNING - Pod uuid 809cf566-4330-4cfc-b7b1-a90b65015205 is still seen in agent 10.0.0.29 VM list 2025-03-30 13:09:24,164 - DEBUG - Pod cc9e3fb5-bd19-4d7a-acbf-182268185f0e is not in agent 10.0.0.29 VM list 2025-03-30 13:09:24,178 - DEBUG - VMI a528e18a-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:09:24,178 - INFO - Verified that pod ctest-pod-51277229 is removed in agent 2025-03-30 13:09:24,190 - DEBUG - Pod 02e87f01-c172-4e4d-99d3-a0066dccb9ba is not in agent 10.0.0.29 VM list 2025-03-30 13:09:24,195 - DEBUG - Pod 30f8af77-b035-4c40-b9e9-2eefe200b86c is not in agent 10.0.0.29 VM list 2025-03-30 13:09:24,197 - DEBUG - Pod 809cf566-4330-4cfc-b7b1-a90b65015205 is not in agent 10.0.0.29 VM list 2025-03-30 13:09:24,210 - DEBUG - VMI a39387e4-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:09:24,211 - INFO - Verified that pod ctest-pod-10588255 is removed in agent 2025-03-30 13:09:24,212 - DEBUG - VMI a4a9d660-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:09:24,212 - INFO - Verified that pod ctest-pod-41531705 is removed in agent 2025-03-30 13:09:24,213 - DEBUG - VMI a42b9552-0d67-11f0-a6dc-fa163eb2d69f is removed from agent 10.0.0.29 2025-03-30 13:09:24,213 - INFO - Verified that pod ctest-pod-26713342 is removed in agent 2025-03-30 13:09:24,213 - INFO - Deleting namespace ctest-non-default-42702433 2025-03-30 13:09:24,234 - DEBUG - Namespace ctest-non-default-42702433 still in k8s 2025-03-30 13:09:26,242 - DEBUG - Namespace ctest-non-default-42702433 still in k8s 2025-03-30 13:09:28,247 - DEBUG - Namespace ctest-non-default-42702433 still in k8s 2025-03-30 13:09:30,251 - DEBUG - Namespace ctest-non-default-42702433 is not in k8s 2025-03-30 13:09:30,251 - DEBUG - No need to check project deletion in contrail-api 2025-03-30 13:09:30,251 - INFO - Deleting namespace ctest-new-default-36272959 2025-03-30 13:09:30,260 - DEBUG - Namespace ctest-new-default-36272959 still in k8s 2025-03-30 13:09:32,265 - DEBUG - Namespace ctest-new-default-36272959 still in k8s 2025-03-30 13:09:34,269 - DEBUG - Namespace ctest-new-default-36272959 still in k8s 2025-03-30 13:09:36,275 - DEBUG - Namespace ctest-new-default-36272959 is not in k8s 2025-03-30 13:09:36,275 - DEBUG - No need to check project deletion in contrail-api