2025-07-04 15:04:07,513 - INFO - Using existing project ['default-domain', 'k8s-default'](d5dad23a-f995-4af0-98c5-258c275c20a2) 2025-07-04 15:04:07,532 - DEBUG - Namespace ctest-new-default-17145492 not present 2025-07-04 15:04:07,543 - INFO - Created namespace ctest-new-default-17145492 2025-07-04 15:04:10,548 - DEBUG - Namespace ctest-non-default-71422998 not present 2025-07-04 15:04:10,560 - INFO - Created namespace ctest-non-default-71422998 2025-07-04 15:04:13,580 - DEBUG - Pod ctest-pod-65757524 not present 2025-07-04 15:04:13,581 - INFO - Creating Pod ctest-pod-65757524 2025-07-04 15:04:13,638 - DEBUG - Pod : ctest-pod-65757524 UUID is a037f8f6-01c0-4603-8f71-64897af89cc4 2025-07-04 15:04:13,645 - DEBUG - Pod ctest-pod-28964198 not present 2025-07-04 15:04:13,645 - INFO - Creating Pod ctest-pod-28964198 2025-07-04 15:04:13,717 - DEBUG - Pod : ctest-pod-28964198 UUID is 6e4f4490-d3e1-49be-b7b5-56d8172b1956 2025-07-04 15:04:13,721 - DEBUG - Pod ctest-pod-33974848 not present 2025-07-04 15:04:13,722 - INFO - Creating Pod ctest-pod-33974848 2025-07-04 15:04:13,754 - DEBUG - Pod : ctest-pod-33974848 UUID is 67f44527-e4c0-4031-b3a3-a0b1b11b3e39 2025-07-04 15:04:13,757 - DEBUG - Pod ctest-pod-91241321 not present 2025-07-04 15:04:13,757 - INFO - Creating Pod ctest-pod-91241321 2025-07-04 15:04:13,776 - DEBUG - Pod : ctest-pod-91241321 UUID is 198a96f1-61ea-44ad-bf92-4b899fcaf0fa 2025-07-04 15:04:13,781 - DEBUG - Pod ctest-pod-74447075 not present 2025-07-04 15:04:13,781 - INFO - Creating Pod ctest-pod-74447075 2025-07-04 15:04:13,810 - DEBUG - Pod : ctest-pod-74447075 UUID is 7844c6b2-caeb-49e7-a869-ce7238a2de94 2025-07-04 15:04:13,815 - DEBUG - Pod ctest-pod-44984031 not present 2025-07-04 15:04:13,816 - INFO - Creating Pod ctest-pod-44984031 2025-07-04 15:04:13,847 - DEBUG - Pod : ctest-pod-44984031 UUID is ce05237b-f2a8-4c9e-82b3-397e84622902 2025-07-04 15:04:13,850 - DEBUG - Pod ctest-pod-86547786 not present 2025-07-04 15:04:13,850 - INFO - Creating Pod ctest-pod-86547786 2025-07-04 15:04:13,874 - DEBUG - Pod : ctest-pod-86547786 UUID is dae180b4-95f6-46cf-b6c3-e869e0af3a29 2025-07-04 15:04:13,876 - DEBUG - Pod ctest-pod-98294854 not present 2025-07-04 15:04:13,877 - INFO - Creating Pod ctest-pod-98294854 2025-07-04 15:04:13,895 - DEBUG - Pod : ctest-pod-98294854 UUID is 7cb78340-b877-4787-8937-ac7a841f8dfb 2025-07-04 15:04:14,068 - INFO - Project default-domain:k8s-ctest-new-default-17145492 for Namespace ctest-new-default-17145492 is seen in contrail-api 2025-07-04 15:04:14,068 - DEBUG - Project uuid in Contrail is d3b26002-366f-4c8b-bb34-95b4e50bdcb7 2025-07-04 15:04:14,282 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=36362669-a962-4501-b926-09ddd3bbadff 2025-07-04 15:04:14,288 - INFO - Namespace ctest-new-default-17145492 with uuid 36362669-a962-4501-b926-09ddd3bbadff found in kube manager 2025-07-04 15:04:14,289 - INFO - Namespace ctest-new-default-17145492 verification passed 2025-07-04 15:04:14,504 - INFO - Project default-domain:k8s-ctest-non-default-71422998 for Namespace ctest-non-default-71422998 is seen in contrail-api 2025-07-04 15:04:14,504 - DEBUG - Project uuid in Contrail is 97389ea7-19b9-4ad6-9be0-33b94db5b7de 2025-07-04 15:04:14,505 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=893b9ba7-4eca-4325-be65-1d476f5e2bac 2025-07-04 15:04:14,514 - INFO - Namespace ctest-non-default-71422998 with uuid 893b9ba7-4eca-4325-be65-1d476f5e2bac found in kube manager 2025-07-04 15:04:14,514 - INFO - Namespace ctest-non-default-71422998 verification passed 2025-07-04 15:04:14,521 - DEBUG - Pod ctest-pod-65757524 not in running state.Currently in Pending 2025-07-04 15:04:19,527 - DEBUG - Pod ctest-pod-65757524 not in running state.Currently in Pending 2025-07-04 15:04:24,540 - DEBUG - Pod ctest-pod-65757524 not in running state.Currently in Pending 2025-07-04 15:04:29,547 - INFO - Pod ctest-pod-65757524 is in running state.Got IP 10.47.255.251 2025-07-04 15:04:29,561 - DEBUG - Pod ctest-pod-65757524 has vmi 26c5b472-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:29,561 - INFO - Verified pod ctest-pod-65757524 in contrail-api 2025-07-04 15:04:29,576 - DEBUG - VMI 26c5b472-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:29,576 - INFO - Verified Pod ctest-pod-65757524 in agent 10.0.0.56 2025-07-04 15:04:29,576 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=a037f8f6-01c0-4603-8f71-64897af89cc4 2025-07-04 15:04:29,581 - INFO - Pod ctest-pod-65757524 with uuid a037f8f6-01c0-4603-8f71-64897af89cc4 found in kube manager 2025-07-04 15:04:29,581 - INFO - Pod ctest-pod-65757524 verification passed 2025-07-04 15:04:29,586 - INFO - Pod ctest-pod-28964198 is in running state.Got IP 10.47.255.250 2025-07-04 15:04:29,644 - DEBUG - Pod ctest-pod-28964198 has vmi 2753fe80-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:29,644 - INFO - Verified pod ctest-pod-28964198 in contrail-api 2025-07-04 15:04:29,658 - DEBUG - VMI 2753fe80-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:29,659 - INFO - Verified Pod ctest-pod-28964198 in agent 10.0.0.56 2025-07-04 15:04:29,659 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=6e4f4490-d3e1-49be-b7b5-56d8172b1956 2025-07-04 15:04:29,665 - INFO - Pod ctest-pod-28964198 with uuid 6e4f4490-d3e1-49be-b7b5-56d8172b1956 found in kube manager 2025-07-04 15:04:29,665 - INFO - Pod ctest-pod-28964198 verification passed 2025-07-04 15:04:29,673 - INFO - Pod ctest-pod-33974848 is in running state.Got IP 10.47.255.249 2025-07-04 15:04:29,690 - DEBUG - Pod ctest-pod-33974848 has vmi 280307d6-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:29,691 - INFO - Verified pod ctest-pod-33974848 in contrail-api 2025-07-04 15:04:29,706 - DEBUG - VMI 280307d6-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:29,706 - INFO - Verified Pod ctest-pod-33974848 in agent 10.0.0.56 2025-07-04 15:04:29,706 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=67f44527-e4c0-4031-b3a3-a0b1b11b3e39 2025-07-04 15:04:29,713 - INFO - Pod ctest-pod-33974848 with uuid 67f44527-e4c0-4031-b3a3-a0b1b11b3e39 found in kube manager 2025-07-04 15:04:29,713 - INFO - Pod ctest-pod-33974848 verification passed 2025-07-04 15:04:29,721 - INFO - Pod ctest-pod-91241321 is in running state.Got IP 10.47.255.248 2025-07-04 15:04:29,785 - DEBUG - Pod ctest-pod-91241321 has vmi 2891be7c-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:29,785 - INFO - Verified pod ctest-pod-91241321 in contrail-api 2025-07-04 15:04:29,798 - DEBUG - VMI 2891be7c-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:29,799 - INFO - Verified Pod ctest-pod-91241321 in agent 10.0.0.56 2025-07-04 15:04:29,799 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=198a96f1-61ea-44ad-bf92-4b899fcaf0fa 2025-07-04 15:04:29,803 - INFO - Pod ctest-pod-91241321 with uuid 198a96f1-61ea-44ad-bf92-4b899fcaf0fa found in kube manager 2025-07-04 15:04:29,803 - INFO - Pod ctest-pod-91241321 verification passed 2025-07-04 15:04:29,808 - DEBUG - Pod ctest-pod-74447075 not in running state.Currently in Pending 2025-07-04 15:04:34,816 - INFO - Pod ctest-pod-74447075 is in running state.Got IP 10.47.255.247 2025-07-04 15:04:34,832 - DEBUG - Pod ctest-pod-74447075 has vmi 292bebb4-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:34,832 - INFO - Verified pod ctest-pod-74447075 in contrail-api 2025-07-04 15:04:34,848 - DEBUG - VMI 292bebb4-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:34,849 - INFO - Verified Pod ctest-pod-74447075 in agent 10.0.0.56 2025-07-04 15:04:34,849 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=7844c6b2-caeb-49e7-a869-ce7238a2de94 2025-07-04 15:04:34,854 - INFO - Pod ctest-pod-74447075 with uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 found in kube manager 2025-07-04 15:04:34,854 - INFO - Pod ctest-pod-74447075 verification passed 2025-07-04 15:04:34,859 - INFO - Pod ctest-pod-86547786 is in running state.Got IP 10.47.255.245 2025-07-04 15:04:34,929 - DEBUG - Pod ctest-pod-86547786 has vmi 2a1feb92-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:34,929 - INFO - Verified pod ctest-pod-86547786 in contrail-api 2025-07-04 15:04:34,946 - DEBUG - VMI 2a1feb92-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:34,946 - INFO - Verified Pod ctest-pod-86547786 in agent 10.0.0.56 2025-07-04 15:04:34,946 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=dae180b4-95f6-46cf-b6c3-e869e0af3a29 2025-07-04 15:04:34,951 - INFO - Pod ctest-pod-86547786 with uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 found in kube manager 2025-07-04 15:04:34,951 - INFO - Pod ctest-pod-86547786 verification passed 2025-07-04 15:04:35,027 - INFO - Pod ctest-pod-44984031 is in running state.Got IP 10.47.255.246 2025-07-04 15:04:35,043 - DEBUG - Pod ctest-pod-44984031 has vmi 29a857da-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:35,043 - INFO - Verified pod ctest-pod-44984031 in contrail-api 2025-07-04 15:04:35,056 - DEBUG - VMI 29a857da-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:35,056 - INFO - Verified Pod ctest-pod-44984031 in agent 10.0.0.56 2025-07-04 15:04:35,056 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=ce05237b-f2a8-4c9e-82b3-397e84622902 2025-07-04 15:04:35,061 - INFO - Pod ctest-pod-44984031 with uuid ce05237b-f2a8-4c9e-82b3-397e84622902 found in kube manager 2025-07-04 15:04:35,061 - INFO - Pod ctest-pod-44984031 verification passed 2025-07-04 15:04:35,067 - INFO - Pod ctest-pod-98294854 is in running state.Got IP 10.47.255.244 2025-07-04 15:04:35,125 - DEBUG - Pod ctest-pod-98294854 has vmi 2a9c7022-58e8-11f0-bcfc-fa163ef6f2be 2025-07-04 15:04:35,125 - INFO - Verified pod ctest-pod-98294854 in contrail-api 2025-07-04 15:04:35,139 - DEBUG - VMI 2a9c7022-58e8-11f0-bcfc-fa163ef6f2be is active in agent 10.0.0.56 2025-07-04 15:04:35,139 - INFO - Verified Pod ctest-pod-98294854 in agent 10.0.0.56 2025-07-04 15:04:35,139 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=7cb78340-b877-4787-8937-ac7a841f8dfb 2025-07-04 15:04:35,144 - INFO - Pod ctest-pod-98294854 with uuid 7cb78340-b877-4787-8937-ac7a841f8dfb found in kube manager 2025-07-04 15:04:35,144 - INFO - Pod ctest-pod-98294854 verification passed 2025-07-04 15:04:35,144 - INFO - ================================================================================ 2025-07-04 15:04:35,145 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-07-04 15:04:35,145 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-07-04 15:04:35,397 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.65': '0'}} with 2025-07-04 15:04:35,397 - INFO - Initial checks done. Running the testcase now 2025-07-04 15:04:35,397 - INFO - 2025-07-04 15:04:35,465 - DEBUG - [Pod ctest-pod-65757524] Cmd: echo ctest-pod-65757524 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:04:35,521 - DEBUG - [Pod ctest-pod-28964198] Cmd: echo ctest-pod-28964198 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:04:35,594 - DEBUG - [Pod ctest-pod-33974848] Cmd: echo ctest-pod-33974848 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:04:35,654 - DEBUG - [Pod ctest-pod-91241321] Cmd: echo ctest-pod-91241321 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:04:35,657 - DEBUG - Service ctest-nginx-svc-42235822 not present 2025-07-04 15:04:35,657 - INFO - Creating service ctest-nginx-svc-42235822 2025-07-04 15:04:35,682 - INFO - Created Service ctest-nginx-svc-42235822 2025-07-04 15:04:35,696 - WARNING - Service UUID 50819273-56a4-42d8-b8d2-2c2c025e2abf not yet found in contrail-api 2025-07-04 15:04:36,716 - INFO - Validated that Service ctest-nginx-svc-42235822 is seen in contrail-api 2025-07-04 15:04:36,717 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=50819273-56a4-42d8-b8d2-2c2c025e2abf 2025-07-04 15:04:36,725 - INFO - Service ctest-nginx-svc-42235822 with uuid 50819273-56a4-42d8-b8d2-2c2c025e2abf found in kube manager 2025-07-04 15:04:36,725 - INFO - Service ctest-nginx-svc-42235822 verification passed 2025-07-04 15:04:37,804 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-65757524 2025-07-04 15:04:37,804 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:04:37,804 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-65757524 2025-07-04 15:04:37,864 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28964198 2025-07-04 15:04:37,864 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:04:37,864 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28964198 2025-07-04 15:04:37,864 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-65757524': 1, 'ctest-pod-28964198': 1} 2025-07-04 15:04:37,923 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-28964198 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:04:37,923 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:04:37,923 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: ctest-pod-28964198 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:04:37,990 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:04:37,990 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:04:37,991 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:04:37,991 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-65757524': 1, 'ctest-pod-28964198': 1} 2025-07-04 15:04:37,995 - DEBUG - Network policy ingress-on-service not present 2025-07-04 15:04:37,996 - INFO - Creating Network Policy ingress-on-service 2025-07-04 15:04:38,018 - INFO - Network policy found in k8s 2025-07-04 15:04:38,018 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=82f38fa7-2015-4e6e-8de3-8cc339eb6967 2025-07-04 15:04:38,028 - INFO - Network Policy ingress-on-service with uuid 82f38fa7-2015-4e6e-8de3-8cc339eb6967 found in kube manager 2025-07-04 15:04:38,073 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-07-04 15:04:38,074 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-07-04 15:04:38,074 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=82f38fa7-2015-4e6e-8de3-8cc339eb6967 2025-07-04 15:04:38,131 - WARNING - Network policy with name ingress-on-service not found in agent 2025-07-04 15:04:40,132 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=82f38fa7-2015-4e6e-8de3-8cc339eb6967 2025-07-04 15:04:40,164 - INFO - Network policy with name ingress-on-service found in agent 2025-07-04 15:04:40,165 - INFO - Network Policy ingress-on-service verification passed 2025-07-04 15:04:45,218 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:45,218 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:45,218 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:50,269 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:50,269 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:50,269 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:55,321 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:55,321 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:04:55,321 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:00,381 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:00,381 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:00,381 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:05,449 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:05,449 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:05,450 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:10,501 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:10,501 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:10,501 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:15,553 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:15,553 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:15,553 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:20,601 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:20,601 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:20,601 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:25,650 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:25,650 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:25,650 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:30,702 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:30,702 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:30,702 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:30,702 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-65757524': 0, 'ctest-pod-28964198': 0} 2025-07-04 15:05:30,764 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,764 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:05:30,764 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,822 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,823 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:05:30,823 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,879 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,879 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:05:30,879 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,929 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-28964198 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,930 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:05:30,930 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: ctest-pod-28964198 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:05:30,930 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-65757524': 3, 'ctest-pod-28964198': 1} 2025-07-04 15:05:35,989 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:35,990 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:35,990 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:41,041 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:41,042 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:41,042 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:46,093 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:46,093 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:46,093 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:51,138 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:51,138 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:51,138 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:05:55,947 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-07-04 15:06:06,309 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:06,310 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:06,310 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:11,363 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:11,363 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:11,364 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:16,421 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:16,421 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:16,421 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:21,473 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:21,473 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:21,473 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:26,525 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:26,525 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:26,525 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:31,569 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:31,569 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:31,569 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:31,569 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-65757524': 0, 'ctest-pod-28964198': 0} 2025-07-04 15:06:33,621 - DEBUG - [Pod ctest-pod-44984031] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.437 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.071 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.192/0.437 ms 2025-07-04 15:06:33,622 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-44984031 with expectation True passed 2025-07-04 15:06:35,669 - DEBUG - [Pod ctest-pod-74447075] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.058 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.402/1.058 ms 2025-07-04 15:06:35,669 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-74447075 with expectation True passed 2025-07-04 15:06:37,723 - DEBUG - [Pod ctest-pod-86547786] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.380 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.844/2.380 ms 2025-07-04 15:06:37,723 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86547786 with expectation True passed 2025-07-04 15:06:37,776 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:06:37,777 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:06:37,777 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:06:37,777 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44984031 passed 2025-07-04 15:06:37,830 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:06:37,830 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:06:37,830 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:06:37,830 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44984031 passed 2025-07-04 15:06:42,881 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:06:42,881 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:06:42,881 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:06:42,882 - INFO - wget check of of http://10.47.255.250 from ctest-pod-74447075 passed 2025-07-04 15:06:47,935 - DEBUG - [Pod ctest-pod-98294854] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-04 15:06:47,935 - DEBUG - [Pod Pod ctest-pod-98294854] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-04 15:06:47,935 - DEBUG - [Pod Pod ctest-pod-98294854] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-04 15:06:47,935 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98294854 passed 2025-07-04 15:06:47,944 - INFO - Updating Network Policy ingress-on-service 2025-07-04 15:06:53,018 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:53,018 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:53,018 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:58,082 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:58,082 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:06:58,082 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:03,137 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:03,137 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:03,137 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:08,198 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:08,198 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:08,198 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:13,250 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:13,250 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:13,250 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:18,301 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:18,301 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:18,301 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:23,353 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:23,353 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:23,353 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:28,405 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:28,405 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:28,405 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:33,453 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:33,454 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:33,454 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:38,507 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:38,507 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:38,507 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) wget: download timed out 2025-07-04 15:07:38,507 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-65757524': 0, 'ctest-pod-28964198': 0} 2025-07-04 15:07:38,566 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28964198 2025-07-04 15:07:38,566 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:07:38,566 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28964198 2025-07-04 15:07:38,620 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:07:38,620 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:07:38,620 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:07:38,620 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-65757524': 1, 'ctest-pod-28964198': 1} 2025-07-04 15:07:38,670 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-28964198 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:07:38,670 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:07:38,671 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: ctest-pod-28964198 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:07:38,716 - DEBUG - [Pod ctest-pod-86547786] Cmd: wget http://10.96.116.174:80/ -O - -T 5 -t 1 , Output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:07:38,716 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd wget http://10.96.116.174:80/ -O - -T 5 -t 1 passed 2025-07-04 15:07:38,716 - DEBUG - [Pod Pod ctest-pod-86547786] Cmd output: ctest-pod-65757524 Connecting to 10.96.116.174:80 (10.96.116.174:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:07:38,717 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-65757524': 1, 'ctest-pod-28964198': 1} 2025-07-04 15:07:40,774 - DEBUG - [Pod ctest-pod-44984031] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.616 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.102 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.261/0.616 ms 2025-07-04 15:07:40,774 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-44984031 with expectation True passed 2025-07-04 15:07:42,829 - DEBUG - [Pod ctest-pod-74447075] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.254 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.474/1.254 ms 2025-07-04 15:07:42,830 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-74447075 with expectation True passed 2025-07-04 15:07:44,891 - DEBUG - [Pod ctest-pod-86547786] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.415 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.532/1.415 ms 2025-07-04 15:07:44,891 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86547786 with expectation True passed 2025-07-04 15:07:44,938 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:07:44,938 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:07:44,938 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:07:44,938 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44984031 passed 2025-07-04 15:07:44,977 - DEBUG - [Pod ctest-pod-44984031] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:07:44,977 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:07:44,978 - DEBUG - [Pod Pod ctest-pod-44984031] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:07:44,978 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44984031 passed 2025-07-04 15:07:50,037 - DEBUG - [Pod ctest-pod-74447075] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:07:50,037 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:07:50,037 - DEBUG - [Pod Pod ctest-pod-74447075] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:07:50,037 - INFO - wget check of of http://10.47.255.250 from ctest-pod-74447075 passed 2025-07-04 15:07:50,087 - DEBUG - [Pod ctest-pod-98294854] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:07:50,099 - DEBUG - [Pod Pod ctest-pod-98294854] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:07:50,099 - DEBUG - [Pod Pod ctest-pod-98294854] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:07:50,099 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98294854 passed 2025-07-04 15:07:50,100 - INFO - Deleting Network Policy : ingress-on-service 2025-07-04 15:07:50,100 - INFO - Deleting service : ctest-nginx-svc-42235822 2025-07-04 15:07:50,359 - DEBUG - No XMPP flaps were noticed during the test 2025-07-04 15:07:50,360 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2025-07-04 15:07:50,360 - INFO - -------------------------------------------------------------------------------- 2025-07-04 15:07:50,365 - INFO - Deleting pod ctest-new-default-17145492:ctest-pod-65757524 2025-07-04 15:07:50,366 - INFO - Deleting pod ctest-new-default-17145492:ctest-pod-28964198 2025-07-04 15:07:50,366 - INFO - Deleting pod ctest-non-default-71422998:ctest-pod-33974848 2025-07-04 15:07:50,368 - INFO - Deleting pod ctest-non-default-71422998:ctest-pod-91241321 2025-07-04 15:07:50,368 - INFO - Deleting pod ctest-new-default-17145492:ctest-pod-74447075 2025-07-04 15:07:50,368 - INFO - Deleting pod ctest-new-default-17145492:ctest-pod-44984031 2025-07-04 15:07:50,369 - INFO - Deleting pod ctest-non-default-71422998:ctest-pod-86547786 2025-07-04 15:07:50,369 - INFO - Deleting pod ctest-non-default-71422998:ctest-pod-98294854 2025-07-04 15:07:50,513 - WARNING - Pod uuid a037f8f6-01c0-4603-8f71-64897af89cc4 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,563 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,564 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,565 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,566 - WARNING - Pod uuid 6e4f4490-d3e1-49be-b7b5-56d8172b1956 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,567 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,567 - WARNING - Pod uuid 67f44527-e4c0-4031-b3a3-a0b1b11b3e39 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:50,567 - WARNING - Pod uuid 198a96f1-61ea-44ad-bf92-4b899fcaf0fa is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:55,523 - DEBUG - Pod a037f8f6-01c0-4603-8f71-64897af89cc4 is not in agent 10.0.0.56 VM list 2025-07-04 15:07:55,542 - DEBUG - VMI 26c5b472-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:07:55,542 - INFO - Verified that pod ctest-pod-65757524 is removed in agent 2025-07-04 15:07:55,606 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:55,607 - DEBUG - Pod 6e4f4490-d3e1-49be-b7b5-56d8172b1956 is not in agent 10.0.0.56 VM list 2025-07-04 15:07:55,609 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:55,609 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:55,610 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:07:55,612 - DEBUG - Pod 67f44527-e4c0-4031-b3a3-a0b1b11b3e39 is not in agent 10.0.0.56 VM list 2025-07-04 15:07:55,614 - DEBUG - Pod 198a96f1-61ea-44ad-bf92-4b899fcaf0fa is not in agent 10.0.0.56 VM list 2025-07-04 15:07:55,627 - DEBUG - VMI 2753fe80-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:07:55,627 - INFO - Verified that pod ctest-pod-28964198 is removed in agent 2025-07-04 15:07:55,629 - DEBUG - VMI 280307d6-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:07:55,629 - INFO - Verified that pod ctest-pod-33974848 is removed in agent 2025-07-04 15:07:55,629 - DEBUG - VMI 2891be7c-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:07:55,629 - INFO - Verified that pod ctest-pod-91241321 is removed in agent 2025-07-04 15:08:00,639 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:00,641 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:00,642 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:00,643 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:05,659 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:05,660 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:05,661 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:05,662 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:10,698 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:10,700 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:10,706 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:10,707 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:15,713 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:15,714 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:15,721 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:15,722 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:20,726 - WARNING - Pod uuid 7844c6b2-caeb-49e7-a869-ce7238a2de94 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:20,728 - WARNING - Pod uuid dae180b4-95f6-46cf-b6c3-e869e0af3a29 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:20,735 - WARNING - Pod uuid 7cb78340-b877-4787-8937-ac7a841f8dfb is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:20,736 - WARNING - Pod uuid ce05237b-f2a8-4c9e-82b3-397e84622902 is still seen in agent 10.0.0.56 VM list 2025-07-04 15:08:25,741 - DEBUG - Pod dae180b4-95f6-46cf-b6c3-e869e0af3a29 is not in agent 10.0.0.56 VM list 2025-07-04 15:08:25,742 - DEBUG - Pod 7844c6b2-caeb-49e7-a869-ce7238a2de94 is not in agent 10.0.0.56 VM list 2025-07-04 15:08:25,756 - DEBUG - Pod ce05237b-f2a8-4c9e-82b3-397e84622902 is not in agent 10.0.0.56 VM list 2025-07-04 15:08:25,757 - DEBUG - Pod 7cb78340-b877-4787-8937-ac7a841f8dfb is not in agent 10.0.0.56 VM list 2025-07-04 15:08:25,761 - DEBUG - VMI 292bebb4-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:08:25,761 - INFO - Verified that pod ctest-pod-74447075 is removed in agent 2025-07-04 15:08:25,761 - DEBUG - VMI 2a1feb92-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:08:25,761 - INFO - Verified that pod ctest-pod-86547786 is removed in agent 2025-07-04 15:08:25,769 - DEBUG - VMI 29a857da-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:08:25,769 - INFO - Verified that pod ctest-pod-44984031 is removed in agent 2025-07-04 15:08:25,770 - DEBUG - VMI 2a9c7022-58e8-11f0-bcfc-fa163ef6f2be is removed from agent 10.0.0.56 2025-07-04 15:08:25,770 - INFO - Verified that pod ctest-pod-98294854 is removed in agent 2025-07-04 15:08:25,770 - INFO - Deleting namespace ctest-non-default-71422998 2025-07-04 15:08:25,787 - DEBUG - Namespace ctest-non-default-71422998 still in k8s 2025-07-04 15:08:27,792 - DEBUG - Namespace ctest-non-default-71422998 still in k8s 2025-07-04 15:08:29,796 - DEBUG - Namespace ctest-non-default-71422998 still in k8s 2025-07-04 15:08:31,800 - DEBUG - Namespace ctest-non-default-71422998 is not in k8s 2025-07-04 15:08:31,800 - DEBUG - No need to check project deletion in contrail-api 2025-07-04 15:08:31,800 - INFO - Deleting namespace ctest-new-default-17145492 2025-07-04 15:08:31,812 - DEBUG - Namespace ctest-new-default-17145492 still in k8s 2025-07-04 15:08:33,817 - DEBUG - Namespace ctest-new-default-17145492 still in k8s 2025-07-04 15:08:35,823 - DEBUG - Namespace ctest-new-default-17145492 still in k8s 2025-07-04 15:08:37,827 - DEBUG - Namespace ctest-new-default-17145492 is not in k8s 2025-07-04 15:08:37,827 - DEBUG - No need to check project deletion in contrail-api