2025-04-14 12:24:55,221 - INFO - Using existing project ['default-domain', 'k8s-default'](bb015736-e992-40a7-85b8-facf5e7b87dd) 2025-04-14 12:24:55,247 - DEBUG - Namespace ctest-new-default-04048242 not present 2025-04-14 12:24:55,258 - INFO - Created namespace ctest-new-default-04048242 2025-04-14 12:24:58,263 - DEBUG - Namespace ctest-non-default-83961850 not present 2025-04-14 12:24:58,270 - INFO - Created namespace ctest-non-default-83961850 2025-04-14 12:25:01,291 - DEBUG - Pod ctest-pod-58890581 not present 2025-04-14 12:25:01,292 - INFO - Creating Pod ctest-pod-58890581 2025-04-14 12:25:01,324 - DEBUG - Pod : ctest-pod-58890581 UUID is c3338b1c-76a1-477a-9b59-4d4f88002e97 2025-04-14 12:25:01,327 - DEBUG - Pod ctest-pod-11043935 not present 2025-04-14 12:25:01,327 - INFO - Creating Pod ctest-pod-11043935 2025-04-14 12:25:01,352 - DEBUG - Pod : ctest-pod-11043935 UUID is d9443f92-1bff-4bd6-88fd-eeddde95a921 2025-04-14 12:25:01,355 - DEBUG - Pod ctest-pod-96485950 not present 2025-04-14 12:25:01,355 - INFO - Creating Pod ctest-pod-96485950 2025-04-14 12:25:01,385 - DEBUG - Pod : ctest-pod-96485950 UUID is 3b7b744b-dfea-4a0c-804e-fd0e0e90ea55 2025-04-14 12:25:01,388 - DEBUG - Pod ctest-pod-28719274 not present 2025-04-14 12:25:01,388 - INFO - Creating Pod ctest-pod-28719274 2025-04-14 12:25:01,407 - DEBUG - Pod : ctest-pod-28719274 UUID is 3bf91f57-df6e-473f-b8cd-96e978c4b97b 2025-04-14 12:25:01,412 - DEBUG - Pod ctest-pod-32954867 not present 2025-04-14 12:25:01,412 - INFO - Creating Pod ctest-pod-32954867 2025-04-14 12:25:01,433 - DEBUG - Pod : ctest-pod-32954867 UUID is 094232a4-2b83-41f4-a370-433c84e418d9 2025-04-14 12:25:01,439 - DEBUG - Pod ctest-pod-50837897 not present 2025-04-14 12:25:01,439 - INFO - Creating Pod ctest-pod-50837897 2025-04-14 12:25:01,458 - DEBUG - Pod : ctest-pod-50837897 UUID is 8d2dd1f4-a705-418f-a56d-3a2075659e63 2025-04-14 12:25:01,460 - DEBUG - Pod ctest-pod-58442475 not present 2025-04-14 12:25:01,461 - INFO - Creating Pod ctest-pod-58442475 2025-04-14 12:25:01,481 - DEBUG - Pod : ctest-pod-58442475 UUID is 28213e45-6e09-4a94-8b21-cc03ed288283 2025-04-14 12:25:01,484 - DEBUG - Pod ctest-pod-32009104 not present 2025-04-14 12:25:01,485 - INFO - Creating Pod ctest-pod-32009104 2025-04-14 12:25:01,505 - DEBUG - Pod : ctest-pod-32009104 UUID is 959aca1e-4de1-45ba-abb3-e1d9eca5b22a 2025-04-14 12:25:01,810 - INFO - Project default-domain:k8s-ctest-new-default-04048242 for Namespace ctest-new-default-04048242 is seen in contrail-api 2025-04-14 12:25:01,810 - DEBUG - Project uuid in Contrail is e5d3e36f-2f07-4d64-8e10-3bb6b5f7554f 2025-04-14 12:25:02,040 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NamespaceDatabaseList?namespace_uuid=19bfeb38-3fc9-46f8-9a78-b6e11d910842 2025-04-14 12:25:02,046 - INFO - Namespace ctest-new-default-04048242 with uuid 19bfeb38-3fc9-46f8-9a78-b6e11d910842 found in kube manager 2025-04-14 12:25:02,046 - INFO - Namespace ctest-new-default-04048242 verification passed 2025-04-14 12:25:02,328 - INFO - Project default-domain:k8s-ctest-non-default-83961850 for Namespace ctest-non-default-83961850 is seen in contrail-api 2025-04-14 12:25:02,329 - DEBUG - Project uuid in Contrail is d824fb27-a76c-4ac3-89d5-eca65e22017f 2025-04-14 12:25:02,329 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NamespaceDatabaseList?namespace_uuid=bee76af5-c4a9-4da7-ada0-2d90c264324b 2025-04-14 12:25:02,337 - INFO - Namespace ctest-non-default-83961850 with uuid bee76af5-c4a9-4da7-ada0-2d90c264324b found in kube manager 2025-04-14 12:25:02,337 - INFO - Namespace ctest-non-default-83961850 verification passed 2025-04-14 12:25:02,346 - DEBUG - Pod ctest-pod-58890581 not in running state.Currently in Pending 2025-04-14 12:25:07,353 - DEBUG - Pod ctest-pod-58890581 not in running state.Currently in Pending 2025-04-14 12:25:12,360 - DEBUG - Pod ctest-pod-58890581 not in running state.Currently in Pending 2025-04-14 12:25:17,370 - DEBUG - Pod ctest-pod-58890581 not in running state.Currently in Pending 2025-04-14 12:25:22,377 - DEBUG - Pod ctest-pod-58890581 not in running state.Currently in Pending 2025-04-14 12:25:27,384 - INFO - Pod ctest-pod-58890581 is in running state.Got IP 10.47.255.248 2025-04-14 12:25:27,400 - DEBUG - Pod ctest-pod-58890581 has vmi 82fdea0e-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:27,400 - INFO - Verified pod ctest-pod-58890581 in contrail-api 2025-04-14 12:25:27,412 - DEBUG - VMI 82fdea0e-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:27,412 - INFO - Verified Pod ctest-pod-58890581 in agent 10.0.0.254 2025-04-14 12:25:27,412 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=c3338b1c-76a1-477a-9b59-4d4f88002e97 2025-04-14 12:25:27,417 - INFO - Pod ctest-pod-58890581 with uuid c3338b1c-76a1-477a-9b59-4d4f88002e97 found in kube manager 2025-04-14 12:25:27,418 - INFO - Pod ctest-pod-58890581 verification passed 2025-04-14 12:25:27,423 - DEBUG - Pod ctest-pod-11043935 not in running state.Currently in Pending 2025-04-14 12:25:32,429 - INFO - Pod ctest-pod-11043935 is in running state.Got IP 10.47.255.247 2025-04-14 12:25:32,443 - DEBUG - Pod ctest-pod-11043935 has vmi 8493fae8-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:32,443 - INFO - Verified pod ctest-pod-11043935 in contrail-api 2025-04-14 12:25:32,454 - DEBUG - VMI 8493fae8-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:32,454 - INFO - Verified Pod ctest-pod-11043935 in agent 10.0.0.254 2025-04-14 12:25:32,454 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=d9443f92-1bff-4bd6-88fd-eeddde95a921 2025-04-14 12:25:32,458 - INFO - Pod ctest-pod-11043935 with uuid d9443f92-1bff-4bd6-88fd-eeddde95a921 found in kube manager 2025-04-14 12:25:32,458 - INFO - Pod ctest-pod-11043935 verification passed 2025-04-14 12:25:32,464 - DEBUG - Pod ctest-pod-96485950 not in running state.Currently in Pending 2025-04-14 12:25:37,470 - INFO - Pod ctest-pod-96485950 is in running state.Got IP 10.47.255.246 2025-04-14 12:25:37,484 - DEBUG - Pod ctest-pod-96485950 has vmi 88007152-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:37,484 - INFO - Verified pod ctest-pod-96485950 in contrail-api 2025-04-14 12:25:37,495 - DEBUG - VMI 88007152-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:37,495 - INFO - Verified Pod ctest-pod-96485950 in agent 10.0.0.254 2025-04-14 12:25:37,496 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=3b7b744b-dfea-4a0c-804e-fd0e0e90ea55 2025-04-14 12:25:37,500 - INFO - Pod ctest-pod-96485950 with uuid 3b7b744b-dfea-4a0c-804e-fd0e0e90ea55 found in kube manager 2025-04-14 12:25:37,500 - INFO - Pod ctest-pod-96485950 verification passed 2025-04-14 12:25:37,507 - INFO - Pod ctest-pod-28719274 is in running state.Got IP 10.47.255.245 2025-04-14 12:25:37,522 - DEBUG - Pod ctest-pod-28719274 has vmi 898de8ce-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:37,522 - INFO - Verified pod ctest-pod-28719274 in contrail-api 2025-04-14 12:25:37,537 - DEBUG - VMI 898de8ce-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:37,538 - INFO - Verified Pod ctest-pod-28719274 in agent 10.0.0.254 2025-04-14 12:25:37,538 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=3bf91f57-df6e-473f-b8cd-96e978c4b97b 2025-04-14 12:25:37,548 - INFO - Pod ctest-pod-28719274 with uuid 3bf91f57-df6e-473f-b8cd-96e978c4b97b found in kube manager 2025-04-14 12:25:37,548 - INFO - Pod ctest-pod-28719274 verification passed 2025-04-14 12:25:37,555 - DEBUG - Pod ctest-pod-32954867 not in running state.Currently in Pending 2025-04-14 12:25:42,562 - DEBUG - Pod ctest-pod-32954867 not in running state.Currently in Pending 2025-04-14 12:25:47,573 - DEBUG - Pod ctest-pod-32954867 not in running state.Currently in Pending 2025-04-14 12:25:52,580 - INFO - Pod ctest-pod-32954867 is in running state.Got IP 10.47.255.244 2025-04-14 12:25:52,595 - DEBUG - Pod ctest-pod-32954867 has vmi 8c612016-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:52,595 - INFO - Verified pod ctest-pod-32954867 in contrail-api 2025-04-14 12:25:52,609 - DEBUG - VMI 8c612016-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:52,609 - INFO - Verified Pod ctest-pod-32954867 in agent 10.0.0.254 2025-04-14 12:25:52,609 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=094232a4-2b83-41f4-a370-433c84e418d9 2025-04-14 12:25:52,615 - INFO - Pod ctest-pod-32954867 with uuid 094232a4-2b83-41f4-a370-433c84e418d9 found in kube manager 2025-04-14 12:25:52,615 - INFO - Pod ctest-pod-32954867 verification passed 2025-04-14 12:25:52,622 - DEBUG - Pod ctest-pod-58442475 not in running state.Currently in Pending 2025-04-14 12:25:57,629 - INFO - Pod ctest-pod-58442475 is in running state.Got IP 10.47.255.242 2025-04-14 12:25:57,643 - DEBUG - Pod ctest-pod-58442475 has vmi 91d0f260-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:57,643 - INFO - Verified pod ctest-pod-58442475 in contrail-api 2025-04-14 12:25:57,656 - DEBUG - VMI 91d0f260-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:57,656 - INFO - Verified Pod ctest-pod-58442475 in agent 10.0.0.254 2025-04-14 12:25:57,656 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=28213e45-6e09-4a94-8b21-cc03ed288283 2025-04-14 12:25:57,660 - INFO - Pod ctest-pod-58442475 with uuid 28213e45-6e09-4a94-8b21-cc03ed288283 found in kube manager 2025-04-14 12:25:57,660 - INFO - Pod ctest-pod-58442475 verification passed 2025-04-14 12:25:57,739 - INFO - Pod ctest-pod-50837897 is in running state.Got IP 10.47.255.243 2025-04-14 12:25:57,754 - DEBUG - Pod ctest-pod-50837897 has vmi 8f1922ea-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:57,754 - INFO - Verified pod ctest-pod-50837897 in contrail-api 2025-04-14 12:25:57,766 - DEBUG - VMI 8f1922ea-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:57,767 - INFO - Verified Pod ctest-pod-50837897 in agent 10.0.0.254 2025-04-14 12:25:57,767 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=8d2dd1f4-a705-418f-a56d-3a2075659e63 2025-04-14 12:25:57,771 - INFO - Pod ctest-pod-50837897 with uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 found in kube manager 2025-04-14 12:25:57,771 - INFO - Pod ctest-pod-50837897 verification passed 2025-04-14 12:25:57,778 - INFO - Pod ctest-pod-32009104 is in running state.Got IP 10.47.255.241 2025-04-14 12:25:57,794 - DEBUG - Pod ctest-pod-32009104 has vmi 9485d2f0-192b-11f0-9ba2-fa163ed388cb 2025-04-14 12:25:57,794 - INFO - Verified pod ctest-pod-32009104 in contrail-api 2025-04-14 12:25:57,805 - DEBUG - VMI 9485d2f0-192b-11f0-9ba2-fa163ed388cb is active in agent 10.0.0.254 2025-04-14 12:25:57,805 - INFO - Verified Pod ctest-pod-32009104 in agent 10.0.0.254 2025-04-14 12:25:57,806 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_VirtualMachineDatabaseList?x=959aca1e-4de1-45ba-abb3-e1d9eca5b22a 2025-04-14 12:25:57,810 - INFO - Pod ctest-pod-32009104 with uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a found in kube manager 2025-04-14 12:25:57,810 - INFO - Pod ctest-pod-32009104 verification passed 2025-04-14 12:25:57,811 - INFO - ================================================================================ 2025-04-14 12:25:57,811 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-14 12:25:57,811 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-14 12:25:58,315 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.0.0.254': '0'}} with 2025-04-14 12:25:58,315 - INFO - Initial checks done. Running the testcase now 2025-04-14 12:25:58,315 - INFO - 2025-04-14 12:25:58,386 - DEBUG - [Pod ctest-pod-58890581] Cmd: echo ctest-pod-58890581 > /usr/share/nginx/html/index.html, Output: 2025-04-14 12:25:58,433 - DEBUG - [Pod ctest-pod-11043935] Cmd: echo ctest-pod-11043935 > /usr/share/nginx/html/index.html, Output: 2025-04-14 12:25:58,481 - DEBUG - [Pod ctest-pod-96485950] Cmd: echo ctest-pod-96485950 > /usr/share/nginx/html/index.html, Output: 2025-04-14 12:25:58,531 - DEBUG - [Pod ctest-pod-28719274] Cmd: echo ctest-pod-28719274 > /usr/share/nginx/html/index.html, Output: 2025-04-14 12:25:58,534 - DEBUG - Service ctest-nginx-svc-55529514 not present 2025-04-14 12:25:58,534 - INFO - Creating service ctest-nginx-svc-55529514 2025-04-14 12:25:58,549 - INFO - Created Service ctest-nginx-svc-55529514 2025-04-14 12:25:58,554 - WARNING - Service UUID d8f0f84f-1ee4-439b-9848-f3f4b93794f6 not yet found in contrail-api 2025-04-14 12:25:59,560 - WARNING - Service UUID d8f0f84f-1ee4-439b-9848-f3f4b93794f6 not yet found in contrail-api 2025-04-14 12:26:00,566 - WARNING - Service UUID d8f0f84f-1ee4-439b-9848-f3f4b93794f6 not yet found in contrail-api 2025-04-14 12:26:01,572 - WARNING - Service UUID d8f0f84f-1ee4-439b-9848-f3f4b93794f6 not yet found in contrail-api 2025-04-14 12:26:02,580 - INFO - Validated that Service ctest-nginx-svc-55529514 is seen in contrail-api 2025-04-14 12:26:02,580 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_LoadbalancerDatabaseList?x=d8f0f84f-1ee4-439b-9848-f3f4b93794f6 2025-04-14 12:26:02,585 - INFO - Service ctest-nginx-svc-55529514 with uuid d8f0f84f-1ee4-439b-9848-f3f4b93794f6 found in kube manager 2025-04-14 12:26:02,585 - INFO - Service ctest-nginx-svc-55529514 verification passed 2025-04-14 12:26:05,686 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11043935 2025-04-14 12:26:05,686 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:26:05,686 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11043935 2025-04-14 12:26:05,796 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: ctest-pod-58890581 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:26:05,796 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:26:05,796 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: ctest-pod-58890581 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:26:05,796 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58890581': 1, 'ctest-pod-11043935': 1} 2025-04-14 12:26:05,846 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58890581 2025-04-14 12:26:05,846 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:26:05,846 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58890581 2025-04-14 12:26:05,896 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: ctest-pod-11043935 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:26:05,896 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:26:05,896 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: ctest-pod-11043935 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:26:05,896 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58890581': 1, 'ctest-pod-11043935': 1} 2025-04-14 12:26:05,900 - DEBUG - Network policy ingress-on-service not present 2025-04-14 12:26:05,900 - INFO - Creating Network Policy ingress-on-service 2025-04-14 12:26:05,914 - INFO - Network policy found in k8s 2025-04-14 12:26:05,914 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:05,922 - INFO - Network Policy ingress-on-service with uuid e8063a11-493c-418f-96d2-b51d1a5f72e6 found in kube manager 2025-04-14 12:26:05,964 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-14 12:26:05,964 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-14 12:26:05,964 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:05,997 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 12:26:07,998 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:08,042 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 12:26:10,043 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:10,073 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 12:26:12,074 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:12,106 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 12:26:14,107 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:14,141 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 12:26:16,143 - DEBUG - Requesting: http://10.0.0.254:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8063a11-493c-418f-96d2-b51d1a5f72e6 2025-04-14 12:26:16,175 - INFO - Network policy with name ingress-on-service found in agent 2025-04-14 12:26:16,175 - INFO - Network Policy ingress-on-service verification passed 2025-04-14 12:26:21,230 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:21,230 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:21,230 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:26,280 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:26,280 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:26,280 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:31,320 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:31,320 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:31,320 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:36,372 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:36,372 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:36,372 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:41,427 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:41,427 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:41,427 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:46,471 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:46,471 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:46,471 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:51,512 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:51,512 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:51,512 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:56,563 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:56,563 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:26:56,563 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:01,605 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:01,605 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:01,606 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:06,652 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:06,652 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:06,652 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:06,652 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58890581': 0, 'ctest-pod-11043935': 0} 2025-04-14 12:27:06,700 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) ctest-pod-11043935 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:27:06,700 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:27:06,700 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) ctest-pod-11043935 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:27:06,750 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58890581 2025-04-14 12:27:06,750 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:27:06,750 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58890581 2025-04-14 12:27:06,750 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58890581': 1, 'ctest-pod-11043935': 1} 2025-04-14 12:27:11,803 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:11,804 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:11,804 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:16,845 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:16,845 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:16,845 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:21,888 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:21,888 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:21,888 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:26,934 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:26,934 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:26,935 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:31,983 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:31,983 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:31,983 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:37,038 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:37,038 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:37,038 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:42,082 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:42,082 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:42,082 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:47,127 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:47,127 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:47,127 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:52,179 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:52,179 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:52,179 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:57,220 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:57,220 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:57,220 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:27:57,220 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58890581': 0, 'ctest-pod-11043935': 0} 2025-04-14 12:27:59,266 - DEBUG - [Pod ctest-pod-50837897] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.891 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.090 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.346/0.891 ms 2025-04-14 12:27:59,267 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-50837897 with expectation True passed 2025-04-14 12:28:01,322 - DEBUG - [Pod ctest-pod-32954867] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.982 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.071 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.373/0.982 ms 2025-04-14 12:28:01,322 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-32954867 with expectation True passed 2025-04-14 12:28:03,371 - DEBUG - [Pod ctest-pod-58442475] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.388 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.080 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.181/0.388 ms 2025-04-14 12:28:03,371 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-58442475 with expectation True passed 2025-04-14 12:28:03,423 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:28:03,424 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2025-04-14 12:28:03,424 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:28:03,424 - INFO - wget check of of http://10.47.255.248 from ctest-pod-50837897 passed 2025-04-14 12:28:03,478 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:28:03,478 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2025-04-14 12:28:03,478 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:28:03,478 - INFO - wget check of of http://10.47.255.247 from ctest-pod-50837897 passed 2025-04-14 12:28:08,524 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 12:28:08,525 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 12:28:08,525 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 12:28:08,525 - INFO - wget check of of http://10.47.255.247 from ctest-pod-32954867 passed 2025-04-14 12:28:13,570 - DEBUG - [Pod ctest-pod-32009104] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2025-04-14 12:28:13,570 - DEBUG - [Pod Pod ctest-pod-32009104] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2025-04-14 12:28:13,570 - DEBUG - [Pod Pod ctest-pod-32009104] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2025-04-14 12:28:13,570 - INFO - wget check of of http://10.47.255.248 from ctest-pod-32009104 passed 2025-04-14 12:28:13,581 - INFO - Updating Network Policy ingress-on-service 2025-04-14 12:28:18,649 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:18,649 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:18,649 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:23,690 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:23,690 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:23,690 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:28,740 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:28,740 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:28,740 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:33,780 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:33,780 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:33,780 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:38,825 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:38,825 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:38,826 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:43,875 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:43,875 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:43,875 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:48,928 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:48,929 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:48,929 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:53,999 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:53,999 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:53,999 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:59,046 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:59,046 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:28:59,046 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:29:04,090 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:29:04,090 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:29:04,090 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) wget: download timed out 2025-04-14 12:29:04,090 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58890581': 0, 'ctest-pod-11043935': 0} 2025-04-14 12:29:04,134 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58890581 2025-04-14 12:29:04,134 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:29:04,134 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58890581 2025-04-14 12:29:04,176 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout ctest-pod-58890581 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:29:04,177 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:29:04,177 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout ctest-pod-58890581 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:29:04,222 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11043935 2025-04-14 12:29:04,222 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:29:04,222 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11043935 2025-04-14 12:29:04,222 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58890581': 2, 'ctest-pod-11043935': 1} 2025-04-14 12:29:04,281 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: ctest-pod-11043935 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:29:04,281 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:29:04,281 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: ctest-pod-11043935 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:29:04,336 - DEBUG - [Pod ctest-pod-58442475] Cmd: wget http://10.105.189.83:80/ -O - -T 5 -t 1 , Output: ctest-pod-58890581 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:29:04,336 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd wget http://10.105.189.83:80/ -O - -T 5 -t 1 passed 2025-04-14 12:29:04,336 - DEBUG - [Pod Pod ctest-pod-58442475] Cmd output: ctest-pod-58890581 Connecting to 10.105.189.83:80 (10.105.189.83:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 12:29:04,336 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58890581': 1, 'ctest-pod-11043935': 1} 2025-04-14 12:29:06,389 - DEBUG - [Pod ctest-pod-50837897] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.432 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.095 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.198/0.432 ms 2025-04-14 12:29:06,389 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-50837897 with expectation True passed 2025-04-14 12:29:08,436 - DEBUG - [Pod ctest-pod-32954867] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.738 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.083 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.295/0.738 ms 2025-04-14 12:29:08,436 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-32954867 with expectation True passed 2025-04-14 12:29:10,483 - DEBUG - [Pod ctest-pod-58442475] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.178 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.094 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.443/1.178 ms 2025-04-14 12:29:10,483 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-58442475 with expectation True passed 2025-04-14 12:29:10,540 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:29:10,540 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2025-04-14 12:29:10,540 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:29:10,540 - INFO - wget check of of http://10.47.255.248 from ctest-pod-50837897 passed 2025-04-14 12:29:10,605 - DEBUG - [Pod ctest-pod-50837897] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:29:10,605 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2025-04-14 12:29:10,605 - DEBUG - [Pod Pod ctest-pod-50837897] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:29:10,605 - INFO - wget check of of http://10.47.255.247 from ctest-pod-50837897 passed 2025-04-14 12:29:15,652 - DEBUG - [Pod ctest-pod-32954867] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 12:29:15,652 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 12:29:15,652 - DEBUG - [Pod Pod ctest-pod-32954867] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 12:29:15,652 - INFO - wget check of of http://10.47.255.247 from ctest-pod-32954867 passed 2025-04-14 12:29:15,698 - DEBUG - [Pod ctest-pod-32009104] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:29:15,698 - DEBUG - [Pod Pod ctest-pod-32009104] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2025-04-14 12:29:15,698 - DEBUG - [Pod Pod ctest-pod-32009104] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 12:29:15,698 - INFO - wget check of of http://10.47.255.248 from ctest-pod-32009104 passed 2025-04-14 12:29:15,698 - INFO - Deleting Network Policy : ingress-on-service 2025-04-14 12:29:15,699 - INFO - Deleting service : ctest-nginx-svc-55529514 2025-04-14 12:29:16,210 - DEBUG - No XMPP flaps were noticed during the test 2025-04-14 12:29:16,210 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:19] 2025-04-14 12:29:16,210 - INFO - -------------------------------------------------------------------------------- 2025-04-14 12:29:16,215 - INFO - Deleting pod ctest-new-default-04048242:ctest-pod-58890581 2025-04-14 12:29:16,215 - INFO - Deleting pod ctest-new-default-04048242:ctest-pod-11043935 2025-04-14 12:29:16,215 - INFO - Deleting pod ctest-non-default-83961850:ctest-pod-96485950 2025-04-14 12:29:16,216 - INFO - Deleting pod ctest-non-default-83961850:ctest-pod-28719274 2025-04-14 12:29:16,216 - INFO - Deleting pod ctest-new-default-04048242:ctest-pod-32954867 2025-04-14 12:29:16,217 - INFO - Deleting pod ctest-new-default-04048242:ctest-pod-50837897 2025-04-14 12:29:16,217 - INFO - Deleting pod ctest-non-default-83961850:ctest-pod-58442475 2025-04-14 12:29:16,217 - INFO - Deleting pod ctest-non-default-83961850:ctest-pod-32009104 2025-04-14 12:29:16,379 - WARNING - Pod uuid c3338b1c-76a1-477a-9b59-4d4f88002e97 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,395 - WARNING - Pod uuid d9443f92-1bff-4bd6-88fd-eeddde95a921 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,409 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,416 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,419 - WARNING - Pod uuid 3bf91f57-df6e-473f-b8cd-96e978c4b97b is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,420 - WARNING - Pod uuid 3b7b744b-dfea-4a0c-804e-fd0e0e90ea55 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,420 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:16,426 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,386 - WARNING - Pod uuid c3338b1c-76a1-477a-9b59-4d4f88002e97 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,404 - DEBUG - Pod d9443f92-1bff-4bd6-88fd-eeddde95a921 is not in agent 10.0.0.254 VM list 2025-04-14 12:29:21,414 - DEBUG - VMI 8493fae8-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:21,414 - INFO - Verified that pod ctest-pod-11043935 is removed in agent 2025-04-14 12:29:21,420 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,438 - WARNING - Pod uuid 3bf91f57-df6e-473f-b8cd-96e978c4b97b is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,439 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,441 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,441 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:21,441 - DEBUG - Pod 3b7b744b-dfea-4a0c-804e-fd0e0e90ea55 is not in agent 10.0.0.254 VM list 2025-04-14 12:29:21,448 - DEBUG - VMI 88007152-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:21,448 - INFO - Verified that pod ctest-pod-96485950 is removed in agent 2025-04-14 12:29:26,393 - DEBUG - Pod c3338b1c-76a1-477a-9b59-4d4f88002e97 is not in agent 10.0.0.254 VM list 2025-04-14 12:29:26,399 - DEBUG - VMI 82fdea0e-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:26,399 - INFO - Verified that pod ctest-pod-58890581 is removed in agent 2025-04-14 12:29:26,428 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:26,467 - DEBUG - Pod 3bf91f57-df6e-473f-b8cd-96e978c4b97b is not in agent 10.0.0.254 VM list 2025-04-14 12:29:26,470 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:26,472 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:26,473 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:26,478 - DEBUG - VMI 898de8ce-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:26,478 - INFO - Verified that pod ctest-pod-28719274 is removed in agent 2025-04-14 12:29:31,437 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:31,492 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:31,493 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:31,493 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:36,444 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:36,510 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:36,510 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:36,511 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:41,451 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:41,527 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:41,527 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:41,528 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:46,459 - WARNING - Pod uuid 8d2dd1f4-a705-418f-a56d-3a2075659e63 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:46,596 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:46,599 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:46,600 - WARNING - Pod uuid 094232a4-2b83-41f4-a370-433c84e418d9 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:51,466 - DEBUG - Pod 8d2dd1f4-a705-418f-a56d-3a2075659e63 is not in agent 10.0.0.254 VM list 2025-04-14 12:29:51,471 - DEBUG - VMI 8f1922ea-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:51,471 - INFO - Verified that pod ctest-pod-50837897 is removed in agent 2025-04-14 12:29:51,614 - DEBUG - Pod 094232a4-2b83-41f4-a370-433c84e418d9 is not in agent 10.0.0.254 VM list 2025-04-14 12:29:51,615 - WARNING - Pod uuid 28213e45-6e09-4a94-8b21-cc03ed288283 is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:51,616 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:51,622 - DEBUG - VMI 8c612016-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:51,622 - INFO - Verified that pod ctest-pod-32954867 is removed in agent 2025-04-14 12:29:56,625 - WARNING - Pod uuid 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is still seen in agent 10.0.0.254 VM list 2025-04-14 12:29:56,627 - DEBUG - Pod 28213e45-6e09-4a94-8b21-cc03ed288283 is not in agent 10.0.0.254 VM list 2025-04-14 12:29:56,632 - DEBUG - VMI 91d0f260-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:29:56,632 - INFO - Verified that pod ctest-pod-58442475 is removed in agent 2025-04-14 12:30:01,634 - DEBUG - Pod 959aca1e-4de1-45ba-abb3-e1d9eca5b22a is not in agent 10.0.0.254 VM list 2025-04-14 12:30:01,641 - DEBUG - VMI 9485d2f0-192b-11f0-9ba2-fa163ed388cb is removed from agent 10.0.0.254 2025-04-14 12:30:01,641 - INFO - Verified that pod ctest-pod-32009104 is removed in agent 2025-04-14 12:30:01,647 - INFO - Deleting namespace ctest-non-default-83961850 2025-04-14 12:30:01,661 - DEBUG - Namespace ctest-non-default-83961850 still in k8s 2025-04-14 12:30:03,666 - DEBUG - Namespace ctest-non-default-83961850 still in k8s 2025-04-14 12:30:05,672 - DEBUG - Namespace ctest-non-default-83961850 still in k8s 2025-04-14 12:30:07,677 - DEBUG - Namespace ctest-non-default-83961850 is not in k8s 2025-04-14 12:30:07,677 - DEBUG - No need to check project deletion in contrail-api 2025-04-14 12:30:07,677 - INFO - Deleting namespace ctest-new-default-04048242 2025-04-14 12:30:07,690 - DEBUG - Namespace ctest-new-default-04048242 still in k8s 2025-04-14 12:30:09,696 - DEBUG - Namespace ctest-new-default-04048242 still in k8s 2025-04-14 12:30:11,701 - DEBUG - Namespace ctest-new-default-04048242 still in k8s 2025-04-14 12:30:13,706 - DEBUG - Namespace ctest-new-default-04048242 is not in k8s 2025-04-14 12:30:13,706 - DEBUG - No need to check project deletion in contrail-api