2024-09-03 17:39:57,548 - INFO - Using existing project ['default-domain', 'k8s-default'](8bd6e510-d455-49b0-ad47-6fb56fbf0c16) 2024-09-03 17:39:57,569 - DEBUG - Namespace ctest-new-default-17943099 not present 2024-09-03 17:39:57,586 - INFO - Created namespace ctest-new-default-17943099 2024-09-03 17:40:00,590 - DEBUG - Namespace ctest-non-default-78341712 not present 2024-09-03 17:40:00,602 - INFO - Created namespace ctest-non-default-78341712 2024-09-03 17:40:03,632 - DEBUG - Pod ctest-pod-16123599 not present 2024-09-03 17:40:03,633 - INFO - Creating Pod ctest-pod-16123599 2024-09-03 17:40:03,669 - DEBUG - Pod : ctest-pod-16123599 UUID is 2409adf0-1ea0-4f4f-8344-9de313ab4f36 2024-09-03 17:40:03,672 - DEBUG - Pod ctest-pod-50803511 not present 2024-09-03 17:40:03,672 - INFO - Creating Pod ctest-pod-50803511 2024-09-03 17:40:03,693 - DEBUG - Pod : ctest-pod-50803511 UUID is 11706f82-445e-4977-a199-f0f7a52ab104 2024-09-03 17:40:03,701 - DEBUG - Pod ctest-pod-18763930 not present 2024-09-03 17:40:03,701 - INFO - Creating Pod ctest-pod-18763930 2024-09-03 17:40:03,721 - DEBUG - Pod : ctest-pod-18763930 UUID is 57b75ca8-e5e2-4a02-a6a5-b240b406345b 2024-09-03 17:40:03,730 - DEBUG - Pod ctest-pod-17302177 not present 2024-09-03 17:40:03,731 - INFO - Creating Pod ctest-pod-17302177 2024-09-03 17:40:03,752 - DEBUG - Pod : ctest-pod-17302177 UUID is 4e3540cb-e84a-4fc0-b121-a2ae8e02eb22 2024-09-03 17:40:03,757 - DEBUG - Pod ctest-pod-67649545 not present 2024-09-03 17:40:03,758 - INFO - Creating Pod ctest-pod-67649545 2024-09-03 17:40:03,776 - DEBUG - Pod : ctest-pod-67649545 UUID is 51f78a4c-c866-4286-ae10-261cc9bdaa39 2024-09-03 17:40:03,778 - DEBUG - Pod ctest-pod-24670950 not present 2024-09-03 17:40:03,779 - INFO - Creating Pod ctest-pod-24670950 2024-09-03 17:40:03,800 - DEBUG - Pod : ctest-pod-24670950 UUID is dd6b27ff-3d99-4f31-9545-cb85c027f9e6 2024-09-03 17:40:03,802 - DEBUG - Pod ctest-pod-82192191 not present 2024-09-03 17:40:03,802 - INFO - Creating Pod ctest-pod-82192191 2024-09-03 17:40:03,830 - DEBUG - Pod : ctest-pod-82192191 UUID is cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc 2024-09-03 17:40:03,832 - DEBUG - Pod ctest-pod-45139832 not present 2024-09-03 17:40:03,833 - INFO - Creating Pod ctest-pod-45139832 2024-09-03 17:40:03,850 - DEBUG - Pod : ctest-pod-45139832 UUID is e8088368-9097-4b3a-95f4-91e98f86b589 2024-09-03 17:40:04,013 - INFO - Project default-domain:k8s-ctest-new-default-17943099 for Namespace ctest-new-default-17943099 is seen in contrail-api 2024-09-03 17:40:04,014 - DEBUG - Project uuid in Contrail is b0708016-0513-4f6d-9bae-db50cb4f0cb5 2024-09-03 17:40:04,194 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=f6076e6a-6927-4a46-ae09-2a3c2d4bad41 2024-09-03 17:40:04,200 - INFO - Namespace ctest-new-default-17943099 with uuid f6076e6a-6927-4a46-ae09-2a3c2d4bad41 found in kube manager 2024-09-03 17:40:04,200 - INFO - Namespace ctest-new-default-17943099 verification passed 2024-09-03 17:40:04,358 - INFO - Project default-domain:k8s-ctest-non-default-78341712 for Namespace ctest-non-default-78341712 is seen in contrail-api 2024-09-03 17:40:04,358 - DEBUG - Project uuid in Contrail is 9c2f19a0-cb62-4327-b784-56376e9a5f3c 2024-09-03 17:40:04,358 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=0885875a-ab57-4937-a917-5e2f1c81b07a 2024-09-03 17:40:04,363 - INFO - Namespace ctest-non-default-78341712 with uuid 0885875a-ab57-4937-a917-5e2f1c81b07a found in kube manager 2024-09-03 17:40:04,364 - INFO - Namespace ctest-non-default-78341712 verification passed 2024-09-03 17:40:04,369 - DEBUG - Pod ctest-pod-16123599 not in running state.Currently in Pending 2024-09-03 17:40:09,376 - DEBUG - Pod ctest-pod-16123599 not in running state.Currently in Pending 2024-09-03 17:40:14,383 - DEBUG - Pod ctest-pod-16123599 not in running state.Currently in Pending 2024-09-03 17:40:19,389 - DEBUG - Pod ctest-pod-16123599 not in running state.Currently in Pending 2024-09-03 17:40:24,395 - INFO - Pod ctest-pod-16123599 is in running state.Got IP 10.47.255.251 2024-09-03 17:40:24,409 - DEBUG - Pod ctest-pod-16123599 has vmi 8e27ae2a-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,409 - INFO - Verified pod ctest-pod-16123599 in contrail-api 2024-09-03 17:40:24,426 - DEBUG - VMI 8e27ae2a-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,426 - INFO - Verified Pod ctest-pod-16123599 in agent 10.0.0.22 2024-09-03 17:40:24,426 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=2409adf0-1ea0-4f4f-8344-9de313ab4f36 2024-09-03 17:40:24,431 - INFO - Pod ctest-pod-16123599 with uuid 2409adf0-1ea0-4f4f-8344-9de313ab4f36 found in kube manager 2024-09-03 17:40:24,431 - INFO - Pod ctest-pod-16123599 verification passed 2024-09-03 17:40:24,436 - INFO - Pod ctest-pod-50803511 is in running state.Got IP 10.47.255.250 2024-09-03 17:40:24,489 - DEBUG - Pod ctest-pod-50803511 has vmi 8ea3ae94-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,489 - INFO - Verified pod ctest-pod-50803511 in contrail-api 2024-09-03 17:40:24,504 - DEBUG - VMI 8ea3ae94-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,504 - INFO - Verified Pod ctest-pod-50803511 in agent 10.0.0.22 2024-09-03 17:40:24,504 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=11706f82-445e-4977-a199-f0f7a52ab104 2024-09-03 17:40:24,508 - INFO - Pod ctest-pod-50803511 with uuid 11706f82-445e-4977-a199-f0f7a52ab104 found in kube manager 2024-09-03 17:40:24,509 - INFO - Pod ctest-pod-50803511 verification passed 2024-09-03 17:40:24,514 - INFO - Pod ctest-pod-18763930 is in running state.Got IP 10.47.255.249 2024-09-03 17:40:24,524 - DEBUG - Pod ctest-pod-18763930 has vmi 8f42acf6-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,524 - INFO - Verified pod ctest-pod-18763930 in contrail-api 2024-09-03 17:40:24,537 - DEBUG - VMI 8f42acf6-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,537 - INFO - Verified Pod ctest-pod-18763930 in agent 10.0.0.22 2024-09-03 17:40:24,537 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=57b75ca8-e5e2-4a02-a6a5-b240b406345b 2024-09-03 17:40:24,542 - INFO - Pod ctest-pod-18763930 with uuid 57b75ca8-e5e2-4a02-a6a5-b240b406345b found in kube manager 2024-09-03 17:40:24,542 - INFO - Pod ctest-pod-18763930 verification passed 2024-09-03 17:40:24,548 - INFO - Pod ctest-pod-17302177 is in running state.Got IP 10.47.255.248 2024-09-03 17:40:24,601 - DEBUG - Pod ctest-pod-17302177 has vmi 8fb94bcc-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,601 - INFO - Verified pod ctest-pod-17302177 in contrail-api 2024-09-03 17:40:24,616 - DEBUG - VMI 8fb94bcc-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,616 - INFO - Verified Pod ctest-pod-17302177 in agent 10.0.0.22 2024-09-03 17:40:24,616 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=4e3540cb-e84a-4fc0-b121-a2ae8e02eb22 2024-09-03 17:40:24,621 - INFO - Pod ctest-pod-17302177 with uuid 4e3540cb-e84a-4fc0-b121-a2ae8e02eb22 found in kube manager 2024-09-03 17:40:24,621 - INFO - Pod ctest-pod-17302177 verification passed 2024-09-03 17:40:24,626 - INFO - Pod ctest-pod-67649545 is in running state.Got IP 10.47.255.247 2024-09-03 17:40:24,687 - DEBUG - Pod ctest-pod-67649545 has vmi 90413bb8-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,688 - INFO - Verified pod ctest-pod-67649545 in contrail-api 2024-09-03 17:40:24,704 - DEBUG - VMI 90413bb8-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,705 - INFO - Verified Pod ctest-pod-67649545 in agent 10.0.0.22 2024-09-03 17:40:24,705 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=51f78a4c-c866-4286-ae10-261cc9bdaa39 2024-09-03 17:40:24,711 - INFO - Pod ctest-pod-67649545 with uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 found in kube manager 2024-09-03 17:40:24,711 - INFO - Pod ctest-pod-67649545 verification passed 2024-09-03 17:40:24,717 - INFO - Pod ctest-pod-82192191 is in running state.Got IP 10.47.255.245 2024-09-03 17:40:24,728 - DEBUG - Pod ctest-pod-82192191 has vmi 9110d986-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,728 - INFO - Verified pod ctest-pod-82192191 in contrail-api 2024-09-03 17:40:24,742 - DEBUG - VMI 9110d986-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,742 - INFO - Verified Pod ctest-pod-82192191 in agent 10.0.0.22 2024-09-03 17:40:24,742 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc 2024-09-03 17:40:24,748 - INFO - Pod ctest-pod-82192191 with uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc found in kube manager 2024-09-03 17:40:24,748 - INFO - Pod ctest-pod-82192191 verification passed 2024-09-03 17:40:24,755 - INFO - Pod ctest-pod-24670950 is in running state.Got IP 10.47.255.246 2024-09-03 17:40:24,815 - DEBUG - Pod ctest-pod-24670950 has vmi 90a8b63a-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,816 - INFO - Verified pod ctest-pod-24670950 in contrail-api 2024-09-03 17:40:24,830 - DEBUG - VMI 90a8b63a-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,830 - INFO - Verified Pod ctest-pod-24670950 in agent 10.0.0.22 2024-09-03 17:40:24,830 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=dd6b27ff-3d99-4f31-9545-cb85c027f9e6 2024-09-03 17:40:24,834 - INFO - Pod ctest-pod-24670950 with uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 found in kube manager 2024-09-03 17:40:24,834 - INFO - Pod ctest-pod-24670950 verification passed 2024-09-03 17:40:24,839 - INFO - Pod ctest-pod-45139832 is in running state.Got IP 10.47.255.244 2024-09-03 17:40:24,849 - DEBUG - Pod ctest-pod-45139832 has vmi 917c869a-6a1b-11ef-a7c5-fa163ee58f17 2024-09-03 17:40:24,849 - INFO - Verified pod ctest-pod-45139832 in contrail-api 2024-09-03 17:40:24,863 - DEBUG - VMI 917c869a-6a1b-11ef-a7c5-fa163ee58f17 is active in agent 10.0.0.22 2024-09-03 17:40:24,863 - INFO - Verified Pod ctest-pod-45139832 in agent 10.0.0.22 2024-09-03 17:40:24,863 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=e8088368-9097-4b3a-95f4-91e98f86b589 2024-09-03 17:40:24,867 - INFO - Pod ctest-pod-45139832 with uuid e8088368-9097-4b3a-95f4-91e98f86b589 found in kube manager 2024-09-03 17:40:24,867 - INFO - Pod ctest-pod-45139832 verification passed 2024-09-03 17:40:24,867 - INFO - ================================================================================ 2024-09-03 17:40:24,867 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-03 17:40:24,867 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-03 17:40:25,078 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.23': '0'}} with 2024-09-03 17:40:25,078 - INFO - Initial checks done. Running the testcase now 2024-09-03 17:40:25,078 - INFO - 2024-09-03 17:40:25,143 - DEBUG - [Pod ctest-pod-16123599] Cmd: echo ctest-pod-16123599 > /usr/share/nginx/html/index.html, Output: 2024-09-03 17:40:25,221 - DEBUG - [Pod ctest-pod-50803511] Cmd: echo ctest-pod-50803511 > /usr/share/nginx/html/index.html, Output: 2024-09-03 17:40:25,280 - DEBUG - [Pod ctest-pod-18763930] Cmd: echo ctest-pod-18763930 > /usr/share/nginx/html/index.html, Output: 2024-09-03 17:40:25,348 - DEBUG - [Pod ctest-pod-17302177] Cmd: echo ctest-pod-17302177 > /usr/share/nginx/html/index.html, Output: 2024-09-03 17:40:25,350 - DEBUG - Service ctest-nginx-svc-13465879 not present 2024-09-03 17:40:25,351 - INFO - Creating service ctest-nginx-svc-13465879 2024-09-03 17:40:25,365 - INFO - Created Service ctest-nginx-svc-13465879 2024-09-03 17:40:25,369 - WARNING - Service UUID 3b35144d-b314-4100-9dd1-f2af1c90f073 not yet found in contrail-api 2024-09-03 17:40:26,377 - INFO - Validated that Service ctest-nginx-svc-13465879 is seen in contrail-api 2024-09-03 17:40:26,378 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=3b35144d-b314-4100-9dd1-f2af1c90f073 2024-09-03 17:40:26,384 - INFO - Service ctest-nginx-svc-13465879 with uuid 3b35144d-b314-4100-9dd1-f2af1c90f073 found in kube manager 2024-09-03 17:40:26,384 - INFO - Service ctest-nginx-svc-13465879 verification passed 2024-09-03 17:40:27,461 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:40:27,462 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:40:27,462 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:40:27,529 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:40:27,529 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:40:27,529 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:40:27,593 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-16123599 2024-09-03 17:40:27,593 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:40:27,593 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-16123599 2024-09-03 17:40:27,593 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16123599': 1, 'ctest-pod-50803511': 2} 2024-09-03 17:40:27,663 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) ctest-pod-16123599 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:40:27,663 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:40:27,663 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) ctest-pod-16123599 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:40:27,717 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:40:27,717 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:40:27,717 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:40:27,717 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16123599': 1, 'ctest-pod-50803511': 1} 2024-09-03 17:40:27,721 - DEBUG - Network policy ingress-on-service not present 2024-09-03 17:40:27,721 - INFO - Creating Network Policy ingress-on-service 2024-09-03 17:40:27,736 - INFO - Network policy found in k8s 2024-09-03 17:40:27,736 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=25c7ad6a-6887-441e-ae66-ac617363d2cf 2024-09-03 17:40:27,742 - INFO - Network Policy ingress-on-service with uuid 25c7ad6a-6887-441e-ae66-ac617363d2cf found in kube manager 2024-09-03 17:40:27,779 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-03 17:40:27,779 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-03 17:40:27,779 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=25c7ad6a-6887-441e-ae66-ac617363d2cf 2024-09-03 17:40:27,808 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-03 17:40:29,809 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=25c7ad6a-6887-441e-ae66-ac617363d2cf 2024-09-03 17:40:29,845 - INFO - Network policy with name ingress-on-service found in agent 2024-09-03 17:40:29,846 - INFO - Network Policy ingress-on-service verification passed 2024-09-03 17:40:34,910 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:34,910 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:34,911 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:39,978 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:39,978 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:39,978 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:45,037 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:45,037 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:45,037 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:50,102 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:50,102 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:50,102 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:55,166 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:55,166 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:40:55,166 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:00,226 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:00,226 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:00,226 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:05,282 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:05,282 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:05,282 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:10,343 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:10,343 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:10,343 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:15,438 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:15,438 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:15,438 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:20,494 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:20,494 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:20,494 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:20,494 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16123599': 0, 'ctest-pod-50803511': 0} 2024-09-03 17:41:20,566 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:41:20,566 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:41:20,566 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:41:20,631 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:41:20,632 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:41:20,632 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:41:20,632 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16123599': 1, 'ctest-pod-50803511': 1} 2024-09-03 17:41:25,695 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:25,695 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:25,695 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:30,744 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:30,744 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:30,744 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:35,802 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:35,802 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:35,802 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:40,864 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:40,864 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:40,864 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:45,924 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:45,924 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:45,924 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:50,972 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:50,972 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:50,972 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:56,032 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:56,032 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:41:56,032 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:01,106 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:01,106 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:01,107 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:06,165 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:06,165 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:06,165 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:12,214 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:12,214 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:12,214 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:12,214 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16123599': 0, 'ctest-pod-50803511': 0} 2024-09-03 17:42:14,282 - DEBUG - [Pod ctest-pod-24670950] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.166 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.438/1.166 ms 2024-09-03 17:42:14,282 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24670950 with expectation True passed 2024-09-03 17:42:16,338 - DEBUG - [Pod ctest-pod-67649545] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.902 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.347/0.902 ms 2024-09-03 17:42:16,339 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67649545 with expectation True passed 2024-09-03 17:42:18,550 - DEBUG - [Pod ctest-pod-82192191] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.461 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.205/0.461 ms 2024-09-03 17:42:18,550 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-82192191 with expectation True passed 2024-09-03 17:42:18,607 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:42:18,607 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-03 17:42:18,607 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:42:18,607 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24670950 passed 2024-09-03 17:42:18,668 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:42:18,668 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-03 17:42:18,668 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:42:18,668 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24670950 passed 2024-09-03 17:42:23,726 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-03 17:42:23,727 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-03 17:42:23,727 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-03 17:42:23,727 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67649545 passed 2024-09-03 17:42:28,791 - DEBUG - [Pod ctest-pod-45139832] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-03 17:42:28,791 - DEBUG - [Pod Pod ctest-pod-45139832] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-03 17:42:28,791 - DEBUG - [Pod Pod ctest-pod-45139832] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-03 17:42:28,791 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45139832 passed 2024-09-03 17:42:28,800 - INFO - Updating Network Policy ingress-on-service 2024-09-03 17:42:33,862 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:33,862 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:33,862 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:38,936 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:38,936 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:38,936 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:44,007 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:44,008 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:44,008 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:49,062 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:49,062 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:49,062 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:54,123 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:54,123 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:54,123 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:59,191 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:59,191 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:42:59,191 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:04,243 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:04,244 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:04,244 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:09,298 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:09,298 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:09,298 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:14,375 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:14,375 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:14,375 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:19,443 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:19,443 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:19,443 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) wget: download timed out 2024-09-03 17:43:19,443 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16123599': 0, 'ctest-pod-50803511': 0} 2024-09-03 17:43:19,510 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,510 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,510 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,563 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,564 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,564 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,627 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,627 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,627 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,689 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,689 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,689 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,741 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-50803511 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,741 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,741 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: ctest-pod-50803511 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,741 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16123599': 4, 'ctest-pod-50803511': 1} 2024-09-03 17:43:19,804 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,804 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,804 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,867 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,868 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,868 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: ctest-pod-16123599 Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-03 17:43:19,926 - DEBUG - [Pod ctest-pod-82192191] Cmd: wget http://10.98.187.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:43:19,926 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd wget http://10.98.187.193:80/ -O - -T 5 -t 1 passed 2024-09-03 17:43:19,926 - DEBUG - [Pod Pod ctest-pod-82192191] Cmd output: Connecting to 10.98.187.193:80 (10.98.187.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-50803511 2024-09-03 17:43:19,926 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16123599': 2, 'ctest-pod-50803511': 1} 2024-09-03 17:43:21,974 - DEBUG - [Pod ctest-pod-24670950] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.263 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.143/0.263 ms 2024-09-03 17:43:21,975 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24670950 with expectation True passed 2024-09-03 17:43:24,030 - DEBUG - [Pod ctest-pod-67649545] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.343 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.166/0.343 ms 2024-09-03 17:43:24,030 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67649545 with expectation True passed 2024-09-03 17:43:26,087 - DEBUG - [Pod ctest-pod-82192191] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.689 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.283/0.689 ms 2024-09-03 17:43:26,087 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-82192191 with expectation True passed 2024-09-03 17:43:26,160 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:43:26,161 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-03 17:43:26,161 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:43:26,161 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24670950 passed 2024-09-03 17:43:26,240 - DEBUG - [Pod ctest-pod-24670950] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:43:26,240 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-03 17:43:26,240 - DEBUG - [Pod Pod ctest-pod-24670950] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:43:26,240 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24670950 passed 2024-09-03 17:43:31,294 - DEBUG - [Pod ctest-pod-67649545] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-03 17:43:31,294 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-03 17:43:31,294 - DEBUG - [Pod Pod ctest-pod-67649545] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-03 17:43:31,294 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67649545 passed 2024-09-03 17:43:31,358 - DEBUG - [Pod ctest-pod-45139832] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:43:31,359 - DEBUG - [Pod Pod ctest-pod-45139832] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-03 17:43:31,359 - DEBUG - [Pod Pod ctest-pod-45139832] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-03 17:43:31,359 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45139832 passed 2024-09-03 17:43:31,359 - INFO - Deleting Network Policy : ingress-on-service 2024-09-03 17:43:31,359 - INFO - Deleting service : ctest-nginx-svc-13465879 2024-09-03 17:43:31,580 - DEBUG - No XMPP flaps were noticed during the test 2024-09-03 17:43:31,580 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07] 2024-09-03 17:43:31,580 - INFO - -------------------------------------------------------------------------------- 2024-09-03 17:43:31,587 - INFO - Deleting pod ctest-new-default-17943099:ctest-pod-16123599 2024-09-03 17:43:31,587 - INFO - Deleting pod ctest-new-default-17943099:ctest-pod-50803511 2024-09-03 17:43:31,588 - INFO - Deleting pod ctest-non-default-78341712:ctest-pod-18763930 2024-09-03 17:43:31,588 - INFO - Deleting pod ctest-non-default-78341712:ctest-pod-17302177 2024-09-03 17:43:31,589 - INFO - Deleting pod ctest-new-default-17943099:ctest-pod-67649545 2024-09-03 17:43:31,589 - INFO - Deleting pod ctest-new-default-17943099:ctest-pod-24670950 2024-09-03 17:43:31,590 - INFO - Deleting pod ctest-non-default-78341712:ctest-pod-82192191 2024-09-03 17:43:31,591 - INFO - Deleting pod ctest-non-default-78341712:ctest-pod-45139832 2024-09-03 17:43:31,753 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,753 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,754 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,754 - WARNING - Pod uuid 57b75ca8-e5e2-4a02-a6a5-b240b406345b is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,755 - WARNING - Pod uuid 2409adf0-1ea0-4f4f-8344-9de313ab4f36 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,756 - WARNING - Pod uuid 4e3540cb-e84a-4fc0-b121-a2ae8e02eb22 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,756 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:31,756 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:36,801 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:36,802 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:36,802 - DEBUG - Pod 2409adf0-1ea0-4f4f-8344-9de313ab4f36 is not in agent 10.0.0.22 VM list 2024-09-03 17:43:36,804 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:36,806 - DEBUG - Pod 57b75ca8-e5e2-4a02-a6a5-b240b406345b is not in agent 10.0.0.22 VM list 2024-09-03 17:43:36,807 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:36,808 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:36,808 - DEBUG - Pod 4e3540cb-e84a-4fc0-b121-a2ae8e02eb22 is not in agent 10.0.0.22 VM list 2024-09-03 17:43:36,823 - DEBUG - VMI 8f42acf6-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:43:36,823 - INFO - Verified that pod ctest-pod-18763930 is removed in agent 2024-09-03 17:43:36,824 - DEBUG - VMI 8fb94bcc-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:43:36,824 - INFO - Verified that pod ctest-pod-17302177 is removed in agent 2024-09-03 17:43:36,824 - DEBUG - VMI 8e27ae2a-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:43:36,824 - INFO - Verified that pod ctest-pod-16123599 is removed in agent 2024-09-03 17:43:41,822 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:41,824 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:41,824 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:41,825 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:41,825 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:46,843 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:46,844 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:46,846 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:46,846 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:46,846 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:51,866 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:51,866 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:51,868 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:51,868 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:51,868 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:56,886 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:56,889 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:56,890 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:56,890 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:43:56,891 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:44:01,916 - WARNING - Pod uuid cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is still seen in agent 10.0.0.22 VM list 2024-09-03 17:44:01,918 - WARNING - Pod uuid dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:44:01,919 - WARNING - Pod uuid e8088368-9097-4b3a-95f4-91e98f86b589 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:44:01,919 - WARNING - Pod uuid 51f78a4c-c866-4286-ae10-261cc9bdaa39 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:44:01,919 - WARNING - Pod uuid 11706f82-445e-4977-a199-f0f7a52ab104 is still seen in agent 10.0.0.22 VM list 2024-09-03 17:44:06,939 - DEBUG - Pod dd6b27ff-3d99-4f31-9545-cb85c027f9e6 is not in agent 10.0.0.22 VM list 2024-09-03 17:44:06,943 - DEBUG - Pod e8088368-9097-4b3a-95f4-91e98f86b589 is not in agent 10.0.0.22 VM list 2024-09-03 17:44:06,944 - DEBUG - Pod 11706f82-445e-4977-a199-f0f7a52ab104 is not in agent 10.0.0.22 VM list 2024-09-03 17:44:06,946 - DEBUG - Pod 51f78a4c-c866-4286-ae10-261cc9bdaa39 is not in agent 10.0.0.22 VM list 2024-09-03 17:44:06,947 - DEBUG - Pod cb6f2c50-cac7-4aa9-9aa6-624697d9a0cc is not in agent 10.0.0.22 VM list 2024-09-03 17:44:06,966 - DEBUG - VMI 917c869a-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:44:06,966 - INFO - Verified that pod ctest-pod-45139832 is removed in agent 2024-09-03 17:44:06,968 - DEBUG - VMI 90413bb8-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:44:06,968 - INFO - Verified that pod ctest-pod-67649545 is removed in agent 2024-09-03 17:44:06,969 - DEBUG - VMI 8ea3ae94-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:44:06,969 - INFO - Verified that pod ctest-pod-50803511 is removed in agent 2024-09-03 17:44:06,969 - DEBUG - VMI 9110d986-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:44:06,969 - INFO - Verified that pod ctest-pod-82192191 is removed in agent 2024-09-03 17:44:06,969 - DEBUG - VMI 90a8b63a-6a1b-11ef-a7c5-fa163ee58f17 is removed from agent 10.0.0.22 2024-09-03 17:44:06,969 - INFO - Verified that pod ctest-pod-24670950 is removed in agent 2024-09-03 17:44:06,969 - INFO - Deleting namespace ctest-non-default-78341712 2024-09-03 17:44:06,989 - DEBUG - Namespace ctest-non-default-78341712 still in k8s 2024-09-03 17:44:08,993 - DEBUG - Namespace ctest-non-default-78341712 still in k8s 2024-09-03 17:44:10,999 - DEBUG - Namespace ctest-non-default-78341712 still in k8s 2024-09-03 17:44:13,003 - DEBUG - Namespace ctest-non-default-78341712 is not in k8s 2024-09-03 17:44:13,003 - DEBUG - No need to check project deletion in contrail-api 2024-09-03 17:44:13,003 - INFO - Deleting namespace ctest-new-default-17943099 2024-09-03 17:44:13,016 - DEBUG - Namespace ctest-new-default-17943099 still in k8s 2024-09-03 17:44:15,022 - DEBUG - Namespace ctest-new-default-17943099 still in k8s 2024-09-03 17:44:17,027 - DEBUG - Namespace ctest-new-default-17943099 still in k8s 2024-09-03 17:44:19,032 - DEBUG - Namespace ctest-new-default-17943099 is not in k8s 2024-09-03 17:44:19,032 - DEBUG - No need to check project deletion in contrail-api