2024-08-21 19:46:22,758 - INFO - Using existing project ['default-domain', 'k8s-default'](5f8decb5-970e-4738-acfc-2b068e244617) 2024-08-21 19:46:22,774 - DEBUG - Namespace ctest-new-default-59455807 not present 2024-08-21 19:46:22,788 - INFO - Created namespace ctest-new-default-59455807 2024-08-21 19:46:25,797 - DEBUG - Namespace ctest-non-default-42654653 not present 2024-08-21 19:46:25,820 - INFO - Created namespace ctest-non-default-42654653 2024-08-21 19:46:28,841 - DEBUG - Pod ctest-pod-79156485 not present 2024-08-21 19:46:28,841 - INFO - Creating Pod ctest-pod-79156485 2024-08-21 19:46:28,868 - DEBUG - Pod : ctest-pod-79156485 UUID is 2a9e51e9-a947-4457-8484-7c66e1a4afe8 2024-08-21 19:46:28,871 - DEBUG - Pod ctest-pod-35401414 not present 2024-08-21 19:46:28,871 - INFO - Creating Pod ctest-pod-35401414 2024-08-21 19:46:28,915 - DEBUG - Pod : ctest-pod-35401414 UUID is 6a173104-88f8-4646-b05d-eac753923685 2024-08-21 19:46:28,918 - DEBUG - Pod ctest-pod-69808613 not present 2024-08-21 19:46:28,919 - INFO - Creating Pod ctest-pod-69808613 2024-08-21 19:46:28,955 - DEBUG - Pod : ctest-pod-69808613 UUID is 950b441d-9945-4985-be52-d14f86893a65 2024-08-21 19:46:28,957 - DEBUG - Pod ctest-pod-10630720 not present 2024-08-21 19:46:28,957 - INFO - Creating Pod ctest-pod-10630720 2024-08-21 19:46:28,978 - DEBUG - Pod : ctest-pod-10630720 UUID is d7d46709-71f8-44dc-bcb7-222f29c92ddc 2024-08-21 19:46:28,981 - DEBUG - Pod ctest-pod-99922589 not present 2024-08-21 19:46:28,982 - INFO - Creating Pod ctest-pod-99922589 2024-08-21 19:46:29,001 - DEBUG - Pod : ctest-pod-99922589 UUID is 138aa37d-24aa-4b6d-ba55-308e2e2602b9 2024-08-21 19:46:29,004 - DEBUG - Pod ctest-pod-23249776 not present 2024-08-21 19:46:29,004 - INFO - Creating Pod ctest-pod-23249776 2024-08-21 19:46:29,024 - DEBUG - Pod : ctest-pod-23249776 UUID is c36132d1-03c3-4ed8-8cfa-02f0cac65635 2024-08-21 19:46:29,026 - DEBUG - Pod ctest-pod-05042008 not present 2024-08-21 19:46:29,027 - INFO - Creating Pod ctest-pod-05042008 2024-08-21 19:46:29,067 - DEBUG - Pod : ctest-pod-05042008 UUID is 520eac88-45dd-4a61-b455-7fad41f5c8ff 2024-08-21 19:46:29,070 - DEBUG - Pod ctest-pod-33515876 not present 2024-08-21 19:46:29,071 - INFO - Creating Pod ctest-pod-33515876 2024-08-21 19:46:29,094 - DEBUG - Pod : ctest-pod-33515876 UUID is 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 2024-08-21 19:46:29,531 - INFO - Project default-domain:k8s-ctest-new-default-59455807 for Namespace ctest-new-default-59455807 is seen in contrail-api 2024-08-21 19:46:29,532 - DEBUG - Project uuid in Contrail is adf9d075-a87c-46cb-8698-f0821f29533b 2024-08-21 19:46:29,671 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NamespaceDatabaseList?namespace_uuid=0b40d97d-5d09-45b7-9b54-c6ce9e2f0dbd 2024-08-21 19:46:29,677 - INFO - Namespace ctest-new-default-59455807 with uuid 0b40d97d-5d09-45b7-9b54-c6ce9e2f0dbd found in kube manager 2024-08-21 19:46:29,677 - INFO - Namespace ctest-new-default-59455807 verification passed 2024-08-21 19:46:29,921 - INFO - Project default-domain:k8s-ctest-non-default-42654653 for Namespace ctest-non-default-42654653 is seen in contrail-api 2024-08-21 19:46:29,921 - DEBUG - Project uuid in Contrail is bc17be62-0b6f-41df-89a0-1e335afd693b 2024-08-21 19:46:29,921 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NamespaceDatabaseList?namespace_uuid=337e3f49-71e9-448f-b2a1-43c89e8560dc 2024-08-21 19:46:29,926 - INFO - Namespace ctest-non-default-42654653 with uuid 337e3f49-71e9-448f-b2a1-43c89e8560dc found in kube manager 2024-08-21 19:46:29,926 - INFO - Namespace ctest-non-default-42654653 verification passed 2024-08-21 19:46:29,932 - DEBUG - Pod ctest-pod-79156485 not in running state.Currently in Pending 2024-08-21 19:46:34,944 - DEBUG - Pod ctest-pod-79156485 not in running state.Currently in Pending 2024-08-21 19:46:39,956 - DEBUG - Pod ctest-pod-79156485 not in running state.Currently in Pending 2024-08-21 19:46:44,963 - DEBUG - Pod ctest-pod-79156485 not in running state.Currently in Pending 2024-08-21 19:46:49,971 - DEBUG - Pod ctest-pod-79156485 not in running state.Currently in Pending 2024-08-21 19:46:54,978 - INFO - Pod ctest-pod-79156485 is in running state.Got IP 10.47.255.251 2024-08-21 19:46:54,988 - DEBUG - Pod ctest-pod-79156485 has vmi 0fe16f1c-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:54,988 - INFO - Verified pod ctest-pod-79156485 in contrail-api 2024-08-21 19:46:55,002 - DEBUG - VMI 0fe16f1c-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,003 - INFO - Verified Pod ctest-pod-79156485 in agent 10.0.0.45 2024-08-21 19:46:55,003 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=2a9e51e9-a947-4457-8484-7c66e1a4afe8 2024-08-21 19:46:55,008 - INFO - Pod ctest-pod-79156485 with uuid 2a9e51e9-a947-4457-8484-7c66e1a4afe8 found in kube manager 2024-08-21 19:46:55,008 - INFO - Pod ctest-pod-79156485 verification passed 2024-08-21 19:46:55,013 - INFO - Pod ctest-pod-35401414 is in running state.Got IP 10.47.255.250 2024-08-21 19:46:55,063 - DEBUG - Pod ctest-pod-35401414 has vmi 103c936a-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,063 - INFO - Verified pod ctest-pod-35401414 in contrail-api 2024-08-21 19:46:55,076 - DEBUG - VMI 103c936a-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,077 - INFO - Verified Pod ctest-pod-35401414 in agent 10.0.0.45 2024-08-21 19:46:55,077 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=6a173104-88f8-4646-b05d-eac753923685 2024-08-21 19:46:55,081 - INFO - Pod ctest-pod-35401414 with uuid 6a173104-88f8-4646-b05d-eac753923685 found in kube manager 2024-08-21 19:46:55,081 - INFO - Pod ctest-pod-35401414 verification passed 2024-08-21 19:46:55,087 - INFO - Pod ctest-pod-69808613 is in running state.Got IP 10.47.255.249 2024-08-21 19:46:55,113 - DEBUG - Pod ctest-pod-69808613 has vmi 10d3406c-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,113 - INFO - Verified pod ctest-pod-69808613 in contrail-api 2024-08-21 19:46:55,126 - DEBUG - VMI 10d3406c-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,127 - INFO - Verified Pod ctest-pod-69808613 in agent 10.0.0.45 2024-08-21 19:46:55,127 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=950b441d-9945-4985-be52-d14f86893a65 2024-08-21 19:46:55,131 - INFO - Pod ctest-pod-69808613 with uuid 950b441d-9945-4985-be52-d14f86893a65 found in kube manager 2024-08-21 19:46:55,131 - INFO - Pod ctest-pod-69808613 verification passed 2024-08-21 19:46:55,136 - INFO - Pod ctest-pod-10630720 is in running state.Got IP 10.47.255.248 2024-08-21 19:46:55,190 - DEBUG - Pod ctest-pod-10630720 has vmi 114b1e7a-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,190 - INFO - Verified pod ctest-pod-10630720 in contrail-api 2024-08-21 19:46:55,203 - DEBUG - VMI 114b1e7a-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,203 - INFO - Verified Pod ctest-pod-10630720 in agent 10.0.0.45 2024-08-21 19:46:55,204 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=d7d46709-71f8-44dc-bcb7-222f29c92ddc 2024-08-21 19:46:55,209 - INFO - Pod ctest-pod-10630720 with uuid d7d46709-71f8-44dc-bcb7-222f29c92ddc found in kube manager 2024-08-21 19:46:55,209 - INFO - Pod ctest-pod-10630720 verification passed 2024-08-21 19:46:55,216 - INFO - Pod ctest-pod-99922589 is in running state.Got IP 10.47.255.247 2024-08-21 19:46:55,271 - DEBUG - Pod ctest-pod-99922589 has vmi 11d5d380-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,272 - INFO - Verified pod ctest-pod-99922589 in contrail-api 2024-08-21 19:46:55,286 - DEBUG - VMI 11d5d380-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,286 - INFO - Verified Pod ctest-pod-99922589 in agent 10.0.0.45 2024-08-21 19:46:55,286 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=138aa37d-24aa-4b6d-ba55-308e2e2602b9 2024-08-21 19:46:55,292 - INFO - Pod ctest-pod-99922589 with uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 found in kube manager 2024-08-21 19:46:55,292 - INFO - Pod ctest-pod-99922589 verification passed 2024-08-21 19:46:55,300 - INFO - Pod ctest-pod-05042008 is in running state.Got IP 10.47.255.245 2024-08-21 19:46:55,313 - DEBUG - Pod ctest-pod-05042008 has vmi 12a02d38-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,313 - INFO - Verified pod ctest-pod-05042008 in contrail-api 2024-08-21 19:46:55,329 - DEBUG - VMI 12a02d38-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,330 - INFO - Verified Pod ctest-pod-05042008 in agent 10.0.0.45 2024-08-21 19:46:55,330 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=520eac88-45dd-4a61-b455-7fad41f5c8ff 2024-08-21 19:46:55,335 - INFO - Pod ctest-pod-05042008 with uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff found in kube manager 2024-08-21 19:46:55,335 - INFO - Pod ctest-pod-05042008 verification passed 2024-08-21 19:46:55,342 - INFO - Pod ctest-pod-23249776 is in running state.Got IP 10.47.255.246 2024-08-21 19:46:55,396 - DEBUG - Pod ctest-pod-23249776 has vmi 1240b038-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,396 - INFO - Verified pod ctest-pod-23249776 in contrail-api 2024-08-21 19:46:55,419 - DEBUG - VMI 1240b038-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:55,420 - INFO - Verified Pod ctest-pod-23249776 in agent 10.0.0.45 2024-08-21 19:46:55,420 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=c36132d1-03c3-4ed8-8cfa-02f0cac65635 2024-08-21 19:46:55,425 - INFO - Pod ctest-pod-23249776 with uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 found in kube manager 2024-08-21 19:46:55,425 - INFO - Pod ctest-pod-23249776 verification passed 2024-08-21 19:46:55,430 - INFO - Pod ctest-pod-33515876 is in running state.Got IP 10.47.255.244 2024-08-21 19:46:55,446 - DEBUG - Pod ctest-pod-33515876 has vmi 13020f9e-5ff6-11ef-929b-fa163eefc9fe 2024-08-21 19:46:55,446 - INFO - Verified pod ctest-pod-33515876 in contrail-api 2024-08-21 19:46:56,665 - DEBUG - VMI 13020f9e-5ff6-11ef-929b-fa163eefc9fe is active in agent 10.0.0.45 2024-08-21 19:46:56,665 - INFO - Verified Pod ctest-pod-33515876 in agent 10.0.0.45 2024-08-21 19:46:56,666 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_VirtualMachineDatabaseList?x=8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 2024-08-21 19:46:56,671 - INFO - Pod ctest-pod-33515876 with uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 found in kube manager 2024-08-21 19:46:56,671 - INFO - Pod ctest-pod-33515876 verification passed 2024-08-21 19:46:56,671 - INFO - ================================================================================ 2024-08-21 19:46:56,672 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-21 19:46:56,672 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-21 19:46:56,931 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.44': '0'}} with 2024-08-21 19:46:56,931 - INFO - Initial checks done. Running the testcase now 2024-08-21 19:46:56,931 - INFO - 2024-08-21 19:46:56,987 - DEBUG - [Pod ctest-pod-79156485] Cmd: echo ctest-pod-79156485 > /usr/share/nginx/html/index.html, Output: 2024-08-21 19:46:57,063 - DEBUG - [Pod ctest-pod-35401414] Cmd: echo ctest-pod-35401414 > /usr/share/nginx/html/index.html, Output: 2024-08-21 19:46:57,123 - DEBUG - [Pod ctest-pod-69808613] Cmd: echo ctest-pod-69808613 > /usr/share/nginx/html/index.html, Output: 2024-08-21 19:46:57,206 - DEBUG - [Pod ctest-pod-10630720] Cmd: echo ctest-pod-10630720 > /usr/share/nginx/html/index.html, Output: 2024-08-21 19:46:57,210 - DEBUG - Service ctest-nginx-svc-43644967 not present 2024-08-21 19:46:57,210 - INFO - Creating service ctest-nginx-svc-43644967 2024-08-21 19:46:57,231 - INFO - Created Service ctest-nginx-svc-43644967 2024-08-21 19:46:57,268 - WARNING - Service UUID 3922d552-d327-4298-b213-1638cf967fbd not yet found in contrail-api 2024-08-21 19:46:58,275 - INFO - Validated that Service ctest-nginx-svc-43644967 is seen in contrail-api 2024-08-21 19:46:58,275 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_LoadbalancerDatabaseList?x=3922d552-d327-4298-b213-1638cf967fbd 2024-08-21 19:46:58,280 - INFO - Service ctest-nginx-svc-43644967 with uuid 3922d552-d327-4298-b213-1638cf967fbd found in kube manager 2024-08-21 19:46:58,280 - INFO - Service ctest-nginx-svc-43644967 verification passed 2024-08-21 19:46:58,343 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,343 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,343 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,411 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,412 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,412 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,478 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-35401414 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,479 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,479 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-35401414 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,548 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-35401414 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,548 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,548 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-35401414 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,594 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35401414 2024-08-21 19:46:58,594 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,595 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35401414 2024-08-21 19:46:58,661 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,661 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,661 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,726 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,726 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,726 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:46:58,727 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79156485': 1, 'ctest-pod-35401414': 6} 2024-08-21 19:46:58,799 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-79156485 2024-08-21 19:46:58,799 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,800 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-79156485 2024-08-21 19:46:58,854 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35401414 2024-08-21 19:46:58,854 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:46:58,854 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35401414 2024-08-21 19:46:58,854 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79156485': 1, 'ctest-pod-35401414': 1} 2024-08-21 19:46:58,857 - DEBUG - Network policy ingress-on-service not present 2024-08-21 19:46:58,858 - INFO - Creating Network Policy ingress-on-service 2024-08-21 19:46:58,881 - INFO - Network policy found in k8s 2024-08-21 19:46:58,881 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fc9b4d-60b9-4556-b7a9-d7d253c17af0 2024-08-21 19:46:58,886 - INFO - Network Policy ingress-on-service with uuid f4fc9b4d-60b9-4556-b7a9-d7d253c17af0 found in kube manager 2024-08-21 19:46:58,919 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-21 19:46:58,919 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-21 19:46:58,919 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fc9b4d-60b9-4556-b7a9-d7d253c17af0 2024-08-21 19:46:58,951 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-21 19:47:00,952 - DEBUG - Requesting: http://10.0.0.44:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fc9b4d-60b9-4556-b7a9-d7d253c17af0 2024-08-21 19:47:01,000 - INFO - Network policy with name ingress-on-service found in agent 2024-08-21 19:47:01,001 - INFO - Network Policy ingress-on-service verification passed 2024-08-21 19:47:06,051 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:06,051 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:06,051 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:11,109 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:11,109 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:11,109 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:16,161 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:16,161 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:16,161 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:35,903 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:35,903 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:35,903 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:40,966 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:40,967 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:40,967 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:46,045 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:46,046 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:46,046 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:51,113 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:51,113 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:51,113 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:56,190 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:56,190 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:47:56,190 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:01,248 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:01,248 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:01,248 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:06,309 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:06,310 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:06,310 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:06,310 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79156485': 0, 'ctest-pod-35401414': 0} 2024-08-21 19:48:06,369 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:48:06,369 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:48:06,369 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:48:06,443 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-79156485 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:48:06,443 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:48:06,443 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-79156485 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:48:06,443 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79156485': 1, 'ctest-pod-35401414': 1} 2024-08-21 19:48:11,501 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:11,502 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:11,502 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:16,545 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:16,546 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:16,546 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:21,597 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:21,597 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:21,597 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:26,669 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:26,669 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:26,669 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:31,729 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:31,729 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:31,729 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:36,795 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:36,795 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:36,795 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:41,864 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:41,864 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:41,864 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:46,923 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:46,923 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:46,923 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:51,994 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:51,994 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:51,994 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:57,060 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:57,060 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:57,060 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:48:57,060 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79156485': 0, 'ctest-pod-35401414': 0} 2024-08-21 19:48:59,151 - DEBUG - [Pod ctest-pod-23249776] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.462 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.543/1.462 ms 2024-08-21 19:48:59,151 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-23249776 with expectation True passed 2024-08-21 19:49:01,220 - DEBUG - [Pod ctest-pod-99922589] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.300 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.485/1.300 ms 2024-08-21 19:49:01,220 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99922589 with expectation True passed 2024-08-21 19:49:03,284 - DEBUG - [Pod ctest-pod-05042008] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.441 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.123 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.119/0.561/1.441 ms 2024-08-21 19:49:03,284 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05042008 with expectation True passed 2024-08-21 19:49:03,357 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:49:03,357 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-21 19:49:03,357 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:49:03,357 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23249776 passed 2024-08-21 19:49:03,429 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:49:03,429 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-21 19:49:03,429 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:49:03,429 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23249776 passed 2024-08-21 19:49:08,481 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 19:49:08,481 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 19:49:08,481 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 19:49:08,481 - INFO - wget check of of http://10.47.255.250 from ctest-pod-99922589 passed 2024-08-21 19:49:13,562 - DEBUG - [Pod ctest-pod-33515876] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-21 19:49:13,562 - DEBUG - [Pod Pod ctest-pod-33515876] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-21 19:49:13,562 - DEBUG - [Pod Pod ctest-pod-33515876] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-21 19:49:13,562 - INFO - wget check of of http://10.47.255.251 from ctest-pod-33515876 passed 2024-08-21 19:49:13,570 - INFO - Updating Network Policy ingress-on-service 2024-08-21 19:49:18,637 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:18,637 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:18,637 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:23,696 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:23,697 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:23,697 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:28,748 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:28,749 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:28,749 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:33,800 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:33,800 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:33,800 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:38,869 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:38,869 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:38,869 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:43,945 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:43,945 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:43,945 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:55,716 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:55,716 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:49:55,716 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:00,794 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:00,794 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:00,794 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:05,880 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:05,880 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:05,880 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:10,942 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:10,942 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:10,942 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) wget: download timed out 2024-08-21 19:50:10,942 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79156485': 0, 'ctest-pod-35401414': 0} 2024-08-21 19:50:11,006 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,007 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,007 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,069 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,069 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,069 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,120 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-35401414 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,120 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,120 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) ctest-pod-35401414 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,121 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79156485': 2, 'ctest-pod-35401414': 1} 2024-08-21 19:50:11,186 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,186 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,186 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,249 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,249 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,249 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,311 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,311 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,311 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: ctest-pod-35401414 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,379 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35401414 2024-08-21 19:50:11,379 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,379 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35401414 2024-08-21 19:50:11,454 - DEBUG - [Pod ctest-pod-05042008] Cmd: wget http://10.105.148.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,454 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd wget http://10.105.148.105:80/ -O - -T 5 -t 1 passed 2024-08-21 19:50:11,454 - DEBUG - [Pod Pod ctest-pod-05042008] Cmd output: ctest-pod-79156485 Connecting to 10.105.148.105:80 (10.105.148.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 19:50:11,454 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79156485': 1, 'ctest-pod-35401414': 4} 2024-08-21 19:50:13,512 - DEBUG - [Pod ctest-pod-23249776] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.857 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.348/0.857 ms 2024-08-21 19:50:13,512 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-23249776 with expectation True passed 2024-08-21 19:50:15,575 - DEBUG - [Pod ctest-pod-99922589] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.137 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.116 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.442/1.137 ms 2024-08-21 19:50:15,575 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99922589 with expectation True passed 2024-08-21 19:50:17,635 - DEBUG - [Pod ctest-pod-05042008] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.681 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.277/0.681 ms 2024-08-21 19:50:17,635 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05042008 with expectation True passed 2024-08-21 19:50:17,702 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:50:17,702 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-21 19:50:17,702 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:50:17,702 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23249776 passed 2024-08-21 19:50:17,759 - DEBUG - [Pod ctest-pod-23249776] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:50:17,759 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-21 19:50:17,759 - DEBUG - [Pod Pod ctest-pod-23249776] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:50:17,759 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23249776 passed 2024-08-21 19:50:22,815 - DEBUG - [Pod ctest-pod-99922589] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 19:50:22,815 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 19:50:22,815 - DEBUG - [Pod Pod ctest-pod-99922589] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 19:50:22,815 - INFO - wget check of of http://10.47.255.250 from ctest-pod-99922589 passed 2024-08-21 19:50:22,867 - DEBUG - [Pod ctest-pod-33515876] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:50:22,867 - DEBUG - [Pod Pod ctest-pod-33515876] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-21 19:50:22,867 - DEBUG - [Pod Pod ctest-pod-33515876] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 19:50:22,867 - INFO - wget check of of http://10.47.255.251 from ctest-pod-33515876 passed 2024-08-21 19:50:22,867 - INFO - Deleting Network Policy : ingress-on-service 2024-08-21 19:50:22,868 - INFO - Deleting service : ctest-nginx-svc-43644967 2024-08-21 19:50:23,109 - DEBUG - No XMPP flaps were noticed during the test
2024-08-21 19:50:23,109 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:27]
2024-08-21 19:50:23,109 - INFO - -------------------------------------------------------------------------------- 2024-08-21 19:50:23,116 - INFO - Deleting pod ctest-new-default-59455807:ctest-pod-79156485 2024-08-21 19:50:23,117 - INFO - Deleting pod ctest-new-default-59455807:ctest-pod-35401414 2024-08-21 19:50:23,117 - INFO - Deleting pod ctest-non-default-42654653:ctest-pod-69808613 2024-08-21 19:50:23,118 - INFO - Deleting pod ctest-non-default-42654653:ctest-pod-10630720 2024-08-21 19:50:23,118 - INFO - Deleting pod ctest-new-default-59455807:ctest-pod-99922589 2024-08-21 19:50:23,118 - INFO - Deleting pod ctest-new-default-59455807:ctest-pod-23249776 2024-08-21 19:50:23,119 - INFO - Deleting pod ctest-non-default-42654653:ctest-pod-05042008 2024-08-21 19:50:23,119 - INFO - Deleting pod ctest-non-default-42654653:ctest-pod-33515876 2024-08-21 19:50:23,250 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,250 - WARNING - Pod uuid d7d46709-71f8-44dc-bcb7-222f29c92ddc is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,251 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,252 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,253 - WARNING - Pod uuid 6a173104-88f8-4646-b05d-eac753923685 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,253 - WARNING - Pod uuid 2a9e51e9-a947-4457-8484-7c66e1a4afe8 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,253 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:23,254 - WARNING - Pod uuid 950b441d-9945-4985-be52-d14f86893a65 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:28,283 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:28,286 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:28,286 - DEBUG - Pod 950b441d-9945-4985-be52-d14f86893a65 is not in agent 10.0.0.45 VM list 2024-08-21 19:50:28,288 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:28,288 - DEBUG - Pod 2a9e51e9-a947-4457-8484-7c66e1a4afe8 is not in agent 10.0.0.45 VM list 2024-08-21 19:50:28,289 - DEBUG - Pod 6a173104-88f8-4646-b05d-eac753923685 is not in agent 10.0.0.45 VM list 2024-08-21 19:50:28,291 - DEBUG - Pod d7d46709-71f8-44dc-bcb7-222f29c92ddc is not in agent 10.0.0.45 VM list 2024-08-21 19:50:28,293 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:28,306 - DEBUG - VMI 0fe16f1c-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:28,306 - INFO - Verified that pod ctest-pod-79156485 is removed in agent 2024-08-21 19:50:28,308 - DEBUG - VMI 103c936a-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:28,308 - INFO - Verified that pod ctest-pod-35401414 is removed in agent 2024-08-21 19:50:28,309 - DEBUG - VMI 114b1e7a-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:28,309 - INFO - Verified that pod ctest-pod-10630720 is removed in agent 2024-08-21 19:50:28,309 - DEBUG - VMI 10d3406c-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:28,309 - INFO - Verified that pod ctest-pod-69808613 is removed in agent 2024-08-21 19:50:33,304 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:33,305 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:33,306 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:33,306 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:38,323 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:38,325 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:38,325 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:38,326 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:43,341 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:43,343 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:43,343 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:43,343 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:48,360 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:48,362 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:48,363 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:48,363 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:53,393 - WARNING - Pod uuid 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:53,395 - WARNING - Pod uuid 520eac88-45dd-4a61-b455-7fad41f5c8ff is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:53,396 - WARNING - Pod uuid 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:53,396 - WARNING - Pod uuid c36132d1-03c3-4ed8-8cfa-02f0cac65635 is still seen in agent 10.0.0.45 VM list 2024-08-21 19:50:58,402 - DEBUG - Pod 8820dfb6-f8b6-4fcc-bc58-9944f3d225b6 is not in agent 10.0.0.45 VM list 2024-08-21 19:50:58,414 - DEBUG - Pod 520eac88-45dd-4a61-b455-7fad41f5c8ff is not in agent 10.0.0.45 VM list 2024-08-21 19:50:58,418 - DEBUG - VMI 13020f9e-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:58,418 - INFO - Verified that pod ctest-pod-33515876 is removed in agent 2024-08-21 19:50:58,418 - DEBUG - Pod c36132d1-03c3-4ed8-8cfa-02f0cac65635 is not in agent 10.0.0.45 VM list 2024-08-21 19:50:58,420 - DEBUG - Pod 138aa37d-24aa-4b6d-ba55-308e2e2602b9 is not in agent 10.0.0.45 VM list 2024-08-21 19:50:58,429 - DEBUG - VMI 11d5d380-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:58,429 - INFO - Verified that pod ctest-pod-99922589 is removed in agent 2024-08-21 19:50:58,430 - DEBUG - VMI 1240b038-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:58,430 - INFO - Verified that pod ctest-pod-23249776 is removed in agent 2024-08-21 19:50:58,718 - DEBUG - VMI 12a02d38-5ff6-11ef-929b-fa163eefc9fe is removed from agent 10.0.0.45 2024-08-21 19:50:58,718 - INFO - Verified that pod ctest-pod-05042008 is removed in agent 2024-08-21 19:50:58,718 - INFO - Deleting namespace ctest-non-default-42654653 2024-08-21 19:50:58,739 - DEBUG - Namespace ctest-non-default-42654653 still in k8s 2024-08-21 19:51:00,743 - DEBUG - Namespace ctest-non-default-42654653 still in k8s 2024-08-21 19:51:02,747 - DEBUG - Namespace ctest-non-default-42654653 still in k8s 2024-08-21 19:51:04,751 - DEBUG - Namespace ctest-non-default-42654653 is not in k8s 2024-08-21 19:51:04,752 - DEBUG - No need to check project deletion in contrail-api 2024-08-21 19:51:04,752 - INFO - Deleting namespace ctest-new-default-59455807 2024-08-21 19:51:04,760 - DEBUG - Namespace ctest-new-default-59455807 still in k8s 2024-08-21 19:51:06,764 - DEBUG - Namespace ctest-new-default-59455807 still in k8s 2024-08-21 19:51:08,770 - DEBUG - Namespace ctest-new-default-59455807 still in k8s 2024-08-21 19:51:10,774 - DEBUG - Namespace ctest-new-default-59455807 is not in k8s 2024-08-21 19:51:10,774 - DEBUG - No need to check project deletion in contrail-api