2025-01-08 12:00:25,113 - INFO - Using existing project ['default-domain', 'k8s-default'](cf72eb8b-8868-4c1c-b964-7e5eb7f8ebad) 2025-01-08 12:00:25,147 - DEBUG - Namespace ctest-new-default-86040091 not present 2025-01-08 12:00:25,168 - INFO - Created namespace ctest-new-default-86040091 2025-01-08 12:00:28,174 - DEBUG - Namespace ctest-non-default-42803770 not present 2025-01-08 12:00:28,191 - INFO - Created namespace ctest-non-default-42803770 2025-01-08 12:00:31,215 - DEBUG - Pod ctest-pod-94336338 not present 2025-01-08 12:00:31,215 - INFO - Creating Pod ctest-pod-94336338 2025-01-08 12:00:31,273 - DEBUG - Pod : ctest-pod-94336338 UUID is 95458b20-533f-415f-99ce-628cf405a4e9 2025-01-08 12:00:31,276 - DEBUG - Pod ctest-pod-38487483 not present 2025-01-08 12:00:31,277 - INFO - Creating Pod ctest-pod-38487483 2025-01-08 12:00:31,305 - DEBUG - Pod : ctest-pod-38487483 UUID is 58153549-6911-4ee8-a0c7-48f0f96743ec 2025-01-08 12:00:31,308 - DEBUG - Pod ctest-pod-64508868 not present 2025-01-08 12:00:31,309 - INFO - Creating Pod ctest-pod-64508868 2025-01-08 12:00:31,349 - DEBUG - Pod : ctest-pod-64508868 UUID is ccc00349-e00c-45c1-b3ed-cc9f3506c9c9 2025-01-08 12:00:31,352 - DEBUG - Pod ctest-pod-76456690 not present 2025-01-08 12:00:31,352 - INFO - Creating Pod ctest-pod-76456690 2025-01-08 12:00:31,374 - DEBUG - Pod : ctest-pod-76456690 UUID is fecc91be-43b8-482c-b6b0-b278a5276a0e 2025-01-08 12:00:31,383 - DEBUG - Pod ctest-pod-17900989 not present 2025-01-08 12:00:31,383 - INFO - Creating Pod ctest-pod-17900989 2025-01-08 12:00:31,415 - DEBUG - Pod : ctest-pod-17900989 UUID is 098d23af-964e-4e7b-b8a5-229157d4cfae 2025-01-08 12:00:31,419 - DEBUG - Pod ctest-pod-67777404 not present 2025-01-08 12:00:31,419 - INFO - Creating Pod ctest-pod-67777404 2025-01-08 12:00:31,448 - DEBUG - Pod : ctest-pod-67777404 UUID is 40f2dd29-6ab1-4664-a507-e161e98fd23a 2025-01-08 12:00:31,453 - DEBUG - Pod ctest-pod-35881376 not present 2025-01-08 12:00:31,453 - INFO - Creating Pod ctest-pod-35881376 2025-01-08 12:00:31,478 - DEBUG - Pod : ctest-pod-35881376 UUID is 6d9a0481-34c2-48a1-a457-a9dd1f09c203 2025-01-08 12:00:31,481 - DEBUG - Pod ctest-pod-29900628 not present 2025-01-08 12:00:31,482 - INFO - Creating Pod ctest-pod-29900628 2025-01-08 12:00:31,521 - DEBUG - Pod : ctest-pod-29900628 UUID is e29aee4a-8fd2-45b4-bebc-783feedc7586 2025-01-08 12:00:31,723 - INFO - Project default-domain:k8s-ctest-new-default-86040091 for Namespace ctest-new-default-86040091 is seen in contrail-api 2025-01-08 12:00:31,723 - DEBUG - Project uuid in Contrail is b611f4b0-580e-4091-8a58-d2bad3508aee 2025-01-08 12:00:31,943 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=0e8bf92d-984f-4ebb-84eb-cd5f5416d36f 2025-01-08 12:00:31,956 - INFO - Namespace ctest-new-default-86040091 with uuid 0e8bf92d-984f-4ebb-84eb-cd5f5416d36f found in kube manager 2025-01-08 12:00:31,956 - INFO - Namespace ctest-new-default-86040091 verification passed 2025-01-08 12:00:32,204 - INFO - Project default-domain:k8s-ctest-non-default-42803770 for Namespace ctest-non-default-42803770 is seen in contrail-api 2025-01-08 12:00:32,204 - DEBUG - Project uuid in Contrail is d0a04e57-79de-4514-89e9-fa7909c40f7e 2025-01-08 12:00:32,204 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=d6c5eb41-636c-4906-b7ad-e7d02e637d66 2025-01-08 12:00:32,213 - INFO - Namespace ctest-non-default-42803770 with uuid d6c5eb41-636c-4906-b7ad-e7d02e637d66 found in kube manager 2025-01-08 12:00:32,213 - INFO - Namespace ctest-non-default-42803770 verification passed 2025-01-08 12:00:32,219 - DEBUG - Pod ctest-pod-94336338 not in running state.Currently in Pending 2025-01-08 12:00:37,230 - DEBUG - Pod ctest-pod-94336338 not in running state.Currently in Pending 2025-01-08 12:00:42,239 - DEBUG - Pod ctest-pod-94336338 not in running state.Currently in Pending 2025-01-08 12:00:47,248 - INFO - Pod ctest-pod-94336338 is in running state.Got IP 10.47.255.251 2025-01-08 12:00:47,307 - DEBUG - Pod ctest-pod-94336338 has vmi 2a0acfe8-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:47,307 - INFO - Verified pod ctest-pod-94336338 in contrail-api 2025-01-08 12:00:47,324 - DEBUG - VMI 2a0acfe8-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:47,324 - INFO - Verified Pod ctest-pod-94336338 in agent 10.0.0.34 2025-01-08 12:00:47,325 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=95458b20-533f-415f-99ce-628cf405a4e9 2025-01-08 12:00:47,330 - INFO - Pod ctest-pod-94336338 with uuid 95458b20-533f-415f-99ce-628cf405a4e9 found in kube manager 2025-01-08 12:00:47,331 - INFO - Pod ctest-pod-94336338 verification passed 2025-01-08 12:00:47,339 - INFO - Pod ctest-pod-38487483 is in running state.Got IP 10.47.255.250 2025-01-08 12:00:47,375 - DEBUG - Pod ctest-pod-38487483 has vmi 2ae2c682-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:47,375 - INFO - Verified pod ctest-pod-38487483 in contrail-api 2025-01-08 12:00:47,391 - DEBUG - VMI 2ae2c682-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:47,391 - INFO - Verified Pod ctest-pod-38487483 in agent 10.0.0.34 2025-01-08 12:00:47,391 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=58153549-6911-4ee8-a0c7-48f0f96743ec 2025-01-08 12:00:47,398 - INFO - Pod ctest-pod-38487483 with uuid 58153549-6911-4ee8-a0c7-48f0f96743ec found in kube manager 2025-01-08 12:00:47,398 - INFO - Pod ctest-pod-38487483 verification passed 2025-01-08 12:00:47,404 - INFO - Pod ctest-pod-64508868 is in running state.Got IP 10.47.255.249 2025-01-08 12:00:47,465 - DEBUG - Pod ctest-pod-64508868 has vmi 2ba5ccae-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:47,465 - INFO - Verified pod ctest-pod-64508868 in contrail-api 2025-01-08 12:00:47,480 - DEBUG - VMI 2ba5ccae-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:47,481 - INFO - Verified Pod ctest-pod-64508868 in agent 10.0.0.34 2025-01-08 12:00:47,481 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=ccc00349-e00c-45c1-b3ed-cc9f3506c9c9 2025-01-08 12:00:47,486 - INFO - Pod ctest-pod-64508868 with uuid ccc00349-e00c-45c1-b3ed-cc9f3506c9c9 found in kube manager 2025-01-08 12:00:47,486 - INFO - Pod ctest-pod-64508868 verification passed 2025-01-08 12:00:47,493 - DEBUG - Pod ctest-pod-76456690 not in running state.Currently in Pending 2025-01-08 12:00:52,501 - INFO - Pod ctest-pod-76456690 is in running state.Got IP 10.47.255.248 2025-01-08 12:00:52,529 - DEBUG - Pod ctest-pod-76456690 has vmi 2c424958-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:52,529 - INFO - Verified pod ctest-pod-76456690 in contrail-api 2025-01-08 12:00:52,548 - DEBUG - VMI 2c424958-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:52,549 - INFO - Verified Pod ctest-pod-76456690 in agent 10.0.0.34 2025-01-08 12:00:52,549 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=fecc91be-43b8-482c-b6b0-b278a5276a0e 2025-01-08 12:00:52,560 - INFO - Pod ctest-pod-76456690 with uuid fecc91be-43b8-482c-b6b0-b278a5276a0e found in kube manager 2025-01-08 12:00:52,560 - INFO - Pod ctest-pod-76456690 verification passed 2025-01-08 12:00:52,573 - INFO - Pod ctest-pod-17900989 is in running state.Got IP 10.47.255.247 2025-01-08 12:00:52,660 - DEBUG - Pod ctest-pod-17900989 has vmi 2d038578-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:52,660 - INFO - Verified pod ctest-pod-17900989 in contrail-api 2025-01-08 12:00:52,699 - DEBUG - VMI 2d038578-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:52,699 - INFO - Verified Pod ctest-pod-17900989 in agent 10.0.0.34 2025-01-08 12:00:52,699 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=098d23af-964e-4e7b-b8a5-229157d4cfae 2025-01-08 12:00:52,714 - INFO - Pod ctest-pod-17900989 with uuid 098d23af-964e-4e7b-b8a5-229157d4cfae found in kube manager 2025-01-08 12:00:52,714 - INFO - Pod ctest-pod-17900989 verification passed 2025-01-08 12:00:52,724 - INFO - Pod ctest-pod-35881376 is in running state.Got IP 10.47.255.245 2025-01-08 12:00:52,758 - DEBUG - Pod ctest-pod-35881376 has vmi 2e2ce444-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:52,758 - INFO - Verified pod ctest-pod-35881376 in contrail-api 2025-01-08 12:00:52,778 - DEBUG - VMI 2e2ce444-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:52,778 - INFO - Verified Pod ctest-pod-35881376 in agent 10.0.0.34 2025-01-08 12:00:52,779 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=6d9a0481-34c2-48a1-a457-a9dd1f09c203 2025-01-08 12:00:52,787 - INFO - Pod ctest-pod-35881376 with uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 found in kube manager 2025-01-08 12:00:52,788 - INFO - Pod ctest-pod-35881376 verification passed 2025-01-08 12:00:52,800 - INFO - Pod ctest-pod-67777404 is in running state.Got IP 10.47.255.246 2025-01-08 12:00:52,829 - DEBUG - Pod ctest-pod-67777404 has vmi 2d8fcc04-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:52,829 - INFO - Verified pod ctest-pod-67777404 in contrail-api 2025-01-08 12:00:52,848 - DEBUG - VMI 2d8fcc04-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:52,849 - INFO - Verified Pod ctest-pod-67777404 in agent 10.0.0.34 2025-01-08 12:00:52,850 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=40f2dd29-6ab1-4664-a507-e161e98fd23a 2025-01-08 12:00:52,859 - INFO - Pod ctest-pod-67777404 with uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a found in kube manager 2025-01-08 12:00:52,860 - INFO - Pod ctest-pod-67777404 verification passed 2025-01-08 12:00:52,869 - INFO - Pod ctest-pod-29900628 is in running state.Got IP 10.47.255.244 2025-01-08 12:00:52,935 - DEBUG - Pod ctest-pod-29900628 has vmi 2ebc6394-cdb8-11ef-882f-fa163eb2dec0 2025-01-08 12:00:52,935 - INFO - Verified pod ctest-pod-29900628 in contrail-api 2025-01-08 12:00:52,957 - DEBUG - VMI 2ebc6394-cdb8-11ef-882f-fa163eb2dec0 is active in agent 10.0.0.34 2025-01-08 12:00:52,958 - INFO - Verified Pod ctest-pod-29900628 in agent 10.0.0.34 2025-01-08 12:00:52,958 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=e29aee4a-8fd2-45b4-bebc-783feedc7586 2025-01-08 12:00:52,968 - INFO - Pod ctest-pod-29900628 with uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 found in kube manager 2025-01-08 12:00:52,968 - INFO - Pod ctest-pod-29900628 verification passed 2025-01-08 12:00:52,968 - INFO - ================================================================================ 2025-01-08 12:00:52,968 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-08 12:00:52,968 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-08 12:00:53,228 - DEBUG - Nothing to compare xmpp stats {'10.0.0.34': {'10.0.0.24': '0'}} with 2025-01-08 12:00:53,228 - INFO - Initial checks done. Running the testcase now 2025-01-08 12:00:53,228 - INFO - 2025-01-08 12:00:53,300 - DEBUG - [Pod ctest-pod-94336338] Cmd: echo ctest-pod-94336338 > /usr/share/nginx/html/index.html, Output: 2025-01-08 12:00:53,357 - DEBUG - [Pod ctest-pod-38487483] Cmd: echo ctest-pod-38487483 > /usr/share/nginx/html/index.html, Output: 2025-01-08 12:00:53,420 - DEBUG - [Pod ctest-pod-64508868] Cmd: echo ctest-pod-64508868 > /usr/share/nginx/html/index.html, Output: 2025-01-08 12:00:53,490 - DEBUG - [Pod ctest-pod-76456690] Cmd: echo ctest-pod-76456690 > /usr/share/nginx/html/index.html, Output: 2025-01-08 12:00:53,504 - DEBUG - Service ctest-nginx-svc-95168387 not present 2025-01-08 12:00:53,504 - INFO - Creating service ctest-nginx-svc-95168387 2025-01-08 12:00:53,525 - INFO - Created Service ctest-nginx-svc-95168387 2025-01-08 12:00:53,563 - WARNING - Service UUID 44efc91b-2e37-4ec6-9715-5514a93ca771 not yet found in contrail-api 2025-01-08 12:00:54,602 - INFO - Validated that Service ctest-nginx-svc-95168387 is seen in contrail-api 2025-01-08 12:00:54,602 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=44efc91b-2e37-4ec6-9715-5514a93ca771 2025-01-08 12:00:54,610 - INFO - Service ctest-nginx-svc-95168387 with uuid 44efc91b-2e37-4ec6-9715-5514a93ca771 found in kube manager 2025-01-08 12:00:54,610 - INFO - Service ctest-nginx-svc-95168387 verification passed 2025-01-08 12:00:55,709 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:00:55,709 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:55,709 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:00:55,769 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:55,772 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:55,772 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:55,825 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:55,825 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:55,825 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:55,879 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38487483 2025-01-08 12:00:55,879 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:55,880 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38487483 2025-01-08 12:00:55,880 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94336338': 3, 'ctest-pod-38487483': 1} 2025-01-08 12:00:55,949 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:55,949 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:55,949 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:56,007 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:00:56,007 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:56,007 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:00:56,067 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-38487483 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:56,067 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:00:56,067 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: ctest-pod-38487483 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:00:56,067 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94336338': 2, 'ctest-pod-38487483': 1} 2025-01-08 12:00:56,072 - DEBUG - Network policy ingress-on-service not present 2025-01-08 12:00:56,072 - INFO - Creating Network Policy ingress-on-service 2025-01-08 12:00:56,089 - INFO - Network policy found in k8s 2025-01-08 12:00:56,089 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fc576a0f-84dd-48e9-b77e-77b53323e6e4 2025-01-08 12:00:56,102 - INFO - Network Policy ingress-on-service with uuid fc576a0f-84dd-48e9-b77e-77b53323e6e4 found in kube manager 2025-01-08 12:00:56,155 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-08 12:00:56,155 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-08 12:00:56,156 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fc576a0f-84dd-48e9-b77e-77b53323e6e4 2025-01-08 12:00:56,190 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-08 12:00:58,192 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fc576a0f-84dd-48e9-b77e-77b53323e6e4 2025-01-08 12:00:58,230 - INFO - Network policy with name ingress-on-service found in agent 2025-01-08 12:00:58,230 - INFO - Network Policy ingress-on-service verification passed 2025-01-08 12:01:03,282 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:03,282 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:03,282 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:08,348 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:08,348 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:08,348 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:13,558 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:13,558 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:13,558 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:18,637 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:18,638 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:18,638 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:23,706 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:23,706 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:23,706 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:28,762 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:28,763 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:28,763 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:33,832 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:33,832 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:33,832 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:38,898 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:38,898 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:38,898 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:43,952 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:43,952 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:43,953 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:49,009 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:49,009 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:49,010 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:49,010 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94336338': 0, 'ctest-pod-38487483': 0} 2025-01-08 12:01:49,089 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,090 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:01:49,090 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,145 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,145 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:01:49,145 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,207 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,207 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:01:49,207 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,266 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:01:49,266 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:01:49,266 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:01:49,335 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,335 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:01:49,335 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:01:49,407 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38487483 2025-01-08 12:01:49,407 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:01:49,407 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38487483 2025-01-08 12:01:49,407 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94336338': 5, 'ctest-pod-38487483': 1} 2025-01-08 12:01:54,471 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:54,471 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:54,471 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:59,518 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:59,519 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:01:59,519 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:02,647 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-08 12:02:12,719 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:12,719 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:12,720 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:17,772 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:17,772 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:17,772 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:22,838 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:22,838 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:22,838 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:27,916 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:27,917 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:27,917 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:32,973 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:32,973 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:32,973 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:38,037 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:38,037 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:38,038 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:43,101 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:43,101 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:43,101 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:48,153 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:48,153 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:48,153 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:02:48,154 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94336338': 0, 'ctest-pod-38487483': 0} 2025-01-08 12:02:50,204 - DEBUG - [Pod ctest-pod-67777404] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.273 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.087 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.476/1.273 ms 2025-01-08 12:02:50,205 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67777404 with expectation True passed 2025-01-08 12:02:52,266 - DEBUG - [Pod ctest-pod-17900989] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.081 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.406/1.081 ms 2025-01-08 12:02:52,266 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17900989 with expectation True passed 2025-01-08 12:02:54,339 - DEBUG - [Pod ctest-pod-35881376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.596 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.247/0.596 ms 2025-01-08 12:02:54,339 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35881376 with expectation True passed 2025-01-08 12:02:54,407 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:02:54,407 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 12:02:54,407 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:02:54,407 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67777404 passed 2025-01-08 12:02:54,472 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:02:54,472 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-08 12:02:54,472 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:02:54,472 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67777404 passed 2025-01-08 12:02:59,539 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 12:02:59,540 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 12:02:59,540 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 12:02:59,540 - INFO - wget check of of http://10.47.255.250 from ctest-pod-17900989 passed 2025-01-08 12:03:04,616 - DEBUG - [Pod ctest-pod-29900628] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 12:03:04,616 - DEBUG - [Pod Pod ctest-pod-29900628] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 12:03:04,616 - DEBUG - [Pod Pod ctest-pod-29900628] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-08 12:03:04,616 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29900628 passed 2025-01-08 12:03:04,626 - INFO - Updating Network Policy ingress-on-service 2025-01-08 12:03:09,699 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:09,699 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:09,699 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:14,755 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:14,755 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:14,755 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:19,811 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:19,811 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:19,811 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:24,861 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:24,861 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:24,861 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:29,923 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:29,923 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:29,923 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:34,971 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:34,971 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:34,971 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:40,024 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:40,024 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:40,024 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:45,077 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:45,077 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:45,077 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:50,129 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:50,129 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:50,129 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:55,182 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:55,182 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:55,182 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) wget: download timed out 2025-01-08 12:03:55,182 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94336338': 0, 'ctest-pod-38487483': 0} 2025-01-08 12:03:55,234 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-38487483 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,234 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:03:55,234 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: ctest-pod-38487483 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,306 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,306 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:03:55,306 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,306 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94336338': 1, 'ctest-pod-38487483': 1} 2025-01-08 12:03:55,370 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:03:55,370 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:03:55,370 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94336338 2025-01-08 12:03:55,441 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,441 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:03:55,441 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: ctest-pod-94336338 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,494 - DEBUG - [Pod ctest-pod-35881376] Cmd: wget http://10.99.7.75:80/ -O - -T 5 -t 1 , Output: ctest-pod-38487483 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,495 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd wget http://10.99.7.75:80/ -O - -T 5 -t 1 passed 2025-01-08 12:03:55,495 - DEBUG - [Pod Pod ctest-pod-35881376] Cmd output: ctest-pod-38487483 Connecting to 10.99.7.75:80 (10.99.7.75:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-08 12:03:55,495 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94336338': 2, 'ctest-pod-38487483': 1} 2025-01-08 12:03:57,561 - DEBUG - [Pod ctest-pod-67777404] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.420 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.087 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.525/1.420 ms 2025-01-08 12:03:57,561 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67777404 with expectation True passed 2025-01-08 12:03:59,629 - DEBUG - [Pod ctest-pod-17900989] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.770 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.308/0.770 ms 2025-01-08 12:03:59,630 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17900989 with expectation True passed 2025-01-08 12:04:01,686 - DEBUG - [Pod ctest-pod-35881376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.652 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.276/0.652 ms 2025-01-08 12:04:01,686 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35881376 with expectation True passed 2025-01-08 12:04:01,736 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:04:01,736 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 12:04:01,736 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:04:01,736 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67777404 passed 2025-01-08 12:04:01,795 - DEBUG - [Pod ctest-pod-67777404] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:04:01,795 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-08 12:04:01,795 - DEBUG - [Pod Pod ctest-pod-67777404] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:04:01,795 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67777404 passed 2025-01-08 12:04:06,858 - DEBUG - [Pod ctest-pod-17900989] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 12:04:06,858 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 12:04:06,858 - DEBUG - [Pod Pod ctest-pod-17900989] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-08 12:04:06,858 - INFO - wget check of of http://10.47.255.250 from ctest-pod-17900989 passed 2025-01-08 12:04:06,963 - DEBUG - [Pod ctest-pod-29900628] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:04:06,963 - DEBUG - [Pod Pod ctest-pod-29900628] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-08 12:04:06,963 - DEBUG - [Pod Pod ctest-pod-29900628] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-08 12:04:06,963 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29900628 passed 2025-01-08 12:04:06,964 - INFO - Deleting Network Policy : ingress-on-service 2025-01-08 12:04:06,965 - INFO - Deleting service : ctest-nginx-svc-95168387 2025-01-08 12:04:07,200 - DEBUG - No XMPP flaps were noticed during the test 2025-01-08 12:04:07,200 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2025-01-08 12:04:07,200 - INFO - -------------------------------------------------------------------------------- 2025-01-08 12:04:07,208 - INFO - Deleting pod ctest-new-default-86040091:ctest-pod-94336338 2025-01-08 12:04:07,208 - INFO - Deleting pod ctest-new-default-86040091:ctest-pod-38487483 2025-01-08 12:04:07,209 - INFO - Deleting pod ctest-non-default-42803770:ctest-pod-64508868 2025-01-08 12:04:07,209 - INFO - Deleting pod ctest-non-default-42803770:ctest-pod-76456690 2025-01-08 12:04:07,210 - INFO - Deleting pod ctest-new-default-86040091:ctest-pod-17900989 2025-01-08 12:04:07,210 - INFO - Deleting pod ctest-new-default-86040091:ctest-pod-67777404 2025-01-08 12:04:07,211 - INFO - Deleting pod ctest-non-default-42803770:ctest-pod-35881376 2025-01-08 12:04:07,211 - INFO - Deleting pod ctest-non-default-42803770:ctest-pod-29900628 2025-01-08 12:04:07,316 - WARNING - Pod uuid 95458b20-533f-415f-99ce-628cf405a4e9 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,326 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,376 - WARNING - Pod uuid ccc00349-e00c-45c1-b3ed-cc9f3506c9c9 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,378 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,378 - WARNING - Pod uuid fecc91be-43b8-482c-b6b0-b278a5276a0e is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,403 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,404 - WARNING - Pod uuid 58153549-6911-4ee8-a0c7-48f0f96743ec is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:07,405 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:12,325 - DEBUG - Pod 95458b20-533f-415f-99ce-628cf405a4e9 is not in agent 10.0.0.34 VM list 2025-01-08 12:04:12,338 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:12,338 - DEBUG - VMI 2a0acfe8-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:12,338 - INFO - Verified that pod ctest-pod-94336338 is removed in agent 2025-01-08 12:04:12,392 - DEBUG - Pod ccc00349-e00c-45c1-b3ed-cc9f3506c9c9 is not in agent 10.0.0.34 VM list 2025-01-08 12:04:12,396 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:12,396 - DEBUG - Pod fecc91be-43b8-482c-b6b0-b278a5276a0e is not in agent 10.0.0.34 VM list 2025-01-08 12:04:12,411 - DEBUG - VMI 2c424958-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:12,412 - INFO - Verified that pod ctest-pod-76456690 is removed in agent 2025-01-08 12:04:12,412 - DEBUG - VMI 2ba5ccae-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:12,412 - INFO - Verified that pod ctest-pod-64508868 is removed in agent 2025-01-08 12:04:12,421 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:12,423 - DEBUG - Pod 58153549-6911-4ee8-a0c7-48f0f96743ec is not in agent 10.0.0.34 VM list 2025-01-08 12:04:12,424 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:12,429 - DEBUG - VMI 2ae2c682-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:12,429 - INFO - Verified that pod ctest-pod-38487483 is removed in agent 2025-01-08 12:04:17,347 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:17,406 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:17,430 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:17,434 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:22,356 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:22,424 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:22,438 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:22,449 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:27,368 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:27,432 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:27,447 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:27,457 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:32,376 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:32,442 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:32,455 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:32,465 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:37,385 - WARNING - Pod uuid 40f2dd29-6ab1-4664-a507-e161e98fd23a is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:37,453 - WARNING - Pod uuid 098d23af-964e-4e7b-b8a5-229157d4cfae is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:37,465 - WARNING - Pod uuid e29aee4a-8fd2-45b4-bebc-783feedc7586 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:37,477 - WARNING - Pod uuid 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is still seen in agent 10.0.0.34 VM list 2025-01-08 12:04:42,394 - DEBUG - Pod 40f2dd29-6ab1-4664-a507-e161e98fd23a is not in agent 10.0.0.34 VM list 2025-01-08 12:04:42,401 - DEBUG - VMI 2d8fcc04-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:42,402 - INFO - Verified that pod ctest-pod-67777404 is removed in agent 2025-01-08 12:04:42,462 - DEBUG - Pod 098d23af-964e-4e7b-b8a5-229157d4cfae is not in agent 10.0.0.34 VM list 2025-01-08 12:04:42,469 - DEBUG - VMI 2d038578-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:42,470 - INFO - Verified that pod ctest-pod-17900989 is removed in agent 2025-01-08 12:04:42,474 - DEBUG - Pod e29aee4a-8fd2-45b4-bebc-783feedc7586 is not in agent 10.0.0.34 VM list 2025-01-08 12:04:42,497 - DEBUG - Pod 6d9a0481-34c2-48a1-a457-a9dd1f09c203 is not in agent 10.0.0.34 VM list 2025-01-08 12:04:42,500 - DEBUG - VMI 2ebc6394-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:42,500 - INFO - Verified that pod ctest-pod-29900628 is removed in agent 2025-01-08 12:04:42,506 - DEBUG - VMI 2e2ce444-cdb8-11ef-882f-fa163eb2dec0 is removed from agent 10.0.0.34 2025-01-08 12:04:42,506 - INFO - Verified that pod ctest-pod-35881376 is removed in agent 2025-01-08 12:04:42,506 - INFO - Deleting namespace ctest-non-default-42803770 2025-01-08 12:04:42,541 - DEBUG - Namespace ctest-non-default-42803770 still in k8s 2025-01-08 12:04:44,547 - DEBUG - Namespace ctest-non-default-42803770 still in k8s 2025-01-08 12:04:46,554 - DEBUG - Namespace ctest-non-default-42803770 still in k8s 2025-01-08 12:04:48,562 - DEBUG - Namespace ctest-non-default-42803770 is not in k8s 2025-01-08 12:04:48,563 - DEBUG - No need to check project deletion in contrail-api 2025-01-08 12:04:48,563 - INFO - Deleting namespace ctest-new-default-86040091 2025-01-08 12:04:48,577 - DEBUG - Namespace ctest-new-default-86040091 still in k8s 2025-01-08 12:04:50,584 - DEBUG - Namespace ctest-new-default-86040091 still in k8s 2025-01-08 12:04:52,591 - DEBUG - Namespace ctest-new-default-86040091 still in k8s 2025-01-08 12:04:54,596 - DEBUG - Namespace ctest-new-default-86040091 is not in k8s 2025-01-08 12:04:54,596 - DEBUG - No need to check project deletion in contrail-api