2024-09-18 04:51:12,164 - INFO - Using existing project ['default-domain', 'k8s-default'](58e594d0-d2b4-4c90-89fb-f07af76f1d64) 2024-09-18 04:51:12,188 - DEBUG - Namespace ctest-new-default-44556253 not present 2024-09-18 04:51:12,209 - INFO - Created namespace ctest-new-default-44556253 2024-09-18 04:51:15,215 - DEBUG - Namespace ctest-non-default-37905247 not present 2024-09-18 04:51:15,229 - INFO - Created namespace ctest-non-default-37905247 2024-09-18 04:51:18,257 - DEBUG - Pod ctest-pod-34351536 not present 2024-09-18 04:51:18,257 - INFO - Creating Pod ctest-pod-34351536 2024-09-18 04:51:18,315 - DEBUG - Pod : ctest-pod-34351536 UUID is 95e8be85-3ecf-431c-a170-9b1a37419154 2024-09-18 04:51:18,322 - DEBUG - Pod ctest-pod-35177840 not present 2024-09-18 04:51:18,322 - INFO - Creating Pod ctest-pod-35177840 2024-09-18 04:51:18,360 - DEBUG - Pod : ctest-pod-35177840 UUID is bd289745-0fe9-4c76-b6dc-d8ad9574bacd 2024-09-18 04:51:18,374 - DEBUG - Pod ctest-pod-16578315 not present 2024-09-18 04:51:18,374 - INFO - Creating Pod ctest-pod-16578315 2024-09-18 04:51:18,434 - DEBUG - Pod : ctest-pod-16578315 UUID is e9800290-eb3d-4b3d-a5cd-66a5b94b60cb 2024-09-18 04:51:18,438 - DEBUG - Pod ctest-pod-49308086 not present 2024-09-18 04:51:18,439 - INFO - Creating Pod ctest-pod-49308086 2024-09-18 04:51:18,481 - DEBUG - Pod : ctest-pod-49308086 UUID is bcbcf7a2-4112-4464-9da4-de8c637fada6 2024-09-18 04:51:18,488 - DEBUG - Pod ctest-pod-92411313 not present 2024-09-18 04:51:18,489 - INFO - Creating Pod ctest-pod-92411313 2024-09-18 04:51:18,548 - DEBUG - Pod : ctest-pod-92411313 UUID is d730fd15-e42c-4b2c-afd3-c7fc13307902 2024-09-18 04:51:18,554 - DEBUG - Pod ctest-pod-32633886 not present 2024-09-18 04:51:18,554 - INFO - Creating Pod ctest-pod-32633886 2024-09-18 04:51:18,608 - DEBUG - Pod : ctest-pod-32633886 UUID is 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c 2024-09-18 04:51:18,612 - DEBUG - Pod ctest-pod-52799108 not present 2024-09-18 04:51:18,613 - INFO - Creating Pod ctest-pod-52799108 2024-09-18 04:51:18,652 - DEBUG - Pod : ctest-pod-52799108 UUID is 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 2024-09-18 04:51:18,656 - DEBUG - Pod ctest-pod-83848767 not present 2024-09-18 04:51:18,657 - INFO - Creating Pod ctest-pod-83848767 2024-09-18 04:51:18,701 - DEBUG - Pod : ctest-pod-83848767 UUID is 16470bd5-9e04-4be8-8911-bc8e8e955eab 2024-09-18 04:51:19,054 - INFO - Project default-domain:k8s-ctest-new-default-44556253 for Namespace ctest-new-default-44556253 is seen in contrail-api 2024-09-18 04:51:19,054 - DEBUG - Project uuid in Contrail is bdc43474-e9dd-4839-bb7f-2eb713e52fde 2024-09-18 04:51:19,290 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=5b53d5c8-07b8-42c5-8daf-a275a3f826b3 2024-09-18 04:51:19,295 - INFO - Namespace ctest-new-default-44556253 with uuid 5b53d5c8-07b8-42c5-8daf-a275a3f826b3 found in kube manager 2024-09-18 04:51:19,295 - INFO - Namespace ctest-new-default-44556253 verification passed 2024-09-18 04:51:19,605 - INFO - Project default-domain:k8s-ctest-non-default-37905247 for Namespace ctest-non-default-37905247 is seen in contrail-api 2024-09-18 04:51:19,606 - DEBUG - Project uuid in Contrail is 51d8d165-c00a-47ca-81d6-7adcad06ae0a 2024-09-18 04:51:19,606 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=f9feb6dc-72c1-45ff-a8b3-19c1b7f9a4b5 2024-09-18 04:51:19,613 - INFO - Namespace ctest-non-default-37905247 with uuid f9feb6dc-72c1-45ff-a8b3-19c1b7f9a4b5 found in kube manager 2024-09-18 04:51:19,613 - INFO - Namespace ctest-non-default-37905247 verification passed 2024-09-18 04:51:19,690 - DEBUG - Pod ctest-pod-34351536 not in running state.Currently in Pending 2024-09-18 04:51:24,698 - DEBUG - Pod ctest-pod-34351536 not in running state.Currently in Pending 2024-09-18 04:51:29,706 - INFO - Pod ctest-pod-34351536 is in running state.Got IP 10.47.255.251 2024-09-18 04:51:29,771 - DEBUG - Pod ctest-pod-34351536 has vmi a6c1454a-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:29,772 - INFO - Verified pod ctest-pod-34351536 in contrail-api 2024-09-18 04:51:29,788 - DEBUG - VMI a6c1454a-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:29,788 - INFO - Verified Pod ctest-pod-34351536 in agent 10.0.0.23 2024-09-18 04:51:29,788 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=95e8be85-3ecf-431c-a170-9b1a37419154 2024-09-18 04:51:29,794 - INFO - Pod ctest-pod-34351536 with uuid 95e8be85-3ecf-431c-a170-9b1a37419154 found in kube manager 2024-09-18 04:51:29,794 - INFO - Pod ctest-pod-34351536 verification passed 2024-09-18 04:51:29,799 - INFO - Pod ctest-pod-35177840 is in running state.Got IP 10.47.255.250 2024-09-18 04:51:29,828 - DEBUG - Pod ctest-pod-35177840 has vmi a76705ac-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:29,828 - INFO - Verified pod ctest-pod-35177840 in contrail-api 2024-09-18 04:51:29,850 - DEBUG - VMI a76705ac-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:29,850 - INFO - Verified Pod ctest-pod-35177840 in agent 10.0.0.23 2024-09-18 04:51:29,850 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=bd289745-0fe9-4c76-b6dc-d8ad9574bacd 2024-09-18 04:51:29,868 - INFO - Pod ctest-pod-35177840 with uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd found in kube manager 2024-09-18 04:51:29,868 - INFO - Pod ctest-pod-35177840 verification passed 2024-09-18 04:51:29,876 - DEBUG - Pod ctest-pod-16578315 not in running state.Currently in Pending 2024-09-18 04:51:34,883 - INFO - Pod ctest-pod-16578315 is in running state.Got IP 10.47.255.249 2024-09-18 04:51:34,963 - DEBUG - Pod ctest-pod-16578315 has vmi a8480f84-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:34,963 - INFO - Verified pod ctest-pod-16578315 in contrail-api 2024-09-18 04:51:34,977 - DEBUG - VMI a8480f84-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:34,977 - INFO - Verified Pod ctest-pod-16578315 in agent 10.0.0.23 2024-09-18 04:51:34,977 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=e9800290-eb3d-4b3d-a5cd-66a5b94b60cb 2024-09-18 04:51:34,984 - INFO - Pod ctest-pod-16578315 with uuid e9800290-eb3d-4b3d-a5cd-66a5b94b60cb found in kube manager 2024-09-18 04:51:34,984 - INFO - Pod ctest-pod-16578315 verification passed 2024-09-18 04:51:34,992 - DEBUG - Pod ctest-pod-49308086 not in running state.Currently in Pending 2024-09-18 04:51:40,004 - INFO - Pod ctest-pod-49308086 is in running state.Got IP 10.47.255.248 2024-09-18 04:51:40,027 - DEBUG - Pod ctest-pod-49308086 has vmi a8efbefa-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:40,027 - INFO - Verified pod ctest-pod-49308086 in contrail-api 2024-09-18 04:51:40,999 - DEBUG - VMI a8efbefa-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:40,999 - INFO - Verified Pod ctest-pod-49308086 in agent 10.0.0.23 2024-09-18 04:51:41,000 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=bcbcf7a2-4112-4464-9da4-de8c637fada6 2024-09-18 04:51:41,005 - INFO - Pod ctest-pod-49308086 with uuid bcbcf7a2-4112-4464-9da4-de8c637fada6 found in kube manager 2024-09-18 04:51:41,005 - INFO - Pod ctest-pod-49308086 verification passed 2024-09-18 04:51:41,014 - DEBUG - Pod ctest-pod-92411313 not in running state.Currently in Pending 2024-09-18 04:51:46,023 - INFO - Pod ctest-pod-92411313 is in running state.Got IP 10.47.255.247 2024-09-18 04:51:46,046 - DEBUG - Pod ctest-pod-92411313 has vmi a9a1636c-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:46,046 - INFO - Verified pod ctest-pod-92411313 in contrail-api 2024-09-18 04:51:46,563 - DEBUG - VMI a9a1636c-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:46,563 - INFO - Verified Pod ctest-pod-92411313 in agent 10.0.0.23 2024-09-18 04:51:46,563 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=d730fd15-e42c-4b2c-afd3-c7fc13307902 2024-09-18 04:51:46,569 - INFO - Pod ctest-pod-92411313 with uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 found in kube manager 2024-09-18 04:51:46,569 - INFO - Pod ctest-pod-92411313 verification passed 2024-09-18 04:51:46,578 - INFO - Pod ctest-pod-52799108 is in running state.Got IP 10.47.255.245 2024-09-18 04:51:46,643 - DEBUG - Pod ctest-pod-52799108 has vmi aafe7d58-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:46,643 - INFO - Verified pod ctest-pod-52799108 in contrail-api 2024-09-18 04:51:46,658 - DEBUG - VMI aafe7d58-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:46,659 - INFO - Verified Pod ctest-pod-52799108 in agent 10.0.0.23 2024-09-18 04:51:46,659 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 2024-09-18 04:51:46,664 - INFO - Pod ctest-pod-52799108 with uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 found in kube manager 2024-09-18 04:51:46,665 - INFO - Pod ctest-pod-52799108 verification passed 2024-09-18 04:51:46,671 - INFO - Pod ctest-pod-32633886 is in running state.Got IP 10.47.255.246 2024-09-18 04:51:46,692 - DEBUG - Pod ctest-pod-32633886 has vmi aa6154c4-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:46,692 - INFO - Verified pod ctest-pod-32633886 in contrail-api 2024-09-18 04:51:46,709 - DEBUG - VMI aa6154c4-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:46,710 - INFO - Verified Pod ctest-pod-32633886 in agent 10.0.0.23 2024-09-18 04:51:46,710 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=3dce3aa1-f5e8-44e7-99a6-054e89d3f17c 2024-09-18 04:51:46,721 - INFO - Pod ctest-pod-32633886 with uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c found in kube manager 2024-09-18 04:51:46,721 - INFO - Pod ctest-pod-32633886 verification passed 2024-09-18 04:51:46,730 - INFO - Pod ctest-pod-83848767 is in running state.Got IP 10.47.255.244 2024-09-18 04:51:46,791 - DEBUG - Pod ctest-pod-83848767 has vmi ab8f916c-7579-11ef-a8af-fa163eb64f90 2024-09-18 04:51:46,792 - INFO - Verified pod ctest-pod-83848767 in contrail-api 2024-09-18 04:51:46,808 - DEBUG - VMI ab8f916c-7579-11ef-a8af-fa163eb64f90 is active in agent 10.0.0.23 2024-09-18 04:51:46,809 - INFO - Verified Pod ctest-pod-83848767 in agent 10.0.0.23 2024-09-18 04:51:46,809 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=16470bd5-9e04-4be8-8911-bc8e8e955eab 2024-09-18 04:51:46,816 - INFO - Pod ctest-pod-83848767 with uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab found in kube manager 2024-09-18 04:51:46,816 - INFO - Pod ctest-pod-83848767 verification passed 2024-09-18 04:51:46,817 - INFO - ================================================================================ 2024-09-18 04:51:46,817 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-18 04:51:46,817 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-18 04:51:47,085 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.49': '0'}} with 2024-09-18 04:51:47,085 - INFO - Initial checks done. Running the testcase now 2024-09-18 04:51:47,085 - INFO - 2024-09-18 04:51:47,161 - DEBUG - [Pod ctest-pod-34351536] Cmd: echo ctest-pod-34351536 > /usr/share/nginx/html/index.html, Output: 2024-09-18 04:51:47,236 - DEBUG - [Pod ctest-pod-35177840] Cmd: echo ctest-pod-35177840 > /usr/share/nginx/html/index.html, Output: 2024-09-18 04:51:47,309 - DEBUG - [Pod ctest-pod-16578315] Cmd: echo ctest-pod-16578315 > /usr/share/nginx/html/index.html, Output: 2024-09-18 04:51:47,382 - DEBUG - [Pod ctest-pod-49308086] Cmd: echo ctest-pod-49308086 > /usr/share/nginx/html/index.html, Output: 2024-09-18 04:51:47,385 - DEBUG - Service ctest-nginx-svc-65771411 not present 2024-09-18 04:51:47,385 - INFO - Creating service ctest-nginx-svc-65771411 2024-09-18 04:51:47,408 - INFO - Created Service ctest-nginx-svc-65771411 2024-09-18 04:51:47,425 - WARNING - Service UUID d982f879-0a62-40ce-914f-ed4ea1aa8ce7 not yet found in contrail-api 2024-09-18 04:51:48,458 - INFO - Validated that Service ctest-nginx-svc-65771411 is seen in contrail-api 2024-09-18 04:51:48,458 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=d982f879-0a62-40ce-914f-ed4ea1aa8ce7 2024-09-18 04:51:48,463 - INFO - Service ctest-nginx-svc-65771411 with uuid d982f879-0a62-40ce-914f-ed4ea1aa8ce7 found in kube manager 2024-09-18 04:51:48,463 - INFO - Service ctest-nginx-svc-65771411 verification passed 2024-09-18 04:51:49,541 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) ctest-pod-35177840 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:51:49,541 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:51:49,541 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) ctest-pod-35177840 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:51:49,633 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-34351536 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:51:49,634 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:51:49,634 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: ctest-pod-34351536 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:51:49,634 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34351536': 1, 'ctest-pod-35177840': 1} 2024-09-18 04:51:49,711 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:51:49,711 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:51:49,712 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:51:49,788 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34351536 2024-09-18 04:51:49,789 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:51:49,789 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34351536 2024-09-18 04:51:49,789 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34351536': 1, 'ctest-pod-35177840': 1} 2024-09-18 04:51:49,794 - DEBUG - Network policy ingress-on-service not present 2024-09-18 04:51:49,794 - INFO - Creating Network Policy ingress-on-service 2024-09-18 04:51:49,806 - INFO - Network policy found in k8s 2024-09-18 04:51:49,806 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=72d311b5-d1ef-47c4-bd40-d5c1a980c505 2024-09-18 04:51:49,816 - INFO - Network Policy ingress-on-service with uuid 72d311b5-d1ef-47c4-bd40-d5c1a980c505 found in kube manager 2024-09-18 04:51:49,880 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-18 04:51:49,880 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-18 04:51:49,880 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=72d311b5-d1ef-47c4-bd40-d5c1a980c505 2024-09-18 04:51:49,931 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-18 04:51:51,932 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=72d311b5-d1ef-47c4-bd40-d5c1a980c505 2024-09-18 04:51:51,970 - INFO - Network policy with name ingress-on-service found in agent 2024-09-18 04:51:51,970 - INFO - Network Policy ingress-on-service verification passed 2024-09-18 04:51:57,040 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:51:57,040 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:51:57,041 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:02,089 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:02,089 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:02,089 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:07,154 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:07,154 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:07,154 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:12,207 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:12,207 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:12,207 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:17,277 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:17,277 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:17,277 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:22,365 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:22,365 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:22,365 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:27,426 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:27,426 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:27,426 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:32,493 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:32,493 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:32,493 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:37,558 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:37,558 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:37,558 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:42,623 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:42,623 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:42,623 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:42,624 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34351536': 0, 'ctest-pod-35177840': 0} 2024-09-18 04:52:42,690 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35177840 2024-09-18 04:52:42,690 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:52:42,690 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35177840 2024-09-18 04:52:42,768 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) ctest-pod-34351536 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:52:42,768 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:52:42,768 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) ctest-pod-34351536 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:52:42,768 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34351536': 1, 'ctest-pod-35177840': 1} 2024-09-18 04:52:47,831 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:47,831 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:47,831 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:52,912 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:52,912 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:52,912 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:57,982 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:57,982 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:52:57,982 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:03,483 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:03,483 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:03,483 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:08,559 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:08,559 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:08,559 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:13,637 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:13,637 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:13,637 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:18,703 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:18,703 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:18,704 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:23,764 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:23,764 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:23,764 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:28,813 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:28,814 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:28,814 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:33,893 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:33,893 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:33,893 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:33,893 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34351536': 0, 'ctest-pod-35177840': 0} 2024-09-18 04:53:35,947 - DEBUG - [Pod ctest-pod-32633886] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.032 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.396/1.032 ms 2024-09-18 04:53:35,947 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-32633886 with expectation True passed 2024-09-18 04:53:38,010 - DEBUG - [Pod ctest-pod-92411313] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.093 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.417/1.093 ms 2024-09-18 04:53:38,010 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92411313 with expectation True passed 2024-09-18 04:53:40,070 - DEBUG - [Pod ctest-pod-52799108] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.624 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.142 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.277/0.624 ms 2024-09-18 04:53:40,070 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-52799108 with expectation True passed 2024-09-18 04:53:40,144 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:53:40,144 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 04:53:40,144 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:53:40,144 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32633886 passed 2024-09-18 04:53:40,224 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:53:40,224 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 04:53:40,224 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:53:40,224 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32633886 passed 2024-09-18 04:53:45,307 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 04:53:45,307 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 04:53:45,307 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 04:53:45,308 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92411313 passed 2024-09-18 04:53:50,374 - DEBUG - [Pod ctest-pod-83848767] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 04:53:50,374 - DEBUG - [Pod Pod ctest-pod-83848767] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 04:53:50,374 - DEBUG - [Pod Pod ctest-pod-83848767] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 04:53:50,374 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83848767 passed 2024-09-18 04:53:50,385 - INFO - Updating Network Policy ingress-on-service 2024-09-18 04:53:55,468 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:55,468 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:53:55,468 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:00,531 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:00,532 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:00,532 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:05,597 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:05,598 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:05,598 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:10,651 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:10,651 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:10,651 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:15,706 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:15,706 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:15,706 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:21,334 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:21,334 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:21,334 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:26,489 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:26,489 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:26,489 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:31,550 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:31,550 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:31,550 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:36,618 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:36,618 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:36,618 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:41,673 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:41,673 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:41,673 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.100.252.227:80 (10.100.252.227:80) wget: download timed out 2024-09-18 04:54:41,673 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34351536': 0, 'ctest-pod-35177840': 0} 2024-09-18 04:54:41,717 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,718 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:54:41,718 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,770 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-34351536 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,771 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:54:41,771 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: ctest-pod-34351536 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,771 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34351536': 1, 'ctest-pod-35177840': 1} 2024-09-18 04:54:41,821 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,822 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:54:41,822 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,877 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,878 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:54:41,878 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: ctest-pod-35177840 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,951 - DEBUG - [Pod ctest-pod-52799108] Cmd: wget http://10.100.252.227:80/ -O - -T 5 -t 1 , Output: ctest-pod-34351536 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,952 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd wget http://10.100.252.227:80/ -O - -T 5 -t 1 passed 2024-09-18 04:54:41,952 - DEBUG - [Pod Pod ctest-pod-52799108] Cmd output: ctest-pod-34351536 Connecting to 10.100.252.227:80 (10.100.252.227:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 04:54:41,952 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34351536': 1, 'ctest-pod-35177840': 2} 2024-09-18 04:54:44,025 - DEBUG - [Pod ctest-pod-32633886] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.361 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.173/0.361 ms 2024-09-18 04:54:44,025 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-32633886 with expectation True passed 2024-09-18 04:54:46,086 - DEBUG - [Pod ctest-pod-92411313] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.589 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.252/0.589 ms 2024-09-18 04:54:46,086 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92411313 with expectation True passed 2024-09-18 04:54:48,145 - DEBUG - [Pod ctest-pod-52799108] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.930 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.056 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.056/0.686/1.930 ms 2024-09-18 04:54:48,145 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-52799108 with expectation True passed 2024-09-18 04:54:48,203 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:54:48,203 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 04:54:48,203 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:54:48,203 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32633886 passed 2024-09-18 04:54:48,265 - DEBUG - [Pod ctest-pod-32633886] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:54:48,265 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 04:54:48,265 - DEBUG - [Pod Pod ctest-pod-32633886] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:54:48,265 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32633886 passed 2024-09-18 04:54:53,329 - DEBUG - [Pod ctest-pod-92411313] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 04:54:53,329 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 04:54:53,329 - DEBUG - [Pod Pod ctest-pod-92411313] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 04:54:53,329 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92411313 passed 2024-09-18 04:54:53,410 - DEBUG - [Pod ctest-pod-83848767] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:54:53,410 - DEBUG - [Pod Pod ctest-pod-83848767] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 04:54:53,410 - DEBUG - [Pod Pod ctest-pod-83848767] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 04:54:53,410 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83848767 passed 2024-09-18 04:54:53,410 - INFO - Deleting Network Policy : ingress-on-service 2024-09-18 04:54:53,411 - INFO - Deleting service : ctest-nginx-svc-65771411 2024-09-18 04:54:53,646 - DEBUG - No XMPP flaps were noticed during the test
2024-09-18 04:54:53,646 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07]
2024-09-18 04:54:53,646 - INFO - -------------------------------------------------------------------------------- 2024-09-18 04:54:53,652 - INFO - Deleting pod ctest-new-default-44556253:ctest-pod-34351536 2024-09-18 04:54:53,653 - INFO - Deleting pod ctest-new-default-44556253:ctest-pod-35177840 2024-09-18 04:54:53,653 - INFO - Deleting pod ctest-non-default-37905247:ctest-pod-16578315 2024-09-18 04:54:53,653 - INFO - Deleting pod ctest-non-default-37905247:ctest-pod-49308086 2024-09-18 04:54:53,654 - INFO - Deleting pod ctest-new-default-44556253:ctest-pod-92411313 2024-09-18 04:54:53,654 - INFO - Deleting pod ctest-new-default-44556253:ctest-pod-32633886 2024-09-18 04:54:53,655 - INFO - Deleting pod ctest-non-default-37905247:ctest-pod-52799108 2024-09-18 04:54:53,655 - INFO - Deleting pod ctest-non-default-37905247:ctest-pod-83848767 2024-09-18 04:54:53,717 - WARNING - Pod uuid 95e8be85-3ecf-431c-a170-9b1a37419154 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,759 - WARNING - Pod uuid bcbcf7a2-4112-4464-9da4-de8c637fada6 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,763 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,763 - WARNING - Pod uuid e9800290-eb3d-4b3d-a5cd-66a5b94b60cb is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,789 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,790 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,790 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:53,790 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:58,726 - DEBUG - Pod 95e8be85-3ecf-431c-a170-9b1a37419154 is not in agent 10.0.0.23 VM list 2024-09-18 04:54:58,734 - DEBUG - VMI a6c1454a-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:54:58,734 - INFO - Verified that pod ctest-pod-34351536 is removed in agent 2024-09-18 04:54:58,779 - DEBUG - Pod e9800290-eb3d-4b3d-a5cd-66a5b94b60cb is not in agent 10.0.0.23 VM list 2024-09-18 04:54:58,780 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:58,786 - DEBUG - VMI a8480f84-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:54:58,786 - INFO - Verified that pod ctest-pod-16578315 is removed in agent 2024-09-18 04:54:58,816 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:58,817 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:54:58,817 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:00,749 - DEBUG - Pod bcbcf7a2-4112-4464-9da4-de8c637fada6 is not in agent 10.0.0.23 VM list 2024-09-18 04:55:00,758 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:00,766 - DEBUG - VMI a8efbefa-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:55:00,766 - INFO - Verified that pod ctest-pod-49308086 is removed in agent 2024-09-18 04:55:03,789 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:03,837 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:03,842 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:03,843 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:05,767 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:08,799 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:08,848 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:08,854 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:08,855 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:10,776 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:14,378 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:14,381 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:14,382 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:14,382 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:15,787 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:19,400 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:19,401 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:19,401 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:19,401 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:20,796 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:24,431 - WARNING - Pod uuid d730fd15-e42c-4b2c-afd3-c7fc13307902 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:24,433 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:24,433 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:24,434 - WARNING - Pod uuid bd289745-0fe9-4c76-b6dc-d8ad9574bacd is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:26,418 - WARNING - Pod uuid 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:29,453 - WARNING - Pod uuid 16470bd5-9e04-4be8-8911-bc8e8e955eab is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:29,455 - DEBUG - Pod d730fd15-e42c-4b2c-afd3-c7fc13307902 is not in agent 10.0.0.23 VM list 2024-09-18 04:55:29,461 - WARNING - Pod uuid 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is still seen in agent 10.0.0.23 VM list 2024-09-18 04:55:29,461 - DEBUG - Pod bd289745-0fe9-4c76-b6dc-d8ad9574bacd is not in agent 10.0.0.23 VM list 2024-09-18 04:55:29,474 - DEBUG - VMI a9a1636c-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:55:29,474 - INFO - Verified that pod ctest-pod-92411313 is removed in agent 2024-09-18 04:55:29,475 - DEBUG - VMI a76705ac-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:55:29,475 - INFO - Verified that pod ctest-pod-35177840 is removed in agent 2024-09-18 04:55:31,427 - DEBUG - Pod 3dce3aa1-f5e8-44e7-99a6-054e89d3f17c is not in agent 10.0.0.23 VM list 2024-09-18 04:55:31,434 - DEBUG - VMI aa6154c4-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:55:31,434 - INFO - Verified that pod ctest-pod-32633886 is removed in agent 2024-09-18 04:55:34,465 - DEBUG - Pod 16470bd5-9e04-4be8-8911-bc8e8e955eab is not in agent 10.0.0.23 VM list 2024-09-18 04:55:34,476 - DEBUG - Pod 00eb9f95-6e8f-4de5-b4af-e0a0f1615f78 is not in agent 10.0.0.23 VM list 2024-09-18 04:55:34,477 - DEBUG - VMI ab8f916c-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:55:34,477 - INFO - Verified that pod ctest-pod-83848767 is removed in agent 2024-09-18 04:55:34,498 - DEBUG - VMI aafe7d58-7579-11ef-a8af-fa163eb64f90 is removed from agent 10.0.0.23 2024-09-18 04:55:34,498 - INFO - Verified that pod ctest-pod-52799108 is removed in agent 2024-09-18 04:55:34,498 - INFO - Deleting namespace ctest-non-default-37905247 2024-09-18 04:55:36,445 - DEBUG - Namespace ctest-non-default-37905247 still in k8s 2024-09-18 04:55:38,450 - DEBUG - Namespace ctest-non-default-37905247 still in k8s 2024-09-18 04:55:40,457 - DEBUG - Namespace ctest-non-default-37905247 still in k8s 2024-09-18 04:55:42,460 - DEBUG - Namespace ctest-non-default-37905247 is not in k8s 2024-09-18 04:55:42,461 - DEBUG - No need to check project deletion in contrail-api 2024-09-18 04:55:42,461 - INFO - Deleting namespace ctest-new-default-44556253 2024-09-18 04:55:42,469 - DEBUG - Namespace ctest-new-default-44556253 still in k8s 2024-09-18 04:55:45,313 - DEBUG - Namespace ctest-new-default-44556253 still in k8s 2024-09-18 04:55:47,318 - DEBUG - Namespace ctest-new-default-44556253 still in k8s 2024-09-18 04:55:49,327 - DEBUG - Namespace ctest-new-default-44556253 is not in k8s 2024-09-18 04:55:49,328 - DEBUG - No need to check project deletion in contrail-api