2024-09-04 23:02:17,209 - INFO - Using existing project ['default-domain', 'k8s-default'](5463dfd0-2d5c-4b65-ad49-2de54f098b6b) 2024-09-04 23:02:17,239 - DEBUG - Namespace ctest-new-default-65239675 not present 2024-09-04 23:02:17,264 - INFO - Created namespace ctest-new-default-65239675 2024-09-04 23:02:20,286 - DEBUG - Namespace ctest-non-default-22663056 not present 2024-09-04 23:02:20,308 - INFO - Created namespace ctest-non-default-22663056 2024-09-04 23:02:23,341 - DEBUG - Pod ctest-pod-41144885 not present 2024-09-04 23:02:23,342 - INFO - Creating Pod ctest-pod-41144885 2024-09-04 23:02:23,392 - DEBUG - Pod : ctest-pod-41144885 UUID is 8bb84d02-fae9-457c-88c6-443e5500ac91 2024-09-04 23:02:23,399 - DEBUG - Pod ctest-pod-10781342 not present 2024-09-04 23:02:23,400 - INFO - Creating Pod ctest-pod-10781342 2024-09-04 23:02:23,434 - DEBUG - Pod : ctest-pod-10781342 UUID is c44682ab-176b-4a31-bc99-4f071649c7b9 2024-09-04 23:02:23,437 - DEBUG - Pod ctest-pod-36931175 not present 2024-09-04 23:02:23,437 - INFO - Creating Pod ctest-pod-36931175 2024-09-04 23:02:23,478 - DEBUG - Pod : ctest-pod-36931175 UUID is 09f60aee-9f09-498d-912f-cf1beff7d5a4 2024-09-04 23:02:23,481 - DEBUG - Pod ctest-pod-43022195 not present 2024-09-04 23:02:23,482 - INFO - Creating Pod ctest-pod-43022195 2024-09-04 23:02:23,544 - DEBUG - Pod : ctest-pod-43022195 UUID is 350dfd81-efea-4df7-9821-b6531e0ea67e 2024-09-04 23:02:23,546 - DEBUG - Pod ctest-pod-50762444 not present 2024-09-04 23:02:23,546 - INFO - Creating Pod ctest-pod-50762444 2024-09-04 23:02:23,567 - DEBUG - Pod : ctest-pod-50762444 UUID is 0e080013-dd29-482c-8f32-0a521f2b6ea1 2024-09-04 23:02:23,569 - DEBUG - Pod ctest-pod-23338921 not present 2024-09-04 23:02:23,570 - INFO - Creating Pod ctest-pod-23338921 2024-09-04 23:02:23,597 - DEBUG - Pod : ctest-pod-23338921 UUID is f46784b3-f015-4854-9e63-0f77315a9133 2024-09-04 23:02:23,600 - DEBUG - Pod ctest-pod-84568779 not present 2024-09-04 23:02:23,600 - INFO - Creating Pod ctest-pod-84568779 2024-09-04 23:02:23,641 - DEBUG - Pod : ctest-pod-84568779 UUID is e0e9be61-beb6-4cbf-88c5-3ef3df61749b 2024-09-04 23:02:23,644 - DEBUG - Pod ctest-pod-71899259 not present 2024-09-04 23:02:23,644 - INFO - Creating Pod ctest-pod-71899259 2024-09-04 23:02:23,666 - DEBUG - Pod : ctest-pod-71899259 UUID is debe6ebb-38c0-4e4f-8853-797c76dabf28 2024-09-04 23:02:23,937 - INFO - Project default-domain:k8s-ctest-new-default-65239675 for Namespace ctest-new-default-65239675 is seen in contrail-api 2024-09-04 23:02:23,937 - DEBUG - Project uuid in Contrail is 243640f0-4716-4f7f-9164-33ba7df910fd 2024-09-04 23:02:24,094 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=68accee3-928a-42c3-823f-882a08be0ea0 2024-09-04 23:02:24,098 - INFO - Namespace ctest-new-default-65239675 with uuid 68accee3-928a-42c3-823f-882a08be0ea0 found in kube manager 2024-09-04 23:02:24,099 - INFO - Namespace ctest-new-default-65239675 verification passed 2024-09-04 23:02:24,319 - INFO - Project default-domain:k8s-ctest-non-default-22663056 for Namespace ctest-non-default-22663056 is seen in contrail-api 2024-09-04 23:02:24,319 - DEBUG - Project uuid in Contrail is d3d4b529-52ea-47ff-be73-5d43ac6d715a 2024-09-04 23:02:24,320 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=bff0938b-6cc3-455f-b25a-9c40dc7cf264 2024-09-04 23:02:24,324 - INFO - Namespace ctest-non-default-22663056 with uuid bff0938b-6cc3-455f-b25a-9c40dc7cf264 found in kube manager 2024-09-04 23:02:24,324 - INFO - Namespace ctest-non-default-22663056 verification passed 2024-09-04 23:02:24,329 - DEBUG - Pod ctest-pod-41144885 not in running state.Currently in Pending 2024-09-04 23:02:29,339 - DEBUG - Pod ctest-pod-41144885 not in running state.Currently in Pending 2024-09-04 23:02:34,366 - DEBUG - Pod ctest-pod-41144885 not in running state.Currently in Pending 2024-09-04 23:02:39,387 - INFO - Pod ctest-pod-41144885 is in running state.Got IP 10.47.255.251 2024-09-04 23:02:39,421 - DEBUG - Pod ctest-pod-41144885 has vmi bfee3874-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:39,422 - INFO - Verified pod ctest-pod-41144885 in contrail-api 2024-09-04 23:02:39,453 - DEBUG - VMI bfee3874-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:39,454 - INFO - Verified Pod ctest-pod-41144885 in agent 10.0.0.33 2024-09-04 23:02:39,454 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=8bb84d02-fae9-457c-88c6-443e5500ac91 2024-09-04 23:02:39,465 - INFO - Pod ctest-pod-41144885 with uuid 8bb84d02-fae9-457c-88c6-443e5500ac91 found in kube manager 2024-09-04 23:02:39,466 - INFO - Pod ctest-pod-41144885 verification passed 2024-09-04 23:02:39,477 - INFO - Pod ctest-pod-10781342 is in running state.Got IP 10.47.255.250 2024-09-04 23:02:39,503 - DEBUG - Pod ctest-pod-10781342 has vmi c070aa02-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:39,504 - INFO - Verified pod ctest-pod-10781342 in contrail-api 2024-09-04 23:02:39,529 - DEBUG - VMI c070aa02-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:39,530 - INFO - Verified Pod ctest-pod-10781342 in agent 10.0.0.33 2024-09-04 23:02:39,530 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=c44682ab-176b-4a31-bc99-4f071649c7b9 2024-09-04 23:02:39,542 - INFO - Pod ctest-pod-10781342 with uuid c44682ab-176b-4a31-bc99-4f071649c7b9 found in kube manager 2024-09-04 23:02:39,544 - INFO - Pod ctest-pod-10781342 verification passed 2024-09-04 23:02:39,557 - INFO - Pod ctest-pod-36931175 is in running state.Got IP 10.47.255.249 2024-09-04 23:02:39,624 - DEBUG - Pod ctest-pod-36931175 has vmi c1269f9c-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:39,624 - INFO - Verified pod ctest-pod-36931175 in contrail-api 2024-09-04 23:02:39,653 - DEBUG - VMI c1269f9c-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:39,654 - INFO - Verified Pod ctest-pod-36931175 in agent 10.0.0.33 2024-09-04 23:02:39,654 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=09f60aee-9f09-498d-912f-cf1beff7d5a4 2024-09-04 23:02:39,670 - INFO - Pod ctest-pod-36931175 with uuid 09f60aee-9f09-498d-912f-cf1beff7d5a4 found in kube manager 2024-09-04 23:02:39,670 - INFO - Pod ctest-pod-36931175 verification passed 2024-09-04 23:02:39,687 - INFO - Pod ctest-pod-43022195 is in running state.Got IP 10.47.255.248 2024-09-04 23:02:39,729 - DEBUG - Pod ctest-pod-43022195 has vmi c1a62f50-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:39,729 - INFO - Verified pod ctest-pod-43022195 in contrail-api 2024-09-04 23:02:39,754 - DEBUG - VMI c1a62f50-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:39,755 - INFO - Verified Pod ctest-pod-43022195 in agent 10.0.0.33 2024-09-04 23:02:39,755 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=350dfd81-efea-4df7-9821-b6531e0ea67e 2024-09-04 23:02:39,768 - INFO - Pod ctest-pod-43022195 with uuid 350dfd81-efea-4df7-9821-b6531e0ea67e found in kube manager 2024-09-04 23:02:39,769 - INFO - Pod ctest-pod-43022195 verification passed 2024-09-04 23:02:39,784 - INFO - Pod ctest-pod-50762444 is in running state.Got IP 10.47.255.247 2024-09-04 23:02:39,815 - DEBUG - Pod ctest-pod-50762444 has vmi c2421a0a-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:39,815 - INFO - Verified pod ctest-pod-50762444 in contrail-api 2024-09-04 23:02:39,839 - DEBUG - VMI c2421a0a-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:39,840 - INFO - Verified Pod ctest-pod-50762444 in agent 10.0.0.33 2024-09-04 23:02:39,840 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=0e080013-dd29-482c-8f32-0a521f2b6ea1 2024-09-04 23:02:39,850 - INFO - Pod ctest-pod-50762444 with uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 found in kube manager 2024-09-04 23:02:39,851 - INFO - Pod ctest-pod-50762444 verification passed 2024-09-04 23:02:39,865 - INFO - Pod ctest-pod-84568779 is in running state.Got IP 10.47.255.245 2024-09-04 23:02:39,932 - DEBUG - Pod ctest-pod-84568779 has vmi c32a6f76-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:39,932 - INFO - Verified pod ctest-pod-84568779 in contrail-api 2024-09-04 23:02:39,962 - DEBUG - VMI c32a6f76-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:39,963 - INFO - Verified Pod ctest-pod-84568779 in agent 10.0.0.33 2024-09-04 23:02:39,963 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=e0e9be61-beb6-4cbf-88c5-3ef3df61749b 2024-09-04 23:02:39,975 - INFO - Pod ctest-pod-84568779 with uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b found in kube manager 2024-09-04 23:02:39,975 - INFO - Pod ctest-pod-84568779 verification passed 2024-09-04 23:02:39,991 - DEBUG - Pod ctest-pod-23338921 not in running state.Currently in Pending 2024-09-04 23:02:45,017 - INFO - Pod ctest-pod-23338921 is in running state.Got IP 10.47.255.246 2024-09-04 23:02:45,051 - DEBUG - Pod ctest-pod-23338921 has vmi c2b6305c-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:45,051 - INFO - Verified pod ctest-pod-23338921 in contrail-api 2024-09-04 23:02:45,067 - DEBUG - VMI c2b6305c-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:45,067 - INFO - Verified Pod ctest-pod-23338921 in agent 10.0.0.33 2024-09-04 23:02:45,067 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=f46784b3-f015-4854-9e63-0f77315a9133 2024-09-04 23:02:45,074 - INFO - Pod ctest-pod-23338921 with uuid f46784b3-f015-4854-9e63-0f77315a9133 found in kube manager 2024-09-04 23:02:45,074 - INFO - Pod ctest-pod-23338921 verification passed 2024-09-04 23:02:45,081 - INFO - Pod ctest-pod-71899259 is in running state.Got IP 10.47.255.244 2024-09-04 23:02:45,139 - DEBUG - Pod ctest-pod-71899259 has vmi c39a0c6e-6b11-11ef-ad4b-fa163ed60ebe 2024-09-04 23:02:45,139 - INFO - Verified pod ctest-pod-71899259 in contrail-api 2024-09-04 23:02:45,155 - DEBUG - VMI c39a0c6e-6b11-11ef-ad4b-fa163ed60ebe is active in agent 10.0.0.33 2024-09-04 23:02:45,155 - INFO - Verified Pod ctest-pod-71899259 in agent 10.0.0.33 2024-09-04 23:02:45,155 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=debe6ebb-38c0-4e4f-8853-797c76dabf28 2024-09-04 23:02:45,161 - INFO - Pod ctest-pod-71899259 with uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 found in kube manager 2024-09-04 23:02:45,161 - INFO - Pod ctest-pod-71899259 verification passed 2024-09-04 23:02:45,161 - INFO - ================================================================================ 2024-09-04 23:02:45,161 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-04 23:02:45,161 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-04 23:02:45,377 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.48': '0'}} with 2024-09-04 23:02:45,377 - INFO - Initial checks done. Running the testcase now 2024-09-04 23:02:45,378 - INFO - 2024-09-04 23:02:45,458 - DEBUG - [Pod ctest-pod-41144885] Cmd: echo ctest-pod-41144885 > /usr/share/nginx/html/index.html, Output: 2024-09-04 23:02:45,538 - DEBUG - [Pod ctest-pod-10781342] Cmd: echo ctest-pod-10781342 > /usr/share/nginx/html/index.html, Output: 2024-09-04 23:02:45,624 - DEBUG - [Pod ctest-pod-36931175] Cmd: echo ctest-pod-36931175 > /usr/share/nginx/html/index.html, Output: 2024-09-04 23:02:45,692 - DEBUG - [Pod ctest-pod-43022195] Cmd: echo ctest-pod-43022195 > /usr/share/nginx/html/index.html, Output: 2024-09-04 23:02:45,697 - DEBUG - Service ctest-nginx-svc-25691551 not present 2024-09-04 23:02:45,697 - INFO - Creating service ctest-nginx-svc-25691551 2024-09-04 23:02:45,732 - INFO - Created Service ctest-nginx-svc-25691551 2024-09-04 23:02:45,739 - WARNING - Service UUID fe1bfe98-26f9-4267-9859-436f31584beb not yet found in contrail-api 2024-09-04 23:02:46,745 - INFO - Validated that Service ctest-nginx-svc-25691551 is seen in contrail-api 2024-09-04 23:02:46,745 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=fe1bfe98-26f9-4267-9859-436f31584beb 2024-09-04 23:02:46,756 - INFO - Service ctest-nginx-svc-25691551 with uuid fe1bfe98-26f9-4267-9859-436f31584beb found in kube manager 2024-09-04 23:02:46,756 - INFO - Service ctest-nginx-svc-25691551 verification passed 2024-09-04 23:02:47,837 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) ctest-pod-41144885 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:02:47,837 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:47,837 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) ctest-pod-41144885 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:02:47,898 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10781342 2024-09-04 23:02:47,899 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:47,899 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10781342 2024-09-04 23:02:47,899 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41144885': 1, 'ctest-pod-10781342': 1} 2024-09-04 23:02:47,988 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:02:47,989 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:47,989 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:02:48,079 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:02:48,080 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:48,080 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:02:48,178 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:02:48,178 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:48,178 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:02:48,254 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:02:48,254 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:48,254 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:02:48,319 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-10781342 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:02:48,320 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:02:48,320 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-10781342 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:02:48,320 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41144885': 4, 'ctest-pod-10781342': 1} 2024-09-04 23:02:48,325 - DEBUG - Network policy ingress-on-service not present 2024-09-04 23:02:48,325 - INFO - Creating Network Policy ingress-on-service 2024-09-04 23:02:48,347 - INFO - Network policy found in k8s 2024-09-04 23:02:48,347 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0a44f269-5ea7-45c0-ae69-6b9328d7635b 2024-09-04 23:02:48,363 - INFO - Network Policy ingress-on-service with uuid 0a44f269-5ea7-45c0-ae69-6b9328d7635b found in kube manager 2024-09-04 23:02:48,404 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-04 23:02:48,405 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-04 23:02:48,405 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0a44f269-5ea7-45c0-ae69-6b9328d7635b 2024-09-04 23:02:48,448 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-04 23:02:50,449 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0a44f269-5ea7-45c0-ae69-6b9328d7635b 2024-09-04 23:02:50,530 - INFO - Network policy with name ingress-on-service found in agent 2024-09-04 23:02:50,531 - INFO - Network Policy ingress-on-service verification passed 2024-09-04 23:02:55,606 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:02:55,606 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:02:55,607 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:00,678 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:00,679 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:00,679 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:05,760 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:05,761 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:05,761 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:10,845 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:10,845 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:10,845 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:15,923 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:15,924 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:15,924 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:20,989 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:20,990 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:20,990 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:26,063 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:26,063 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:26,063 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:31,154 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:31,158 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:31,158 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:36,225 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:36,225 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:36,225 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:41,307 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:41,307 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:41,307 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:41,308 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41144885': 0, 'ctest-pod-10781342': 0} 2024-09-04 23:03:41,392 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10781342 2024-09-04 23:03:41,393 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:03:41,393 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10781342 2024-09-04 23:03:41,492 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10781342 2024-09-04 23:03:41,492 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:03:41,493 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-10781342 2024-09-04 23:03:41,585 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:03:41,586 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:03:41,586 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:03:41,586 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41144885': 1, 'ctest-pod-10781342': 2} 2024-09-04 23:03:46,686 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:46,687 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:46,687 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:51,787 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:51,788 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:51,788 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:56,877 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:56,877 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:03:56,877 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:01,971 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:01,971 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:01,971 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:07,068 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:07,068 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:07,069 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:12,183 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:12,183 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:12,183 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:17,244 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:17,244 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:17,244 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:22,315 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:22,316 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:22,316 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:27,390 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:27,391 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:27,391 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:32,467 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:32,467 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:32,467 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:32,467 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41144885': 0, 'ctest-pod-10781342': 0} 2024-09-04 23:04:34,535 - DEBUG - [Pod ctest-pod-23338921] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.216 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.107 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.470/1.216 ms 2024-09-04 23:04:34,535 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-23338921 with expectation True passed 2024-09-04 23:04:36,621 - DEBUG - [Pod ctest-pod-50762444] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.875 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.113 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.359/0.875 ms 2024-09-04 23:04:36,621 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50762444 with expectation True passed 2024-09-04 23:04:38,708 - DEBUG - [Pod ctest-pod-84568779] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.353 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.173/0.353 ms 2024-09-04 23:04:38,708 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84568779 with expectation True passed 2024-09-04 23:04:38,821 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:04:38,821 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-04 23:04:38,821 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:04:38,821 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23338921 passed 2024-09-04 23:04:38,905 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:04:38,905 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-04 23:04:38,906 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:04:38,906 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23338921 passed 2024-09-04 23:04:43,981 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 23:04:43,981 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 23:04:43,981 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 23:04:43,981 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50762444 passed 2024-09-04 23:04:49,072 - DEBUG - [Pod ctest-pod-71899259] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-04 23:04:49,072 - DEBUG - [Pod Pod ctest-pod-71899259] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-04 23:04:49,072 - DEBUG - [Pod Pod ctest-pod-71899259] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-04 23:04:49,072 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71899259 passed 2024-09-04 23:04:49,098 - INFO - Updating Network Policy ingress-on-service 2024-09-04 23:04:54,202 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:54,203 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:54,203 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:59,267 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:59,268 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:04:59,268 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:04,356 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:04,356 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:04,356 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:09,430 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:09,430 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:09,430 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:14,522 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:14,522 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:14,522 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:19,577 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:19,577 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:19,577 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:24,672 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:24,672 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:24,673 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:29,758 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:29,758 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:29,758 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:34,836 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:34,837 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:34,837 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:39,919 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:39,919 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:39,920 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) wget: download timed out 2024-09-04 23:05:39,920 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41144885': 0, 'ctest-pod-10781342': 0} 2024-09-04 23:05:40,012 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:05:40,012 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,012 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41144885 2024-09-04 23:05:40,115 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,116 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,116 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,187 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-10781342 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,187 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,187 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: ctest-pod-10781342 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,187 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41144885': 2, 'ctest-pod-10781342': 1} 2024-09-04 23:05:40,259 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,261 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,261 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,327 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,327 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,327 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,403 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,404 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,404 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,490 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,491 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,491 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,558 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,558 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,559 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: ctest-pod-41144885 Connecting to 10.100.221.43:80 (10.100.221.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,647 - DEBUG - [Pod ctest-pod-84568779] Cmd: wget http://10.100.221.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.221.43:80 (10.100.221.43:80) ctest-pod-10781342 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,647 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd wget http://10.100.221.43:80/ -O - -T 5 -t 1 passed 2024-09-04 23:05:40,647 - DEBUG - [Pod Pod ctest-pod-84568779] Cmd output: Connecting to 10.100.221.43:80 (10.100.221.43:80) ctest-pod-10781342 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 23:05:40,647 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41144885': 5, 'ctest-pod-10781342': 1} 2024-09-04 23:05:42,723 - DEBUG - [Pod ctest-pod-23338921] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.602 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.251/0.602 ms 2024-09-04 23:05:42,724 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-23338921 with expectation True passed 2024-09-04 23:05:44,811 - DEBUG - [Pod ctest-pod-50762444] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.550 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.569/1.550 ms 2024-09-04 23:05:44,811 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50762444 with expectation True passed 2024-09-04 23:05:46,886 - DEBUG - [Pod ctest-pod-84568779] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.918 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.360/0.918 ms 2024-09-04 23:05:46,887 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84568779 with expectation True passed 2024-09-04 23:05:46,959 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:05:46,959 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-04 23:05:46,959 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:05:46,959 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23338921 passed 2024-09-04 23:05:47,038 - DEBUG - [Pod ctest-pod-23338921] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:05:47,038 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-04 23:05:47,039 - DEBUG - [Pod Pod ctest-pod-23338921] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:05:47,039 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23338921 passed 2024-09-04 23:05:52,092 - DEBUG - [Pod ctest-pod-50762444] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 23:05:52,092 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 23:05:52,093 - DEBUG - [Pod Pod ctest-pod-50762444] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 23:05:52,093 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50762444 passed 2024-09-04 23:05:52,186 - DEBUG - [Pod ctest-pod-71899259] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:05:52,186 - DEBUG - [Pod Pod ctest-pod-71899259] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-04 23:05:52,186 - DEBUG - [Pod Pod ctest-pod-71899259] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 23:05:52,186 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71899259 passed 2024-09-04 23:05:52,187 - INFO - Deleting Network Policy : ingress-on-service 2024-09-04 23:05:52,188 - INFO - Deleting service : ctest-nginx-svc-25691551 2024-09-04 23:05:52,508 - DEBUG - No XMPP flaps were noticed during the test 2024-09-04 23:05:52,508 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07] 2024-09-04 23:05:52,508 - INFO - -------------------------------------------------------------------------------- 2024-09-04 23:05:52,524 - INFO - Deleting pod ctest-new-default-65239675:ctest-pod-41144885 2024-09-04 23:05:52,525 - INFO - Deleting pod ctest-new-default-65239675:ctest-pod-10781342 2024-09-04 23:05:52,526 - INFO - Deleting pod ctest-non-default-22663056:ctest-pod-36931175 2024-09-04 23:05:52,527 - INFO - Deleting pod ctest-non-default-22663056:ctest-pod-43022195 2024-09-04 23:05:52,528 - INFO - Deleting pod ctest-new-default-65239675:ctest-pod-50762444 2024-09-04 23:05:52,529 - INFO - Deleting pod ctest-new-default-65239675:ctest-pod-23338921 2024-09-04 23:05:52,530 - INFO - Deleting pod ctest-non-default-22663056:ctest-pod-84568779 2024-09-04 23:05:52,530 - INFO - Deleting pod ctest-non-default-22663056:ctest-pod-71899259 2024-09-04 23:05:52,596 - WARNING - Pod uuid 8bb84d02-fae9-457c-88c6-443e5500ac91 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,648 - WARNING - Pod uuid 350dfd81-efea-4df7-9821-b6531e0ea67e is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,659 - WARNING - Pod uuid c44682ab-176b-4a31-bc99-4f071649c7b9 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,704 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,704 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,706 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,706 - WARNING - Pod uuid 09f60aee-9f09-498d-912f-cf1beff7d5a4 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:52,707 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:57,615 - DEBUG - Pod 8bb84d02-fae9-457c-88c6-443e5500ac91 is not in agent 10.0.0.33 VM list 2024-09-04 23:05:57,634 - DEBUG - VMI bfee3874-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:05:57,634 - INFO - Verified that pod ctest-pod-41144885 is removed in agent 2024-09-04 23:05:57,672 - DEBUG - Pod 350dfd81-efea-4df7-9821-b6531e0ea67e is not in agent 10.0.0.33 VM list 2024-09-04 23:05:57,694 - DEBUG - VMI c1a62f50-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:05:57,695 - INFO - Verified that pod ctest-pod-43022195 is removed in agent 2024-09-04 23:05:57,696 - DEBUG - Pod c44682ab-176b-4a31-bc99-4f071649c7b9 is not in agent 10.0.0.33 VM list 2024-09-04 23:05:57,730 - DEBUG - VMI c070aa02-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:05:57,730 - INFO - Verified that pod ctest-pod-10781342 is removed in agent 2024-09-04 23:05:57,751 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:57,752 - DEBUG - Pod 09f60aee-9f09-498d-912f-cf1beff7d5a4 is not in agent 10.0.0.33 VM list 2024-09-04 23:05:57,759 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:57,760 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:57,761 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:05:57,767 - DEBUG - VMI c1269f9c-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:05:57,767 - INFO - Verified that pod ctest-pod-36931175 is removed in agent 2024-09-04 23:06:02,782 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:02,797 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:02,803 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:02,804 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:07,793 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:07,812 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:07,823 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:07,825 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:12,810 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:12,828 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:12,840 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:12,841 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:17,826 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:17,847 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:17,865 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:17,868 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:22,867 - WARNING - Pod uuid 0e080013-dd29-482c-8f32-0a521f2b6ea1 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:22,881 - WARNING - Pod uuid debe6ebb-38c0-4e4f-8853-797c76dabf28 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:22,898 - WARNING - Pod uuid e0e9be61-beb6-4cbf-88c5-3ef3df61749b is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:22,901 - WARNING - Pod uuid f46784b3-f015-4854-9e63-0f77315a9133 is still seen in agent 10.0.0.33 VM list 2024-09-04 23:06:27,885 - DEBUG - Pod 0e080013-dd29-482c-8f32-0a521f2b6ea1 is not in agent 10.0.0.33 VM list 2024-09-04 23:06:27,931 - DEBUG - Pod e0e9be61-beb6-4cbf-88c5-3ef3df61749b is not in agent 10.0.0.33 VM list 2024-09-04 23:06:27,945 - DEBUG - Pod f46784b3-f015-4854-9e63-0f77315a9133 is not in agent 10.0.0.33 VM list 2024-09-04 23:06:27,952 - DEBUG - Pod debe6ebb-38c0-4e4f-8853-797c76dabf28 is not in agent 10.0.0.33 VM list 2024-09-04 23:06:27,957 - DEBUG - VMI c2421a0a-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:06:27,957 - INFO - Verified that pod ctest-pod-50762444 is removed in agent 2024-09-04 23:06:27,973 - DEBUG - VMI c39a0c6e-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:06:27,973 - INFO - Verified that pod ctest-pod-71899259 is removed in agent 2024-09-04 23:06:27,976 - DEBUG - VMI c2b6305c-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:06:27,976 - INFO - Verified that pod ctest-pod-23338921 is removed in agent 2024-09-04 23:06:27,977 - DEBUG - VMI c32a6f76-6b11-11ef-ad4b-fa163ed60ebe is removed from agent 10.0.0.33 2024-09-04 23:06:27,977 - INFO - Verified that pod ctest-pod-84568779 is removed in agent 2024-09-04 23:06:27,978 - INFO - Deleting namespace ctest-non-default-22663056 2024-09-04 23:06:28,026 - DEBUG - Namespace ctest-non-default-22663056 still in k8s 2024-09-04 23:06:30,039 - DEBUG - Namespace ctest-non-default-22663056 still in k8s 2024-09-04 23:06:32,053 - DEBUG - Namespace ctest-non-default-22663056 still in k8s 2024-09-04 23:06:34,057 - DEBUG - Namespace ctest-non-default-22663056 is not in k8s 2024-09-04 23:06:34,057 - DEBUG - No need to check project deletion in contrail-api 2024-09-04 23:06:34,057 - INFO - Deleting namespace ctest-new-default-65239675 2024-09-04 23:06:34,065 - DEBUG - Namespace ctest-new-default-65239675 still in k8s 2024-09-04 23:06:36,074 - DEBUG - Namespace ctest-new-default-65239675 still in k8s 2024-09-04 23:06:38,085 - DEBUG - Namespace ctest-new-default-65239675 still in k8s 2024-09-04 23:06:40,089 - DEBUG - Namespace ctest-new-default-65239675 is not in k8s 2024-09-04 23:06:40,089 - DEBUG - No need to check project deletion in contrail-api