2024-08-20 13:52:07,007 - INFO - Using existing project ['default-domain', 'k8s-default'](417ec10e-b0d5-44ba-bcdb-f796fe2ffc7e) 2024-08-20 13:52:07,031 - DEBUG - Namespace ctest-new-default-69699026 not present 2024-08-20 13:52:07,040 - INFO - Created namespace ctest-new-default-69699026 2024-08-20 13:52:10,045 - DEBUG - Namespace ctest-non-default-37857542 not present 2024-08-20 13:52:10,058 - INFO - Created namespace ctest-non-default-37857542 2024-08-20 13:52:13,075 - DEBUG - Pod ctest-pod-22689329 not present 2024-08-20 13:52:13,076 - INFO - Creating Pod ctest-pod-22689329 2024-08-20 13:52:13,092 - DEBUG - Pod : ctest-pod-22689329 UUID is 47615ce3-6a76-4f44-90b3-cb91f1f5158c 2024-08-20 13:52:13,095 - DEBUG - Pod ctest-pod-28013462 not present 2024-08-20 13:52:13,095 - INFO - Creating Pod ctest-pod-28013462 2024-08-20 13:52:13,117 - DEBUG - Pod : ctest-pod-28013462 UUID is 6d4bf2d1-43ef-4d6f-b106-9199ff1ab7c6 2024-08-20 13:52:13,120 - DEBUG - Pod ctest-pod-01186967 not present 2024-08-20 13:52:13,120 - INFO - Creating Pod ctest-pod-01186967 2024-08-20 13:52:13,142 - DEBUG - Pod : ctest-pod-01186967 UUID is bf2d1267-2a0a-4730-ab55-d88db52f877b 2024-08-20 13:52:13,146 - DEBUG - Pod ctest-pod-30611757 not present 2024-08-20 13:52:13,147 - INFO - Creating Pod ctest-pod-30611757 2024-08-20 13:52:13,174 - DEBUG - Pod : ctest-pod-30611757 UUID is 2c0b3334-3b77-4cf0-9489-7891134767d5 2024-08-20 13:52:13,177 - DEBUG - Pod ctest-pod-43183675 not present 2024-08-20 13:52:13,177 - INFO - Creating Pod ctest-pod-43183675 2024-08-20 13:52:13,199 - DEBUG - Pod : ctest-pod-43183675 UUID is 23f443d9-80f4-474d-b9d6-91c7de0905f0 2024-08-20 13:52:13,201 - DEBUG - Pod ctest-pod-94846911 not present 2024-08-20 13:52:13,201 - INFO - Creating Pod ctest-pod-94846911 2024-08-20 13:52:13,222 - DEBUG - Pod : ctest-pod-94846911 UUID is fa840b7a-20b2-46da-9483-1b57f8115046 2024-08-20 13:52:13,225 - DEBUG - Pod ctest-pod-32610443 not present 2024-08-20 13:52:13,225 - INFO - Creating Pod ctest-pod-32610443 2024-08-20 13:52:13,245 - DEBUG - Pod : ctest-pod-32610443 UUID is 050e44d6-42df-4d96-9933-0f68096708bf 2024-08-20 13:52:13,248 - DEBUG - Pod ctest-pod-65712145 not present 2024-08-20 13:52:13,248 - INFO - Creating Pod ctest-pod-65712145 2024-08-20 13:52:13,264 - DEBUG - Pod : ctest-pod-65712145 UUID is 862b866c-f049-4ace-8248-646ecfad0bee 2024-08-20 13:52:13,512 - INFO - Project default-domain:k8s-ctest-new-default-69699026 for Namespace ctest-new-default-69699026 is seen in contrail-api 2024-08-20 13:52:13,513 - DEBUG - Project uuid in Contrail is 9b56a0af-d125-46d4-b622-07a43440b5d9 2024-08-20 13:52:13,682 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=0a834c80-557e-4eef-8d13-48f0536f3a20 2024-08-20 13:52:13,686 - INFO - Namespace ctest-new-default-69699026 with uuid 0a834c80-557e-4eef-8d13-48f0536f3a20 found in kube manager 2024-08-20 13:52:13,686 - INFO - Namespace ctest-new-default-69699026 verification passed 2024-08-20 13:52:13,959 - INFO - Project default-domain:k8s-ctest-non-default-37857542 for Namespace ctest-non-default-37857542 is seen in contrail-api 2024-08-20 13:52:13,960 - DEBUG - Project uuid in Contrail is 70f5f006-6a08-41e0-8998-fe345994ab3b 2024-08-20 13:52:13,960 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=697ae860-bfe7-48d8-84f7-e02fbb1c523f 2024-08-20 13:52:13,965 - INFO - Namespace ctest-non-default-37857542 with uuid 697ae860-bfe7-48d8-84f7-e02fbb1c523f found in kube manager 2024-08-20 13:52:13,965 - INFO - Namespace ctest-non-default-37857542 verification passed 2024-08-20 13:52:13,970 - DEBUG - Pod ctest-pod-22689329 not in running state.Currently in Pending 2024-08-20 13:52:18,980 - DEBUG - Pod ctest-pod-22689329 not in running state.Currently in Pending 2024-08-20 13:52:23,988 - INFO - Pod ctest-pod-22689329 is in running state.Got IP 10.47.255.248 2024-08-20 13:52:24,039 - DEBUG - Pod ctest-pod-22689329 has vmi 68c827ca-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:24,040 - INFO - Verified pod ctest-pod-22689329 in contrail-api 2024-08-20 13:52:24,051 - DEBUG - VMI 68c827ca-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:24,051 - INFO - Verified Pod ctest-pod-22689329 in agent 10.0.0.57 2024-08-20 13:52:24,052 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=47615ce3-6a76-4f44-90b3-cb91f1f5158c 2024-08-20 13:52:24,056 - INFO - Pod ctest-pod-22689329 with uuid 47615ce3-6a76-4f44-90b3-cb91f1f5158c found in kube manager 2024-08-20 13:52:24,056 - INFO - Pod ctest-pod-22689329 verification passed 2024-08-20 13:52:24,061 - DEBUG - Pod ctest-pod-28013462 not in running state.Currently in Pending 2024-08-20 13:52:29,069 - INFO - Pod ctest-pod-28013462 is in running state.Got IP 10.47.255.247 2024-08-20 13:52:29,119 - DEBUG - Pod ctest-pod-28013462 has vmi 697537e4-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:29,120 - INFO - Verified pod ctest-pod-28013462 in contrail-api 2024-08-20 13:52:29,130 - DEBUG - VMI 697537e4-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:29,131 - INFO - Verified Pod ctest-pod-28013462 in agent 10.0.0.57 2024-08-20 13:52:29,131 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=6d4bf2d1-43ef-4d6f-b106-9199ff1ab7c6 2024-08-20 13:52:29,135 - INFO - Pod ctest-pod-28013462 with uuid 6d4bf2d1-43ef-4d6f-b106-9199ff1ab7c6 found in kube manager 2024-08-20 13:52:29,135 - INFO - Pod ctest-pod-28013462 verification passed 2024-08-20 13:52:29,141 - DEBUG - Pod ctest-pod-01186967 not in running state.Currently in Pending 2024-08-20 13:52:34,148 - INFO - Pod ctest-pod-01186967 is in running state.Got IP 10.47.255.246 2024-08-20 13:52:34,200 - DEBUG - Pod ctest-pod-01186967 has vmi 6a6513fe-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:34,201 - INFO - Verified pod ctest-pod-01186967 in contrail-api 2024-08-20 13:52:34,213 - DEBUG - VMI 6a6513fe-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:34,214 - INFO - Verified Pod ctest-pod-01186967 in agent 10.0.0.57 2024-08-20 13:52:34,214 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=bf2d1267-2a0a-4730-ab55-d88db52f877b 2024-08-20 13:52:34,218 - INFO - Pod ctest-pod-01186967 with uuid bf2d1267-2a0a-4730-ab55-d88db52f877b found in kube manager 2024-08-20 13:52:34,218 - INFO - Pod ctest-pod-01186967 verification passed 2024-08-20 13:52:34,223 - INFO - Pod ctest-pod-30611757 is in running state.Got IP 10.47.255.245 2024-08-20 13:52:34,314 - DEBUG - Pod ctest-pod-30611757 has vmi 6b1f4ff8-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:34,315 - INFO - Verified pod ctest-pod-30611757 in contrail-api 2024-08-20 13:52:34,329 - DEBUG - VMI 6b1f4ff8-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:34,329 - INFO - Verified Pod ctest-pod-30611757 in agent 10.0.0.57 2024-08-20 13:52:34,329 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=2c0b3334-3b77-4cf0-9489-7891134767d5 2024-08-20 13:52:34,334 - INFO - Pod ctest-pod-30611757 with uuid 2c0b3334-3b77-4cf0-9489-7891134767d5 found in kube manager 2024-08-20 13:52:34,334 - INFO - Pod ctest-pod-30611757 verification passed 2024-08-20 13:52:34,340 - DEBUG - Pod ctest-pod-43183675 not in running state.Currently in Pending 2024-08-20 13:52:39,346 - INFO - Pod ctest-pod-43183675 is in running state.Got IP 10.47.255.244 2024-08-20 13:52:39,395 - DEBUG - Pod ctest-pod-43183675 has vmi 6bec4594-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:39,395 - INFO - Verified pod ctest-pod-43183675 in contrail-api 2024-08-20 13:52:39,407 - DEBUG - VMI 6bec4594-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:39,407 - INFO - Verified Pod ctest-pod-43183675 in agent 10.0.0.57 2024-08-20 13:52:39,407 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=23f443d9-80f4-474d-b9d6-91c7de0905f0 2024-08-20 13:52:39,411 - INFO - Pod ctest-pod-43183675 with uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 found in kube manager 2024-08-20 13:52:39,412 - INFO - Pod ctest-pod-43183675 verification passed 2024-08-20 13:52:39,417 - INFO - Pod ctest-pod-32610443 is in running state.Got IP 10.47.255.242 2024-08-20 13:52:39,508 - DEBUG - Pod ctest-pod-32610443 has vmi 6d44e4a0-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:39,508 - INFO - Verified pod ctest-pod-32610443 in contrail-api 2024-08-20 13:52:39,520 - DEBUG - VMI 6d44e4a0-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:39,521 - INFO - Verified Pod ctest-pod-32610443 in agent 10.0.0.57 2024-08-20 13:52:39,521 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=050e44d6-42df-4d96-9933-0f68096708bf 2024-08-20 13:52:39,525 - INFO - Pod ctest-pod-32610443 with uuid 050e44d6-42df-4d96-9933-0f68096708bf found in kube manager 2024-08-20 13:52:39,525 - INFO - Pod ctest-pod-32610443 verification passed 2024-08-20 13:52:39,531 - INFO - Pod ctest-pod-94846911 is in running state.Got IP 10.47.255.243 2024-08-20 13:52:39,621 - DEBUG - Pod ctest-pod-94846911 has vmi 6c94af18-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:39,621 - INFO - Verified pod ctest-pod-94846911 in contrail-api 2024-08-20 13:52:39,633 - DEBUG - VMI 6c94af18-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:39,634 - INFO - Verified Pod ctest-pod-94846911 in agent 10.0.0.57 2024-08-20 13:52:39,634 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=fa840b7a-20b2-46da-9483-1b57f8115046 2024-08-20 13:52:39,638 - INFO - Pod ctest-pod-94846911 with uuid fa840b7a-20b2-46da-9483-1b57f8115046 found in kube manager 2024-08-20 13:52:39,638 - INFO - Pod ctest-pod-94846911 verification passed 2024-08-20 13:52:39,644 - INFO - Pod ctest-pod-65712145 is in running state.Got IP 10.47.255.241 2024-08-20 13:52:39,735 - DEBUG - Pod ctest-pod-65712145 has vmi 6de8502c-5efb-11ef-bdc7-fa163ede1503 2024-08-20 13:52:39,736 - INFO - Verified pod ctest-pod-65712145 in contrail-api 2024-08-20 13:52:39,748 - DEBUG - VMI 6de8502c-5efb-11ef-bdc7-fa163ede1503 is active in agent 10.0.0.57 2024-08-20 13:52:39,748 - INFO - Verified Pod ctest-pod-65712145 in agent 10.0.0.57 2024-08-20 13:52:39,748 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=862b866c-f049-4ace-8248-646ecfad0bee 2024-08-20 13:52:39,752 - INFO - Pod ctest-pod-65712145 with uuid 862b866c-f049-4ace-8248-646ecfad0bee found in kube manager 2024-08-20 13:52:39,752 - INFO - Pod ctest-pod-65712145 verification passed 2024-08-20 13:52:39,752 - INFO - ================================================================================ 2024-08-20 13:52:39,752 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-20 13:52:39,753 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-20 13:52:39,989 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.0.0.57': '0'}} with 2024-08-20 13:52:39,989 - INFO - Initial checks done. Running the testcase now 2024-08-20 13:52:39,989 - INFO - 2024-08-20 13:52:40,043 - DEBUG - [Pod ctest-pod-22689329] Cmd: echo ctest-pod-22689329 > /usr/share/nginx/html/index.html, Output: 2024-08-20 13:52:40,087 - DEBUG - [Pod ctest-pod-28013462] Cmd: echo ctest-pod-28013462 > /usr/share/nginx/html/index.html, Output: 2024-08-20 13:52:40,128 - DEBUG - [Pod ctest-pod-01186967] Cmd: echo ctest-pod-01186967 > /usr/share/nginx/html/index.html, Output: 2024-08-20 13:52:40,169 - DEBUG - [Pod ctest-pod-30611757] Cmd: echo ctest-pod-30611757 > /usr/share/nginx/html/index.html, Output: 2024-08-20 13:52:40,173 - DEBUG - Service ctest-nginx-svc-09000678 not present 2024-08-20 13:52:40,173 - INFO - Creating service ctest-nginx-svc-09000678 2024-08-20 13:52:40,191 - INFO - Created Service ctest-nginx-svc-09000678 2024-08-20 13:52:40,200 - WARNING - Service UUID 8eb6abb6-9605-4e5f-a9bb-a86578bcac3e not yet found in contrail-api 2024-08-20 13:52:41,208 - INFO - Validated that Service ctest-nginx-svc-09000678 is seen in contrail-api 2024-08-20 13:52:41,208 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=8eb6abb6-9605-4e5f-a9bb-a86578bcac3e 2024-08-20 13:52:41,213 - INFO - Service ctest-nginx-svc-09000678 with uuid 8eb6abb6-9605-4e5f-a9bb-a86578bcac3e found in kube manager 2024-08-20 13:52:41,213 - INFO - Service ctest-nginx-svc-09000678 verification passed 2024-08-20 13:52:42,373 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:52:42,373 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:52:42,373 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:52:42,420 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:52:42,421 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:52:42,421 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:52:42,421 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-22689329': 1, 'ctest-pod-28013462': 1} 2024-08-20 13:52:42,468 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:52:42,469 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:52:42,469 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:52:42,510 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:52:42,510 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:52:42,510 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:52:42,552 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: ctest-pod-28013462 Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:52:42,553 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:52:42,553 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: ctest-pod-28013462 Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:52:42,597 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:52:42,597 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:52:42,597 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:52:42,597 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-22689329': 1, 'ctest-pod-28013462': 3} 2024-08-20 13:52:42,601 - DEBUG - Network policy ingress-on-service not present 2024-08-20 13:52:42,602 - INFO - Creating Network Policy ingress-on-service 2024-08-20 13:52:42,615 - INFO - Network policy found in k8s 2024-08-20 13:52:42,615 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d1d018d-2826-4323-aa90-4160bc723d07 2024-08-20 13:52:42,620 - INFO - Network Policy ingress-on-service with uuid 6d1d018d-2826-4323-aa90-4160bc723d07 found in kube manager 2024-08-20 13:52:42,647 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-20 13:52:42,647 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-20 13:52:42,648 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d1d018d-2826-4323-aa90-4160bc723d07 2024-08-20 13:52:42,672 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-20 13:52:44,672 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d1d018d-2826-4323-aa90-4160bc723d07 2024-08-20 13:52:44,705 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-20 13:52:46,706 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d1d018d-2826-4323-aa90-4160bc723d07 2024-08-20 13:52:46,733 - INFO - Network policy with name ingress-on-service found in agent 2024-08-20 13:52:46,733 - INFO - Network Policy ingress-on-service verification passed 2024-08-20 13:52:51,788 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:52:51,788 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:52:51,788 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:52:56,836 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:52:56,836 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:52:56,836 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:01,879 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:01,880 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:01,880 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:06,929 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:06,929 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:06,930 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:11,980 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:11,981 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:11,981 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:17,024 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:17,024 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:17,024 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:22,068 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:22,068 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:22,068 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:27,116 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:27,116 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:27,116 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:32,165 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:32,165 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:32,166 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:37,211 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:37,211 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:37,211 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:37,211 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-22689329': 0, 'ctest-pod-28013462': 0} 2024-08-20 13:53:37,256 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) ctest-pod-22689329 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:53:37,256 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:53:37,256 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) ctest-pod-22689329 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:53:37,301 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) ctest-pod-28013462 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:53:37,302 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:53:37,302 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) ctest-pod-28013462 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:53:37,302 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-22689329': 1, 'ctest-pod-28013462': 1} 2024-08-20 13:53:42,349 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:42,349 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:42,349 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:47,398 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:47,398 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:47,398 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:52,445 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:52,445 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:52,445 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:57,491 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:57,491 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:53:57,491 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:02,535 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:02,536 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:02,536 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:07,588 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:07,588 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:07,588 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:12,642 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:12,643 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:12,643 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:17,698 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:17,699 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:17,699 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:22,753 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:22,753 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:22,753 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:27,804 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:27,804 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:27,804 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:27,804 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-22689329': 0, 'ctest-pod-28013462': 0} 2024-08-20 13:54:29,856 - DEBUG - [Pod ctest-pod-94846911] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.586 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.066 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.237/0.586 ms 2024-08-20 13:54:29,856 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-94846911 with expectation True passed 2024-08-20 13:54:31,908 - DEBUG - [Pod ctest-pod-43183675] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.428 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.060 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.069 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.185/0.428 ms 2024-08-20 13:54:31,908 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-43183675 with expectation True passed 2024-08-20 13:54:33,955 - DEBUG - [Pod ctest-pod-32610443] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.676 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.069 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.272/0.676 ms 2024-08-20 13:54:33,955 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-32610443 with expectation True passed 2024-08-20 13:54:34,003 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:54:34,003 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-20 13:54:34,004 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:54:34,004 - INFO - wget check of of http://10.47.255.248 from ctest-pod-94846911 passed 2024-08-20 13:54:34,055 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:54:34,055 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2024-08-20 13:54:34,055 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:54:34,055 - INFO - wget check of of http://10.47.255.247 from ctest-pod-94846911 passed 2024-08-20 13:54:39,099 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-20 13:54:39,099 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-20 13:54:39,099 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-20 13:54:39,099 - INFO - wget check of of http://10.47.255.247 from ctest-pod-43183675 passed 2024-08-20 13:54:44,148 - DEBUG - [Pod ctest-pod-65712145] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-20 13:54:44,148 - DEBUG - [Pod Pod ctest-pod-65712145] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-20 13:54:44,148 - DEBUG - [Pod Pod ctest-pod-65712145] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-20 13:54:44,148 - INFO - wget check of of http://10.47.255.248 from ctest-pod-65712145 passed 2024-08-20 13:54:44,159 - INFO - Updating Network Policy ingress-on-service 2024-08-20 13:54:49,211 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:49,211 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:49,211 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:54,273 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:54,273 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:54,273 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:59,319 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:59,319 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:54:59,319 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:04,358 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:04,358 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:04,358 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:09,401 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:09,401 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:09,401 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:14,442 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:14,442 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:14,442 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:19,486 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:19,486 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:19,486 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:24,526 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:24,526 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:24,527 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:29,568 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:29,568 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:29,568 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:34,616 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:34,616 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:34,616 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) wget: download timed out 2024-08-20 13:55:34,616 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-22689329': 0, 'ctest-pod-28013462': 0} 2024-08-20 13:55:34,662 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:55:34,662 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:55:34,662 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:55:34,706 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:55:34,706 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:55:34,706 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:55:34,706 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-22689329': 1, 'ctest-pod-28013462': 1} 2024-08-20 13:55:34,750 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:55:34,751 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:55:34,751 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28013462 2024-08-20 13:55:34,795 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) ctest-pod-28013462 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:55:34,795 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:55:34,795 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) ctest-pod-28013462 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-20 13:55:34,837 - DEBUG - [Pod ctest-pod-32610443] Cmd: wget http://10.108.152.114:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:55:34,837 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd wget http://10.108.152.114:80/ -O - -T 5 -t 1 passed 2024-08-20 13:55:34,837 - DEBUG - [Pod Pod ctest-pod-32610443] Cmd output: Connecting to 10.108.152.114:80 (10.108.152.114:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-22689329 2024-08-20 13:55:34,837 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-22689329': 1, 'ctest-pod-28013462': 2} 2024-08-20 13:55:36,879 - DEBUG - [Pod ctest-pod-94846911] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.522 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.080 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.224/0.522 ms 2024-08-20 13:55:36,879 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-94846911 with expectation True passed 2024-08-20 13:55:38,929 - DEBUG - [Pod ctest-pod-43183675] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.392 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.056 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.067 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.056/0.171/0.392 ms 2024-08-20 13:55:38,929 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-43183675 with expectation True passed 2024-08-20 13:55:40,978 - DEBUG - [Pod ctest-pod-32610443] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.473 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.056 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.084 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.056/0.204/0.473 ms 2024-08-20 13:55:40,978 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-32610443 with expectation True passed 2024-08-20 13:55:41,030 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:55:41,030 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-20 13:55:41,030 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:55:41,030 - INFO - wget check of of http://10.47.255.248 from ctest-pod-94846911 passed 2024-08-20 13:55:41,078 - DEBUG - [Pod ctest-pod-94846911] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:55:41,078 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2024-08-20 13:55:41,078 - DEBUG - [Pod Pod ctest-pod-94846911] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:55:41,078 - INFO - wget check of of http://10.47.255.247 from ctest-pod-94846911 passed 2024-08-20 13:55:46,121 - DEBUG - [Pod ctest-pod-43183675] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-20 13:55:46,121 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-20 13:55:46,122 - DEBUG - [Pod Pod ctest-pod-43183675] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-20 13:55:46,122 - INFO - wget check of of http://10.47.255.247 from ctest-pod-43183675 passed 2024-08-20 13:55:46,178 - DEBUG - [Pod ctest-pod-65712145] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:55:46,178 - DEBUG - [Pod Pod ctest-pod-65712145] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-20 13:55:46,178 - DEBUG - [Pod Pod ctest-pod-65712145] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-20 13:55:46,179 - INFO - wget check of of http://10.47.255.248 from ctest-pod-65712145 passed 2024-08-20 13:55:46,179 - INFO - Deleting Network Policy : ingress-on-service 2024-08-20 13:55:46,179 - INFO - Deleting service : ctest-nginx-svc-09000678 2024-08-20 13:55:46,669 - DEBUG - No XMPP flaps were noticed during the test 2024-08-20 13:55:46,669 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07] 2024-08-20 13:55:46,669 - INFO - -------------------------------------------------------------------------------- 2024-08-20 13:55:46,675 - INFO - Deleting pod ctest-new-default-69699026:ctest-pod-22689329 2024-08-20 13:55:46,676 - INFO - Deleting pod ctest-new-default-69699026:ctest-pod-28013462 2024-08-20 13:55:46,676 - INFO - Deleting pod ctest-non-default-37857542:ctest-pod-01186967 2024-08-20 13:55:46,676 - INFO - Deleting pod ctest-non-default-37857542:ctest-pod-30611757 2024-08-20 13:55:46,677 - INFO - Deleting pod ctest-new-default-69699026:ctest-pod-43183675 2024-08-20 13:55:46,677 - INFO - Deleting pod ctest-new-default-69699026:ctest-pod-94846911 2024-08-20 13:55:46,677 - INFO - Deleting pod ctest-non-default-37857542:ctest-pod-32610443 2024-08-20 13:55:46,678 - INFO - Deleting pod ctest-non-default-37857542:ctest-pod-65712145 2024-08-20 13:55:46,734 - WARNING - Pod uuid 47615ce3-6a76-4f44-90b3-cb91f1f5158c is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,798 - WARNING - Pod uuid 2c0b3334-3b77-4cf0-9489-7891134767d5 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,845 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,846 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,846 - WARNING - Pod uuid bf2d1267-2a0a-4730-ab55-d88db52f877b is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,847 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,847 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:46,847 - WARNING - Pod uuid 6d4bf2d1-43ef-4d6f-b106-9199ff1ab7c6 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:51,741 - DEBUG - Pod 47615ce3-6a76-4f44-90b3-cb91f1f5158c is not in agent 10.0.0.57 VM list 2024-08-20 13:55:51,747 - DEBUG - VMI 68c827ca-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:55:51,747 - INFO - Verified that pod ctest-pod-22689329 is removed in agent 2024-08-20 13:55:51,805 - DEBUG - Pod 2c0b3334-3b77-4cf0-9489-7891134767d5 is not in agent 10.0.0.57 VM list 2024-08-20 13:55:51,811 - DEBUG - VMI 6b1f4ff8-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:55:51,811 - INFO - Verified that pod ctest-pod-30611757 is removed in agent 2024-08-20 13:55:51,872 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:51,872 - DEBUG - Pod bf2d1267-2a0a-4730-ab55-d88db52f877b is not in agent 10.0.0.57 VM list 2024-08-20 13:55:51,874 - DEBUG - Pod 6d4bf2d1-43ef-4d6f-b106-9199ff1ab7c6 is not in agent 10.0.0.57 VM list 2024-08-20 13:55:51,875 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:51,875 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:51,876 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:51,884 - DEBUG - VMI 6a6513fe-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:55:51,884 - INFO - Verified that pod ctest-pod-01186967 is removed in agent 2024-08-20 13:55:51,885 - DEBUG - VMI 697537e4-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:55:51,885 - INFO - Verified that pod ctest-pod-28013462 is removed in agent 2024-08-20 13:55:56,881 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:56,888 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:56,890 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:55:56,890 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:01,887 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:01,900 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:01,902 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:01,902 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:06,894 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:06,913 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:06,913 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:06,914 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:11,901 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:11,926 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:11,927 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:11,928 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:16,909 - WARNING - Pod uuid 050e44d6-42df-4d96-9933-0f68096708bf is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:16,962 - WARNING - Pod uuid 862b866c-f049-4ace-8248-646ecfad0bee is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:16,962 - WARNING - Pod uuid 23f443d9-80f4-474d-b9d6-91c7de0905f0 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:16,970 - WARNING - Pod uuid fa840b7a-20b2-46da-9483-1b57f8115046 is still seen in agent 10.0.0.57 VM list 2024-08-20 13:56:21,916 - DEBUG - Pod 050e44d6-42df-4d96-9933-0f68096708bf is not in agent 10.0.0.57 VM list 2024-08-20 13:56:21,920 - DEBUG - VMI 6d44e4a0-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:56:21,921 - INFO - Verified that pod ctest-pod-32610443 is removed in agent 2024-08-20 13:56:21,974 - DEBUG - Pod 862b866c-f049-4ace-8248-646ecfad0bee is not in agent 10.0.0.57 VM list 2024-08-20 13:56:21,975 - DEBUG - Pod 23f443d9-80f4-474d-b9d6-91c7de0905f0 is not in agent 10.0.0.57 VM list 2024-08-20 13:56:21,984 - DEBUG - Pod fa840b7a-20b2-46da-9483-1b57f8115046 is not in agent 10.0.0.57 VM list 2024-08-20 13:56:21,987 - DEBUG - VMI 6bec4594-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:56:21,987 - INFO - Verified that pod ctest-pod-43183675 is removed in agent 2024-08-20 13:56:21,987 - DEBUG - VMI 6de8502c-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:56:21,987 - INFO - Verified that pod ctest-pod-65712145 is removed in agent 2024-08-20 13:56:21,991 - DEBUG - VMI 6c94af18-5efb-11ef-bdc7-fa163ede1503 is removed from agent 10.0.0.57 2024-08-20 13:56:21,991 - INFO - Verified that pod ctest-pod-94846911 is removed in agent 2024-08-20 13:56:21,991 - INFO - Deleting namespace ctest-non-default-37857542 2024-08-20 13:56:22,004 - DEBUG - Namespace ctest-non-default-37857542 still in k8s 2024-08-20 13:56:24,009 - DEBUG - Namespace ctest-non-default-37857542 still in k8s 2024-08-20 13:56:26,013 - DEBUG - Namespace ctest-non-default-37857542 still in k8s 2024-08-20 13:56:28,018 - DEBUG - Namespace ctest-non-default-37857542 is not in k8s 2024-08-20 13:56:28,018 - DEBUG - No need to check project deletion in contrail-api 2024-08-20 13:56:28,018 - INFO - Deleting namespace ctest-new-default-69699026 2024-08-20 13:56:28,028 - DEBUG - Namespace ctest-new-default-69699026 still in k8s 2024-08-20 13:56:30,034 - DEBUG - Namespace ctest-new-default-69699026 still in k8s 2024-08-20 13:56:32,039 - DEBUG - Namespace ctest-new-default-69699026 still in k8s 2024-08-20 13:56:34,044 - DEBUG - Namespace ctest-new-default-69699026 is not in k8s 2024-08-20 13:56:34,044 - DEBUG - No need to check project deletion in contrail-api