2024-08-21 23:42:12,583 - INFO - Using existing project ['default-domain', 'k8s-default'](a85fbb4f-fe81-40a4-86ae-587c4553554e) 2024-08-21 23:42:12,601 - DEBUG - Namespace ctest-new-default-24568107 not present 2024-08-21 23:42:12,608 - INFO - Created namespace ctest-new-default-24568107 2024-08-21 23:42:15,612 - DEBUG - Namespace ctest-non-default-73079365 not present 2024-08-21 23:42:15,624 - INFO - Created namespace ctest-non-default-73079365 2024-08-21 23:42:18,647 - DEBUG - Pod ctest-pod-98853412 not present 2024-08-21 23:42:18,648 - INFO - Creating Pod ctest-pod-98853412 2024-08-21 23:42:18,671 - DEBUG - Pod : ctest-pod-98853412 UUID is 160cf7fb-5220-433b-bb71-2457241c7fee 2024-08-21 23:42:18,673 - DEBUG - Pod ctest-pod-09728589 not present 2024-08-21 23:42:18,674 - INFO - Creating Pod ctest-pod-09728589 2024-08-21 23:42:18,699 - DEBUG - Pod : ctest-pod-09728589 UUID is 765a29dd-ff87-409e-b23b-e1178f25f093 2024-08-21 23:42:18,702 - DEBUG - Pod ctest-pod-54147389 not present 2024-08-21 23:42:18,702 - INFO - Creating Pod ctest-pod-54147389 2024-08-21 23:42:18,725 - DEBUG - Pod : ctest-pod-54147389 UUID is 81d41351-f08c-4dfe-86f0-308e4e10c98a 2024-08-21 23:42:18,728 - DEBUG - Pod ctest-pod-89904169 not present 2024-08-21 23:42:18,728 - INFO - Creating Pod ctest-pod-89904169 2024-08-21 23:42:18,750 - DEBUG - Pod : ctest-pod-89904169 UUID is e90bfa48-45ae-475f-809e-8922959af4fc 2024-08-21 23:42:18,753 - DEBUG - Pod ctest-pod-28191492 not present 2024-08-21 23:42:18,753 - INFO - Creating Pod ctest-pod-28191492 2024-08-21 23:42:18,770 - DEBUG - Pod : ctest-pod-28191492 UUID is edb72968-5731-48bc-8de1-1a08e72343ea 2024-08-21 23:42:18,772 - DEBUG - Pod ctest-pod-16287709 not present 2024-08-21 23:42:18,772 - INFO - Creating Pod ctest-pod-16287709 2024-08-21 23:42:18,790 - DEBUG - Pod : ctest-pod-16287709 UUID is 900158bd-e372-4ad7-9bd6-ad39ad225d4e 2024-08-21 23:42:18,792 - DEBUG - Pod ctest-pod-83233274 not present 2024-08-21 23:42:18,792 - INFO - Creating Pod ctest-pod-83233274 2024-08-21 23:42:18,811 - DEBUG - Pod : ctest-pod-83233274 UUID is 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 2024-08-21 23:42:18,813 - DEBUG - Pod ctest-pod-87309673 not present 2024-08-21 23:42:18,813 - INFO - Creating Pod ctest-pod-87309673 2024-08-21 23:42:18,826 - DEBUG - Pod : ctest-pod-87309673 UUID is ce61e251-681e-4fe5-83a1-0ea48d24250e 2024-08-21 23:42:19,007 - INFO - Project default-domain:k8s-ctest-new-default-24568107 for Namespace ctest-new-default-24568107 is seen in contrail-api 2024-08-21 23:42:19,007 - DEBUG - Project uuid in Contrail is 70ccb61a-1662-4a74-b55d-b3dec1ea4460 2024-08-21 23:42:19,166 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_NamespaceDatabaseList?namespace_uuid=c9fa35fc-289e-4938-ade0-389f2ed815d7 2024-08-21 23:42:19,171 - INFO - Namespace ctest-new-default-24568107 with uuid c9fa35fc-289e-4938-ade0-389f2ed815d7 found in kube manager 2024-08-21 23:42:19,171 - INFO - Namespace ctest-new-default-24568107 verification passed 2024-08-21 23:42:19,326 - INFO - Project default-domain:k8s-ctest-non-default-73079365 for Namespace ctest-non-default-73079365 is seen in contrail-api 2024-08-21 23:42:19,327 - DEBUG - Project uuid in Contrail is 9f6e9ca4-9d2a-473e-81a5-e7698e277c2b 2024-08-21 23:42:19,327 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_NamespaceDatabaseList?namespace_uuid=9cef6cc9-41bd-4da5-9441-15757e15c861 2024-08-21 23:42:19,336 - INFO - Namespace ctest-non-default-73079365 with uuid 9cef6cc9-41bd-4da5-9441-15757e15c861 found in kube manager 2024-08-21 23:42:19,336 - INFO - Namespace ctest-non-default-73079365 verification passed 2024-08-21 23:42:19,342 - DEBUG - Pod ctest-pod-98853412 not in running state.Currently in Pending 2024-08-21 23:42:24,350 - DEBUG - Pod ctest-pod-98853412 not in running state.Currently in Pending 2024-08-21 23:42:29,358 - INFO - Pod ctest-pod-98853412 is in running state.Got IP 10.47.255.251 2024-08-21 23:42:29,369 - DEBUG - Pod ctest-pod-98853412 has vmi 01bb2470-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:29,369 - INFO - Verified pod ctest-pod-98853412 in contrail-api 2024-08-21 23:42:29,383 - DEBUG - VMI 01bb2470-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:29,383 - INFO - Verified Pod ctest-pod-98853412 in agent 10.0.0.33 2024-08-21 23:42:29,383 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=160cf7fb-5220-433b-bb71-2457241c7fee 2024-08-21 23:42:29,389 - INFO - Pod ctest-pod-98853412 with uuid 160cf7fb-5220-433b-bb71-2457241c7fee found in kube manager 2024-08-21 23:42:29,389 - INFO - Pod ctest-pod-98853412 verification passed 2024-08-21 23:42:29,395 - DEBUG - Pod ctest-pod-09728589 not in running state.Currently in Pending 2024-08-21 23:42:34,402 - INFO - Pod ctest-pod-09728589 is in running state.Got IP 10.47.255.250 2024-08-21 23:42:34,414 - DEBUG - Pod ctest-pod-09728589 has vmi 0223d984-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:34,414 - INFO - Verified pod ctest-pod-09728589 in contrail-api 2024-08-21 23:42:34,427 - DEBUG - VMI 0223d984-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:34,428 - INFO - Verified Pod ctest-pod-09728589 in agent 10.0.0.33 2024-08-21 23:42:34,428 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=765a29dd-ff87-409e-b23b-e1178f25f093 2024-08-21 23:42:34,434 - INFO - Pod ctest-pod-09728589 with uuid 765a29dd-ff87-409e-b23b-e1178f25f093 found in kube manager 2024-08-21 23:42:34,434 - INFO - Pod ctest-pod-09728589 verification passed 2024-08-21 23:42:34,440 - INFO - Pod ctest-pod-54147389 is in running state.Got IP 10.47.255.249 2024-08-21 23:42:34,493 - DEBUG - Pod ctest-pod-54147389 has vmi 02b8286e-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:34,493 - INFO - Verified pod ctest-pod-54147389 in contrail-api 2024-08-21 23:42:34,505 - DEBUG - VMI 02b8286e-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:34,505 - INFO - Verified Pod ctest-pod-54147389 in agent 10.0.0.33 2024-08-21 23:42:34,506 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=81d41351-f08c-4dfe-86f0-308e4e10c98a 2024-08-21 23:42:34,510 - INFO - Pod ctest-pod-54147389 with uuid 81d41351-f08c-4dfe-86f0-308e4e10c98a found in kube manager 2024-08-21 23:42:34,510 - INFO - Pod ctest-pod-54147389 verification passed 2024-08-21 23:42:34,516 - INFO - Pod ctest-pod-89904169 is in running state.Got IP 10.47.255.248 2024-08-21 23:42:34,526 - DEBUG - Pod ctest-pod-89904169 has vmi 032dbb42-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:34,526 - INFO - Verified pod ctest-pod-89904169 in contrail-api 2024-08-21 23:42:34,539 - DEBUG - VMI 032dbb42-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:34,539 - INFO - Verified Pod ctest-pod-89904169 in agent 10.0.0.33 2024-08-21 23:42:34,539 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=e90bfa48-45ae-475f-809e-8922959af4fc 2024-08-21 23:42:34,543 - INFO - Pod ctest-pod-89904169 with uuid e90bfa48-45ae-475f-809e-8922959af4fc found in kube manager 2024-08-21 23:42:34,544 - INFO - Pod ctest-pod-89904169 verification passed 2024-08-21 23:42:34,549 - INFO - Pod ctest-pod-28191492 is in running state.Got IP 10.47.255.247 2024-08-21 23:42:34,602 - DEBUG - Pod ctest-pod-28191492 has vmi 03aee442-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:34,602 - INFO - Verified pod ctest-pod-28191492 in contrail-api 2024-08-21 23:42:34,617 - DEBUG - VMI 03aee442-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:34,617 - INFO - Verified Pod ctest-pod-28191492 in agent 10.0.0.33 2024-08-21 23:42:34,617 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=edb72968-5731-48bc-8de1-1a08e72343ea 2024-08-21 23:42:34,621 - INFO - Pod ctest-pod-28191492 with uuid edb72968-5731-48bc-8de1-1a08e72343ea found in kube manager 2024-08-21 23:42:34,621 - INFO - Pod ctest-pod-28191492 verification passed 2024-08-21 23:42:34,627 - INFO - Pod ctest-pod-83233274 is in running state.Got IP 10.47.255.245 2024-08-21 23:42:34,636 - DEBUG - Pod ctest-pod-83233274 has vmi 047927f2-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:34,636 - INFO - Verified pod ctest-pod-83233274 in contrail-api 2024-08-21 23:42:34,647 - DEBUG - VMI 047927f2-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:34,647 - INFO - Verified Pod ctest-pod-83233274 in agent 10.0.0.33 2024-08-21 23:42:34,648 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 2024-08-21 23:42:34,652 - INFO - Pod ctest-pod-83233274 with uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 found in kube manager 2024-08-21 23:42:34,652 - INFO - Pod ctest-pod-83233274 verification passed 2024-08-21 23:42:34,657 - DEBUG - Pod ctest-pod-16287709 not in running state.Currently in Pending 2024-08-21 23:42:39,663 - INFO - Pod ctest-pod-16287709 is in running state.Got IP 10.47.255.246 2024-08-21 23:42:39,720 - DEBUG - Pod ctest-pod-16287709 has vmi 04159854-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:39,720 - INFO - Verified pod ctest-pod-16287709 in contrail-api 2024-08-21 23:42:39,738 - DEBUG - VMI 04159854-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:39,738 - INFO - Verified Pod ctest-pod-16287709 in agent 10.0.0.33 2024-08-21 23:42:39,739 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=900158bd-e372-4ad7-9bd6-ad39ad225d4e 2024-08-21 23:42:39,746 - INFO - Pod ctest-pod-16287709 with uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e found in kube manager 2024-08-21 23:42:39,746 - INFO - Pod ctest-pod-16287709 verification passed 2024-08-21 23:42:39,755 - INFO - Pod ctest-pod-87309673 is in running state.Got IP 10.47.255.244 2024-08-21 23:42:39,770 - DEBUG - Pod ctest-pod-87309673 has vmi 04e1ce4c-6017-11ef-8659-fa163e70e4fc 2024-08-21 23:42:39,770 - INFO - Verified pod ctest-pod-87309673 in contrail-api 2024-08-21 23:42:39,783 - DEBUG - VMI 04e1ce4c-6017-11ef-8659-fa163e70e4fc is active in agent 10.0.0.33 2024-08-21 23:42:39,783 - INFO - Verified Pod ctest-pod-87309673 in agent 10.0.0.33 2024-08-21 23:42:39,784 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_VirtualMachineDatabaseList?x=ce61e251-681e-4fe5-83a1-0ea48d24250e 2024-08-21 23:42:39,788 - INFO - Pod ctest-pod-87309673 with uuid ce61e251-681e-4fe5-83a1-0ea48d24250e found in kube manager 2024-08-21 23:42:39,788 - INFO - Pod ctest-pod-87309673 verification passed 2024-08-21 23:42:39,788 - INFO - ================================================================================ 2024-08-21 23:42:39,789 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-21 23:42:39,789 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-21 23:42:40,029 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.56': '0'}} with 2024-08-21 23:42:40,030 - INFO - Initial checks done. Running the testcase now 2024-08-21 23:42:40,030 - INFO - 2024-08-21 23:42:40,091 - DEBUG - [Pod ctest-pod-98853412] Cmd: echo ctest-pod-98853412 > /usr/share/nginx/html/index.html, Output: 2024-08-21 23:42:40,155 - DEBUG - [Pod ctest-pod-09728589] Cmd: echo ctest-pod-09728589 > /usr/share/nginx/html/index.html, Output: 2024-08-21 23:42:40,223 - DEBUG - [Pod ctest-pod-54147389] Cmd: echo ctest-pod-54147389 > /usr/share/nginx/html/index.html, Output: 2024-08-21 23:42:40,363 - DEBUG - [Pod ctest-pod-89904169] Cmd: echo ctest-pod-89904169 > /usr/share/nginx/html/index.html, Output: 2024-08-21 23:42:40,367 - DEBUG - Service ctest-nginx-svc-95197541 not present 2024-08-21 23:42:40,368 - INFO - Creating service ctest-nginx-svc-95197541 2024-08-21 23:42:40,406 - INFO - Created Service ctest-nginx-svc-95197541 2024-08-21 23:42:40,416 - WARNING - Service UUID e72af586-4b78-4f20-b6a5-23d0dc04a2da not yet found in contrail-api 2024-08-21 23:42:41,423 - INFO - Validated that Service ctest-nginx-svc-95197541 is seen in contrail-api 2024-08-21 23:42:41,423 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_LoadbalancerDatabaseList?x=e72af586-4b78-4f20-b6a5-23d0dc04a2da 2024-08-21 23:42:41,428 - INFO - Service ctest-nginx-svc-95197541 with uuid e72af586-4b78-4f20-b6a5-23d0dc04a2da found in kube manager 2024-08-21 23:42:41,428 - INFO - Service ctest-nginx-svc-95197541 verification passed 2024-08-21 23:42:41,501 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-98853412 2024-08-21 23:42:41,501 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:42:41,501 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-98853412 2024-08-21 23:42:41,564 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-98853412 2024-08-21 23:42:41,567 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:42:41,567 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-98853412 2024-08-21 23:42:41,794 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:42:41,794 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:42:41,794 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:42:41,794 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98853412': 2, 'ctest-pod-09728589': 1} 2024-08-21 23:42:41,873 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:42:41,873 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:42:41,873 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:42:41,930 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:42:41,930 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:42:41,930 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:42:41,930 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98853412': 1, 'ctest-pod-09728589': 1} 2024-08-21 23:42:41,934 - DEBUG - Network policy ingress-on-service not present 2024-08-21 23:42:41,935 - INFO - Creating Network Policy ingress-on-service 2024-08-21 23:42:41,950 - INFO - Network policy found in k8s 2024-08-21 23:42:41,950 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9b497c09-a2e1-4b9b-ab06-030d8b108ea0 2024-08-21 23:42:41,956 - INFO - Network Policy ingress-on-service with uuid 9b497c09-a2e1-4b9b-ab06-030d8b108ea0 found in kube manager 2024-08-21 23:42:41,990 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-21 23:42:41,990 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-21 23:42:41,991 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9b497c09-a2e1-4b9b-ab06-030d8b108ea0 2024-08-21 23:42:42,025 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-21 23:42:44,025 - DEBUG - Requesting: http://10.0.0.56:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9b497c09-a2e1-4b9b-ab06-030d8b108ea0 2024-08-21 23:42:44,056 - INFO - Network policy with name ingress-on-service found in agent 2024-08-21 23:42:44,056 - INFO - Network Policy ingress-on-service verification passed 2024-08-21 23:42:49,117 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:49,117 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:49,117 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:54,169 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:54,169 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:54,169 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:59,217 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:59,217 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:42:59,217 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:04,264 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:04,265 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:04,265 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:09,328 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:09,328 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:09,328 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:14,405 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:14,405 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:14,405 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:19,469 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:19,469 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:19,469 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:24,534 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:24,534 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:24,534 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:29,594 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:29,594 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:29,594 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:34,657 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:34,657 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:34,657 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:34,657 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98853412': 0, 'ctest-pod-09728589': 0} 2024-08-21 23:43:34,725 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:43:34,725 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:43:34,725 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:43:34,790 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:43:34,790 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:43:34,790 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:43:34,790 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98853412': 1, 'ctest-pod-09728589': 1} 2024-08-21 23:43:39,859 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:39,860 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:39,860 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:45,062 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:45,062 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:45,062 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:50,121 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:50,121 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:50,121 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:55,173 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:55,173 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:43:55,173 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:00,236 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:00,236 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:00,236 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:05,293 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:05,293 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:05,293 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:10,354 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:10,355 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:10,355 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:15,424 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:15,424 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:15,424 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:20,498 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:20,498 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:20,498 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:25,556 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:25,556 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:25,556 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:25,556 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98853412': 0, 'ctest-pod-09728589': 0} 2024-08-21 23:44:27,613 - DEBUG - [Pod ctest-pod-16287709] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.197 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.444/1.197 ms 2024-08-21 23:44:27,614 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-16287709 with expectation True passed 2024-08-21 23:44:29,673 - DEBUG - [Pod ctest-pod-28191492] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.411 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.186/0.411 ms 2024-08-21 23:44:29,673 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28191492 with expectation True passed 2024-08-21 23:44:31,729 - DEBUG - [Pod ctest-pod-83233274] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.378 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.062 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.174/0.378 ms 2024-08-21 23:44:31,730 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83233274 with expectation True passed 2024-08-21 23:44:31,799 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:44:31,799 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-21 23:44:31,799 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:44:31,800 - INFO - wget check of of http://10.47.255.251 from ctest-pod-16287709 passed 2024-08-21 23:44:31,856 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:44:31,856 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-21 23:44:31,856 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:44:31,856 - INFO - wget check of of http://10.47.255.250 from ctest-pod-16287709 passed 2024-08-21 23:44:36,905 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 23:44:36,905 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 23:44:36,905 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 23:44:36,905 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28191492 passed 2024-08-21 23:44:41,966 - DEBUG - [Pod ctest-pod-87309673] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-21 23:44:41,966 - DEBUG - [Pod Pod ctest-pod-87309673] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-21 23:44:41,966 - DEBUG - [Pod Pod ctest-pod-87309673] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-21 23:44:41,966 - INFO - wget check of of http://10.47.255.251 from ctest-pod-87309673 passed 2024-08-21 23:44:41,974 - INFO - Updating Network Policy ingress-on-service 2024-08-21 23:44:47,033 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:47,033 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:47,033 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:52,089 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:52,089 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:52,089 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:57,163 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:57,163 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:44:57,163 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:02,221 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:02,221 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:02,221 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:07,277 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:07,278 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:07,278 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:12,324 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:12,325 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:12,325 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:17,381 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:17,381 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:17,381 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:22,434 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:22,434 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:22,434 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:27,497 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:27,497 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:27,498 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:32,550 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:32,550 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:32,551 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) wget: download timed out 2024-08-21 23:45:32,551 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98853412': 0, 'ctest-pod-09728589': 0} 2024-08-21 23:45:32,605 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,605 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,605 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,665 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,665 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,665 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,728 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,728 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,728 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,787 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,787 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,787 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: ctest-pod-98853412 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,842 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09728589 2024-08-21 23:45:32,842 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,842 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09728589 2024-08-21 23:45:32,842 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98853412': 4, 'ctest-pod-09728589': 1} 2024-08-21 23:45:32,916 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,916 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,916 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:32,988 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09728589 2024-08-21 23:45:32,988 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:32,988 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09728589 2024-08-21 23:45:33,048 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:33,048 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:33,048 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: ctest-pod-09728589 Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-21 23:45:33,115 - DEBUG - [Pod ctest-pod-83233274] Cmd: wget http://10.105.177.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-98853412 2024-08-21 23:45:33,115 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd wget http://10.105.177.229:80/ -O - -T 5 -t 1 passed 2024-08-21 23:45:33,115 - DEBUG - [Pod Pod ctest-pod-83233274] Cmd output: Connecting to 10.105.177.229:80 (10.105.177.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-98853412 2024-08-21 23:45:33,115 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98853412': 1, 'ctest-pod-09728589': 3} 2024-08-21 23:45:35,165 - DEBUG - [Pod ctest-pod-16287709] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.357 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.499/1.357 ms 2024-08-21 23:45:35,165 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-16287709 with expectation True passed 2024-08-21 23:45:37,213 - DEBUG - [Pod ctest-pod-28191492] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.804 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.318/0.804 ms 2024-08-21 23:45:37,213 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-28191492 with expectation True passed 2024-08-21 23:45:39,283 - DEBUG - [Pod ctest-pod-83233274] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.963 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.378/0.963 ms 2024-08-21 23:45:39,283 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83233274 with expectation True passed 2024-08-21 23:45:39,376 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:45:39,376 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-21 23:45:39,376 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:45:39,376 - INFO - wget check of of http://10.47.255.251 from ctest-pod-16287709 passed 2024-08-21 23:45:39,456 - DEBUG - [Pod ctest-pod-16287709] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:45:39,456 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-21 23:45:39,456 - DEBUG - [Pod Pod ctest-pod-16287709] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:45:39,456 - INFO - wget check of of http://10.47.255.250 from ctest-pod-16287709 passed 2024-08-21 23:45:45,085 - DEBUG - [Pod ctest-pod-28191492] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 23:45:45,086 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 23:45:45,086 - DEBUG - [Pod Pod ctest-pod-28191492] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-21 23:45:45,086 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28191492 passed 2024-08-21 23:45:45,149 - DEBUG - [Pod ctest-pod-87309673] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:45:45,149 - DEBUG - [Pod Pod ctest-pod-87309673] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-21 23:45:45,149 - DEBUG - [Pod Pod ctest-pod-87309673] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-21 23:45:45,149 - INFO - wget check of of http://10.47.255.251 from ctest-pod-87309673 passed 2024-08-21 23:45:45,149 - INFO - Deleting Network Policy : ingress-on-service 2024-08-21 23:45:45,150 - INFO - Deleting service : ctest-nginx-svc-95197541 2024-08-21 23:45:45,394 - DEBUG - No XMPP flaps were noticed during the test 2024-08-21 23:45:45,394 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-08-21 23:45:45,394 - INFO - -------------------------------------------------------------------------------- 2024-08-21 23:45:45,400 - INFO - Deleting pod ctest-new-default-24568107:ctest-pod-98853412 2024-08-21 23:45:45,400 - INFO - Deleting pod ctest-new-default-24568107:ctest-pod-09728589 2024-08-21 23:45:45,400 - INFO - Deleting pod ctest-non-default-73079365:ctest-pod-54147389 2024-08-21 23:45:45,401 - INFO - Deleting pod ctest-non-default-73079365:ctest-pod-89904169 2024-08-21 23:45:45,401 - INFO - Deleting pod ctest-new-default-24568107:ctest-pod-28191492 2024-08-21 23:45:45,402 - INFO - Deleting pod ctest-new-default-24568107:ctest-pod-16287709 2024-08-21 23:45:45,402 - INFO - Deleting pod ctest-non-default-73079365:ctest-pod-83233274 2024-08-21 23:45:45,402 - INFO - Deleting pod ctest-non-default-73079365:ctest-pod-87309673 2024-08-21 23:45:45,491 - WARNING - Pod uuid 160cf7fb-5220-433b-bb71-2457241c7fee is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,526 - WARNING - Pod uuid 765a29dd-ff87-409e-b23b-e1178f25f093 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,528 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,529 - WARNING - Pod uuid 81d41351-f08c-4dfe-86f0-308e4e10c98a is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,533 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,534 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,535 - WARNING - Pod uuid e90bfa48-45ae-475f-809e-8922959af4fc is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:45,535 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:50,499 - DEBUG - Pod 160cf7fb-5220-433b-bb71-2457241c7fee is not in agent 10.0.0.33 VM list 2024-08-21 23:45:50,505 - DEBUG - VMI 01bb2470-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:45:50,505 - INFO - Verified that pod ctest-pod-98853412 is removed in agent 2024-08-21 23:45:50,543 - DEBUG - Pod 81d41351-f08c-4dfe-86f0-308e4e10c98a is not in agent 10.0.0.33 VM list 2024-08-21 23:45:50,545 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:50,546 - DEBUG - Pod 765a29dd-ff87-409e-b23b-e1178f25f093 is not in agent 10.0.0.33 VM list 2024-08-21 23:45:50,562 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:50,562 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:50,563 - DEBUG - Pod e90bfa48-45ae-475f-809e-8922959af4fc is not in agent 10.0.0.33 VM list 2024-08-21 23:45:50,566 - DEBUG - VMI 02b8286e-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:45:50,566 - INFO - Verified that pod ctest-pod-54147389 is removed in agent 2024-08-21 23:45:50,567 - DEBUG - VMI 0223d984-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:45:50,567 - INFO - Verified that pod ctest-pod-09728589 is removed in agent 2024-08-21 23:45:50,567 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:50,572 - DEBUG - VMI 032dbb42-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:45:50,572 - INFO - Verified that pod ctest-pod-89904169 is removed in agent 2024-08-21 23:45:55,553 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:55,575 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:55,576 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:45:55,577 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:00,563 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:00,590 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:00,591 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:00,592 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:05,575 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:05,608 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:05,610 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:05,610 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:10,582 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:10,628 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:10,630 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:10,630 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:15,591 - WARNING - Pod uuid 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:15,643 - WARNING - Pod uuid 900158bd-e372-4ad7-9bd6-ad39ad225d4e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:15,645 - WARNING - Pod uuid edb72968-5731-48bc-8de1-1a08e72343ea is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:15,645 - WARNING - Pod uuid ce61e251-681e-4fe5-83a1-0ea48d24250e is still seen in agent 10.0.0.33 VM list 2024-08-21 23:46:20,599 - DEBUG - Pod 7995e0b6-3f63-4269-bf08-6fb2ab53e4b1 is not in agent 10.0.0.33 VM list 2024-08-21 23:46:20,606 - DEBUG - VMI 047927f2-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:46:20,606 - INFO - Verified that pod ctest-pod-83233274 is removed in agent 2024-08-21 23:46:20,658 - DEBUG - Pod 900158bd-e372-4ad7-9bd6-ad39ad225d4e is not in agent 10.0.0.33 VM list 2024-08-21 23:46:20,667 - DEBUG - Pod edb72968-5731-48bc-8de1-1a08e72343ea is not in agent 10.0.0.33 VM list 2024-08-21 23:46:20,669 - DEBUG - Pod ce61e251-681e-4fe5-83a1-0ea48d24250e is not in agent 10.0.0.33 VM list 2024-08-21 23:46:20,693 - DEBUG - VMI 04159854-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:46:20,693 - INFO - Verified that pod ctest-pod-16287709 is removed in agent 2024-08-21 23:46:20,695 - DEBUG - VMI 04e1ce4c-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:46:20,695 - INFO - Verified that pod ctest-pod-87309673 is removed in agent 2024-08-21 23:46:20,696 - DEBUG - VMI 03aee442-6017-11ef-8659-fa163e70e4fc is removed from agent 10.0.0.33 2024-08-21 23:46:20,696 - INFO - Verified that pod ctest-pod-28191492 is removed in agent 2024-08-21 23:46:20,696 - INFO - Deleting namespace ctest-non-default-73079365 2024-08-21 23:46:20,826 - DEBUG - Namespace ctest-non-default-73079365 still in k8s 2024-08-21 23:46:22,832 - DEBUG - Namespace ctest-non-default-73079365 still in k8s 2024-08-21 23:46:24,837 - DEBUG - Namespace ctest-non-default-73079365 still in k8s 2024-08-21 23:46:26,847 - DEBUG - Namespace ctest-non-default-73079365 is not in k8s 2024-08-21 23:46:26,847 - DEBUG - No need to check project deletion in contrail-api 2024-08-21 23:46:26,847 - INFO - Deleting namespace ctest-new-default-24568107 2024-08-21 23:46:26,862 - DEBUG - Namespace ctest-new-default-24568107 still in k8s 2024-08-21 23:46:28,867 - DEBUG - Namespace ctest-new-default-24568107 still in k8s 2024-08-21 23:46:30,887 - DEBUG - Namespace ctest-new-default-24568107 still in k8s 2024-08-21 23:46:32,891 - DEBUG - Namespace ctest-new-default-24568107 is not in k8s 2024-08-21 23:46:32,891 - DEBUG - No need to check project deletion in contrail-api