2025-07-21 02:14:08,397 - INFO - Using existing project ['default-domain', 'k8s-default'](1029094f-cbf7-426b-9d49-5cad9ca8cc81) 2025-07-21 02:14:08,420 - DEBUG - Namespace ctest-new-default-92462507 not present 2025-07-21 02:14:08,429 - INFO - Created namespace ctest-new-default-92462507 2025-07-21 02:14:11,434 - DEBUG - Namespace ctest-non-default-39964569 not present 2025-07-21 02:14:11,446 - INFO - Created namespace ctest-non-default-39964569 2025-07-21 02:14:14,472 - DEBUG - Pod ctest-pod-69003838 not present 2025-07-21 02:14:14,473 - INFO - Creating Pod ctest-pod-69003838 2025-07-21 02:14:14,519 - DEBUG - Pod : ctest-pod-69003838 UUID is 6b299a70-8d26-4e7b-954a-2d9972e995ee 2025-07-21 02:14:14,523 - DEBUG - Pod ctest-pod-53527280 not present 2025-07-21 02:14:14,523 - INFO - Creating Pod ctest-pod-53527280 2025-07-21 02:14:14,586 - DEBUG - Pod : ctest-pod-53527280 UUID is 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 2025-07-21 02:14:14,588 - DEBUG - Pod ctest-pod-84476190 not present 2025-07-21 02:14:14,589 - INFO - Creating Pod ctest-pod-84476190 2025-07-21 02:14:14,640 - DEBUG - Pod : ctest-pod-84476190 UUID is c444bd88-6f33-4ec6-a71f-8500fa495911 2025-07-21 02:14:14,643 - DEBUG - Pod ctest-pod-10962474 not present 2025-07-21 02:14:14,643 - INFO - Creating Pod ctest-pod-10962474 2025-07-21 02:14:14,677 - DEBUG - Pod : ctest-pod-10962474 UUID is 4999e4ea-cf89-4d11-9394-89066680aad2 2025-07-21 02:14:14,685 - DEBUG - Pod ctest-pod-83863593 not present 2025-07-21 02:14:14,685 - INFO - Creating Pod ctest-pod-83863593 2025-07-21 02:14:14,711 - DEBUG - Pod : ctest-pod-83863593 UUID is f7cf4c00-e777-4068-b7a5-144522a2e657 2025-07-21 02:14:14,717 - DEBUG - Pod ctest-pod-12276091 not present 2025-07-21 02:14:14,717 - INFO - Creating Pod ctest-pod-12276091 2025-07-21 02:14:14,735 - DEBUG - Pod : ctest-pod-12276091 UUID is 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 2025-07-21 02:14:14,737 - DEBUG - Pod ctest-pod-63399254 not present 2025-07-21 02:14:14,738 - INFO - Creating Pod ctest-pod-63399254 2025-07-21 02:14:14,782 - DEBUG - Pod : ctest-pod-63399254 UUID is 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c 2025-07-21 02:14:14,785 - DEBUG - Pod ctest-pod-08343070 not present 2025-07-21 02:14:14,785 - INFO - Creating Pod ctest-pod-08343070 2025-07-21 02:14:14,814 - DEBUG - Pod : ctest-pod-08343070 UUID is 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 2025-07-21 02:14:14,988 - INFO - Project default-domain:k8s-ctest-new-default-92462507 for Namespace ctest-new-default-92462507 is seen in contrail-api 2025-07-21 02:14:14,988 - DEBUG - Project uuid in Contrail is 9f09c963-97d7-427c-a04f-c1065c647ded 2025-07-21 02:14:15,202 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=e0b94d1c-a4dc-4086-a924-cec1e4917a9e 2025-07-21 02:14:15,211 - INFO - Namespace ctest-new-default-92462507 with uuid e0b94d1c-a4dc-4086-a924-cec1e4917a9e found in kube manager 2025-07-21 02:14:15,212 - INFO - Namespace ctest-new-default-92462507 verification passed 2025-07-21 02:14:15,445 - INFO - Project default-domain:k8s-ctest-non-default-39964569 for Namespace ctest-non-default-39964569 is seen in contrail-api 2025-07-21 02:14:15,446 - DEBUG - Project uuid in Contrail is fa3e9f81-856b-4c80-8a8c-97e0a53b48b9 2025-07-21 02:14:15,446 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=0ff090e0-9ee8-45ea-9fff-1a4922350f84 2025-07-21 02:14:15,452 - INFO - Namespace ctest-non-default-39964569 with uuid 0ff090e0-9ee8-45ea-9fff-1a4922350f84 found in kube manager 2025-07-21 02:14:15,452 - INFO - Namespace ctest-non-default-39964569 verification passed 2025-07-21 02:14:15,460 - DEBUG - Pod ctest-pod-69003838 not in running state.Currently in Pending 2025-07-21 02:14:20,468 - DEBUG - Pod ctest-pod-69003838 not in running state.Currently in Pending 2025-07-21 02:14:25,475 - INFO - Pod ctest-pod-69003838 is in running state.Got IP 10.47.255.251 2025-07-21 02:14:25,533 - DEBUG - Pod ctest-pod-69003838 has vmi 66f736f4-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:25,533 - INFO - Verified pod ctest-pod-69003838 in contrail-api 2025-07-21 02:14:25,546 - DEBUG - VMI 66f736f4-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:25,546 - INFO - Verified Pod ctest-pod-69003838 in agent 10.0.0.27 2025-07-21 02:14:25,547 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=6b299a70-8d26-4e7b-954a-2d9972e995ee 2025-07-21 02:14:25,551 - INFO - Pod ctest-pod-69003838 with uuid 6b299a70-8d26-4e7b-954a-2d9972e995ee found in kube manager 2025-07-21 02:14:25,552 - INFO - Pod ctest-pod-69003838 verification passed 2025-07-21 02:14:25,557 - DEBUG - Pod ctest-pod-53527280 not in running state.Currently in Pending 2025-07-21 02:14:30,570 - INFO - Pod ctest-pod-53527280 is in running state.Got IP 10.47.255.250 2025-07-21 02:14:30,594 - DEBUG - Pod ctest-pod-53527280 has vmi 677b5bf0-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:30,594 - INFO - Verified pod ctest-pod-53527280 in contrail-api 2025-07-21 02:14:30,609 - DEBUG - VMI 677b5bf0-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:30,609 - INFO - Verified Pod ctest-pod-53527280 in agent 10.0.0.27 2025-07-21 02:14:30,609 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=9e3c3f1e-4c88-406f-868b-c2c170b2ce44 2025-07-21 02:14:30,614 - INFO - Pod ctest-pod-53527280 with uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 found in kube manager 2025-07-21 02:14:30,614 - INFO - Pod ctest-pod-53527280 verification passed 2025-07-21 02:14:30,619 - INFO - Pod ctest-pod-84476190 is in running state.Got IP 10.47.255.249 2025-07-21 02:14:30,677 - DEBUG - Pod ctest-pod-84476190 has vmi 681ae404-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:30,677 - INFO - Verified pod ctest-pod-84476190 in contrail-api 2025-07-21 02:14:30,695 - DEBUG - VMI 681ae404-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:30,695 - INFO - Verified Pod ctest-pod-84476190 in agent 10.0.0.27 2025-07-21 02:14:30,696 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c444bd88-6f33-4ec6-a71f-8500fa495911 2025-07-21 02:14:30,700 - INFO - Pod ctest-pod-84476190 with uuid c444bd88-6f33-4ec6-a71f-8500fa495911 found in kube manager 2025-07-21 02:14:30,701 - INFO - Pod ctest-pod-84476190 verification passed 2025-07-21 02:14:30,707 - INFO - Pod ctest-pod-10962474 is in running state.Got IP 10.47.255.248 2025-07-21 02:14:30,733 - DEBUG - Pod ctest-pod-10962474 has vmi 68992008-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:30,733 - INFO - Verified pod ctest-pod-10962474 in contrail-api 2025-07-21 02:14:30,748 - DEBUG - VMI 68992008-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:30,748 - INFO - Verified Pod ctest-pod-10962474 in agent 10.0.0.27 2025-07-21 02:14:30,748 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=4999e4ea-cf89-4d11-9394-89066680aad2 2025-07-21 02:14:30,753 - INFO - Pod ctest-pod-10962474 with uuid 4999e4ea-cf89-4d11-9394-89066680aad2 found in kube manager 2025-07-21 02:14:30,754 - INFO - Pod ctest-pod-10962474 verification passed 2025-07-21 02:14:30,759 - INFO - Pod ctest-pod-83863593 is in running state.Got IP 10.47.255.247 2025-07-21 02:14:30,784 - DEBUG - Pod ctest-pod-83863593 has vmi 692bbc74-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:30,785 - INFO - Verified pod ctest-pod-83863593 in contrail-api 2025-07-21 02:14:30,801 - DEBUG - VMI 692bbc74-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:30,802 - INFO - Verified Pod ctest-pod-83863593 in agent 10.0.0.27 2025-07-21 02:14:30,802 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=f7cf4c00-e777-4068-b7a5-144522a2e657 2025-07-21 02:14:30,806 - INFO - Pod ctest-pod-83863593 with uuid f7cf4c00-e777-4068-b7a5-144522a2e657 found in kube manager 2025-07-21 02:14:30,806 - INFO - Pod ctest-pod-83863593 verification passed 2025-07-21 02:14:30,811 - DEBUG - Pod ctest-pod-63399254 not in running state.Currently in Pending 2025-07-21 02:14:35,817 - INFO - Pod ctest-pod-63399254 is in running state.Got IP 10.47.255.245 2025-07-21 02:14:35,873 - DEBUG - Pod ctest-pod-63399254 has vmi 6a354ba8-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:35,873 - INFO - Verified pod ctest-pod-63399254 in contrail-api 2025-07-21 02:14:35,887 - DEBUG - VMI 6a354ba8-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:35,887 - INFO - Verified Pod ctest-pod-63399254 in agent 10.0.0.27 2025-07-21 02:14:35,888 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=4b6fd9af-1868-4e46-a5ad-251b9bbdf88c 2025-07-21 02:14:35,894 - INFO - Pod ctest-pod-63399254 with uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c found in kube manager 2025-07-21 02:14:35,894 - INFO - Pod ctest-pod-63399254 verification passed 2025-07-21 02:14:35,981 - INFO - Pod ctest-pod-12276091 is in running state.Got IP 10.47.255.246 2025-07-21 02:14:35,995 - DEBUG - Pod ctest-pod-12276091 has vmi 69ab9976-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:35,995 - INFO - Verified pod ctest-pod-12276091 in contrail-api 2025-07-21 02:14:36,010 - DEBUG - VMI 69ab9976-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:36,010 - INFO - Verified Pod ctest-pod-12276091 in agent 10.0.0.27 2025-07-21 02:14:36,010 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 2025-07-21 02:14:36,016 - INFO - Pod ctest-pod-12276091 with uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 found in kube manager 2025-07-21 02:14:36,016 - INFO - Pod ctest-pod-12276091 verification passed 2025-07-21 02:14:36,022 - INFO - Pod ctest-pod-08343070 is in running state.Got IP 10.47.255.244 2025-07-21 02:14:36,081 - DEBUG - Pod ctest-pod-08343070 has vmi 6ab10f86-65d8-11f0-945b-fa163e541cf5 2025-07-21 02:14:36,081 - INFO - Verified pod ctest-pod-08343070 in contrail-api 2025-07-21 02:14:36,095 - DEBUG - VMI 6ab10f86-65d8-11f0-945b-fa163e541cf5 is active in agent 10.0.0.27 2025-07-21 02:14:36,095 - INFO - Verified Pod ctest-pod-08343070 in agent 10.0.0.27 2025-07-21 02:14:36,095 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=7d36d8e9-0330-4eef-a72f-6a5a022e4df8 2025-07-21 02:14:36,111 - INFO - Pod ctest-pod-08343070 with uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 found in kube manager 2025-07-21 02:14:36,111 - INFO - Pod ctest-pod-08343070 verification passed 2025-07-21 02:14:36,111 - INFO - ================================================================================ 2025-07-21 02:14:36,111 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-07-21 02:14:36,111 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-07-21 02:14:36,330 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.19': '0'}} with 2025-07-21 02:14:36,330 - INFO - Initial checks done. Running the testcase now 2025-07-21 02:14:36,330 - INFO - 2025-07-21 02:14:36,387 - DEBUG - [Pod ctest-pod-69003838] Cmd: echo ctest-pod-69003838 > /usr/share/nginx/html/index.html, Output: 2025-07-21 02:14:36,446 - DEBUG - [Pod ctest-pod-53527280] Cmd: echo ctest-pod-53527280 > /usr/share/nginx/html/index.html, Output: 2025-07-21 02:14:36,500 - DEBUG - [Pod ctest-pod-84476190] Cmd: echo ctest-pod-84476190 > /usr/share/nginx/html/index.html, Output: 2025-07-21 02:14:36,553 - DEBUG - [Pod ctest-pod-10962474] Cmd: echo ctest-pod-10962474 > /usr/share/nginx/html/index.html, Output: 2025-07-21 02:14:36,557 - DEBUG - Service ctest-nginx-svc-42160024 not present 2025-07-21 02:14:36,557 - INFO - Creating service ctest-nginx-svc-42160024 2025-07-21 02:14:36,578 - INFO - Created Service ctest-nginx-svc-42160024 2025-07-21 02:14:36,585 - WARNING - Service UUID 42ac1079-b6d7-4d21-9942-705c63f3cab7 not yet found in contrail-api 2025-07-21 02:14:37,608 - INFO - Validated that Service ctest-nginx-svc-42160024 is seen in contrail-api 2025-07-21 02:14:37,608 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=42ac1079-b6d7-4d21-9942-705c63f3cab7 2025-07-21 02:14:37,614 - INFO - Service ctest-nginx-svc-42160024 with uuid 42ac1079-b6d7-4d21-9942-705c63f3cab7 found in kube manager 2025-07-21 02:14:37,615 - INFO - Service ctest-nginx-svc-42160024 verification passed 2025-07-21 02:14:38,699 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) ctest-pod-53527280 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,700 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:14:38,700 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) ctest-pod-53527280 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,761 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,761 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:14:38,761 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,761 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69003838': 1, 'ctest-pod-53527280': 1} 2025-07-21 02:14:38,821 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,821 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:14:38,821 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,877 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,877 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:14:38,877 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:14:38,877 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69003838': 1, 'ctest-pod-53527280': 1} 2025-07-21 02:14:38,880 - DEBUG - Network policy ingress-on-service not present 2025-07-21 02:14:38,881 - INFO - Creating Network Policy ingress-on-service 2025-07-21 02:14:38,900 - INFO - Network policy found in k8s 2025-07-21 02:14:38,900 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9e87d038-7d6f-4c6c-aaa0-be3caa7d3ca3 2025-07-21 02:14:38,907 - INFO - Network Policy ingress-on-service with uuid 9e87d038-7d6f-4c6c-aaa0-be3caa7d3ca3 found in kube manager 2025-07-21 02:14:38,940 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-07-21 02:14:38,940 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-07-21 02:14:38,940 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9e87d038-7d6f-4c6c-aaa0-be3caa7d3ca3 2025-07-21 02:14:38,971 - WARNING - Network policy with name ingress-on-service not found in agent 2025-07-21 02:14:40,972 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9e87d038-7d6f-4c6c-aaa0-be3caa7d3ca3 2025-07-21 02:14:41,021 - INFO - Network policy with name ingress-on-service found in agent 2025-07-21 02:14:41,022 - INFO - Network Policy ingress-on-service verification passed 2025-07-21 02:14:46,075 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:46,075 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:46,075 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:51,123 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:51,123 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:51,123 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:56,179 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:56,179 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:14:56,179 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:01,231 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:01,231 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:01,231 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:06,302 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:06,303 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:06,303 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:11,355 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:11,356 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:11,356 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:16,407 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:16,407 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:16,407 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:21,459 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:21,459 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:21,459 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:26,511 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:26,512 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:26,512 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:31,563 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:31,563 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:31,563 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:31,563 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69003838': 0, 'ctest-pod-53527280': 0} 2025-07-21 02:15:31,624 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:15:31,624 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:15:31,624 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:15:31,672 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:15:31,672 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:15:31,672 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:15:31,672 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69003838': 1, 'ctest-pod-53527280': 1} 2025-07-21 02:15:36,723 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:36,723 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:36,723 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:41,770 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:41,771 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:41,771 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:46,825 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:46,825 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:46,825 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:51,875 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:51,875 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:51,875 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:56,944 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:56,945 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:15:56,945 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:01,995 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:01,995 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:01,995 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:07,055 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:07,055 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:07,055 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:12,112 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:12,112 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:12,112 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:17,160 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:17,161 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:17,161 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:22,215 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:22,215 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:22,215 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:22,215 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69003838': 0, 'ctest-pod-53527280': 0} 2025-07-21 02:16:24,287 - DEBUG - [Pod ctest-pod-12276091] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.564 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.242/0.564 ms 2025-07-21 02:16:24,287 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12276091 with expectation True passed 2025-07-21 02:16:26,339 - DEBUG - [Pod ctest-pod-83863593] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.140 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.433/1.140 ms 2025-07-21 02:16:26,339 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83863593 with expectation True passed 2025-07-21 02:16:28,391 - DEBUG - [Pod ctest-pod-63399254] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.303 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.485/1.303 ms 2025-07-21 02:16:28,391 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63399254 with expectation True passed 2025-07-21 02:16:28,444 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:16:28,444 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-21 02:16:28,444 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:16:28,444 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12276091 passed 2025-07-21 02:16:28,503 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:16:28,504 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-21 02:16:28,504 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:16:28,504 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12276091 passed 2025-07-21 02:16:33,561 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-21 02:16:33,561 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-21 02:16:33,561 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-21 02:16:33,561 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83863593 passed 2025-07-21 02:16:38,618 - DEBUG - [Pod ctest-pod-08343070] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-21 02:16:38,618 - DEBUG - [Pod Pod ctest-pod-08343070] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-21 02:16:38,618 - DEBUG - [Pod Pod ctest-pod-08343070] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-21 02:16:38,618 - INFO - wget check of of http://10.47.255.251 from ctest-pod-08343070 passed 2025-07-21 02:16:38,630 - INFO - Updating Network Policy ingress-on-service 2025-07-21 02:16:43,689 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:43,689 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:43,689 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:48,739 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:48,740 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:48,740 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:53,792 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:53,792 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:53,792 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:58,851 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:58,851 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:16:58,851 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:03,898 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:03,898 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:03,899 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:08,951 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:08,951 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:08,951 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:14,004 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:14,004 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:14,004 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:19,055 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:19,055 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:19,055 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:24,099 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:24,099 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:24,099 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:29,155 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:29,156 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:29,156 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) wget: download timed out 2025-07-21 02:17:29,156 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69003838': 0, 'ctest-pod-53527280': 0} 2025-07-21 02:17:29,224 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69003838 2025-07-21 02:17:29,224 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:17:29,224 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69003838 2025-07-21 02:17:29,285 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:17:29,285 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:17:29,285 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:17:29,285 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69003838': 1, 'ctest-pod-53527280': 1} 2025-07-21 02:17:29,363 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:17:29,363 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:17:29,363 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: ctest-pod-53527280 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:17:29,421 - DEBUG - [Pod ctest-pod-63399254] Cmd: wget http://10.110.211.91:80/ -O - -T 5 -t 1 , Output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:17:29,421 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd wget http://10.110.211.91:80/ -O - -T 5 -t 1 passed 2025-07-21 02:17:29,421 - DEBUG - [Pod Pod ctest-pod-63399254] Cmd output: ctest-pod-69003838 Connecting to 10.110.211.91:80 (10.110.211.91:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-21 02:17:29,421 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69003838': 1, 'ctest-pod-53527280': 1} 2025-07-21 02:17:31,467 - DEBUG - [Pod ctest-pod-12276091] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.397 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.186/0.397 ms 2025-07-21 02:17:31,467 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12276091 with expectation True passed 2025-07-21 02:17:33,523 - DEBUG - [Pod ctest-pod-83863593] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.816 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.325/0.816 ms 2025-07-21 02:17:33,523 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83863593 with expectation True passed 2025-07-21 02:17:35,571 - DEBUG - [Pod ctest-pod-63399254] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.614 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.250/0.614 ms 2025-07-21 02:17:35,571 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63399254 with expectation True passed 2025-07-21 02:17:35,621 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:17:35,621 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-21 02:17:35,621 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:17:35,621 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12276091 passed 2025-07-21 02:17:35,660 - DEBUG - [Pod ctest-pod-12276091] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:17:35,660 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-21 02:17:35,660 - DEBUG - [Pod Pod ctest-pod-12276091] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:17:35,660 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12276091 passed 2025-07-21 02:17:40,734 - DEBUG - [Pod ctest-pod-83863593] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-21 02:17:40,734 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-21 02:17:40,734 - DEBUG - [Pod Pod ctest-pod-83863593] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-21 02:17:40,734 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83863593 passed 2025-07-21 02:17:40,785 - DEBUG - [Pod ctest-pod-08343070] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:17:40,785 - DEBUG - [Pod Pod ctest-pod-08343070] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-21 02:17:40,785 - DEBUG - [Pod Pod ctest-pod-08343070] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-21 02:17:40,785 - INFO - wget check of of http://10.47.255.251 from ctest-pod-08343070 passed 2025-07-21 02:17:40,785 - INFO - Deleting Network Policy : ingress-on-service 2025-07-21 02:17:40,786 - INFO - Deleting service : ctest-nginx-svc-42160024 2025-07-21 02:17:41,012 - DEBUG - No XMPP flaps were noticed during the test 2025-07-21 02:17:41,012 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05] 2025-07-21 02:17:41,012 - INFO - -------------------------------------------------------------------------------- 2025-07-21 02:17:41,018 - INFO - Deleting pod ctest-new-default-92462507:ctest-pod-69003838 2025-07-21 02:17:41,019 - INFO - Deleting pod ctest-new-default-92462507:ctest-pod-53527280 2025-07-21 02:17:41,020 - INFO - Deleting pod ctest-non-default-39964569:ctest-pod-84476190 2025-07-21 02:17:41,020 - INFO - Deleting pod ctest-non-default-39964569:ctest-pod-10962474 2025-07-21 02:17:41,021 - INFO - Deleting pod ctest-new-default-92462507:ctest-pod-83863593 2025-07-21 02:17:41,021 - INFO - Deleting pod ctest-new-default-92462507:ctest-pod-12276091 2025-07-21 02:17:41,021 - INFO - Deleting pod ctest-non-default-39964569:ctest-pod-63399254 2025-07-21 02:17:41,022 - INFO - Deleting pod ctest-non-default-39964569:ctest-pod-08343070 2025-07-21 02:17:41,155 - WARNING - Pod uuid 6b299a70-8d26-4e7b-954a-2d9972e995ee is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,222 - WARNING - Pod uuid c444bd88-6f33-4ec6-a71f-8500fa495911 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,224 - WARNING - Pod uuid 4999e4ea-cf89-4d11-9394-89066680aad2 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,225 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,226 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,227 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,228 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:41,229 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:46,163 - DEBUG - Pod 6b299a70-8d26-4e7b-954a-2d9972e995ee is not in agent 10.0.0.27 VM list 2025-07-21 02:17:46,171 - DEBUG - VMI 66f736f4-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:17:46,171 - INFO - Verified that pod ctest-pod-69003838 is removed in agent 2025-07-21 02:17:46,257 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:46,259 - DEBUG - Pod c444bd88-6f33-4ec6-a71f-8500fa495911 is not in agent 10.0.0.27 VM list 2025-07-21 02:17:46,262 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:46,262 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:46,262 - DEBUG - Pod 4999e4ea-cf89-4d11-9394-89066680aad2 is not in agent 10.0.0.27 VM list 2025-07-21 02:17:46,266 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:46,266 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:46,274 - DEBUG - VMI 68992008-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:17:46,274 - INFO - Verified that pod ctest-pod-10962474 is removed in agent 2025-07-21 02:17:46,275 - DEBUG - VMI 681ae404-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:17:46,275 - INFO - Verified that pod ctest-pod-84476190 is removed in agent 2025-07-21 02:17:51,287 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:51,289 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:51,289 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:51,290 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:51,290 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:56,318 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:56,319 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:56,320 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:56,321 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:17:56,322 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:01,340 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:01,341 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:01,344 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:01,344 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:01,345 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:06,365 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:06,365 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:06,365 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:06,366 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:06,367 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:11,412 - WARNING - Pod uuid 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:11,412 - WARNING - Pod uuid f7cf4c00-e777-4068-b7a5-144522a2e657 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:11,413 - WARNING - Pod uuid 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:11,414 - WARNING - Pod uuid 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:11,414 - WARNING - Pod uuid 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is still seen in agent 10.0.0.27 VM list 2025-07-21 02:18:16,437 - DEBUG - Pod 4b6fd9af-1868-4e46-a5ad-251b9bbdf88c is not in agent 10.0.0.27 VM list 2025-07-21 02:18:16,438 - DEBUG - Pod f7cf4c00-e777-4068-b7a5-144522a2e657 is not in agent 10.0.0.27 VM list 2025-07-21 02:18:16,440 - DEBUG - Pod 9e3c3f1e-4c88-406f-868b-c2c170b2ce44 is not in agent 10.0.0.27 VM list 2025-07-21 02:18:16,444 - DEBUG - Pod 7d36d8e9-0330-4eef-a72f-6a5a022e4df8 is not in agent 10.0.0.27 VM list 2025-07-21 02:18:16,446 - DEBUG - Pod 4a6606a0-c5d7-4bb3-916c-bd7d30d0c109 is not in agent 10.0.0.27 VM list 2025-07-21 02:18:16,461 - DEBUG - VMI 677b5bf0-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:18:16,461 - INFO - Verified that pod ctest-pod-53527280 is removed in agent 2025-07-21 02:18:16,461 - DEBUG - VMI 692bbc74-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:18:16,461 - INFO - Verified that pod ctest-pod-83863593 is removed in agent 2025-07-21 02:18:16,463 - DEBUG - VMI 6ab10f86-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:18:16,463 - INFO - Verified that pod ctest-pod-08343070 is removed in agent 2025-07-21 02:18:16,464 - DEBUG - VMI 69ab9976-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:18:16,464 - INFO - Verified that pod ctest-pod-12276091 is removed in agent 2025-07-21 02:18:16,464 - DEBUG - VMI 6a354ba8-65d8-11f0-945b-fa163e541cf5 is removed from agent 10.0.0.27 2025-07-21 02:18:16,464 - INFO - Verified that pod ctest-pod-63399254 is removed in agent 2025-07-21 02:18:16,464 - INFO - Deleting namespace ctest-non-default-39964569 2025-07-21 02:18:16,489 - DEBUG - Namespace ctest-non-default-39964569 still in k8s 2025-07-21 02:18:18,494 - DEBUG - Namespace ctest-non-default-39964569 still in k8s 2025-07-21 02:18:20,500 - DEBUG - Namespace ctest-non-default-39964569 still in k8s 2025-07-21 02:18:22,504 - DEBUG - Namespace ctest-non-default-39964569 is not in k8s 2025-07-21 02:18:22,504 - DEBUG - No need to check project deletion in contrail-api 2025-07-21 02:18:22,504 - INFO - Deleting namespace ctest-new-default-92462507 2025-07-21 02:18:22,516 - DEBUG - Namespace ctest-new-default-92462507 still in k8s 2025-07-21 02:18:24,522 - DEBUG - Namespace ctest-new-default-92462507 still in k8s 2025-07-21 02:18:26,527 - DEBUG - Namespace ctest-new-default-92462507 still in k8s 2025-07-21 02:18:28,531 - DEBUG - Namespace ctest-new-default-92462507 is not in k8s 2025-07-21 02:18:28,531 - DEBUG - No need to check project deletion in contrail-api