2025-11-24 01:44:59,270 - INFO - Using existing project ['default-domain', 'k8s-default'](d2633be5-db59-4f07-8409-62eebc9b2438) 2025-11-24 01:44:59,295 - DEBUG - Namespace ctest-new-default-90945973 not present 2025-11-24 01:44:59,316 - INFO - Created namespace ctest-new-default-90945973 2025-11-24 01:45:02,321 - DEBUG - Namespace ctest-non-default-47973194 not present 2025-11-24 01:45:02,332 - INFO - Created namespace ctest-non-default-47973194 2025-11-24 01:45:05,357 - DEBUG - Pod ctest-pod-18803017 not present 2025-11-24 01:45:05,358 - INFO - Creating Pod ctest-pod-18803017 2025-11-24 01:45:05,401 - DEBUG - Pod : ctest-pod-18803017 UUID is 7edf024a-f66a-4bbd-8173-238d38171e9f 2025-11-24 01:45:05,405 - DEBUG - Pod ctest-pod-81169844 not present 2025-11-24 01:45:05,406 - INFO - Creating Pod ctest-pod-81169844 2025-11-24 01:45:05,449 - DEBUG - Pod : ctest-pod-81169844 UUID is 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f 2025-11-24 01:45:05,453 - DEBUG - Pod ctest-pod-84662411 not present 2025-11-24 01:45:05,454 - INFO - Creating Pod ctest-pod-84662411 2025-11-24 01:45:05,495 - DEBUG - Pod : ctest-pod-84662411 UUID is e079a81f-6875-4b8b-a229-b05a358f806b 2025-11-24 01:45:05,498 - DEBUG - Pod ctest-pod-75994190 not present 2025-11-24 01:45:05,499 - INFO - Creating Pod ctest-pod-75994190 2025-11-24 01:45:05,520 - DEBUG - Pod : ctest-pod-75994190 UUID is 0ee901f8-54ed-4020-830d-cefb8835af2a 2025-11-24 01:45:05,523 - DEBUG - Pod ctest-pod-00072315 not present 2025-11-24 01:45:05,523 - INFO - Creating Pod ctest-pod-00072315 2025-11-24 01:45:05,543 - DEBUG - Pod : ctest-pod-00072315 UUID is 44f36c5e-3e8e-4596-80c4-12c22ec503ad 2025-11-24 01:45:05,545 - DEBUG - Pod ctest-pod-97111865 not present 2025-11-24 01:45:05,546 - INFO - Creating Pod ctest-pod-97111865 2025-11-24 01:45:05,563 - DEBUG - Pod : ctest-pod-97111865 UUID is 2150be00-a3e0-457c-a88e-9456f6783454 2025-11-24 01:45:05,566 - DEBUG - Pod ctest-pod-60231498 not present 2025-11-24 01:45:05,566 - INFO - Creating Pod ctest-pod-60231498 2025-11-24 01:45:05,605 - DEBUG - Pod : ctest-pod-60231498 UUID is 10059735-f8ac-45cb-96c2-38b8c68ab160 2025-11-24 01:45:05,608 - DEBUG - Pod ctest-pod-85132242 not present 2025-11-24 01:45:05,608 - INFO - Creating Pod ctest-pod-85132242 2025-11-24 01:45:05,629 - DEBUG - Pod : ctest-pod-85132242 UUID is 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c 2025-11-24 01:45:05,843 - INFO - Project default-domain:k8s-ctest-new-default-90945973 for Namespace ctest-new-default-90945973 is seen in contrail-api 2025-11-24 01:45:05,843 - DEBUG - Project uuid in Contrail is fd38a56b-b857-4f54-9784-d6fee6b6d97a 2025-11-24 01:45:06,003 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=1b2dd0d5-24e2-4c72-8d11-955c530eabd8 2025-11-24 01:45:06,008 - INFO - Namespace ctest-new-default-90945973 with uuid 1b2dd0d5-24e2-4c72-8d11-955c530eabd8 found in kube manager 2025-11-24 01:45:06,008 - INFO - Namespace ctest-new-default-90945973 verification passed 2025-11-24 01:45:06,249 - INFO - Project default-domain:k8s-ctest-non-default-47973194 for Namespace ctest-non-default-47973194 is seen in contrail-api 2025-11-24 01:45:06,249 - DEBUG - Project uuid in Contrail is 8aa65816-4918-4e2d-a075-eb6360981323 2025-11-24 01:45:06,249 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=1e862941-698c-434e-b5fc-e124fff336c9 2025-11-24 01:45:06,256 - INFO - Namespace ctest-non-default-47973194 with uuid 1e862941-698c-434e-b5fc-e124fff336c9 found in kube manager 2025-11-24 01:45:06,256 - INFO - Namespace ctest-non-default-47973194 verification passed 2025-11-24 01:45:06,263 - DEBUG - Pod ctest-pod-18803017 not in running state.Currently in Pending 2025-11-24 01:45:11,274 - DEBUG - Pod ctest-pod-18803017 not in running state.Currently in Pending 2025-11-24 01:45:16,282 - INFO - Pod ctest-pod-18803017 is in running state.Got IP 10.47.255.251 2025-11-24 01:45:16,294 - DEBUG - Pod ctest-pod-18803017 has vmi 347bcad4-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:16,294 - INFO - Verified pod ctest-pod-18803017 in contrail-api 2025-11-24 01:45:16,304 - DEBUG - VMI 347bcad4-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:16,304 - INFO - Verified Pod ctest-pod-18803017 in agent 10.0.0.241 2025-11-24 01:45:16,304 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=7edf024a-f66a-4bbd-8173-238d38171e9f 2025-11-24 01:45:16,308 - INFO - Pod ctest-pod-18803017 with uuid 7edf024a-f66a-4bbd-8173-238d38171e9f found in kube manager 2025-11-24 01:45:16,308 - INFO - Pod ctest-pod-18803017 verification passed 2025-11-24 01:45:16,314 - INFO - Pod ctest-pod-81169844 is in running state.Got IP 10.47.255.250 2025-11-24 01:45:16,374 - DEBUG - Pod ctest-pod-81169844 has vmi 34f93c62-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:16,374 - INFO - Verified pod ctest-pod-81169844 in contrail-api 2025-11-24 01:45:16,385 - DEBUG - VMI 34f93c62-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:16,385 - INFO - Verified Pod ctest-pod-81169844 in agent 10.0.0.241 2025-11-24 01:45:16,385 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f 2025-11-24 01:45:16,390 - INFO - Pod ctest-pod-81169844 with uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f found in kube manager 2025-11-24 01:45:16,390 - INFO - Pod ctest-pod-81169844 verification passed 2025-11-24 01:45:16,398 - INFO - Pod ctest-pod-84662411 is in running state.Got IP 10.47.255.249 2025-11-24 01:45:16,454 - DEBUG - Pod ctest-pod-84662411 has vmi 35a6ca76-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:16,454 - INFO - Verified pod ctest-pod-84662411 in contrail-api 2025-11-24 01:45:16,466 - DEBUG - VMI 35a6ca76-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:16,466 - INFO - Verified Pod ctest-pod-84662411 in agent 10.0.0.241 2025-11-24 01:45:16,466 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=e079a81f-6875-4b8b-a229-b05a358f806b 2025-11-24 01:45:16,470 - INFO - Pod ctest-pod-84662411 with uuid e079a81f-6875-4b8b-a229-b05a358f806b found in kube manager 2025-11-24 01:45:16,470 - INFO - Pod ctest-pod-84662411 verification passed 2025-11-24 01:45:16,477 - INFO - Pod ctest-pod-75994190 is in running state.Got IP 10.47.255.248 2025-11-24 01:45:16,491 - DEBUG - Pod ctest-pod-75994190 has vmi 3624336c-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:16,491 - INFO - Verified pod ctest-pod-75994190 in contrail-api 2025-11-24 01:45:16,502 - DEBUG - VMI 3624336c-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:16,502 - INFO - Verified Pod ctest-pod-75994190 in agent 10.0.0.241 2025-11-24 01:45:16,502 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=0ee901f8-54ed-4020-830d-cefb8835af2a 2025-11-24 01:45:16,507 - INFO - Pod ctest-pod-75994190 with uuid 0ee901f8-54ed-4020-830d-cefb8835af2a found in kube manager 2025-11-24 01:45:16,507 - INFO - Pod ctest-pod-75994190 verification passed 2025-11-24 01:45:16,514 - DEBUG - Pod ctest-pod-00072315 not in running state.Currently in Pending 2025-11-24 01:45:21,532 - INFO - Pod ctest-pod-00072315 is in running state.Got IP 10.47.255.247 2025-11-24 01:45:21,586 - DEBUG - Pod ctest-pod-00072315 has vmi 36a9eee4-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:21,586 - INFO - Verified pod ctest-pod-00072315 in contrail-api 2025-11-24 01:45:21,598 - DEBUG - VMI 36a9eee4-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:21,599 - INFO - Verified Pod ctest-pod-00072315 in agent 10.0.0.241 2025-11-24 01:45:21,599 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=44f36c5e-3e8e-4596-80c4-12c22ec503ad 2025-11-24 01:45:21,603 - INFO - Pod ctest-pod-00072315 with uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad found in kube manager 2025-11-24 01:45:21,603 - INFO - Pod ctest-pod-00072315 verification passed 2025-11-24 01:45:21,615 - DEBUG - Pod ctest-pod-60231498 not in running state.Currently in Pending 2025-11-24 01:45:26,622 - INFO - Pod ctest-pod-60231498 is in running state.Got IP 10.47.255.245 2025-11-24 01:45:26,635 - DEBUG - Pod ctest-pod-60231498 has vmi 378ea372-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:26,635 - INFO - Verified pod ctest-pod-60231498 in contrail-api 2025-11-24 01:45:26,647 - DEBUG - VMI 378ea372-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:26,647 - INFO - Verified Pod ctest-pod-60231498 in agent 10.0.0.241 2025-11-24 01:45:26,647 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=10059735-f8ac-45cb-96c2-38b8c68ab160 2025-11-24 01:45:26,651 - INFO - Pod ctest-pod-60231498 with uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 found in kube manager 2025-11-24 01:45:26,651 - INFO - Pod ctest-pod-60231498 verification passed 2025-11-24 01:45:26,659 - INFO - Pod ctest-pod-97111865 is in running state.Got IP 10.47.255.246 2025-11-24 01:45:26,710 - DEBUG - Pod ctest-pod-97111865 has vmi 371cf33a-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:26,710 - INFO - Verified pod ctest-pod-97111865 in contrail-api 2025-11-24 01:45:26,722 - DEBUG - VMI 371cf33a-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:26,722 - INFO - Verified Pod ctest-pod-97111865 in agent 10.0.0.241 2025-11-24 01:45:26,722 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=2150be00-a3e0-457c-a88e-9456f6783454 2025-11-24 01:45:26,726 - INFO - Pod ctest-pod-97111865 with uuid 2150be00-a3e0-457c-a88e-9456f6783454 found in kube manager 2025-11-24 01:45:26,726 - INFO - Pod ctest-pod-97111865 verification passed 2025-11-24 01:45:26,733 - INFO - Pod ctest-pod-85132242 is in running state.Got IP 10.47.255.244 2025-11-24 01:45:26,746 - DEBUG - Pod ctest-pod-85132242 has vmi 3800ea7c-c8d7-11f0-82a2-fa163e5da2a9 2025-11-24 01:45:26,747 - INFO - Verified pod ctest-pod-85132242 in contrail-api 2025-11-24 01:45:26,758 - DEBUG - VMI 3800ea7c-c8d7-11f0-82a2-fa163e5da2a9 is active in agent 10.0.0.241 2025-11-24 01:45:26,758 - INFO - Verified Pod ctest-pod-85132242 in agent 10.0.0.241 2025-11-24 01:45:26,758 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=64cf6fe7-dfaa-404f-af1a-e18a7f199b9c 2025-11-24 01:45:26,762 - INFO - Pod ctest-pod-85132242 with uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c found in kube manager 2025-11-24 01:45:26,763 - INFO - Pod ctest-pod-85132242 verification passed 2025-11-24 01:45:26,763 - INFO - ================================================================================ 2025-11-24 01:45:26,763 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-11-24 01:45:26,763 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-11-24 01:45:27,029 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.19': '0'}} with 2025-11-24 01:45:27,030 - INFO - Initial checks done. Running the testcase now 2025-11-24 01:45:27,030 - INFO - 2025-11-24 01:45:27,081 - DEBUG - [Pod ctest-pod-18803017] Cmd: echo ctest-pod-18803017 > /usr/share/nginx/html/index.html, Output: 2025-11-24 01:45:27,136 - DEBUG - [Pod ctest-pod-81169844] Cmd: echo ctest-pod-81169844 > /usr/share/nginx/html/index.html, Output: 2025-11-24 01:45:27,203 - DEBUG - [Pod ctest-pod-84662411] Cmd: echo ctest-pod-84662411 > /usr/share/nginx/html/index.html, Output: 2025-11-24 01:45:27,258 - DEBUG - [Pod ctest-pod-75994190] Cmd: echo ctest-pod-75994190 > /usr/share/nginx/html/index.html, Output: 2025-11-24 01:45:27,261 - DEBUG - Service ctest-nginx-svc-94196049 not present 2025-11-24 01:45:27,261 - INFO - Creating service ctest-nginx-svc-94196049 2025-11-24 01:45:27,284 - INFO - Created Service ctest-nginx-svc-94196049 2025-11-24 01:45:27,289 - WARNING - Service UUID f4fbe530-f9aa-489d-a997-fab4c0dec6a4 not yet found in contrail-api 2025-11-24 01:45:28,317 - INFO - Validated that Service ctest-nginx-svc-94196049 is seen in contrail-api 2025-11-24 01:45:28,318 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=f4fbe530-f9aa-489d-a997-fab4c0dec6a4 2025-11-24 01:45:28,323 - INFO - Service ctest-nginx-svc-94196049 with uuid f4fbe530-f9aa-489d-a997-fab4c0dec6a4 found in kube manager 2025-11-24 01:45:28,323 - INFO - Service ctest-nginx-svc-94196049 verification passed 2025-11-24 01:45:29,410 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-18803017 2025-11-24 01:45:29,410 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:45:29,410 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-18803017 2025-11-24 01:45:29,463 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81169844 2025-11-24 01:45:29,463 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:45:29,463 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81169844 2025-11-24 01:45:29,463 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18803017': 1, 'ctest-pod-81169844': 1} 2025-11-24 01:45:29,516 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81169844 2025-11-24 01:45:29,516 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:45:29,516 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81169844 2025-11-24 01:45:29,566 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: ctest-pod-81169844 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:45:29,566 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:45:29,566 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: ctest-pod-81169844 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:45:29,620 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-18803017 2025-11-24 01:45:29,620 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:45:29,620 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-18803017 2025-11-24 01:45:29,620 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18803017': 1, 'ctest-pod-81169844': 2} 2025-11-24 01:45:29,624 - DEBUG - Network policy ingress-on-service not present 2025-11-24 01:45:29,625 - INFO - Creating Network Policy ingress-on-service 2025-11-24 01:45:29,643 - INFO - Network policy found in k8s 2025-11-24 01:45:29,643 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305773f-1729-42b7-b48d-fffe516f5147 2025-11-24 01:45:29,650 - INFO - Network Policy ingress-on-service with uuid 7305773f-1729-42b7-b48d-fffe516f5147 found in kube manager 2025-11-24 01:45:29,676 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-11-24 01:45:29,677 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-11-24 01:45:29,677 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305773f-1729-42b7-b48d-fffe516f5147 2025-11-24 01:45:29,700 - WARNING - Network policy with name ingress-on-service not found in agent 2025-11-24 01:45:31,701 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305773f-1729-42b7-b48d-fffe516f5147 2025-11-24 01:45:31,727 - INFO - Network policy with name ingress-on-service found in agent 2025-11-24 01:45:31,727 - INFO - Network Policy ingress-on-service verification passed 2025-11-24 01:45:36,775 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:36,775 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:36,775 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:41,834 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:41,834 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:41,834 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:46,890 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:46,890 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:46,890 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:51,943 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:51,943 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:51,943 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:57,014 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:57,014 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:45:57,014 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:02,067 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:02,067 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:02,067 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:07,118 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:07,118 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:07,118 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:12,170 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:12,170 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:12,170 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:17,222 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:17,222 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:17,222 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:22,282 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:22,282 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:22,282 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:22,282 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-18803017': 0, 'ctest-pod-81169844': 0} 2025-11-24 01:46:22,357 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: ctest-pod-18803017 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:46:22,357 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:46:22,357 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: ctest-pod-18803017 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:46:22,423 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81169844 2025-11-24 01:46:22,423 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:46:22,423 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81169844 2025-11-24 01:46:22,423 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18803017': 1, 'ctest-pod-81169844': 1} 2025-11-24 01:46:27,494 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:27,494 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:27,494 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:32,053 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-11-24 01:46:42,113 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:42,114 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:42,114 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:47,170 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:47,170 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:47,170 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:52,223 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:52,223 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:52,223 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:57,274 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:57,274 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:46:57,274 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:02,330 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:02,330 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:02,330 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:07,382 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:07,383 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:07,383 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:12,441 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:12,441 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:12,441 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:17,505 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:17,506 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:17,506 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:22,557 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:22,557 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:22,557 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:22,557 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-18803017': 0, 'ctest-pod-81169844': 0} 2025-11-24 01:47:24,613 - DEBUG - [Pod ctest-pod-97111865] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.713 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.289/0.713 ms 2025-11-24 01:47:24,613 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97111865 with expectation True passed 2025-11-24 01:47:26,671 - DEBUG - [Pod ctest-pod-00072315] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.369 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.177/0.369 ms 2025-11-24 01:47:26,672 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00072315 with expectation True passed 2025-11-24 01:47:28,721 - DEBUG - [Pod ctest-pod-60231498] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.036 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.398/1.036 ms 2025-11-24 01:47:28,721 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60231498 with expectation True passed 2025-11-24 01:47:28,791 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:47:28,791 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-24 01:47:28,791 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:47:28,791 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97111865 passed 2025-11-24 01:47:28,860 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:47:28,860 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-11-24 01:47:28,860 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:47:28,860 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97111865 passed 2025-11-24 01:47:33,922 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-24 01:47:33,922 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-24 01:47:33,922 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-24 01:47:33,922 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00072315 passed 2025-11-24 01:47:38,980 - DEBUG - [Pod ctest-pod-85132242] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-24 01:47:38,980 - DEBUG - [Pod Pod ctest-pod-85132242] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-24 01:47:38,980 - DEBUG - [Pod Pod ctest-pod-85132242] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-24 01:47:38,981 - INFO - wget check of of http://10.47.255.251 from ctest-pod-85132242 passed 2025-11-24 01:47:38,990 - INFO - Updating Network Policy ingress-on-service 2025-11-24 01:47:44,061 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:44,061 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:44,061 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:49,117 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:49,117 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:49,117 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:54,161 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:54,161 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:54,161 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:59,210 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:59,210 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:47:59,210 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:04,260 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:04,260 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:04,261 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:09,310 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:09,310 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:09,310 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:14,361 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:14,361 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:14,361 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:19,416 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:19,416 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:19,416 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:24,483 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:24,483 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:24,483 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:29,534 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:29,534 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:29,534 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) wget: download timed out 2025-11-24 01:48:29,534 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-18803017': 0, 'ctest-pod-81169844': 0} 2025-11-24 01:48:29,592 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: ctest-pod-18803017 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,592 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:48:29,592 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: ctest-pod-18803017 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,644 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: ctest-pod-81169844 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,645 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:48:29,645 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: ctest-pod-81169844 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,645 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18803017': 1, 'ctest-pod-81169844': 1} 2025-11-24 01:48:29,699 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: ctest-pod-18803017 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,699 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:48:29,699 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: ctest-pod-18803017 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,747 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-18803017 2025-11-24 01:48:29,747 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:48:29,747 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-18803017 2025-11-24 01:48:29,810 - DEBUG - [Pod ctest-pod-60231498] Cmd: wget http://10.98.27.3:80/ -O - -T 5 -t 1 , Output: ctest-pod-81169844 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,811 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd wget http://10.98.27.3:80/ -O - -T 5 -t 1 passed 2025-11-24 01:48:29,811 - DEBUG - [Pod Pod ctest-pod-60231498] Cmd output: ctest-pod-81169844 Connecting to 10.98.27.3:80 (10.98.27.3:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-24 01:48:29,811 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18803017': 2, 'ctest-pod-81169844': 1} 2025-11-24 01:48:31,866 - DEBUG - [Pod ctest-pod-97111865] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.561 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.112 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.097/0.256/0.561 ms 2025-11-24 01:48:31,866 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97111865 with expectation True passed 2025-11-24 01:48:33,926 - DEBUG - [Pod ctest-pod-00072315] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.781 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.123 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.325/0.781 ms 2025-11-24 01:48:33,926 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00072315 with expectation True passed 2025-11-24 01:48:35,983 - DEBUG - [Pod ctest-pod-60231498] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.919 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.363/0.919 ms 2025-11-24 01:48:35,984 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60231498 with expectation True passed 2025-11-24 01:48:36,035 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:48:36,035 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-24 01:48:36,035 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:48:36,035 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97111865 passed 2025-11-24 01:48:36,089 - DEBUG - [Pod ctest-pod-97111865] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:48:36,089 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-11-24 01:48:36,090 - DEBUG - [Pod Pod ctest-pod-97111865] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:48:36,090 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97111865 passed 2025-11-24 01:48:41,137 - DEBUG - [Pod ctest-pod-00072315] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-24 01:48:41,137 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-24 01:48:41,137 - DEBUG - [Pod Pod ctest-pod-00072315] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-24 01:48:41,137 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00072315 passed 2025-11-24 01:48:41,199 - DEBUG - [Pod ctest-pod-85132242] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:48:41,199 - DEBUG - [Pod Pod ctest-pod-85132242] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-24 01:48:41,199 - DEBUG - [Pod Pod ctest-pod-85132242] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-24 01:48:41,199 - INFO - wget check of of http://10.47.255.251 from ctest-pod-85132242 passed 2025-11-24 01:48:41,200 - INFO - Deleting Network Policy : ingress-on-service 2025-11-24 01:48:41,200 - INFO - Deleting service : ctest-nginx-svc-94196049 2025-11-24 01:48:41,424 - DEBUG - No XMPP flaps were noticed during the test 2025-11-24 01:48:41,425 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2025-11-24 01:48:41,425 - INFO - -------------------------------------------------------------------------------- 2025-11-24 01:48:41,431 - INFO - Deleting pod ctest-new-default-90945973:ctest-pod-18803017 2025-11-24 01:48:41,432 - INFO - Deleting pod ctest-new-default-90945973:ctest-pod-81169844 2025-11-24 01:48:41,432 - INFO - Deleting pod ctest-non-default-47973194:ctest-pod-84662411 2025-11-24 01:48:41,433 - INFO - Deleting pod ctest-non-default-47973194:ctest-pod-75994190 2025-11-24 01:48:41,434 - INFO - Deleting pod ctest-new-default-90945973:ctest-pod-00072315 2025-11-24 01:48:41,434 - INFO - Deleting pod ctest-new-default-90945973:ctest-pod-97111865 2025-11-24 01:48:41,435 - INFO - Deleting pod ctest-non-default-47973194:ctest-pod-60231498 2025-11-24 01:48:41,435 - INFO - Deleting pod ctest-non-default-47973194:ctest-pod-85132242 2025-11-24 01:48:41,537 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,538 - WARNING - Pod uuid 0ee901f8-54ed-4020-830d-cefb8835af2a is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,574 - WARNING - Pod uuid 7edf024a-f66a-4bbd-8173-238d38171e9f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,576 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,577 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,578 - WARNING - Pod uuid e079a81f-6875-4b8b-a229-b05a358f806b is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,579 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:41,580 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:46,547 - DEBUG - Pod 0ee901f8-54ed-4020-830d-cefb8835af2a is not in agent 10.0.0.241 VM list 2025-11-24 01:48:46,549 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:46,553 - DEBUG - VMI 3624336c-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:48:46,553 - INFO - Verified that pod ctest-pod-75994190 is removed in agent 2025-11-24 01:48:46,598 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:46,598 - DEBUG - Pod 7edf024a-f66a-4bbd-8173-238d38171e9f is not in agent 10.0.0.241 VM list 2025-11-24 01:48:46,600 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:46,603 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:46,604 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:46,604 - DEBUG - Pod e079a81f-6875-4b8b-a229-b05a358f806b is not in agent 10.0.0.241 VM list 2025-11-24 01:48:46,612 - DEBUG - VMI 35a6ca76-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:48:46,612 - INFO - Verified that pod ctest-pod-84662411 is removed in agent 2025-11-24 01:48:46,613 - DEBUG - VMI 347bcad4-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:48:46,613 - INFO - Verified that pod ctest-pod-18803017 is removed in agent 2025-11-24 01:48:51,557 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:51,621 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:51,622 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:51,623 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:51,623 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:56,566 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:56,637 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:56,639 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:56,639 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:48:56,639 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:01,574 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:01,651 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:01,653 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:01,653 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:01,654 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:06,583 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:06,669 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:06,670 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:06,671 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:06,671 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:11,591 - WARNING - Pod uuid 44f36c5e-3e8e-4596-80c4-12c22ec503ad is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:11,680 - WARNING - Pod uuid 10059735-f8ac-45cb-96c2-38b8c68ab160 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:11,686 - WARNING - Pod uuid 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:11,688 - WARNING - Pod uuid 2150be00-a3e0-457c-a88e-9456f6783454 is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:11,688 - WARNING - Pod uuid 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is still seen in agent 10.0.0.241 VM list 2025-11-24 01:49:16,599 - DEBUG - Pod 44f36c5e-3e8e-4596-80c4-12c22ec503ad is not in agent 10.0.0.241 VM list 2025-11-24 01:49:16,605 - DEBUG - VMI 36a9eee4-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:49:16,605 - INFO - Verified that pod ctest-pod-00072315 is removed in agent 2025-11-24 01:49:16,689 - DEBUG - Pod 10059735-f8ac-45cb-96c2-38b8c68ab160 is not in agent 10.0.0.241 VM list 2025-11-24 01:49:16,700 - DEBUG - Pod 64cf6fe7-dfaa-404f-af1a-e18a7f199b9c is not in agent 10.0.0.241 VM list 2025-11-24 01:49:16,703 - DEBUG - Pod 49438b14-0e5f-40f0-9bec-b5bbfc6a2a7f is not in agent 10.0.0.241 VM list 2025-11-24 01:49:16,704 - DEBUG - Pod 2150be00-a3e0-457c-a88e-9456f6783454 is not in agent 10.0.0.241 VM list 2025-11-24 01:49:16,705 - DEBUG - VMI 378ea372-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:49:16,705 - INFO - Verified that pod ctest-pod-60231498 is removed in agent 2025-11-24 01:49:16,713 - DEBUG - VMI 371cf33a-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:49:16,713 - INFO - Verified that pod ctest-pod-97111865 is removed in agent 2025-11-24 01:49:16,714 - DEBUG - VMI 3800ea7c-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:49:16,714 - INFO - Verified that pod ctest-pod-85132242 is removed in agent 2025-11-24 01:49:16,715 - DEBUG - VMI 34f93c62-c8d7-11f0-82a2-fa163e5da2a9 is removed from agent 10.0.0.241 2025-11-24 01:49:16,715 - INFO - Verified that pod ctest-pod-81169844 is removed in agent 2025-11-24 01:49:16,715 - INFO - Deleting namespace ctest-non-default-47973194 2025-11-24 01:49:16,732 - DEBUG - Namespace ctest-non-default-47973194 still in k8s 2025-11-24 01:49:18,737 - DEBUG - Namespace ctest-non-default-47973194 still in k8s 2025-11-24 01:49:20,742 - DEBUG - Namespace ctest-non-default-47973194 still in k8s 2025-11-24 01:49:22,750 - DEBUG - Namespace ctest-non-default-47973194 is not in k8s 2025-11-24 01:49:22,750 - DEBUG - No need to check project deletion in contrail-api 2025-11-24 01:49:22,750 - INFO - Deleting namespace ctest-new-default-90945973 2025-11-24 01:49:22,761 - DEBUG - Namespace ctest-new-default-90945973 still in k8s 2025-11-24 01:49:24,766 - DEBUG - Namespace ctest-new-default-90945973 still in k8s 2025-11-24 01:49:26,771 - DEBUG - Namespace ctest-new-default-90945973 still in k8s 2025-11-24 01:49:28,775 - DEBUG - Namespace ctest-new-default-90945973 is not in k8s 2025-11-24 01:49:28,776 - DEBUG - No need to check project deletion in contrail-api