2026-05-18 01:52:15,391 - INFO - Using existing project ['default-domain', 'k8s-default'](347c374f-a4ba-470d-948d-8748bb4024f4) 2026-05-18 01:52:15,411 - DEBUG - Namespace ctest-new-default-70905806 not present 2026-05-18 01:52:15,420 - INFO - Created namespace ctest-new-default-70905806 2026-05-18 01:52:18,425 - DEBUG - Namespace ctest-non-default-36325896 not present 2026-05-18 01:52:18,433 - INFO - Created namespace ctest-non-default-36325896 2026-05-18 01:52:21,457 - DEBUG - Pod ctest-pod-99697274 not present 2026-05-18 01:52:21,457 - INFO - Creating Pod ctest-pod-99697274 2026-05-18 01:52:21,488 - DEBUG - Pod : ctest-pod-99697274 UUID is 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 2026-05-18 01:52:21,492 - DEBUG - Pod ctest-pod-31620481 not present 2026-05-18 01:52:21,493 - INFO - Creating Pod ctest-pod-31620481 2026-05-18 01:52:21,531 - DEBUG - Pod : ctest-pod-31620481 UUID is 54ed54e3-57fd-4876-93c1-5195e37dc686 2026-05-18 01:52:21,543 - DEBUG - Pod ctest-pod-85454707 not present 2026-05-18 01:52:21,543 - INFO - Creating Pod ctest-pod-85454707 2026-05-18 01:52:21,589 - DEBUG - Pod : ctest-pod-85454707 UUID is ab7805fc-7b93-4e98-b76d-9286d4167da4 2026-05-18 01:52:21,592 - DEBUG - Pod ctest-pod-57235849 not present 2026-05-18 01:52:21,592 - INFO - Creating Pod ctest-pod-57235849 2026-05-18 01:52:21,626 - DEBUG - Pod : ctest-pod-57235849 UUID is 52483319-6053-4304-bdc0-df6571332b4b 2026-05-18 01:52:21,632 - DEBUG - Pod ctest-pod-53109641 not present 2026-05-18 01:52:21,633 - INFO - Creating Pod ctest-pod-53109641 2026-05-18 01:52:21,669 - DEBUG - Pod : ctest-pod-53109641 UUID is 199840fb-09b6-4036-8368-a191469ef033 2026-05-18 01:52:21,678 - DEBUG - Pod ctest-pod-49114812 not present 2026-05-18 01:52:21,684 - INFO - Creating Pod ctest-pod-49114812 2026-05-18 01:52:21,716 - DEBUG - Pod : ctest-pod-49114812 UUID is a52a4394-e89b-46d3-a16f-2db0b28fa6fe 2026-05-18 01:52:21,718 - DEBUG - Pod ctest-pod-63487700 not present 2026-05-18 01:52:21,719 - INFO - Creating Pod ctest-pod-63487700 2026-05-18 01:52:21,738 - DEBUG - Pod : ctest-pod-63487700 UUID is 7fe7583f-8b30-463f-9456-a774ad03bf0f 2026-05-18 01:52:21,740 - DEBUG - Pod ctest-pod-39885484 not present 2026-05-18 01:52:21,741 - INFO - Creating Pod ctest-pod-39885484 2026-05-18 01:52:21,774 - DEBUG - Pod : ctest-pod-39885484 UUID is efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 2026-05-18 01:52:22,014 - INFO - Project default-domain:k8s-ctest-new-default-70905806 for Namespace ctest-new-default-70905806 is seen in contrail-api 2026-05-18 01:52:22,014 - DEBUG - Project uuid in Contrail is 821701d3-9d5f-4020-85db-e89eac099ea3 2026-05-18 01:52:22,185 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=7af98afa-c32a-48be-877c-422aac46d1a3 2026-05-18 01:52:22,189 - INFO - Namespace ctest-new-default-70905806 with uuid 7af98afa-c32a-48be-877c-422aac46d1a3 found in kube manager 2026-05-18 01:52:22,189 - INFO - Namespace ctest-new-default-70905806 verification passed 2026-05-18 01:52:22,383 - INFO - Project default-domain:k8s-ctest-non-default-36325896 for Namespace ctest-non-default-36325896 is seen in contrail-api 2026-05-18 01:52:22,383 - DEBUG - Project uuid in Contrail is dc0fa317-d558-4bea-9821-4aba8e28d3ed 2026-05-18 01:52:22,383 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=52100a87-5b05-4945-b3a0-75832661d8aa 2026-05-18 01:52:22,387 - INFO - Namespace ctest-non-default-36325896 with uuid 52100a87-5b05-4945-b3a0-75832661d8aa found in kube manager 2026-05-18 01:52:22,387 - INFO - Namespace ctest-non-default-36325896 verification passed 2026-05-18 01:52:22,394 - DEBUG - Pod ctest-pod-99697274 not in running state.Currently in Pending 2026-05-18 01:52:27,408 - DEBUG - Pod ctest-pod-99697274 not in running state.Currently in Pending 2026-05-18 01:52:32,416 - DEBUG - Pod ctest-pod-99697274 not in running state.Currently in Pending 2026-05-18 01:52:37,433 - INFO - Pod ctest-pod-99697274 is in running state.Got IP 10.47.255.251 2026-05-18 01:52:37,449 - DEBUG - Pod ctest-pod-99697274 has vmi 368a6844-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:37,449 - INFO - Verified pod ctest-pod-99697274 in contrail-api 2026-05-18 01:52:37,464 - DEBUG - VMI 368a6844-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:37,464 - INFO - Verified Pod ctest-pod-99697274 in agent 10.0.0.242 2026-05-18 01:52:37,464 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=36c1ed7a-a2d2-480a-9598-ec0eea48bc56 2026-05-18 01:52:37,468 - INFO - Pod ctest-pod-99697274 with uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 found in kube manager 2026-05-18 01:52:37,468 - INFO - Pod ctest-pod-99697274 verification passed 2026-05-18 01:52:37,477 - INFO - Pod ctest-pod-31620481 is in running state.Got IP 10.47.255.250 2026-05-18 01:52:37,531 - DEBUG - Pod ctest-pod-31620481 has vmi 37083f44-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:37,531 - INFO - Verified pod ctest-pod-31620481 in contrail-api 2026-05-18 01:52:37,542 - DEBUG - VMI 37083f44-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:37,542 - INFO - Verified Pod ctest-pod-31620481 in agent 10.0.0.242 2026-05-18 01:52:37,542 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=54ed54e3-57fd-4876-93c1-5195e37dc686 2026-05-18 01:52:37,546 - INFO - Pod ctest-pod-31620481 with uuid 54ed54e3-57fd-4876-93c1-5195e37dc686 found in kube manager 2026-05-18 01:52:37,546 - INFO - Pod ctest-pod-31620481 verification passed 2026-05-18 01:52:37,556 - INFO - Pod ctest-pod-85454707 is in running state.Got IP 10.47.255.249 2026-05-18 01:52:37,574 - DEBUG - Pod ctest-pod-85454707 has vmi 37a649be-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:37,574 - INFO - Verified pod ctest-pod-85454707 in contrail-api 2026-05-18 01:52:37,586 - DEBUG - VMI 37a649be-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:37,586 - INFO - Verified Pod ctest-pod-85454707 in agent 10.0.0.242 2026-05-18 01:52:37,586 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=ab7805fc-7b93-4e98-b76d-9286d4167da4 2026-05-18 01:52:37,590 - INFO - Pod ctest-pod-85454707 with uuid ab7805fc-7b93-4e98-b76d-9286d4167da4 found in kube manager 2026-05-18 01:52:37,591 - INFO - Pod ctest-pod-85454707 verification passed 2026-05-18 01:52:37,599 - INFO - Pod ctest-pod-57235849 is in running state.Got IP 10.47.255.248 2026-05-18 01:52:37,654 - DEBUG - Pod ctest-pod-57235849 has vmi 382b9178-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:37,654 - INFO - Verified pod ctest-pod-57235849 in contrail-api 2026-05-18 01:52:37,666 - DEBUG - VMI 382b9178-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:37,667 - INFO - Verified Pod ctest-pod-57235849 in agent 10.0.0.242 2026-05-18 01:52:37,667 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=52483319-6053-4304-bdc0-df6571332b4b 2026-05-18 01:52:37,671 - INFO - Pod ctest-pod-57235849 with uuid 52483319-6053-4304-bdc0-df6571332b4b found in kube manager 2026-05-18 01:52:37,672 - INFO - Pod ctest-pod-57235849 verification passed 2026-05-18 01:52:37,678 - INFO - Pod ctest-pod-53109641 is in running state.Got IP 10.47.255.247 2026-05-18 01:52:37,731 - DEBUG - Pod ctest-pod-53109641 has vmi 38bfd5f4-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:37,731 - INFO - Verified pod ctest-pod-53109641 in contrail-api 2026-05-18 01:52:37,744 - DEBUG - VMI 38bfd5f4-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:37,744 - INFO - Verified Pod ctest-pod-53109641 in agent 10.0.0.242 2026-05-18 01:52:37,745 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=199840fb-09b6-4036-8368-a191469ef033 2026-05-18 01:52:37,750 - INFO - Pod ctest-pod-53109641 with uuid 199840fb-09b6-4036-8368-a191469ef033 found in kube manager 2026-05-18 01:52:37,750 - INFO - Pod ctest-pod-53109641 verification passed 2026-05-18 01:52:37,757 - DEBUG - Pod ctest-pod-63487700 not in running state.Currently in Pending 2026-05-18 01:52:42,765 - INFO - Pod ctest-pod-63487700 is in running state.Got IP 10.47.255.245 2026-05-18 01:52:42,777 - DEBUG - Pod ctest-pod-63487700 has vmi 39f21644-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:42,778 - INFO - Verified pod ctest-pod-63487700 in contrail-api 2026-05-18 01:52:42,789 - DEBUG - VMI 39f21644-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:42,790 - INFO - Verified Pod ctest-pod-63487700 in agent 10.0.0.242 2026-05-18 01:52:42,791 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=7fe7583f-8b30-463f-9456-a774ad03bf0f 2026-05-18 01:52:42,795 - INFO - Pod ctest-pod-63487700 with uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f found in kube manager 2026-05-18 01:52:42,795 - INFO - Pod ctest-pod-63487700 verification passed 2026-05-18 01:52:42,801 - INFO - Pod ctest-pod-49114812 is in running state.Got IP 10.47.255.246 2026-05-18 01:52:42,813 - DEBUG - Pod ctest-pod-49114812 has vmi 39524b64-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:42,813 - INFO - Verified pod ctest-pod-49114812 in contrail-api 2026-05-18 01:52:42,824 - DEBUG - VMI 39524b64-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:42,824 - INFO - Verified Pod ctest-pod-49114812 in agent 10.0.0.242 2026-05-18 01:52:42,825 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=a52a4394-e89b-46d3-a16f-2db0b28fa6fe 2026-05-18 01:52:42,828 - INFO - Pod ctest-pod-49114812 with uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe found in kube manager 2026-05-18 01:52:42,828 - INFO - Pod ctest-pod-49114812 verification passed 2026-05-18 01:52:42,835 - INFO - Pod ctest-pod-39885484 is in running state.Got IP 10.47.255.244 2026-05-18 01:52:42,887 - DEBUG - Pod ctest-pod-39885484 has vmi 3a6e30f8-525c-11f1-ac34-fa163e99dd38 2026-05-18 01:52:42,887 - INFO - Verified pod ctest-pod-39885484 in contrail-api 2026-05-18 01:52:42,898 - DEBUG - VMI 3a6e30f8-525c-11f1-ac34-fa163e99dd38 is active in agent 10.0.0.242 2026-05-18 01:52:42,899 - INFO - Verified Pod ctest-pod-39885484 in agent 10.0.0.242 2026-05-18 01:52:42,899 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 2026-05-18 01:52:42,903 - INFO - Pod ctest-pod-39885484 with uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 found in kube manager 2026-05-18 01:52:42,903 - INFO - Pod ctest-pod-39885484 verification passed 2026-05-18 01:52:42,903 - INFO - ================================================================================ 2026-05-18 01:52:42,903 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-05-18 01:52:42,903 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-05-18 01:52:43,159 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.129': '0'}} with 2026-05-18 01:52:43,159 - INFO - Initial checks done. Running the testcase now 2026-05-18 01:52:43,159 - INFO - 2026-05-18 01:52:43,213 - DEBUG - [Pod ctest-pod-99697274] Cmd: echo ctest-pod-99697274 > /usr/share/nginx/html/index.html, Output: 2026-05-18 01:52:43,282 - DEBUG - [Pod ctest-pod-31620481] Cmd: echo ctest-pod-31620481 > /usr/share/nginx/html/index.html, Output: 2026-05-18 01:52:43,343 - DEBUG - [Pod ctest-pod-85454707] Cmd: echo ctest-pod-85454707 > /usr/share/nginx/html/index.html, Output: 2026-05-18 01:52:43,400 - DEBUG - [Pod ctest-pod-57235849] Cmd: echo ctest-pod-57235849 > /usr/share/nginx/html/index.html, Output: 2026-05-18 01:52:43,404 - DEBUG - Service ctest-nginx-svc-05992787 not present 2026-05-18 01:52:43,404 - INFO - Creating service ctest-nginx-svc-05992787 2026-05-18 01:52:43,425 - INFO - Created Service ctest-nginx-svc-05992787 2026-05-18 01:52:43,439 - WARNING - Service UUID 84acad8b-83ba-4c5d-96e6-982fd9d05ff6 not yet found in contrail-api 2026-05-18 01:52:44,454 - INFO - Validated that Service ctest-nginx-svc-05992787 is seen in contrail-api 2026-05-18 01:52:44,454 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_LoadbalancerDatabaseList?x=84acad8b-83ba-4c5d-96e6-982fd9d05ff6 2026-05-18 01:52:44,459 - INFO - Service ctest-nginx-svc-05992787 with uuid 84acad8b-83ba-4c5d-96e6-982fd9d05ff6 found in kube manager 2026-05-18 01:52:44,459 - INFO - Service ctest-nginx-svc-05992787 verification passed 2026-05-18 01:52:45,527 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31620481 2026-05-18 01:52:45,527 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:52:45,527 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31620481 2026-05-18 01:52:45,579 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,579 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:52:45,579 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,641 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,641 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:52:45,641 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,641 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99697274': 1, 'ctest-pod-31620481': 2} 2026-05-18 01:52:45,699 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,700 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:52:45,700 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,756 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,756 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:52:45,757 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:52:45,757 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99697274': 1, 'ctest-pod-31620481': 1} 2026-05-18 01:52:45,760 - DEBUG - Network policy ingress-on-service not present 2026-05-18 01:52:45,761 - INFO - Creating Network Policy ingress-on-service 2026-05-18 01:52:45,785 - INFO - Network policy found in k8s 2026-05-18 01:52:45,786 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=813a6d1d-9da4-48b3-a2f0-3394872394f9 2026-05-18 01:52:45,805 - INFO - Network Policy ingress-on-service with uuid 813a6d1d-9da4-48b3-a2f0-3394872394f9 found in kube manager 2026-05-18 01:52:45,843 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-05-18 01:52:45,844 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-05-18 01:52:45,844 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=813a6d1d-9da4-48b3-a2f0-3394872394f9 2026-05-18 01:52:45,883 - WARNING - Network policy with name ingress-on-service not found in agent 2026-05-18 01:52:47,884 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=813a6d1d-9da4-48b3-a2f0-3394872394f9 2026-05-18 01:52:47,909 - INFO - Network policy with name ingress-on-service found in agent 2026-05-18 01:52:47,909 - INFO - Network Policy ingress-on-service verification passed 2026-05-18 01:52:52,954 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:52:52,954 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:52:52,954 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:52:58,009 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:52:58,009 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:52:58,009 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:03,062 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:03,062 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:03,062 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:08,123 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:08,124 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:08,124 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:13,175 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:13,175 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:13,175 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:18,244 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:18,244 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:18,244 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:23,299 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:23,300 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:23,300 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:24,295 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2026-05-18 01:53:34,687 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:34,687 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:34,687 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:39,739 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:39,739 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:39,739 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:44,799 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:44,799 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:44,799 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:44,799 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99697274': 0, 'ctest-pod-31620481': 0} 2026-05-18 01:53:44,869 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:53:44,869 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:53:44,869 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:53:44,930 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:53:44,930 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:53:44,930 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:53:44,930 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99697274': 1, 'ctest-pod-31620481': 1} 2026-05-18 01:53:49,982 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:49,982 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:49,982 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:55,035 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:53:55,035 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:53:55,035 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:00,087 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:00,087 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:00,087 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:05,148 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:05,155 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:05,155 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:10,227 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:10,227 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:10,227 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:15,277 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:15,277 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:15,277 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:20,330 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:20,331 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:20,331 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:25,398 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:25,398 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:25,398 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:30,451 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:30,451 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:30,451 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:35,503 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:35,504 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:35,504 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:35,504 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99697274': 0, 'ctest-pod-31620481': 0} 2026-05-18 01:54:37,563 - DEBUG - [Pod ctest-pod-49114812] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.667 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.121 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.624/1.667 ms 2026-05-18 01:54:37,563 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49114812 with expectation True passed 2026-05-18 01:54:39,615 - DEBUG - [Pod ctest-pod-53109641] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.698 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.103 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.296/0.698 ms 2026-05-18 01:54:39,615 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53109641 with expectation True passed 2026-05-18 01:54:41,667 - DEBUG - [Pod ctest-pod-63487700] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.861 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.345/0.861 ms 2026-05-18 01:54:41,667 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63487700 with expectation True passed 2026-05-18 01:54:41,744 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99697274 2026-05-18 01:54:41,744 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-05-18 01:54:41,744 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99697274 2026-05-18 01:54:41,744 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49114812 passed 2026-05-18 01:54:41,815 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-31620481 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:54:41,815 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-05-18 01:54:41,815 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: ctest-pod-31620481 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:54:41,815 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49114812 passed 2026-05-18 01:54:46,876 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-05-18 01:54:46,877 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-05-18 01:54:46,877 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-05-18 01:54:46,877 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53109641 passed 2026-05-18 01:54:51,936 - DEBUG - [Pod ctest-pod-39885484] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-05-18 01:54:51,936 - DEBUG - [Pod Pod ctest-pod-39885484] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed. 2026-05-18 01:54:51,936 - DEBUG - [Pod Pod ctest-pod-39885484] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-05-18 01:54:51,936 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39885484 passed 2026-05-18 01:54:51,945 - INFO - Updating Network Policy ingress-on-service 2026-05-18 01:54:57,015 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:54:57,015 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:54:57,015 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:02,077 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:02,077 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:02,077 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:07,131 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:07,131 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:07,131 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:12,183 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:12,183 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:12,183 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:17,235 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:17,235 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:17,235 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:22,283 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:22,283 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:22,283 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:27,335 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:27,335 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:27,335 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:32,391 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:32,391 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:32,391 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:37,446 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:37,446 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:37,447 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:42,504 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:42,504 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 failed. 2026-05-18 01:55:42,504 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) wget: download timed out 2026-05-18 01:55:42,504 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99697274': 0, 'ctest-pod-31620481': 0} 2026-05-18 01:55:42,555 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31620481 2026-05-18 01:55:42,556 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:55:42,556 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31620481 2026-05-18 01:55:42,614 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:42,614 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:55:42,614 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:42,614 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99697274': 1, 'ctest-pod-31620481': 1} 2026-05-18 01:55:42,665 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:42,665 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:55:42,665 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: ctest-pod-31620481 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:42,721 - DEBUG - [Pod ctest-pod-63487700] Cmd: wget http://10.97.144.236:80/ -O - -T 5 -t 1 , Output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:42,721 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd wget http://10.97.144.236:80/ -O - -T 5 -t 1 passed 2026-05-18 01:55:42,721 - DEBUG - [Pod Pod ctest-pod-63487700] Cmd output: ctest-pod-99697274 Connecting to 10.97.144.236:80 (10.97.144.236:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:42,721 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99697274': 1, 'ctest-pod-31620481': 1} 2026-05-18 01:55:44,777 - DEBUG - [Pod ctest-pod-49114812] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.616 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.596/1.616 ms 2026-05-18 01:55:44,777 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49114812 with expectation True passed 2026-05-18 01:55:46,832 - DEBUG - [Pod ctest-pod-53109641] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.743 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.306/0.743 ms 2026-05-18 01:55:46,833 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53109641 with expectation True passed 2026-05-18 01:55:48,887 - DEBUG - [Pod ctest-pod-63487700] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.396 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.191/0.396 ms 2026-05-18 01:55:48,887 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63487700 with expectation True passed 2026-05-18 01:55:48,944 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99697274 2026-05-18 01:55:48,944 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-05-18 01:55:48,944 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99697274 2026-05-18 01:55:48,944 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49114812 passed 2026-05-18 01:55:48,998 - DEBUG - [Pod ctest-pod-49114812] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-31620481 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:48,998 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-05-18 01:55:48,998 - DEBUG - [Pod Pod ctest-pod-49114812] Cmd output: ctest-pod-31620481 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:48,998 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49114812 passed 2026-05-18 01:55:54,050 - DEBUG - [Pod ctest-pod-53109641] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-05-18 01:55:54,051 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-05-18 01:55:54,051 - DEBUG - [Pod Pod ctest-pod-53109641] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-05-18 01:55:54,051 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53109641 passed 2026-05-18 01:55:54,106 - DEBUG - [Pod ctest-pod-39885484] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-99697274 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:54,106 - DEBUG - [Pod Pod ctest-pod-39885484] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-05-18 01:55:54,106 - DEBUG - [Pod Pod ctest-pod-39885484] Cmd output: ctest-pod-99697274 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-05-18 01:55:54,106 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39885484 passed 2026-05-18 01:55:54,107 - INFO - Deleting Network Policy : ingress-on-service 2026-05-18 01:55:54,107 - INFO - Deleting service : ctest-nginx-svc-05992787 2026-05-18 01:55:54,368 - DEBUG - No XMPP flaps were noticed during the test 2026-05-18 01:55:54,368 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2026-05-18 01:55:54,368 - INFO - -------------------------------------------------------------------------------- 2026-05-18 01:55:54,372 - INFO - Deleting pod ctest-new-default-70905806:ctest-pod-99697274 2026-05-18 01:55:54,373 - INFO - Deleting pod ctest-new-default-70905806:ctest-pod-31620481 2026-05-18 01:55:54,373 - INFO - Deleting pod ctest-non-default-36325896:ctest-pod-85454707 2026-05-18 01:55:54,373 - INFO - Deleting pod ctest-non-default-36325896:ctest-pod-57235849 2026-05-18 01:55:54,374 - INFO - Deleting pod ctest-new-default-70905806:ctest-pod-53109641 2026-05-18 01:55:54,374 - INFO - Deleting pod ctest-new-default-70905806:ctest-pod-49114812 2026-05-18 01:55:54,374 - INFO - Deleting pod ctest-non-default-36325896:ctest-pod-63487700 2026-05-18 01:55:54,375 - INFO - Deleting pod ctest-non-default-36325896:ctest-pod-39885484 2026-05-18 01:55:54,505 - WARNING - Pod uuid 54ed54e3-57fd-4876-93c1-5195e37dc686 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,506 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,536 - WARNING - Pod uuid ab7805fc-7b93-4e98-b76d-9286d4167da4 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,537 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,538 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,538 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,538 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:54,539 - WARNING - Pod uuid 52483319-6053-4304-bdc0-df6571332b4b is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:59,516 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:59,517 - DEBUG - Pod 54ed54e3-57fd-4876-93c1-5195e37dc686 is not in agent 10.0.0.242 VM list 2026-05-18 01:55:59,522 - DEBUG - VMI 37083f44-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:55:59,523 - INFO - Verified that pod ctest-pod-31620481 is removed in agent 2026-05-18 01:55:59,556 - DEBUG - Pod ab7805fc-7b93-4e98-b76d-9286d4167da4 is not in agent 10.0.0.242 VM list 2026-05-18 01:55:59,560 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:59,560 - DEBUG - Pod 52483319-6053-4304-bdc0-df6571332b4b is not in agent 10.0.0.242 VM list 2026-05-18 01:55:59,561 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:59,562 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:59,562 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:55:59,570 - DEBUG - VMI 37a649be-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:55:59,571 - INFO - Verified that pod ctest-pod-85454707 is removed in agent 2026-05-18 01:55:59,572 - DEBUG - VMI 382b9178-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:55:59,572 - INFO - Verified that pod ctest-pod-57235849 is removed in agent 2026-05-18 01:56:04,528 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:04,577 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:04,578 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:04,591 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:04,591 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:09,537 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:09,589 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:09,589 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:09,600 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:09,601 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:14,545 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:14,601 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:14,605 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:14,612 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:14,612 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:19,554 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:19,610 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:19,612 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:19,621 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:19,622 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:24,593 - WARNING - Pod uuid 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:24,625 - WARNING - Pod uuid 199840fb-09b6-4036-8368-a191469ef033 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:24,626 - WARNING - Pod uuid 7fe7583f-8b30-463f-9456-a774ad03bf0f is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:24,637 - WARNING - Pod uuid a52a4394-e89b-46d3-a16f-2db0b28fa6fe is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:24,637 - WARNING - Pod uuid efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is still seen in agent 10.0.0.242 VM list 2026-05-18 01:56:29,605 - DEBUG - Pod 36c1ed7a-a2d2-480a-9598-ec0eea48bc56 is not in agent 10.0.0.242 VM list 2026-05-18 01:56:29,611 - DEBUG - VMI 368a6844-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:56:29,612 - INFO - Verified that pod ctest-pod-99697274 is removed in agent 2026-05-18 01:56:29,645 - DEBUG - Pod 199840fb-09b6-4036-8368-a191469ef033 is not in agent 10.0.0.242 VM list 2026-05-18 01:56:29,647 - DEBUG - Pod 7fe7583f-8b30-463f-9456-a774ad03bf0f is not in agent 10.0.0.242 VM list 2026-05-18 01:56:29,664 - DEBUG - VMI 39f21644-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:56:29,664 - INFO - Verified that pod ctest-pod-63487700 is removed in agent 2026-05-18 01:56:29,665 - DEBUG - VMI 38bfd5f4-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:56:29,665 - INFO - Verified that pod ctest-pod-53109641 is removed in agent 2026-05-18 01:56:29,666 - DEBUG - Pod a52a4394-e89b-46d3-a16f-2db0b28fa6fe is not in agent 10.0.0.242 VM list 2026-05-18 01:56:29,668 - DEBUG - Pod efe2a4e9-ec25-40f4-ba8c-6bbf6d0c1ad1 is not in agent 10.0.0.242 VM list 2026-05-18 01:56:29,680 - DEBUG - VMI 3a6e30f8-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:56:29,680 - INFO - Verified that pod ctest-pod-39885484 is removed in agent 2026-05-18 01:56:29,682 - DEBUG - VMI 39524b64-525c-11f1-ac34-fa163e99dd38 is removed from agent 10.0.0.242 2026-05-18 01:56:29,682 - INFO - Verified that pod ctest-pod-49114812 is removed in agent 2026-05-18 01:56:29,682 - INFO - Deleting namespace ctest-non-default-36325896 2026-05-18 01:56:29,696 - DEBUG - Namespace ctest-non-default-36325896 still in k8s 2026-05-18 01:56:31,701 - DEBUG - Namespace ctest-non-default-36325896 still in k8s 2026-05-18 01:56:33,707 - DEBUG - Namespace ctest-non-default-36325896 still in k8s 2026-05-18 01:56:35,712 - DEBUG - Namespace ctest-non-default-36325896 is not in k8s 2026-05-18 01:56:35,712 - DEBUG - No need to check project deletion in contrail-api 2026-05-18 01:56:35,712 - INFO - Deleting namespace ctest-new-default-70905806 2026-05-18 01:56:35,728 - DEBUG - Namespace ctest-new-default-70905806 still in k8s 2026-05-18 01:56:37,736 - DEBUG - Namespace ctest-new-default-70905806 still in k8s 2026-05-18 01:56:39,741 - DEBUG - Namespace ctest-new-default-70905806 still in k8s 2026-05-18 01:56:41,746 - DEBUG - Namespace ctest-new-default-70905806 is not in k8s 2026-05-18 01:56:41,746 - DEBUG - No need to check project deletion in contrail-api