2025-09-15 13:41:51,746 - INFO - Using existing project ['default-domain', 'k8s-default'](e495d79c-097b-4321-94a1-146b3804c338) 2025-09-15 13:41:51,765 - DEBUG - Namespace ctest-new-default-50814199 not present 2025-09-15 13:41:51,780 - INFO - Created namespace ctest-new-default-50814199 2025-09-15 13:41:54,785 - DEBUG - Namespace ctest-non-default-39598593 not present 2025-09-15 13:41:54,796 - INFO - Created namespace ctest-non-default-39598593 2025-09-15 13:41:57,814 - DEBUG - Pod ctest-pod-70112691 not present 2025-09-15 13:41:57,814 - INFO - Creating Pod ctest-pod-70112691 2025-09-15 13:41:57,848 - DEBUG - Pod : ctest-pod-70112691 UUID is 85eb5bbf-eb5c-40be-9986-27fa14e8d69b 2025-09-15 13:41:57,856 - DEBUG - Pod ctest-pod-21552564 not present 2025-09-15 13:41:57,866 - INFO - Creating Pod ctest-pod-21552564 2025-09-15 13:41:57,898 - DEBUG - Pod : ctest-pod-21552564 UUID is 146df94e-0dae-4db5-988a-bc9a3acf6ee5 2025-09-15 13:41:57,905 - DEBUG - Pod ctest-pod-09704753 not present 2025-09-15 13:41:57,911 - INFO - Creating Pod ctest-pod-09704753 2025-09-15 13:41:57,953 - DEBUG - Pod : ctest-pod-09704753 UUID is e7084024-a5a1-4ff0-ba7c-b22f90822929 2025-09-15 13:41:57,956 - DEBUG - Pod ctest-pod-28235166 not present 2025-09-15 13:41:57,956 - INFO - Creating Pod ctest-pod-28235166 2025-09-15 13:41:57,979 - DEBUG - Pod : ctest-pod-28235166 UUID is d3bf0be2-934c-410e-b533-8923e6cc9fbc 2025-09-15 13:41:57,984 - DEBUG - Pod ctest-pod-35915444 not present 2025-09-15 13:41:57,984 - INFO - Creating Pod ctest-pod-35915444 2025-09-15 13:41:58,011 - DEBUG - Pod : ctest-pod-35915444 UUID is f774e8f3-70db-4b6e-8fad-b0f30b6e1a2f 2025-09-15 13:41:58,014 - DEBUG - Pod ctest-pod-13976220 not present 2025-09-15 13:41:58,015 - INFO - Creating Pod ctest-pod-13976220 2025-09-15 13:41:58,057 - DEBUG - Pod : ctest-pod-13976220 UUID is 1a6c22d2-d95d-423c-945d-50a80159b8e3 2025-09-15 13:41:58,061 - DEBUG - Pod ctest-pod-43796473 not present 2025-09-15 13:41:58,063 - INFO - Creating Pod ctest-pod-43796473 2025-09-15 13:41:58,085 - DEBUG - Pod : ctest-pod-43796473 UUID is 3398b562-cebc-4d40-a786-2438b7e8e239 2025-09-15 13:41:58,087 - DEBUG - Pod ctest-pod-03710906 not present 2025-09-15 13:41:58,087 - INFO - Creating Pod ctest-pod-03710906 2025-09-15 13:41:58,121 - DEBUG - Pod : ctest-pod-03710906 UUID is 4695a21b-ff6d-4de4-a513-374eb64ec4a0 2025-09-15 13:41:58,296 - INFO - Project default-domain:k8s-ctest-new-default-50814199 for Namespace ctest-new-default-50814199 is seen in contrail-api 2025-09-15 13:41:58,296 - DEBUG - Project uuid in Contrail is cc5181e9-d996-4b6f-be5a-8150a303686e 2025-09-15 13:41:58,457 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=f312b891-5332-44da-8bd0-b02ab00e8891 2025-09-15 13:41:58,462 - INFO - Namespace ctest-new-default-50814199 with uuid f312b891-5332-44da-8bd0-b02ab00e8891 found in kube manager 2025-09-15 13:41:58,462 - INFO - Namespace ctest-new-default-50814199 verification passed 2025-09-15 13:41:58,621 - INFO - Project default-domain:k8s-ctest-non-default-39598593 for Namespace ctest-non-default-39598593 is seen in contrail-api 2025-09-15 13:41:58,621 - DEBUG - Project uuid in Contrail is 887aee66-e7cb-47f5-b5bb-e6c0e8b11764 2025-09-15 13:41:58,621 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=e16f87a3-280e-469a-9c5f-2baf6a660c90 2025-09-15 13:41:58,625 - INFO - Namespace ctest-non-default-39598593 with uuid e16f87a3-280e-469a-9c5f-2baf6a660c90 found in kube manager 2025-09-15 13:41:58,626 - INFO - Namespace ctest-non-default-39598593 verification passed 2025-09-15 13:41:58,635 - DEBUG - Pod ctest-pod-70112691 not in running state.Currently in Pending 2025-09-15 13:42:03,643 - DEBUG - Pod ctest-pod-70112691 not in running state.Currently in Pending 2025-09-15 13:42:08,653 - DEBUG - Pod ctest-pod-70112691 not in running state.Currently in Pending 2025-09-15 13:42:13,661 - INFO - Pod ctest-pod-70112691 is in running state.Got IP 10.47.255.251 2025-09-15 13:42:13,673 - DEBUG - Pod ctest-pod-70112691 has vmi c0e38a40-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:13,673 - INFO - Verified pod ctest-pod-70112691 in contrail-api 2025-09-15 13:42:13,685 - DEBUG - VMI c0e38a40-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:13,686 - INFO - Verified Pod ctest-pod-70112691 in agent 10.0.0.33 2025-09-15 13:42:13,686 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=85eb5bbf-eb5c-40be-9986-27fa14e8d69b 2025-09-15 13:42:13,690 - INFO - Pod ctest-pod-70112691 with uuid 85eb5bbf-eb5c-40be-9986-27fa14e8d69b found in kube manager 2025-09-15 13:42:13,690 - INFO - Pod ctest-pod-70112691 verification passed 2025-09-15 13:42:13,697 - INFO - Pod ctest-pod-21552564 is in running state.Got IP 10.47.255.250 2025-09-15 13:42:13,753 - DEBUG - Pod ctest-pod-21552564 has vmi c16ba4ac-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:13,753 - INFO - Verified pod ctest-pod-21552564 in contrail-api 2025-09-15 13:42:13,764 - DEBUG - VMI c16ba4ac-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:13,765 - INFO - Verified Pod ctest-pod-21552564 in agent 10.0.0.33 2025-09-15 13:42:13,765 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=146df94e-0dae-4db5-988a-bc9a3acf6ee5 2025-09-15 13:42:13,769 - INFO - Pod ctest-pod-21552564 with uuid 146df94e-0dae-4db5-988a-bc9a3acf6ee5 found in kube manager 2025-09-15 13:42:13,769 - INFO - Pod ctest-pod-21552564 verification passed 2025-09-15 13:42:13,776 - INFO - Pod ctest-pod-09704753 is in running state.Got IP 10.47.255.249 2025-09-15 13:42:13,838 - DEBUG - Pod ctest-pod-09704753 has vmi c21122a6-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:13,838 - INFO - Verified pod ctest-pod-09704753 in contrail-api 2025-09-15 13:42:13,849 - DEBUG - VMI c21122a6-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:13,849 - INFO - Verified Pod ctest-pod-09704753 in agent 10.0.0.33 2025-09-15 13:42:13,849 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e7084024-a5a1-4ff0-ba7c-b22f90822929 2025-09-15 13:42:13,853 - INFO - Pod ctest-pod-09704753 with uuid e7084024-a5a1-4ff0-ba7c-b22f90822929 found in kube manager 2025-09-15 13:42:13,853 - INFO - Pod ctest-pod-09704753 verification passed 2025-09-15 13:42:13,860 - INFO - Pod ctest-pod-28235166 is in running state.Got IP 10.47.255.248 2025-09-15 13:42:13,872 - DEBUG - Pod ctest-pod-28235166 has vmi c291e170-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:13,872 - INFO - Verified pod ctest-pod-28235166 in contrail-api 2025-09-15 13:42:13,884 - DEBUG - VMI c291e170-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:13,884 - INFO - Verified Pod ctest-pod-28235166 in agent 10.0.0.33 2025-09-15 13:42:13,884 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=d3bf0be2-934c-410e-b533-8923e6cc9fbc 2025-09-15 13:42:13,889 - INFO - Pod ctest-pod-28235166 with uuid d3bf0be2-934c-410e-b533-8923e6cc9fbc found in kube manager 2025-09-15 13:42:13,889 - INFO - Pod ctest-pod-28235166 verification passed 2025-09-15 13:42:13,895 - DEBUG - Pod ctest-pod-35915444 not in running state.Currently in Pending 2025-09-15 13:42:18,904 - INFO - Pod ctest-pod-35915444 is in running state.Got IP 10.47.255.247 2025-09-15 13:42:18,915 - DEBUG - Pod ctest-pod-35915444 has vmi c3235556-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:18,915 - INFO - Verified pod ctest-pod-35915444 in contrail-api 2025-09-15 13:42:18,926 - DEBUG - VMI c3235556-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:18,926 - INFO - Verified Pod ctest-pod-35915444 in agent 10.0.0.33 2025-09-15 13:42:18,926 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f774e8f3-70db-4b6e-8fad-b0f30b6e1a2f 2025-09-15 13:42:18,929 - INFO - Pod ctest-pod-35915444 with uuid f774e8f3-70db-4b6e-8fad-b0f30b6e1a2f found in kube manager 2025-09-15 13:42:18,930 - INFO - Pod ctest-pod-35915444 verification passed 2025-09-15 13:42:18,939 - INFO - Pod ctest-pod-43796473 is in running state.Got IP 10.47.255.245 2025-09-15 13:42:18,994 - DEBUG - Pod ctest-pod-43796473 has vmi c40b78d6-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:18,994 - INFO - Verified pod ctest-pod-43796473 in contrail-api 2025-09-15 13:42:19,004 - DEBUG - VMI c40b78d6-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:19,005 - INFO - Verified Pod ctest-pod-43796473 in agent 10.0.0.33 2025-09-15 13:42:19,005 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3398b562-cebc-4d40-a786-2438b7e8e239 2025-09-15 13:42:19,009 - INFO - Pod ctest-pod-43796473 with uuid 3398b562-cebc-4d40-a786-2438b7e8e239 found in kube manager 2025-09-15 13:42:19,009 - INFO - Pod ctest-pod-43796473 verification passed 2025-09-15 13:42:19,015 - INFO - Pod ctest-pod-13976220 is in running state.Got IP 10.47.255.246 2025-09-15 13:42:19,027 - DEBUG - Pod ctest-pod-13976220 has vmi c399e4d2-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:19,027 - INFO - Verified pod ctest-pod-13976220 in contrail-api 2025-09-15 13:42:19,038 - DEBUG - VMI c399e4d2-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:19,038 - INFO - Verified Pod ctest-pod-13976220 in agent 10.0.0.33 2025-09-15 13:42:19,039 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1a6c22d2-d95d-423c-945d-50a80159b8e3 2025-09-15 13:42:19,048 - INFO - Pod ctest-pod-13976220 with uuid 1a6c22d2-d95d-423c-945d-50a80159b8e3 found in kube manager 2025-09-15 13:42:19,048 - INFO - Pod ctest-pod-13976220 verification passed 2025-09-15 13:42:19,054 - INFO - Pod ctest-pod-03710906 is in running state.Got IP 10.47.255.244 2025-09-15 13:42:19,113 - DEBUG - Pod ctest-pod-03710906 has vmi c4720bbe-9239-11f0-a4d9-fa163e6c9433 2025-09-15 13:42:19,114 - INFO - Verified pod ctest-pod-03710906 in contrail-api 2025-09-15 13:42:19,124 - DEBUG - VMI c4720bbe-9239-11f0-a4d9-fa163e6c9433 is active in agent 10.0.0.33 2025-09-15 13:42:19,124 - INFO - Verified Pod ctest-pod-03710906 in agent 10.0.0.33 2025-09-15 13:42:19,124 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4695a21b-ff6d-4de4-a513-374eb64ec4a0 2025-09-15 13:42:19,128 - INFO - Pod ctest-pod-03710906 with uuid 4695a21b-ff6d-4de4-a513-374eb64ec4a0 found in kube manager 2025-09-15 13:42:19,128 - INFO - Pod ctest-pod-03710906 verification passed 2025-09-15 13:42:19,128 - INFO - ================================================================================ 2025-09-15 13:42:19,128 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-09-15 13:42:19,128 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-09-15 13:42:19,357 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.50': '0'}} with 2025-09-15 13:42:19,357 - INFO - Initial checks done. Running the testcase now 2025-09-15 13:42:19,357 - INFO - 2025-09-15 13:42:19,415 - DEBUG - [Pod ctest-pod-70112691] Cmd: echo ctest-pod-70112691 > /usr/share/nginx/html/index.html, Output: 2025-09-15 13:42:19,470 - DEBUG - [Pod ctest-pod-21552564] Cmd: echo ctest-pod-21552564 > /usr/share/nginx/html/index.html, Output: 2025-09-15 13:42:19,523 - DEBUG - [Pod ctest-pod-09704753] Cmd: echo ctest-pod-09704753 > /usr/share/nginx/html/index.html, Output: 2025-09-15 13:42:19,585 - DEBUG - [Pod ctest-pod-28235166] Cmd: echo ctest-pod-28235166 > /usr/share/nginx/html/index.html, Output: 2025-09-15 13:42:19,588 - DEBUG - Service ctest-nginx-svc-41859827 not present 2025-09-15 13:42:19,589 - INFO - Creating service ctest-nginx-svc-41859827 2025-09-15 13:42:19,606 - INFO - Created Service ctest-nginx-svc-41859827 2025-09-15 13:42:19,612 - WARNING - Service UUID 790e53fb-9a2f-4b18-a6eb-530b128bd86c not yet found in contrail-api 2025-09-15 13:42:20,620 - INFO - Validated that Service ctest-nginx-svc-41859827 is seen in contrail-api 2025-09-15 13:42:20,620 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=790e53fb-9a2f-4b18-a6eb-530b128bd86c 2025-09-15 13:42:20,625 - INFO - Service ctest-nginx-svc-41859827 with uuid 790e53fb-9a2f-4b18-a6eb-530b128bd86c found in kube manager 2025-09-15 13:42:20,626 - INFO - Service ctest-nginx-svc-41859827 verification passed 2025-09-15 13:42:21,699 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70112691 2025-09-15 13:42:21,699 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:42:21,700 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70112691 2025-09-15 13:42:21,753 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,753 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:42:21,753 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,809 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,810 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:42:21,810 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,862 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,862 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:42:21,862 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,863 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70112691': 3, 'ctest-pod-21552564': 1} 2025-09-15 13:42:21,921 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:21,921 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:42:21,921 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:22,013 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:22,013 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:42:22,013 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:42:22,013 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70112691': 1, 'ctest-pod-21552564': 1} 2025-09-15 13:42:22,017 - DEBUG - Network policy ingress-on-service not present 2025-09-15 13:42:22,018 - INFO - Creating Network Policy ingress-on-service 2025-09-15 13:42:22,031 - INFO - Network policy found in k8s 2025-09-15 13:42:22,032 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a233cddd-0491-40e9-be3d-e4db5c830a42 2025-09-15 13:42:22,038 - INFO - Network Policy ingress-on-service with uuid a233cddd-0491-40e9-be3d-e4db5c830a42 found in kube manager 2025-09-15 13:42:22,071 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-09-15 13:42:22,071 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-09-15 13:42:22,071 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a233cddd-0491-40e9-be3d-e4db5c830a42 2025-09-15 13:42:22,099 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-15 13:42:24,100 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a233cddd-0491-40e9-be3d-e4db5c830a42 2025-09-15 13:42:24,131 - INFO - Network policy with name ingress-on-service found in agent 2025-09-15 13:42:24,131 - INFO - Network Policy ingress-on-service verification passed 2025-09-15 13:42:29,183 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:29,183 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:29,183 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:34,236 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:34,236 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:34,236 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:39,286 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:39,286 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:39,286 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:44,339 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:44,340 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:44,340 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:49,399 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:49,399 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:49,399 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:54,450 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:54,451 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:54,451 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:59,520 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:59,520 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:42:59,520 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:04,570 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:04,571 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:04,571 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:09,620 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:09,620 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:09,620 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:14,684 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:14,684 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:14,684 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:14,684 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-70112691': 0, 'ctest-pod-21552564': 0} 2025-09-15 13:43:14,743 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,743 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:43:14,743 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,793 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,793 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:43:14,793 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,841 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,841 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:43:14,841 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,893 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,894 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:43:14,894 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,944 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:14,944 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:43:14,944 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:15,003 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:15,003 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:43:15,003 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:43:15,003 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70112691': 5, 'ctest-pod-21552564': 1} 2025-09-15 13:43:20,050 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:20,050 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:20,050 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:25,120 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:25,120 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:25,120 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:30,182 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:30,182 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:30,182 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:35,234 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:35,235 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:35,235 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:40,282 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:40,283 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:40,283 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:45,331 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:45,332 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:45,332 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:50,383 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:50,383 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:50,383 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:55,436 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:55,436 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:43:55,436 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:00,494 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:00,494 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:00,494 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:05,559 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:05,559 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:05,559 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:05,559 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-70112691': 0, 'ctest-pod-21552564': 0} 2025-09-15 13:44:07,611 - DEBUG - [Pod ctest-pod-13976220] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.333 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.497/1.333 ms 2025-09-15 13:44:07,611 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-13976220 with expectation True passed 2025-09-15 13:44:09,052 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-09-15 13:44:16,110 - DEBUG - [Pod ctest-pod-35915444] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.495 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.226/0.495 ms 2025-09-15 13:44:16,110 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35915444 with expectation True passed 2025-09-15 13:44:18,166 - DEBUG - [Pod ctest-pod-43796473] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.524 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.056 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.056/0.217/0.524 ms 2025-09-15 13:44:18,167 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43796473 with expectation True passed 2025-09-15 13:44:18,216 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:44:18,216 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-15 13:44:18,216 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:44:18,216 - INFO - wget check of of http://10.47.255.251 from ctest-pod-13976220 passed 2025-09-15 13:44:18,275 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:44:18,275 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 13:44:18,275 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:44:18,275 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13976220 passed 2025-09-15 13:44:23,328 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 13:44:23,328 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 13:44:23,328 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 13:44:23,328 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35915444 passed 2025-09-15 13:44:28,384 - DEBUG - [Pod ctest-pod-03710906] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-15 13:44:28,385 - DEBUG - [Pod Pod ctest-pod-03710906] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-15 13:44:28,385 - DEBUG - [Pod Pod ctest-pod-03710906] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-15 13:44:28,385 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03710906 passed 2025-09-15 13:44:28,398 - INFO - Updating Network Policy ingress-on-service 2025-09-15 13:44:33,473 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:33,473 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:33,473 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:38,528 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:38,528 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:38,528 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:43,580 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:43,580 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:43,580 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:48,639 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:48,639 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:48,639 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:53,690 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:53,690 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:53,690 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:58,739 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:58,739 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:44:58,739 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:03,802 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:03,803 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:03,803 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:08,855 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:08,856 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:08,856 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:13,907 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:13,907 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:13,907 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:18,959 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:18,959 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:18,959 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.107.214.104:80 (10.107.214.104:80) wget: download timed out 2025-09-15 13:45:18,959 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-70112691': 0, 'ctest-pod-21552564': 0} 2025-09-15 13:45:19,008 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,008 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:45:19,008 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,068 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,068 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:45:19,068 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,068 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70112691': 1, 'ctest-pod-21552564': 1} 2025-09-15 13:45:19,121 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,122 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:45:19,122 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,182 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,182 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:45:19,183 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: ctest-pod-21552564 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,236 - DEBUG - [Pod ctest-pod-43796473] Cmd: wget http://10.107.214.104:80/ -O - -T 5 -t 1 , Output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,236 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd wget http://10.107.214.104:80/ -O - -T 5 -t 1 passed 2025-09-15 13:45:19,236 - DEBUG - [Pod Pod ctest-pod-43796473] Cmd output: ctest-pod-70112691 Connecting to 10.107.214.104:80 (10.107.214.104:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 13:45:19,236 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70112691': 1, 'ctest-pod-21552564': 2} 2025-09-15 13:45:21,290 - DEBUG - [Pod ctest-pod-13976220] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.763 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.102 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.308/0.763 ms 2025-09-15 13:45:21,291 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-13976220 with expectation True passed 2025-09-15 13:45:23,342 - DEBUG - [Pod ctest-pod-35915444] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.888 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.355/0.888 ms 2025-09-15 13:45:23,342 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35915444 with expectation True passed 2025-09-15 13:45:25,391 - DEBUG - [Pod ctest-pod-43796473] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.420 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.199/0.420 ms 2025-09-15 13:45:25,391 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43796473 with expectation True passed 2025-09-15 13:45:25,450 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:45:25,451 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-15 13:45:25,451 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:45:25,451 - INFO - wget check of of http://10.47.255.251 from ctest-pod-13976220 passed 2025-09-15 13:45:25,507 - DEBUG - [Pod ctest-pod-13976220] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:45:25,507 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 13:45:25,507 - DEBUG - [Pod Pod ctest-pod-13976220] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:45:25,507 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13976220 passed 2025-09-15 13:45:30,564 - DEBUG - [Pod ctest-pod-35915444] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 13:45:30,564 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 13:45:30,564 - DEBUG - [Pod Pod ctest-pod-35915444] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 13:45:30,564 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35915444 passed 2025-09-15 13:45:30,626 - DEBUG - [Pod ctest-pod-03710906] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:45:30,626 - DEBUG - [Pod Pod ctest-pod-03710906] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-15 13:45:30,626 - DEBUG - [Pod Pod ctest-pod-03710906] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 13:45:30,626 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03710906 passed 2025-09-15 13:45:30,626 - INFO - Deleting Network Policy : ingress-on-service 2025-09-15 13:45:30,627 - INFO - Deleting service : ctest-nginx-svc-41859827 2025-09-15 13:45:30,896 - DEBUG - No XMPP flaps were noticed during the test