2025-08-25 02:21:36,775 - INFO - Using existing project ['default-domain', 'k8s-default'](9c59825d-1b01-4200-90f8-5aa320debe75) 2025-08-25 02:21:36,797 - DEBUG - Namespace ctest-new-default-43221090 not present 2025-08-25 02:21:36,821 - INFO - Created namespace ctest-new-default-43221090 2025-08-25 02:21:39,836 - DEBUG - Namespace ctest-non-default-82977191 not present 2025-08-25 02:21:39,852 - INFO - Created namespace ctest-non-default-82977191 2025-08-25 02:21:42,870 - DEBUG - Pod ctest-pod-57117347 not present 2025-08-25 02:21:42,870 - INFO - Creating Pod ctest-pod-57117347 2025-08-25 02:21:42,898 - DEBUG - Pod : ctest-pod-57117347 UUID is 3262c2c4-fa75-40c6-895f-9884cd3a2033 2025-08-25 02:21:42,904 - DEBUG - Pod ctest-pod-17585992 not present 2025-08-25 02:21:42,905 - INFO - Creating Pod ctest-pod-17585992 2025-08-25 02:21:42,931 - DEBUG - Pod : ctest-pod-17585992 UUID is 0097c81d-e4c3-493d-88dc-ac81898900d8 2025-08-25 02:21:42,936 - DEBUG - Pod ctest-pod-91095701 not present 2025-08-25 02:21:42,936 - INFO - Creating Pod ctest-pod-91095701 2025-08-25 02:21:42,970 - DEBUG - Pod : ctest-pod-91095701 UUID is 3cca8623-1146-4415-bf95-ecd9be7fa31b 2025-08-25 02:21:42,984 - DEBUG - Pod ctest-pod-77505229 not present 2025-08-25 02:21:42,984 - INFO - Creating Pod ctest-pod-77505229 2025-08-25 02:21:43,021 - DEBUG - Pod : ctest-pod-77505229 UUID is be7fcd24-ccea-45ac-a643-00c545b1ea91 2025-08-25 02:21:43,026 - DEBUG - Pod ctest-pod-09870035 not present 2025-08-25 02:21:43,027 - INFO - Creating Pod ctest-pod-09870035 2025-08-25 02:21:43,069 - DEBUG - Pod : ctest-pod-09870035 UUID is 0cd6d936-2e7d-4f4e-ad5f-c0784dc56b00 2025-08-25 02:21:43,073 - DEBUG - Pod ctest-pod-81160154 not present 2025-08-25 02:21:43,075 - INFO - Creating Pod ctest-pod-81160154 2025-08-25 02:21:43,104 - DEBUG - Pod : ctest-pod-81160154 UUID is f051e3bf-ff66-43de-b341-4638c2295d7b 2025-08-25 02:21:43,107 - DEBUG - Pod ctest-pod-09901777 not present 2025-08-25 02:21:43,107 - INFO - Creating Pod ctest-pod-09901777 2025-08-25 02:21:43,133 - DEBUG - Pod : ctest-pod-09901777 UUID is 8bb07429-b3ff-431b-a00d-b71a746bcceb 2025-08-25 02:21:43,137 - DEBUG - Pod ctest-pod-76523064 not present 2025-08-25 02:21:43,137 - INFO - Creating Pod ctest-pod-76523064 2025-08-25 02:21:43,204 - DEBUG - Pod : ctest-pod-76523064 UUID is 6b1d7a7e-3533-4542-83fb-ac1bea27213c 2025-08-25 02:21:43,589 - INFO - Project default-domain:k8s-ctest-new-default-43221090 for Namespace ctest-new-default-43221090 is seen in contrail-api 2025-08-25 02:21:43,589 - DEBUG - Project uuid in Contrail is d19d9261-70d6-47cb-97eb-ccfe9d69e6ed 2025-08-25 02:21:43,815 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=c76f2aaf-8b5a-4423-9b32-acaf419d2b44 2025-08-25 02:21:43,830 - INFO - Namespace ctest-new-default-43221090 with uuid c76f2aaf-8b5a-4423-9b32-acaf419d2b44 found in kube manager 2025-08-25 02:21:43,830 - INFO - Namespace ctest-new-default-43221090 verification passed 2025-08-25 02:21:44,123 - INFO - Project default-domain:k8s-ctest-non-default-82977191 for Namespace ctest-non-default-82977191 is seen in contrail-api 2025-08-25 02:21:44,124 - DEBUG - Project uuid in Contrail is 0517b592-9339-4a55-b251-c781501eb099 2025-08-25 02:21:44,124 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=45c24a24-0352-4a0f-a930-264b04729309 2025-08-25 02:21:44,140 - INFO - Namespace ctest-non-default-82977191 with uuid 45c24a24-0352-4a0f-a930-264b04729309 found in kube manager 2025-08-25 02:21:44,145 - INFO - Namespace ctest-non-default-82977191 verification passed 2025-08-25 02:21:44,162 - DEBUG - Pod ctest-pod-57117347 not in running state.Currently in Pending 2025-08-25 02:21:49,167 - DEBUG - Pod ctest-pod-57117347 not in running state.Currently in Pending 2025-08-25 02:21:54,182 - INFO - Pod ctest-pod-57117347 is in running state.Got IP 10.47.255.251 2025-08-25 02:21:54,195 - DEBUG - Pod ctest-pod-57117347 has vmi 3eda436c-815a-11f0-81ec-fa163e953332 2025-08-25 02:21:54,195 - INFO - Verified pod ctest-pod-57117347 in contrail-api 2025-08-25 02:21:54,211 - DEBUG - VMI 3eda436c-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:21:54,211 - INFO - Verified Pod ctest-pod-57117347 in agent 10.0.0.33 2025-08-25 02:21:54,211 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=3262c2c4-fa75-40c6-895f-9884cd3a2033 2025-08-25 02:21:54,215 - INFO - Pod ctest-pod-57117347 with uuid 3262c2c4-fa75-40c6-895f-9884cd3a2033 found in kube manager 2025-08-25 02:21:54,216 - INFO - Pod ctest-pod-57117347 verification passed 2025-08-25 02:21:54,221 - DEBUG - Pod ctest-pod-17585992 not in running state.Currently in Pending 2025-08-25 02:21:59,250 - INFO - Pod ctest-pod-17585992 is in running state.Got IP 10.47.255.250 2025-08-25 02:21:59,305 - DEBUG - Pod ctest-pod-17585992 has vmi 3f762a98-815a-11f0-81ec-fa163e953332 2025-08-25 02:21:59,305 - INFO - Verified pod ctest-pod-17585992 in contrail-api 2025-08-25 02:21:59,335 - DEBUG - VMI 3f762a98-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:21:59,335 - INFO - Verified Pod ctest-pod-17585992 in agent 10.0.0.33 2025-08-25 02:21:59,335 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=0097c81d-e4c3-493d-88dc-ac81898900d8 2025-08-25 02:21:59,351 - INFO - Pod ctest-pod-17585992 with uuid 0097c81d-e4c3-493d-88dc-ac81898900d8 found in kube manager 2025-08-25 02:21:59,352 - INFO - Pod ctest-pod-17585992 verification passed 2025-08-25 02:21:59,357 - INFO - Pod ctest-pod-91095701 is in running state.Got IP 10.47.255.249 2025-08-25 02:21:59,370 - DEBUG - Pod ctest-pod-91095701 has vmi 401be7d0-815a-11f0-81ec-fa163e953332 2025-08-25 02:21:59,371 - INFO - Verified pod ctest-pod-91095701 in contrail-api 2025-08-25 02:21:59,385 - DEBUG - VMI 401be7d0-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:21:59,385 - INFO - Verified Pod ctest-pod-91095701 in agent 10.0.0.33 2025-08-25 02:21:59,385 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=3cca8623-1146-4415-bf95-ecd9be7fa31b 2025-08-25 02:21:59,400 - INFO - Pod ctest-pod-91095701 with uuid 3cca8623-1146-4415-bf95-ecd9be7fa31b found in kube manager 2025-08-25 02:21:59,400 - INFO - Pod ctest-pod-91095701 verification passed 2025-08-25 02:21:59,408 - INFO - Pod ctest-pod-77505229 is in running state.Got IP 10.47.255.248 2025-08-25 02:21:59,422 - DEBUG - Pod ctest-pod-77505229 has vmi 409e6e62-815a-11f0-81ec-fa163e953332 2025-08-25 02:21:59,422 - INFO - Verified pod ctest-pod-77505229 in contrail-api 2025-08-25 02:21:59,443 - DEBUG - VMI 409e6e62-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:21:59,443 - INFO - Verified Pod ctest-pod-77505229 in agent 10.0.0.33 2025-08-25 02:21:59,445 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=be7fcd24-ccea-45ac-a643-00c545b1ea91 2025-08-25 02:21:59,455 - INFO - Pod ctest-pod-77505229 with uuid be7fcd24-ccea-45ac-a643-00c545b1ea91 found in kube manager 2025-08-25 02:21:59,455 - INFO - Pod ctest-pod-77505229 verification passed 2025-08-25 02:21:59,461 - INFO - Pod ctest-pod-09870035 is in running state.Got IP 10.47.255.247 2025-08-25 02:21:59,520 - DEBUG - Pod ctest-pod-09870035 has vmi 413874a8-815a-11f0-81ec-fa163e953332 2025-08-25 02:21:59,520 - INFO - Verified pod ctest-pod-09870035 in contrail-api 2025-08-25 02:21:59,534 - DEBUG - VMI 413874a8-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:21:59,534 - INFO - Verified Pod ctest-pod-09870035 in agent 10.0.0.33 2025-08-25 02:21:59,535 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=0cd6d936-2e7d-4f4e-ad5f-c0784dc56b00 2025-08-25 02:21:59,541 - INFO - Pod ctest-pod-09870035 with uuid 0cd6d936-2e7d-4f4e-ad5f-c0784dc56b00 found in kube manager 2025-08-25 02:21:59,541 - INFO - Pod ctest-pod-09870035 verification passed 2025-08-25 02:21:59,560 - DEBUG - Pod ctest-pod-09901777 not in running state.Currently in Pending 2025-08-25 02:22:04,577 - INFO - Pod ctest-pod-09901777 is in running state.Got IP 10.47.255.245 2025-08-25 02:22:04,609 - DEBUG - Pod ctest-pod-09901777 has vmi 425983c2-815a-11f0-81ec-fa163e953332 2025-08-25 02:22:04,610 - INFO - Verified pod ctest-pod-09901777 in contrail-api 2025-08-25 02:22:04,624 - DEBUG - VMI 425983c2-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:22:04,624 - INFO - Verified Pod ctest-pod-09901777 in agent 10.0.0.33 2025-08-25 02:22:04,625 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=8bb07429-b3ff-431b-a00d-b71a746bcceb 2025-08-25 02:22:04,631 - INFO - Pod ctest-pod-09901777 with uuid 8bb07429-b3ff-431b-a00d-b71a746bcceb found in kube manager 2025-08-25 02:22:04,631 - INFO - Pod ctest-pod-09901777 verification passed 2025-08-25 02:22:04,639 - INFO - Pod ctest-pod-81160154 is in running state.Got IP 10.47.255.246 2025-08-25 02:22:04,700 - DEBUG - Pod ctest-pod-81160154 has vmi 41cd1504-815a-11f0-81ec-fa163e953332 2025-08-25 02:22:04,701 - INFO - Verified pod ctest-pod-81160154 in contrail-api 2025-08-25 02:22:04,715 - DEBUG - VMI 41cd1504-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:22:04,715 - INFO - Verified Pod ctest-pod-81160154 in agent 10.0.0.33 2025-08-25 02:22:04,716 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=f051e3bf-ff66-43de-b341-4638c2295d7b 2025-08-25 02:22:04,725 - INFO - Pod ctest-pod-81160154 with uuid f051e3bf-ff66-43de-b341-4638c2295d7b found in kube manager 2025-08-25 02:22:04,725 - INFO - Pod ctest-pod-81160154 verification passed 2025-08-25 02:22:04,731 - INFO - Pod ctest-pod-76523064 is in running state.Got IP 10.47.255.244 2025-08-25 02:22:04,748 - DEBUG - Pod ctest-pod-76523064 has vmi 42e75792-815a-11f0-81ec-fa163e953332 2025-08-25 02:22:04,748 - INFO - Verified pod ctest-pod-76523064 in contrail-api 2025-08-25 02:22:04,763 - DEBUG - VMI 42e75792-815a-11f0-81ec-fa163e953332 is active in agent 10.0.0.33 2025-08-25 02:22:04,763 - INFO - Verified Pod ctest-pod-76523064 in agent 10.0.0.33 2025-08-25 02:22:04,763 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=6b1d7a7e-3533-4542-83fb-ac1bea27213c 2025-08-25 02:22:04,768 - INFO - Pod ctest-pod-76523064 with uuid 6b1d7a7e-3533-4542-83fb-ac1bea27213c found in kube manager 2025-08-25 02:22:04,768 - INFO - Pod ctest-pod-76523064 verification passed 2025-08-25 02:22:04,768 - INFO - ================================================================================ 2025-08-25 02:22:04,768 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-08-25 02:22:04,768 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-08-25 02:22:05,035 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.49': '0'}} with 2025-08-25 02:22:05,035 - INFO - Initial checks done. Running the testcase now 2025-08-25 02:22:05,035 - INFO - 2025-08-25 02:22:05,082 - DEBUG - [Pod ctest-pod-57117347] Cmd: echo ctest-pod-57117347 > /usr/share/nginx/html/index.html, Output: 2025-08-25 02:22:05,118 - DEBUG - [Pod ctest-pod-17585992] Cmd: echo ctest-pod-17585992 > /usr/share/nginx/html/index.html, Output: 2025-08-25 02:22:05,176 - DEBUG - [Pod ctest-pod-91095701] Cmd: echo ctest-pod-91095701 > /usr/share/nginx/html/index.html, Output: 2025-08-25 02:22:05,227 - DEBUG - [Pod ctest-pod-77505229] Cmd: echo ctest-pod-77505229 > /usr/share/nginx/html/index.html, Output: 2025-08-25 02:22:05,232 - DEBUG - Service ctest-nginx-svc-47226746 not present 2025-08-25 02:22:05,232 - INFO - Creating service ctest-nginx-svc-47226746 2025-08-25 02:22:05,253 - INFO - Created Service ctest-nginx-svc-47226746 2025-08-25 02:22:05,261 - WARNING - Service UUID 5332410d-c412-4693-aa1f-42c48eea5a05 not yet found in contrail-api 2025-08-25 02:22:06,272 - INFO - Validated that Service ctest-nginx-svc-47226746 is seen in contrail-api 2025-08-25 02:22:06,272 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=5332410d-c412-4693-aa1f-42c48eea5a05 2025-08-25 02:22:06,279 - INFO - Service ctest-nginx-svc-47226746 with uuid 5332410d-c412-4693-aa1f-42c48eea5a05 found in kube manager 2025-08-25 02:22:06,280 - INFO - Service ctest-nginx-svc-47226746 verification passed 2025-08-25 02:22:07,345 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:22:07,345 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:07,345 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:22:07,952 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:07,952 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:07,952 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,103 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:22:08,103 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:08,103 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:22:08,150 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:22:08,150 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:08,150 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:22:08,200 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,212 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:08,212 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,212 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57117347': 4, 'ctest-pod-17585992': 1} 2025-08-25 02:22:08,266 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,266 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:08,266 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,319 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,319 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:08,319 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,428 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,428 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:22:08,428 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:22:08,428 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57117347': 2, 'ctest-pod-17585992': 1} 2025-08-25 02:22:08,431 - DEBUG - Network policy ingress-on-service not present 2025-08-25 02:22:08,432 - INFO - Creating Network Policy ingress-on-service 2025-08-25 02:22:08,461 - INFO - Network policy found in k8s 2025-08-25 02:22:08,462 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c9fa7eae-0780-4de9-a611-3b256feb8529 2025-08-25 02:22:08,470 - INFO - Network Policy ingress-on-service with uuid c9fa7eae-0780-4de9-a611-3b256feb8529 found in kube manager 2025-08-25 02:22:08,509 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-08-25 02:22:08,516 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-08-25 02:22:08,516 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c9fa7eae-0780-4de9-a611-3b256feb8529 2025-08-25 02:22:08,579 - WARNING - Network policy with name ingress-on-service not found in agent 2025-08-25 02:22:10,579 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c9fa7eae-0780-4de9-a611-3b256feb8529 2025-08-25 02:22:10,639 - INFO - Network policy with name ingress-on-service found in agent 2025-08-25 02:22:10,641 - INFO - Network Policy ingress-on-service verification passed 2025-08-25 02:22:15,697 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:15,697 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:15,697 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:20,744 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:20,745 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:20,745 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:25,810 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:25,810 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:25,810 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:30,864 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:30,864 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:30,864 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:35,909 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:35,909 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:35,909 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:40,973 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:40,973 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:40,973 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:46,034 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:46,034 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:46,034 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:51,101 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:51,102 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:51,102 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:56,156 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:56,156 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:22:56,156 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:01,223 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:01,223 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:01,223 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:01,224 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57117347': 0, 'ctest-pod-17585992': 0} 2025-08-25 02:23:01,296 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:23:01,296 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:23:01,296 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57117347 2025-08-25 02:23:01,352 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:23:01,352 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:23:01,352 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:23:01,352 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57117347': 1, 'ctest-pod-17585992': 1} 2025-08-25 02:23:06,410 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:06,410 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:06,410 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:11,477 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:11,477 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:11,477 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:16,545 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:16,545 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:16,545 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:21,608 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:21,608 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:21,608 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:26,686 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:26,687 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:26,687 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:31,761 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:31,762 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:31,762 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:36,821 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:36,821 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:36,821 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:41,869 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:41,869 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:41,869 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:46,940 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:46,941 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:46,941 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:51,985 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:51,985 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:51,986 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:23:51,986 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57117347': 0, 'ctest-pod-17585992': 0} 2025-08-25 02:23:54,044 - DEBUG - [Pod ctest-pod-81160154] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.000 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.380/1.000 ms 2025-08-25 02:23:54,044 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81160154 with expectation True passed 2025-08-25 02:23:56,101 - DEBUG - [Pod ctest-pod-09870035] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.930 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.065 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.354/0.930 ms 2025-08-25 02:23:56,101 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09870035 with expectation True passed 2025-08-25 02:23:58,151 - DEBUG - [Pod ctest-pod-09901777] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.739 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.296/0.739 ms 2025-08-25 02:23:58,151 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09901777 with expectation True passed 2025-08-25 02:23:58,207 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:23:58,207 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-25 02:23:58,207 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:23:58,207 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81160154 passed 2025-08-25 02:23:58,351 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:23:58,351 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-08-25 02:23:58,351 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:23:58,351 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81160154 passed 2025-08-25 02:24:03,402 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-25 02:24:03,402 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-25 02:24:03,402 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-25 02:24:03,402 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09870035 passed 2025-08-25 02:24:08,459 - DEBUG - [Pod ctest-pod-76523064] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-25 02:24:08,459 - DEBUG - [Pod Pod ctest-pod-76523064] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-25 02:24:08,459 - DEBUG - [Pod Pod ctest-pod-76523064] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-25 02:24:08,459 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76523064 passed 2025-08-25 02:24:08,484 - INFO - Updating Network Policy ingress-on-service 2025-08-25 02:24:13,560 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:13,561 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:13,561 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:18,628 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:18,628 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:18,628 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:23,681 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:23,681 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:23,681 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:28,746 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:28,746 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:28,746 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:33,807 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:33,807 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:33,807 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:38,856 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:38,857 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:38,857 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:43,900 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:43,900 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:43,900 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:48,971 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:48,971 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:48,972 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:54,040 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:54,040 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:54,040 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:59,111 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:59,111 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:59,112 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) wget: download timed out 2025-08-25 02:24:59,112 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57117347': 0, 'ctest-pod-17585992': 0} 2025-08-25 02:24:59,196 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,196 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,196 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: ctest-pod-17585992 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,265 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,265 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,265 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,265 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57117347': 1, 'ctest-pod-17585992': 1} 2025-08-25 02:24:59,337 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,337 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,337 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,398 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,398 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,398 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,449 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,449 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,449 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,515 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,515 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,515 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,583 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,583 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,583 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,643 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,643 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,643 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: ctest-pod-57117347 Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-25 02:24:59,692 - DEBUG - [Pod ctest-pod-09901777] Cmd: wget http://10.101.234.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17585992 2025-08-25 02:24:59,692 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd wget http://10.101.234.138:80/ -O - -T 5 -t 1 passed 2025-08-25 02:24:59,692 - DEBUG - [Pod Pod ctest-pod-09901777] Cmd output: Connecting to 10.101.234.138:80 (10.101.234.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17585992 2025-08-25 02:24:59,692 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57117347': 6, 'ctest-pod-17585992': 1} 2025-08-25 02:25:01,738 - DEBUG - [Pod ctest-pod-81160154] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.989 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.383/0.989 ms 2025-08-25 02:25:01,738 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81160154 with expectation True passed 2025-08-25 02:25:03,804 - DEBUG - [Pod ctest-pod-09870035] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.729 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.295/0.729 ms 2025-08-25 02:25:03,804 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09870035 with expectation True passed 2025-08-25 02:25:05,878 - DEBUG - [Pod ctest-pod-09901777] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.379 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.505/1.379 ms 2025-08-25 02:25:05,878 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09901777 with expectation True passed 2025-08-25 02:25:05,949 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:25:05,949 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-25 02:25:05,949 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:25:05,949 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81160154 passed 2025-08-25 02:25:06,008 - DEBUG - [Pod ctest-pod-81160154] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:25:06,008 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-08-25 02:25:06,008 - DEBUG - [Pod Pod ctest-pod-81160154] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:25:06,008 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81160154 passed 2025-08-25 02:25:11,070 - DEBUG - [Pod ctest-pod-09870035] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-25 02:25:11,070 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-25 02:25:11,070 - DEBUG - [Pod Pod ctest-pod-09870035] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-25 02:25:11,070 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09870035 passed 2025-08-25 02:25:11,138 - DEBUG - [Pod ctest-pod-76523064] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:25:11,138 - DEBUG - [Pod Pod ctest-pod-76523064] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-25 02:25:11,138 - DEBUG - [Pod Pod ctest-pod-76523064] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-25 02:25:11,138 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76523064 passed 2025-08-25 02:25:11,138 - INFO - Deleting Network Policy : ingress-on-service 2025-08-25 02:25:11,139 - INFO - Deleting service : ctest-nginx-svc-47226746 2025-08-25 02:25:11,391 - DEBUG - No XMPP flaps were noticed during the test