2025-06-18 07:59:29,370 - INFO - Using existing project ['default-domain', 'k8s-default'](c04c92ed-c284-49bc-b594-737b3bfd3b03) 2025-06-18 07:59:29,417 - DEBUG - Namespace ctest-new-default-47113102 not present 2025-06-18 07:59:29,433 - INFO - Created namespace ctest-new-default-47113102 2025-06-18 07:59:32,439 - DEBUG - Namespace ctest-non-default-46925136 not present 2025-06-18 07:59:32,456 - INFO - Created namespace ctest-non-default-46925136 2025-06-18 07:59:35,477 - DEBUG - Pod ctest-pod-67587605 not present 2025-06-18 07:59:35,482 - INFO - Creating Pod ctest-pod-67587605 2025-06-18 07:59:35,529 - DEBUG - Pod : ctest-pod-67587605 UUID is ca1a06d1-b0fa-48c1-bb70-7b98f6b28eab 2025-06-18 07:59:35,534 - DEBUG - Pod ctest-pod-88727383 not present 2025-06-18 07:59:35,535 - INFO - Creating Pod ctest-pod-88727383 2025-06-18 07:59:35,577 - DEBUG - Pod : ctest-pod-88727383 UUID is 0f3a82be-2529-4018-8f29-bbc84fc2618d 2025-06-18 07:59:35,586 - DEBUG - Pod ctest-pod-95034618 not present 2025-06-18 07:59:35,587 - INFO - Creating Pod ctest-pod-95034618 2025-06-18 07:59:35,623 - DEBUG - Pod : ctest-pod-95034618 UUID is b520aaed-370a-4bca-ac60-26463a93cc9a 2025-06-18 07:59:35,628 - DEBUG - Pod ctest-pod-28766638 not present 2025-06-18 07:59:35,629 - INFO - Creating Pod ctest-pod-28766638 2025-06-18 07:59:35,670 - DEBUG - Pod : ctest-pod-28766638 UUID is ae0859cf-d1f3-419f-9481-38571529ee4a 2025-06-18 07:59:35,674 - DEBUG - Pod ctest-pod-35064871 not present 2025-06-18 07:59:35,675 - INFO - Creating Pod ctest-pod-35064871 2025-06-18 07:59:35,710 - DEBUG - Pod : ctest-pod-35064871 UUID is fd1e406d-4137-4a92-a1d2-7ab971121b81 2025-06-18 07:59:35,714 - DEBUG - Pod ctest-pod-66743693 not present 2025-06-18 07:59:35,715 - INFO - Creating Pod ctest-pod-66743693 2025-06-18 07:59:35,741 - DEBUG - Pod : ctest-pod-66743693 UUID is 5a9cee2f-b787-483a-96a8-c5ac9a9298a6 2025-06-18 07:59:35,744 - DEBUG - Pod ctest-pod-25483281 not present 2025-06-18 07:59:35,744 - INFO - Creating Pod ctest-pod-25483281 2025-06-18 07:59:35,764 - DEBUG - Pod : ctest-pod-25483281 UUID is ab16b01e-c93b-4edc-9562-198f5ee247f0 2025-06-18 07:59:35,772 - DEBUG - Pod ctest-pod-19358866 not present 2025-06-18 07:59:35,773 - INFO - Creating Pod ctest-pod-19358866 2025-06-18 07:59:35,813 - DEBUG - Pod : ctest-pod-19358866 UUID is 8ff26648-c1fe-48bc-8d0b-6f5a1e0ddb7a 2025-06-18 07:59:36,161 - INFO - Project default-domain:k8s-ctest-new-default-47113102 for Namespace ctest-new-default-47113102 is seen in contrail-api 2025-06-18 07:59:36,161 - DEBUG - Project uuid in Contrail is 20e0207f-fa0e-4b54-b352-a152aaf3aa77 2025-06-18 07:59:36,422 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=fd4b68da-edf2-4ea9-92d7-160247b3aec1 2025-06-18 07:59:36,427 - INFO - Namespace ctest-new-default-47113102 with uuid fd4b68da-edf2-4ea9-92d7-160247b3aec1 found in kube manager 2025-06-18 07:59:36,427 - INFO - Namespace ctest-new-default-47113102 verification passed 2025-06-18 07:59:36,799 - INFO - Project default-domain:k8s-ctest-non-default-46925136 for Namespace ctest-non-default-46925136 is seen in contrail-api 2025-06-18 07:59:36,800 - DEBUG - Project uuid in Contrail is 5d21b323-c777-4d5e-b55e-67d345aa49cb 2025-06-18 07:59:36,800 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=2b6ad266-9f95-43da-9f8c-53273ed0f34b 2025-06-18 07:59:36,808 - INFO - Namespace ctest-non-default-46925136 with uuid 2b6ad266-9f95-43da-9f8c-53273ed0f34b found in kube manager 2025-06-18 07:59:36,808 - INFO - Namespace ctest-non-default-46925136 verification passed 2025-06-18 07:59:36,821 - DEBUG - Pod ctest-pod-67587605 not in running state.Currently in Pending 2025-06-18 07:59:41,834 - DEBUG - Pod ctest-pod-67587605 not in running state.Currently in Pending 2025-06-18 07:59:46,841 - INFO - Pod ctest-pod-67587605 is in running state.Got IP 10.47.255.251 2025-06-18 07:59:46,860 - DEBUG - Pod ctest-pod-67587605 has vmi 2e52938e-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:46,861 - INFO - Verified pod ctest-pod-67587605 in contrail-api 2025-06-18 07:59:46,876 - DEBUG - VMI 2e52938e-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:46,876 - INFO - Verified Pod ctest-pod-67587605 in agent 10.0.0.22 2025-06-18 07:59:46,876 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=ca1a06d1-b0fa-48c1-bb70-7b98f6b28eab 2025-06-18 07:59:46,882 - INFO - Pod ctest-pod-67587605 with uuid ca1a06d1-b0fa-48c1-bb70-7b98f6b28eab found in kube manager 2025-06-18 07:59:46,882 - INFO - Pod ctest-pod-67587605 verification passed 2025-06-18 07:59:46,888 - DEBUG - Pod ctest-pod-88727383 not in running state.Currently in Pending 2025-06-18 07:59:51,897 - INFO - Pod ctest-pod-88727383 is in running state.Got IP 10.47.255.250 2025-06-18 07:59:51,966 - DEBUG - Pod ctest-pod-88727383 has vmi 2ee50c82-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:51,967 - INFO - Verified pod ctest-pod-88727383 in contrail-api 2025-06-18 07:59:51,984 - DEBUG - VMI 2ee50c82-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:51,984 - INFO - Verified Pod ctest-pod-88727383 in agent 10.0.0.22 2025-06-18 07:59:51,984 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=0f3a82be-2529-4018-8f29-bbc84fc2618d 2025-06-18 07:59:51,990 - INFO - Pod ctest-pod-88727383 with uuid 0f3a82be-2529-4018-8f29-bbc84fc2618d found in kube manager 2025-06-18 07:59:51,991 - INFO - Pod ctest-pod-88727383 verification passed 2025-06-18 07:59:51,997 - INFO - Pod ctest-pod-95034618 is in running state.Got IP 10.47.255.249 2025-06-18 07:59:52,016 - DEBUG - Pod ctest-pod-95034618 has vmi 2f999788-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:52,016 - INFO - Verified pod ctest-pod-95034618 in contrail-api 2025-06-18 07:59:52,031 - DEBUG - VMI 2f999788-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:52,031 - INFO - Verified Pod ctest-pod-95034618 in agent 10.0.0.22 2025-06-18 07:59:52,031 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=b520aaed-370a-4bca-ac60-26463a93cc9a 2025-06-18 07:59:52,037 - INFO - Pod ctest-pod-95034618 with uuid b520aaed-370a-4bca-ac60-26463a93cc9a found in kube manager 2025-06-18 07:59:52,037 - INFO - Pod ctest-pod-95034618 verification passed 2025-06-18 07:59:52,045 - DEBUG - Pod ctest-pod-28766638 not in running state.Currently in Pending 2025-06-18 07:59:57,052 - INFO - Pod ctest-pod-28766638 is in running state.Got IP 10.47.255.248 2025-06-18 07:59:57,126 - DEBUG - Pod ctest-pod-28766638 has vmi 302e39f6-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:57,126 - INFO - Verified pod ctest-pod-28766638 in contrail-api 2025-06-18 07:59:57,145 - DEBUG - VMI 302e39f6-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:57,146 - INFO - Verified Pod ctest-pod-28766638 in agent 10.0.0.22 2025-06-18 07:59:57,146 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=ae0859cf-d1f3-419f-9481-38571529ee4a 2025-06-18 07:59:57,151 - INFO - Pod ctest-pod-28766638 with uuid ae0859cf-d1f3-419f-9481-38571529ee4a found in kube manager 2025-06-18 07:59:57,152 - INFO - Pod ctest-pod-28766638 verification passed 2025-06-18 07:59:57,158 - INFO - Pod ctest-pod-35064871 is in running state.Got IP 10.47.255.247 2025-06-18 07:59:57,178 - DEBUG - Pod ctest-pod-35064871 has vmi 30cf9af8-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:57,178 - INFO - Verified pod ctest-pod-35064871 in contrail-api 2025-06-18 07:59:57,193 - DEBUG - VMI 30cf9af8-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:57,194 - INFO - Verified Pod ctest-pod-35064871 in agent 10.0.0.22 2025-06-18 07:59:57,194 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=fd1e406d-4137-4a92-a1d2-7ab971121b81 2025-06-18 07:59:57,201 - INFO - Pod ctest-pod-35064871 with uuid fd1e406d-4137-4a92-a1d2-7ab971121b81 found in kube manager 2025-06-18 07:59:57,201 - INFO - Pod ctest-pod-35064871 verification passed 2025-06-18 07:59:57,209 - INFO - Pod ctest-pod-25483281 is in running state.Got IP 10.47.255.245 2025-06-18 07:59:57,267 - DEBUG - Pod ctest-pod-25483281 has vmi 31e74fc6-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:57,268 - INFO - Verified pod ctest-pod-25483281 in contrail-api 2025-06-18 07:59:57,284 - DEBUG - VMI 31e74fc6-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:57,284 - INFO - Verified Pod ctest-pod-25483281 in agent 10.0.0.22 2025-06-18 07:59:57,284 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=ab16b01e-c93b-4edc-9562-198f5ee247f0 2025-06-18 07:59:57,289 - INFO - Pod ctest-pod-25483281 with uuid ab16b01e-c93b-4edc-9562-198f5ee247f0 found in kube manager 2025-06-18 07:59:57,289 - INFO - Pod ctest-pod-25483281 verification passed 2025-06-18 07:59:57,374 - INFO - Pod ctest-pod-66743693 is in running state.Got IP 10.47.255.246 2025-06-18 07:59:57,392 - DEBUG - Pod ctest-pod-66743693 has vmi 3160c80c-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:57,392 - INFO - Verified pod ctest-pod-66743693 in contrail-api 2025-06-18 07:59:57,408 - DEBUG - VMI 3160c80c-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:57,408 - INFO - Verified Pod ctest-pod-66743693 in agent 10.0.0.22 2025-06-18 07:59:57,408 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=5a9cee2f-b787-483a-96a8-c5ac9a9298a6 2025-06-18 07:59:57,414 - INFO - Pod ctest-pod-66743693 with uuid 5a9cee2f-b787-483a-96a8-c5ac9a9298a6 found in kube manager 2025-06-18 07:59:57,414 - INFO - Pod ctest-pod-66743693 verification passed 2025-06-18 07:59:57,420 - INFO - Pod ctest-pod-19358866 is in running state.Got IP 10.47.255.244 2025-06-18 07:59:57,481 - DEBUG - Pod ctest-pod-19358866 has vmi 326782e0-4c1a-11f0-9ed3-fa163e46fc63 2025-06-18 07:59:57,481 - INFO - Verified pod ctest-pod-19358866 in contrail-api 2025-06-18 07:59:57,499 - DEBUG - VMI 326782e0-4c1a-11f0-9ed3-fa163e46fc63 is active in agent 10.0.0.22 2025-06-18 07:59:57,499 - INFO - Verified Pod ctest-pod-19358866 in agent 10.0.0.22 2025-06-18 07:59:57,499 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=8ff26648-c1fe-48bc-8d0b-6f5a1e0ddb7a 2025-06-18 07:59:57,505 - INFO - Pod ctest-pod-19358866 with uuid 8ff26648-c1fe-48bc-8d0b-6f5a1e0ddb7a found in kube manager 2025-06-18 07:59:57,505 - INFO - Pod ctest-pod-19358866 verification passed 2025-06-18 07:59:57,506 - INFO - ================================================================================ 2025-06-18 07:59:57,506 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-18 07:59:57,506 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-18 07:59:57,772 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.129': '0'}} with 2025-06-18 07:59:57,772 - INFO - Initial checks done. Running the testcase now 2025-06-18 07:59:57,772 - INFO - 2025-06-18 07:59:57,838 - DEBUG - [Pod ctest-pod-67587605] Cmd: echo ctest-pod-67587605 > /usr/share/nginx/html/index.html, Output: 2025-06-18 07:59:57,893 - DEBUG - [Pod ctest-pod-88727383] Cmd: echo ctest-pod-88727383 > /usr/share/nginx/html/index.html, Output: 2025-06-18 07:59:57,954 - DEBUG - [Pod ctest-pod-95034618] Cmd: echo ctest-pod-95034618 > /usr/share/nginx/html/index.html, Output: 2025-06-18 07:59:58,016 - DEBUG - [Pod ctest-pod-28766638] Cmd: echo ctest-pod-28766638 > /usr/share/nginx/html/index.html, Output: 2025-06-18 07:59:58,020 - DEBUG - Service ctest-nginx-svc-88068789 not present 2025-06-18 07:59:58,021 - INFO - Creating service ctest-nginx-svc-88068789 2025-06-18 07:59:58,037 - INFO - Created Service ctest-nginx-svc-88068789 2025-06-18 07:59:58,048 - WARNING - Service UUID 483d930b-187c-4534-82e8-8cdfbfcc48f4 not yet found in contrail-api 2025-06-18 07:59:59,056 - INFO - Validated that Service ctest-nginx-svc-88068789 is seen in contrail-api 2025-06-18 07:59:59,057 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_LoadbalancerDatabaseList?x=483d930b-187c-4534-82e8-8cdfbfcc48f4 2025-06-18 07:59:59,062 - INFO - Service ctest-nginx-svc-88068789 with uuid 483d930b-187c-4534-82e8-8cdfbfcc48f4 found in kube manager 2025-06-18 07:59:59,062 - INFO - Service ctest-nginx-svc-88068789 verification passed 2025-06-18 08:00:00,122 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) ctest-pod-88727383 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,123 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,123 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) ctest-pod-88727383 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,182 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,182 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,182 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,259 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,259 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,259 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,259 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67587605': 1, 'ctest-pod-88727383': 2} 2025-06-18 08:00:00,327 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,327 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,327 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,384 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,385 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,385 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,441 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,442 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,442 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:00,505 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67587605 2025-06-18 08:00:00,505 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:00,505 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67587605 2025-06-18 08:00:00,505 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67587605': 1, 'ctest-pod-88727383': 3} 2025-06-18 08:00:00,509 - DEBUG - Network policy ingress-on-service not present 2025-06-18 08:00:00,510 - INFO - Creating Network Policy ingress-on-service 2025-06-18 08:00:00,526 - INFO - Network policy found in k8s 2025-06-18 08:00:00,526 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=58854ef4-fddb-4998-aa52-08ebb5835e85 2025-06-18 08:00:00,534 - INFO - Network Policy ingress-on-service with uuid 58854ef4-fddb-4998-aa52-08ebb5835e85 found in kube manager 2025-06-18 08:00:00,572 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-18 08:00:00,572 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-18 08:00:00,572 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=58854ef4-fddb-4998-aa52-08ebb5835e85 2025-06-18 08:00:00,615 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-18 08:00:02,616 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=58854ef4-fddb-4998-aa52-08ebb5835e85 2025-06-18 08:00:02,655 - INFO - Network policy with name ingress-on-service found in agent 2025-06-18 08:00:02,656 - INFO - Network Policy ingress-on-service verification passed 2025-06-18 08:00:07,718 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:07,718 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:07,719 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:12,775 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:12,775 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:12,775 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:17,838 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:17,838 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:17,838 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:22,919 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:22,919 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:22,919 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:27,989 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:27,989 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:27,989 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:33,046 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:33,046 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:33,046 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:38,110 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:38,110 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:38,110 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:43,170 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:43,170 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:43,170 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:48,234 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:48,234 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:48,234 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:53,292 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:53,292 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:53,292 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:53,292 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67587605': 0, 'ctest-pod-88727383': 0} 2025-06-18 08:00:53,355 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:53,355 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:53,355 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:53,411 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:53,412 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:53,412 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:53,472 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:53,472 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:00:53,472 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:00:53,472 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67587605': 1, 'ctest-pod-88727383': 2} 2025-06-18 08:00:58,530 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:58,530 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:00:58,530 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:03,589 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:03,590 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:03,590 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:08,654 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:08,654 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:08,654 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:13,710 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:13,710 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:13,710 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:18,762 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:18,762 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:18,762 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:23,819 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:23,819 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:23,819 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:28,881 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:28,881 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:28,881 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:33,941 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:33,941 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:33,941 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:38,998 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:38,999 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:38,999 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:44,062 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:44,062 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:44,062 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:01:44,062 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67587605': 0, 'ctest-pod-88727383': 0} 2025-06-18 08:01:46,123 - DEBUG - [Pod ctest-pod-66743693] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.726 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.101 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.100 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.100/0.309/0.726 ms 2025-06-18 08:01:46,123 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-66743693 with expectation True passed 2025-06-18 08:01:48,177 - DEBUG - [Pod ctest-pod-35064871] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.216 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.121 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.474/1.216 ms 2025-06-18 08:01:48,177 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35064871 with expectation True passed 2025-06-18 08:01:50,249 - DEBUG - [Pod ctest-pod-25483281] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.881 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.127 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.365/0.881 ms 2025-06-18 08:01:50,250 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-25483281 with expectation True passed 2025-06-18 08:01:50,309 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:01:50,309 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-18 08:01:50,309 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:01:50,309 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66743693 passed 2025-06-18 08:01:50,363 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:01:50,363 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-18 08:01:50,363 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:01:50,363 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66743693 passed 2025-06-18 08:01:55,430 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-18 08:01:55,430 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-18 08:01:55,430 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-18 08:01:55,430 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35064871 passed 2025-06-18 08:02:00,517 - DEBUG - [Pod ctest-pod-19358866] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-18 08:02:00,517 - DEBUG - [Pod Pod ctest-pod-19358866] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-18 08:02:00,517 - DEBUG - [Pod Pod ctest-pod-19358866] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-18 08:02:00,518 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19358866 passed 2025-06-18 08:02:00,529 - INFO - Updating Network Policy ingress-on-service 2025-06-18 08:02:05,617 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:05,617 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:05,617 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:10,688 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:10,688 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:10,688 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:15,743 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:15,744 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:15,744 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:20,794 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:20,794 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:20,794 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:25,848 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:25,848 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:25,848 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:30,906 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:30,907 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:30,907 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:35,965 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:35,965 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:35,965 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:41,026 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:41,027 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:41,027 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:46,077 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:46,077 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:46,077 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:51,132 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:51,132 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:51,132 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.96.103.108:80 (10.96.103.108:80) wget: download timed out 2025-06-18 08:02:51,132 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67587605': 0, 'ctest-pod-88727383': 0} 2025-06-18 08:02:51,192 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,192 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:02:51,192 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,248 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,249 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:02:51,249 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,302 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,303 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:02:51,303 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,303 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67587605': 1, 'ctest-pod-88727383': 2} 2025-06-18 08:02:51,355 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,356 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:02:51,356 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: ctest-pod-67587605 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,421 - DEBUG - [Pod ctest-pod-25483281] Cmd: wget http://10.96.103.108:80/ -O - -T 5 -t 1 , Output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,421 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd wget http://10.96.103.108:80/ -O - -T 5 -t 1 passed 2025-06-18 08:02:51,421 - DEBUG - [Pod Pod ctest-pod-25483281] Cmd output: ctest-pod-88727383 Connecting to 10.96.103.108:80 (10.96.103.108:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-18 08:02:51,421 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67587605': 1, 'ctest-pod-88727383': 1} 2025-06-18 08:02:53,486 - DEBUG - [Pod ctest-pod-66743693] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.558 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.113 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.099/0.590/1.558 ms 2025-06-18 08:02:53,486 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-66743693 with expectation True passed 2025-06-18 08:02:55,539 - DEBUG - [Pod ctest-pod-35064871] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.342 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.101 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.178/0.342 ms 2025-06-18 08:02:55,539 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35064871 with expectation True passed 2025-06-18 08:02:57,593 - DEBUG - [Pod ctest-pod-25483281] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.468 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.225/0.468 ms 2025-06-18 08:02:57,593 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-25483281 with expectation True passed 2025-06-18 08:02:57,649 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:02:57,649 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-18 08:02:57,649 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:02:57,649 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66743693 passed 2025-06-18 08:02:57,708 - DEBUG - [Pod ctest-pod-66743693] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:02:57,709 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-18 08:02:57,709 - DEBUG - [Pod Pod ctest-pod-66743693] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:02:57,709 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66743693 passed 2025-06-18 08:03:02,775 - DEBUG - [Pod ctest-pod-35064871] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-18 08:03:02,776 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-18 08:03:02,776 - DEBUG - [Pod Pod ctest-pod-35064871] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-18 08:03:02,776 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35064871 passed 2025-06-18 08:03:02,844 - DEBUG - [Pod ctest-pod-19358866] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:03:02,844 - DEBUG - [Pod Pod ctest-pod-19358866] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-18 08:03:02,844 - DEBUG - [Pod Pod ctest-pod-19358866] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-18 08:03:02,844 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19358866 passed 2025-06-18 08:03:02,844 - INFO - Deleting Network Policy : ingress-on-service 2025-06-18 08:03:02,845 - INFO - Deleting service : ctest-nginx-svc-88068789 2025-06-18 08:03:03,111 - DEBUG - No XMPP flaps were noticed during the test