2025-02-04 17:38:39,917 - INFO - Using existing project ['default-domain', 'k8s-default'](df123110-4a38-4631-9f9e-a59dd617cf5c) 2025-02-04 17:38:39,934 - DEBUG - Namespace ctest-new-default-42110817 not present 2025-02-04 17:38:39,952 - INFO - Created namespace ctest-new-default-42110817 2025-02-04 17:38:42,957 - DEBUG - Namespace ctest-non-default-38858779 not present 2025-02-04 17:38:42,970 - INFO - Created namespace ctest-non-default-38858779 2025-02-04 17:38:46,015 - DEBUG - Pod ctest-pod-67168800 not present 2025-02-04 17:38:46,015 - INFO - Creating Pod ctest-pod-67168800 2025-02-04 17:38:46,053 - DEBUG - Pod : ctest-pod-67168800 UUID is 0d724717-2740-4613-a8a5-dcaf047b1ee7 2025-02-04 17:38:46,056 - DEBUG - Pod ctest-pod-30689171 not present 2025-02-04 17:38:46,056 - INFO - Creating Pod ctest-pod-30689171 2025-02-04 17:38:46,098 - DEBUG - Pod : ctest-pod-30689171 UUID is 9fb599b9-8061-454f-9562-cd830015f11d 2025-02-04 17:38:46,102 - DEBUG - Pod ctest-pod-02047791 not present 2025-02-04 17:38:46,102 - INFO - Creating Pod ctest-pod-02047791 2025-02-04 17:38:46,188 - DEBUG - Pod : ctest-pod-02047791 UUID is 5b0945e8-661a-47db-9b1c-88b4bd2b7551 2025-02-04 17:38:46,195 - DEBUG - Pod ctest-pod-86545729 not present 2025-02-04 17:38:46,195 - INFO - Creating Pod ctest-pod-86545729 2025-02-04 17:38:46,243 - DEBUG - Pod : ctest-pod-86545729 UUID is 4d7ece46-ea03-48a4-b7c8-393f5a1f9701 2025-02-04 17:38:46,246 - DEBUG - Pod ctest-pod-76434455 not present 2025-02-04 17:38:46,246 - INFO - Creating Pod ctest-pod-76434455 2025-02-04 17:38:46,267 - DEBUG - Pod : ctest-pod-76434455 UUID is 2de4b073-c9dc-4ad3-955e-c292bc791fef 2025-02-04 17:38:46,270 - DEBUG - Pod ctest-pod-76795560 not present 2025-02-04 17:38:46,270 - INFO - Creating Pod ctest-pod-76795560 2025-02-04 17:38:46,297 - DEBUG - Pod : ctest-pod-76795560 UUID is ad4b8c8a-e4f7-4151-a49c-87f09ad1a0ef 2025-02-04 17:38:46,300 - DEBUG - Pod ctest-pod-30481662 not present 2025-02-04 17:38:46,300 - INFO - Creating Pod ctest-pod-30481662 2025-02-04 17:38:46,353 - DEBUG - Pod : ctest-pod-30481662 UUID is 23a1a3cc-a1e9-4241-b215-8468e4e03c22 2025-02-04 17:38:46,356 - DEBUG - Pod ctest-pod-63070171 not present 2025-02-04 17:38:46,357 - INFO - Creating Pod ctest-pod-63070171 2025-02-04 17:38:46,377 - DEBUG - Pod : ctest-pod-63070171 UUID is ba280934-f476-4ecf-a2ec-95b9a53115bd 2025-02-04 17:38:46,629 - INFO - Project default-domain:k8s-ctest-new-default-42110817 for Namespace ctest-new-default-42110817 is seen in contrail-api 2025-02-04 17:38:46,629 - DEBUG - Project uuid in Contrail is ede66a91-5f49-48b3-a180-a071c3c8ab05 2025-02-04 17:38:46,773 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=d27f8da0-7e0c-416a-a40a-f5f09a09009f 2025-02-04 17:38:46,785 - INFO - Namespace ctest-new-default-42110817 with uuid d27f8da0-7e0c-416a-a40a-f5f09a09009f found in kube manager 2025-02-04 17:38:46,785 - INFO - Namespace ctest-new-default-42110817 verification passed 2025-02-04 17:38:46,964 - INFO - Project default-domain:k8s-ctest-non-default-38858779 for Namespace ctest-non-default-38858779 is seen in contrail-api 2025-02-04 17:38:46,965 - DEBUG - Project uuid in Contrail is 425f6a3d-f963-41f9-94d4-be3ec7caae8a 2025-02-04 17:38:46,965 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=8ecc5c2f-b53d-435c-90a9-cd4d3aa19a0e 2025-02-04 17:38:46,970 - INFO - Namespace ctest-non-default-38858779 with uuid 8ecc5c2f-b53d-435c-90a9-cd4d3aa19a0e found in kube manager 2025-02-04 17:38:46,971 - INFO - Namespace ctest-non-default-38858779 verification passed 2025-02-04 17:38:46,976 - DEBUG - Pod ctest-pod-67168800 not in running state.Currently in Pending 2025-02-04 17:38:51,995 - DEBUG - Pod ctest-pod-67168800 not in running state.Currently in Pending 2025-02-04 17:38:57,002 - INFO - Pod ctest-pod-67168800 is in running state.Got IP 10.47.255.251 2025-02-04 17:38:57,056 - DEBUG - Pod ctest-pod-67168800 has vmi e3a5c9be-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:38:57,056 - INFO - Verified pod ctest-pod-67168800 in contrail-api 2025-02-04 17:38:57,069 - DEBUG - VMI e3a5c9be-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:38:57,069 - INFO - Verified Pod ctest-pod-67168800 in agent 10.0.0.27 2025-02-04 17:38:57,069 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0d724717-2740-4613-a8a5-dcaf047b1ee7 2025-02-04 17:38:57,073 - INFO - Pod ctest-pod-67168800 with uuid 0d724717-2740-4613-a8a5-dcaf047b1ee7 found in kube manager 2025-02-04 17:38:57,073 - INFO - Pod ctest-pod-67168800 verification passed 2025-02-04 17:38:57,079 - INFO - Pod ctest-pod-30689171 is in running state.Got IP 10.47.255.250 2025-02-04 17:38:57,093 - DEBUG - Pod ctest-pod-30689171 has vmi e42227c0-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:38:57,093 - INFO - Verified pod ctest-pod-30689171 in contrail-api 2025-02-04 17:38:57,106 - DEBUG - VMI e42227c0-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:38:57,106 - INFO - Verified Pod ctest-pod-30689171 in agent 10.0.0.27 2025-02-04 17:38:57,107 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9fb599b9-8061-454f-9562-cd830015f11d 2025-02-04 17:38:57,111 - INFO - Pod ctest-pod-30689171 with uuid 9fb599b9-8061-454f-9562-cd830015f11d found in kube manager 2025-02-04 17:38:57,111 - INFO - Pod ctest-pod-30689171 verification passed 2025-02-04 17:38:57,117 - DEBUG - Pod ctest-pod-02047791 not in running state.Currently in Pending 2025-02-04 17:39:02,124 - INFO - Pod ctest-pod-02047791 is in running state.Got IP 10.47.255.249 2025-02-04 17:39:02,180 - DEBUG - Pod ctest-pod-02047791 has vmi e4e67f44-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:39:02,180 - INFO - Verified pod ctest-pod-02047791 in contrail-api 2025-02-04 17:39:02,198 - DEBUG - VMI e4e67f44-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:39:02,198 - INFO - Verified Pod ctest-pod-02047791 in agent 10.0.0.27 2025-02-04 17:39:02,198 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=5b0945e8-661a-47db-9b1c-88b4bd2b7551 2025-02-04 17:39:02,203 - INFO - Pod ctest-pod-02047791 with uuid 5b0945e8-661a-47db-9b1c-88b4bd2b7551 found in kube manager 2025-02-04 17:39:02,203 - INFO - Pod ctest-pod-02047791 verification passed 2025-02-04 17:39:02,208 - INFO - Pod ctest-pod-86545729 is in running state.Got IP 10.47.255.248 2025-02-04 17:39:02,224 - DEBUG - Pod ctest-pod-86545729 has vmi e5700d4a-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:39:02,224 - INFO - Verified pod ctest-pod-86545729 in contrail-api 2025-02-04 17:39:02,242 - DEBUG - VMI e5700d4a-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:39:02,242 - INFO - Verified Pod ctest-pod-86545729 in agent 10.0.0.27 2025-02-04 17:39:02,242 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=4d7ece46-ea03-48a4-b7c8-393f5a1f9701 2025-02-04 17:39:02,247 - INFO - Pod ctest-pod-86545729 with uuid 4d7ece46-ea03-48a4-b7c8-393f5a1f9701 found in kube manager 2025-02-04 17:39:02,247 - INFO - Pod ctest-pod-86545729 verification passed 2025-02-04 17:39:02,252 - INFO - Pod ctest-pod-76434455 is in running state.Got IP 10.47.255.247 2025-02-04 17:39:02,307 - DEBUG - Pod ctest-pod-76434455 has vmi e5fcf9f8-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:39:02,308 - INFO - Verified pod ctest-pod-76434455 in contrail-api 2025-02-04 17:39:02,323 - DEBUG - VMI e5fcf9f8-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:39:02,324 - INFO - Verified Pod ctest-pod-76434455 in agent 10.0.0.27 2025-02-04 17:39:02,324 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2de4b073-c9dc-4ad3-955e-c292bc791fef 2025-02-04 17:39:02,329 - INFO - Pod ctest-pod-76434455 with uuid 2de4b073-c9dc-4ad3-955e-c292bc791fef found in kube manager 2025-02-04 17:39:02,329 - INFO - Pod ctest-pod-76434455 verification passed 2025-02-04 17:39:02,397 - DEBUG - Pod ctest-pod-30481662 not in running state.Currently in Pending 2025-02-04 17:39:07,403 - INFO - Pod ctest-pod-30481662 is in running state.Got IP 10.47.255.245 2025-02-04 17:39:07,418 - DEBUG - Pod ctest-pod-30481662 has vmi e711eb8c-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:39:07,418 - INFO - Verified pod ctest-pod-30481662 in contrail-api 2025-02-04 17:39:07,434 - DEBUG - VMI e711eb8c-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:39:07,434 - INFO - Verified Pod ctest-pod-30481662 in agent 10.0.0.27 2025-02-04 17:39:07,435 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=23a1a3cc-a1e9-4241-b215-8468e4e03c22 2025-02-04 17:39:07,439 - INFO - Pod ctest-pod-30481662 with uuid 23a1a3cc-a1e9-4241-b215-8468e4e03c22 found in kube manager 2025-02-04 17:39:07,439 - INFO - Pod ctest-pod-30481662 verification passed 2025-02-04 17:39:07,444 - INFO - Pod ctest-pod-76795560 is in running state.Got IP 10.47.255.246 2025-02-04 17:39:07,500 - DEBUG - Pod ctest-pod-76795560 has vmi e67fa2ae-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:39:07,500 - INFO - Verified pod ctest-pod-76795560 in contrail-api 2025-02-04 17:39:07,514 - DEBUG - VMI e67fa2ae-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:39:07,514 - INFO - Verified Pod ctest-pod-76795560 in agent 10.0.0.27 2025-02-04 17:39:07,514 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ad4b8c8a-e4f7-4151-a49c-87f09ad1a0ef 2025-02-04 17:39:07,518 - INFO - Pod ctest-pod-76795560 with uuid ad4b8c8a-e4f7-4151-a49c-87f09ad1a0ef found in kube manager 2025-02-04 17:39:07,519 - INFO - Pod ctest-pod-76795560 verification passed 2025-02-04 17:39:07,524 - INFO - Pod ctest-pod-63070171 is in running state.Got IP 10.47.255.244 2025-02-04 17:39:07,580 - DEBUG - Pod ctest-pod-63070171 has vmi e7a59544-e31e-11ef-984b-fa163e2914eb 2025-02-04 17:39:07,580 - INFO - Verified pod ctest-pod-63070171 in contrail-api 2025-02-04 17:39:07,594 - DEBUG - VMI e7a59544-e31e-11ef-984b-fa163e2914eb is active in agent 10.0.0.27 2025-02-04 17:39:07,594 - INFO - Verified Pod ctest-pod-63070171 in agent 10.0.0.27 2025-02-04 17:39:07,594 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ba280934-f476-4ecf-a2ec-95b9a53115bd 2025-02-04 17:39:07,599 - INFO - Pod ctest-pod-63070171 with uuid ba280934-f476-4ecf-a2ec-95b9a53115bd found in kube manager 2025-02-04 17:39:07,599 - INFO - Pod ctest-pod-63070171 verification passed 2025-02-04 17:39:07,599 - INFO - ================================================================================ 2025-02-04 17:39:07,599 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-02-04 17:39:07,599 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-02-04 17:39:07,798 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.22': '0'}} with 2025-02-04 17:39:07,798 - INFO - Initial checks done. Running the testcase now 2025-02-04 17:39:07,798 - INFO - 2025-02-04 17:39:07,857 - DEBUG - [Pod ctest-pod-67168800] Cmd: echo ctest-pod-67168800 > /usr/share/nginx/html/index.html, Output: 2025-02-04 17:39:07,924 - DEBUG - [Pod ctest-pod-30689171] Cmd: echo ctest-pod-30689171 > /usr/share/nginx/html/index.html, Output: 2025-02-04 17:39:07,999 - DEBUG - [Pod ctest-pod-02047791] Cmd: echo ctest-pod-02047791 > /usr/share/nginx/html/index.html, Output: 2025-02-04 17:39:08,064 - DEBUG - [Pod ctest-pod-86545729] Cmd: echo ctest-pod-86545729 > /usr/share/nginx/html/index.html, Output: 2025-02-04 17:39:08,068 - DEBUG - Service ctest-nginx-svc-44114586 not present 2025-02-04 17:39:08,068 - INFO - Creating service ctest-nginx-svc-44114586 2025-02-04 17:39:08,084 - INFO - Created Service ctest-nginx-svc-44114586 2025-02-04 17:39:08,092 - WARNING - Service UUID 1f3361ab-70ce-4069-8a81-4058ed9229e8 not yet found in contrail-api 2025-02-04 17:39:09,114 - INFO - Validated that Service ctest-nginx-svc-44114586 is seen in contrail-api 2025-02-04 17:39:09,115 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=1f3361ab-70ce-4069-8a81-4058ed9229e8 2025-02-04 17:39:09,125 - INFO - Service ctest-nginx-svc-44114586 with uuid 1f3361ab-70ce-4069-8a81-4058ed9229e8 found in kube manager 2025-02-04 17:39:09,125 - INFO - Service ctest-nginx-svc-44114586 verification passed 2025-02-04 17:39:10,203 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) ctest-pod-67168800 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,203 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:39:10,203 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) ctest-pod-67168800 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,277 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67168800 2025-02-04 17:39:10,277 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:39:10,277 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67168800 2025-02-04 17:39:10,341 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,342 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:39:10,342 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,342 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67168800': 2, 'ctest-pod-30689171': 1} 2025-02-04 17:39:10,414 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,414 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:39:10,415 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,481 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) ctest-pod-30689171 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,482 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:39:10,482 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) ctest-pod-30689171 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,533 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-67168800 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,533 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:39:10,533 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: ctest-pod-67168800 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:39:10,533 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67168800': 1, 'ctest-pod-30689171': 2} 2025-02-04 17:39:10,536 - DEBUG - Network policy ingress-on-service not present 2025-02-04 17:39:10,536 - INFO - Creating Network Policy ingress-on-service 2025-02-04 17:39:10,548 - INFO - Network policy found in k8s 2025-02-04 17:39:10,548 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ae59fae6-0dee-47f9-9edd-f230a6244d91 2025-02-04 17:39:10,555 - INFO - Network Policy ingress-on-service with uuid ae59fae6-0dee-47f9-9edd-f230a6244d91 found in kube manager 2025-02-04 17:39:10,592 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-02-04 17:39:10,593 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-02-04 17:39:10,593 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ae59fae6-0dee-47f9-9edd-f230a6244d91 2025-02-04 17:39:10,625 - WARNING - Network policy with name ingress-on-service not found in agent 2025-02-04 17:39:12,625 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ae59fae6-0dee-47f9-9edd-f230a6244d91 2025-02-04 17:39:12,657 - INFO - Network policy with name ingress-on-service found in agent 2025-02-04 17:39:12,657 - INFO - Network Policy ingress-on-service verification passed 2025-02-04 17:39:17,708 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:17,708 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:17,708 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:22,764 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:22,764 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:22,764 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:27,818 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:27,818 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:27,818 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:32,871 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:32,871 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:32,871 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:37,931 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:37,931 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:37,931 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:42,999 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:42,999 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:42,999 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:48,069 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:48,069 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:48,069 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:53,144 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:53,144 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:53,144 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:58,212 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:58,212 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:39:58,212 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:03,281 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:03,281 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:03,282 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:03,282 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67168800': 0, 'ctest-pod-30689171': 0} 2025-02-04 17:40:03,341 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:40:03,342 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:40:03,342 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:40:03,405 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-67168800 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:40:03,405 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:40:03,405 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: ctest-pod-67168800 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:40:03,405 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67168800': 1, 'ctest-pod-30689171': 1} 2025-02-04 17:40:08,455 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:08,456 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:08,456 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:13,504 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:13,505 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:13,505 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:18,567 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:18,567 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:18,567 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:23,628 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:23,629 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:23,629 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:28,700 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:28,701 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:28,701 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:33,766 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:33,766 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:33,767 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:38,831 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:38,832 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:38,832 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:43,886 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:43,887 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:43,887 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:48,951 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:48,951 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:48,951 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:54,025 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:54,025 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:54,025 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:40:54,026 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67168800': 0, 'ctest-pod-30689171': 0} 2025-02-04 17:40:56,093 - DEBUG - [Pod ctest-pod-76795560] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.037 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.400/1.037 ms 2025-02-04 17:40:56,093 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76795560 with expectation True passed 2025-02-04 17:40:58,158 - DEBUG - [Pod ctest-pod-76434455] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.783 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.311/0.783 ms 2025-02-04 17:40:58,158 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76434455 with expectation True passed 2025-02-04 17:41:00,228 - DEBUG - [Pod ctest-pod-30481662] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.080 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.414/1.080 ms 2025-02-04 17:41:00,228 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30481662 with expectation True passed 2025-02-04 17:41:00,290 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:41:00,290 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-04 17:41:00,290 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:41:00,290 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76795560 passed 2025-02-04 17:41:00,356 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:41:00,356 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-04 17:41:00,356 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:41:00,356 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76795560 passed 2025-02-04 17:41:05,420 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-04 17:41:05,420 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-04 17:41:05,420 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-04 17:41:05,421 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76434455 passed 2025-02-04 17:41:10,482 - DEBUG - [Pod ctest-pod-63070171] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-04 17:41:10,482 - DEBUG - [Pod Pod ctest-pod-63070171] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-04 17:41:10,482 - DEBUG - [Pod Pod ctest-pod-63070171] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-04 17:41:10,482 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63070171 passed 2025-02-04 17:41:10,491 - INFO - Updating Network Policy ingress-on-service 2025-02-04 17:41:15,563 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:15,563 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:15,563 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:20,628 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:20,628 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:20,628 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:25,698 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:25,698 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:25,698 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:30,739 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:30,739 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:30,739 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:35,796 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:35,796 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:35,796 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:40,872 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:40,872 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:40,872 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:45,936 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:45,936 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:45,936 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:50,996 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:50,996 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:50,996 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:56,067 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:56,067 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:41:56,067 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:42:01,132 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:42:01,132 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:42:01,132 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) wget: download timed out 2025-02-04 17:42:01,132 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67168800': 0, 'ctest-pod-30689171': 0} 2025-02-04 17:42:01,195 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:42:01,195 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:42:01,195 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:42:01,263 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67168800 2025-02-04 17:42:01,263 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:42:01,263 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67168800 2025-02-04 17:42:01,263 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67168800': 1, 'ctest-pod-30689171': 1} 2025-02-04 17:42:01,327 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:42:01,328 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:42:01,328 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: ctest-pod-30689171 Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-04 17:42:01,409 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-30689171 2025-02-04 17:42:01,409 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:42:01,409 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-30689171 2025-02-04 17:42:01,464 - DEBUG - [Pod ctest-pod-30481662] Cmd: wget http://10.111.152.203:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67168800 2025-02-04 17:42:01,464 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd wget http://10.111.152.203:80/ -O - -T 5 -t 1 passed 2025-02-04 17:42:01,465 - DEBUG - [Pod Pod ctest-pod-30481662] Cmd output: Connecting to 10.111.152.203:80 (10.111.152.203:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67168800 2025-02-04 17:42:01,465 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67168800': 1, 'ctest-pod-30689171': 2} 2025-02-04 17:42:03,513 - DEBUG - [Pod ctest-pod-76795560] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.169 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.442/1.169 ms 2025-02-04 17:42:03,513 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76795560 with expectation True passed 2025-02-04 17:42:05,580 - DEBUG - [Pod ctest-pod-76434455] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.696 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.289/0.696 ms 2025-02-04 17:42:05,580 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76434455 with expectation True passed 2025-02-04 17:42:07,647 - DEBUG - [Pod ctest-pod-30481662] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.520 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.227/0.520 ms 2025-02-04 17:42:07,647 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30481662 with expectation True passed 2025-02-04 17:42:07,710 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:42:07,710 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-04 17:42:07,710 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:42:07,710 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76795560 passed 2025-02-04 17:42:07,763 - DEBUG - [Pod ctest-pod-76795560] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:42:07,764 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-04 17:42:07,764 - DEBUG - [Pod Pod ctest-pod-76795560] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:42:07,764 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76795560 passed 2025-02-04 17:42:12,827 - DEBUG - [Pod ctest-pod-76434455] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-04 17:42:12,827 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-04 17:42:12,827 - DEBUG - [Pod Pod ctest-pod-76434455] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-04 17:42:12,827 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76434455 passed 2025-02-04 17:42:12,898 - DEBUG - [Pod ctest-pod-63070171] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:42:12,898 - DEBUG - [Pod Pod ctest-pod-63070171] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-04 17:42:12,898 - DEBUG - [Pod Pod ctest-pod-63070171] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-04 17:42:12,898 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63070171 passed 2025-02-04 17:42:12,898 - INFO - Deleting Network Policy : ingress-on-service 2025-02-04 17:42:12,899 - INFO - Deleting service : ctest-nginx-svc-44114586 2025-02-04 17:42:13,100 - DEBUG - No XMPP flaps were noticed during the test