2024-11-04 06:41:23,534 - INFO - Using existing project ['default-domain', 'k8s-default'](e94ef266-d145-4666-8a77-c4ef379f6cce) 2024-11-04 06:41:23,557 - DEBUG - Namespace ctest-new-default-95781369 not present 2024-11-04 06:41:23,564 - INFO - Created namespace ctest-new-default-95781369 2024-11-04 06:41:26,569 - DEBUG - Namespace ctest-non-default-58115746 not present 2024-11-04 06:41:26,578 - INFO - Created namespace ctest-non-default-58115746 2024-11-04 06:41:29,600 - DEBUG - Pod ctest-pod-47931204 not present 2024-11-04 06:41:29,600 - INFO - Creating Pod ctest-pod-47931204 2024-11-04 06:41:29,634 - DEBUG - Pod : ctest-pod-47931204 UUID is fae101c8-e46c-465c-8c1f-8a217464280e 2024-11-04 06:41:29,647 - DEBUG - Pod ctest-pod-40062168 not present 2024-11-04 06:41:29,648 - INFO - Creating Pod ctest-pod-40062168 2024-11-04 06:41:29,674 - DEBUG - Pod : ctest-pod-40062168 UUID is 0e34846f-c5ef-4b2a-a420-35adac9cb4c8 2024-11-04 06:41:29,676 - DEBUG - Pod ctest-pod-87437915 not present 2024-11-04 06:41:29,677 - INFO - Creating Pod ctest-pod-87437915 2024-11-04 06:41:29,709 - DEBUG - Pod : ctest-pod-87437915 UUID is 00db8505-fb0e-49e1-941a-f490ce24bf56 2024-11-04 06:41:29,712 - DEBUG - Pod ctest-pod-51307838 not present 2024-11-04 06:41:29,712 - INFO - Creating Pod ctest-pod-51307838 2024-11-04 06:41:29,748 - DEBUG - Pod : ctest-pod-51307838 UUID is 12aef489-2ebb-46ed-86a3-191278f1b696 2024-11-04 06:41:29,750 - DEBUG - Pod ctest-pod-81931917 not present 2024-11-04 06:41:29,750 - INFO - Creating Pod ctest-pod-81931917 2024-11-04 06:41:29,768 - DEBUG - Pod : ctest-pod-81931917 UUID is 055ee4e4-37d4-4588-9c29-5c9f704b55f8 2024-11-04 06:41:29,770 - DEBUG - Pod ctest-pod-25423100 not present 2024-11-04 06:41:29,770 - INFO - Creating Pod ctest-pod-25423100 2024-11-04 06:41:29,790 - DEBUG - Pod : ctest-pod-25423100 UUID is 2a62e95a-74df-4391-bfdd-9a915b5db64e 2024-11-04 06:41:29,792 - DEBUG - Pod ctest-pod-10794407 not present 2024-11-04 06:41:29,793 - INFO - Creating Pod ctest-pod-10794407 2024-11-04 06:41:29,808 - DEBUG - Pod : ctest-pod-10794407 UUID is 1b0fe9cd-cfb2-4e00-bf03-467118f1e810 2024-11-04 06:41:29,810 - DEBUG - Pod ctest-pod-21104748 not present 2024-11-04 06:41:29,810 - INFO - Creating Pod ctest-pod-21104748 2024-11-04 06:41:29,828 - DEBUG - Pod : ctest-pod-21104748 UUID is 5d945252-09b0-46f9-8830-c074907ed653 2024-11-04 06:41:30,012 - INFO - Project default-domain:k8s-ctest-new-default-95781369 for Namespace ctest-new-default-95781369 is seen in contrail-api 2024-11-04 06:41:30,013 - DEBUG - Project uuid in Contrail is a21cfbc7-3c46-4305-8c82-5dd1006c7141 2024-11-04 06:41:30,140 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=d2021d23-743f-46e3-815f-8c9352f1c459 2024-11-04 06:41:30,144 - INFO - Namespace ctest-new-default-95781369 with uuid d2021d23-743f-46e3-815f-8c9352f1c459 found in kube manager 2024-11-04 06:41:30,144 - INFO - Namespace ctest-new-default-95781369 verification passed 2024-11-04 06:41:30,350 - INFO - Project default-domain:k8s-ctest-non-default-58115746 for Namespace ctest-non-default-58115746 is seen in contrail-api 2024-11-04 06:41:30,350 - DEBUG - Project uuid in Contrail is 76d74232-22dc-4a6e-ad0a-993616af5127 2024-11-04 06:41:30,350 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=836bbd75-27a6-4045-9530-51e8c8419728 2024-11-04 06:41:30,356 - INFO - Namespace ctest-non-default-58115746 with uuid 836bbd75-27a6-4045-9530-51e8c8419728 found in kube manager 2024-11-04 06:41:30,356 - INFO - Namespace ctest-non-default-58115746 verification passed 2024-11-04 06:41:30,361 - DEBUG - Pod ctest-pod-47931204 not in running state.Currently in Pending 2024-11-04 06:41:35,368 - DEBUG - Pod ctest-pod-47931204 not in running state.Currently in Pending 2024-11-04 06:41:40,374 - DEBUG - Pod ctest-pod-47931204 not in running state.Currently in Pending 2024-11-04 06:41:45,381 - INFO - Pod ctest-pod-47931204 is in running state.Got IP 10.47.255.251 2024-11-04 06:41:45,402 - DEBUG - Pod ctest-pod-47931204 has vmi d3c73d06-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:45,402 - INFO - Verified pod ctest-pod-47931204 in contrail-api 2024-11-04 06:41:45,417 - DEBUG - VMI d3c73d06-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:45,418 - INFO - Verified Pod ctest-pod-47931204 in agent 10.0.0.43 2024-11-04 06:41:45,418 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=fae101c8-e46c-465c-8c1f-8a217464280e 2024-11-04 06:41:45,422 - INFO - Pod ctest-pod-47931204 with uuid fae101c8-e46c-465c-8c1f-8a217464280e found in kube manager 2024-11-04 06:41:45,422 - INFO - Pod ctest-pod-47931204 verification passed 2024-11-04 06:41:45,428 - INFO - Pod ctest-pod-40062168 is in running state.Got IP 10.47.255.250 2024-11-04 06:41:45,487 - DEBUG - Pod ctest-pod-40062168 has vmi d451361e-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:45,487 - INFO - Verified pod ctest-pod-40062168 in contrail-api 2024-11-04 06:41:45,500 - DEBUG - VMI d451361e-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:45,500 - INFO - Verified Pod ctest-pod-40062168 in agent 10.0.0.43 2024-11-04 06:41:45,501 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=0e34846f-c5ef-4b2a-a420-35adac9cb4c8 2024-11-04 06:41:45,505 - INFO - Pod ctest-pod-40062168 with uuid 0e34846f-c5ef-4b2a-a420-35adac9cb4c8 found in kube manager 2024-11-04 06:41:45,505 - INFO - Pod ctest-pod-40062168 verification passed 2024-11-04 06:41:45,512 - INFO - Pod ctest-pod-87437915 is in running state.Got IP 10.47.255.249 2024-11-04 06:41:45,529 - DEBUG - Pod ctest-pod-87437915 has vmi d50b36ea-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:45,529 - INFO - Verified pod ctest-pod-87437915 in contrail-api 2024-11-04 06:41:45,543 - DEBUG - VMI d50b36ea-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:45,544 - INFO - Verified Pod ctest-pod-87437915 in agent 10.0.0.43 2024-11-04 06:41:45,544 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=00db8505-fb0e-49e1-941a-f490ce24bf56 2024-11-04 06:41:45,548 - INFO - Pod ctest-pod-87437915 with uuid 00db8505-fb0e-49e1-941a-f490ce24bf56 found in kube manager 2024-11-04 06:41:45,548 - INFO - Pod ctest-pod-87437915 verification passed 2024-11-04 06:41:45,553 - INFO - Pod ctest-pod-51307838 is in running state.Got IP 10.47.255.248 2024-11-04 06:41:45,619 - DEBUG - Pod ctest-pod-51307838 has vmi d5a545aa-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:45,619 - INFO - Verified pod ctest-pod-51307838 in contrail-api 2024-11-04 06:41:45,636 - DEBUG - VMI d5a545aa-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:45,637 - INFO - Verified Pod ctest-pod-51307838 in agent 10.0.0.43 2024-11-04 06:41:45,637 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=12aef489-2ebb-46ed-86a3-191278f1b696 2024-11-04 06:41:45,642 - INFO - Pod ctest-pod-51307838 with uuid 12aef489-2ebb-46ed-86a3-191278f1b696 found in kube manager 2024-11-04 06:41:45,642 - INFO - Pod ctest-pod-51307838 verification passed 2024-11-04 06:41:45,647 - DEBUG - Pod ctest-pod-81931917 not in running state.Currently in Pending 2024-11-04 06:41:50,653 - INFO - Pod ctest-pod-81931917 is in running state.Got IP 10.47.255.247 2024-11-04 06:41:50,698 - DEBUG - Pod ctest-pod-81931917 has vmi d6401990-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:50,698 - INFO - Verified pod ctest-pod-81931917 in contrail-api 2024-11-04 06:41:50,733 - DEBUG - VMI d6401990-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:50,733 - INFO - Verified Pod ctest-pod-81931917 in agent 10.0.0.43 2024-11-04 06:41:50,739 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=055ee4e4-37d4-4588-9c29-5c9f704b55f8 2024-11-04 06:41:50,744 - INFO - Pod ctest-pod-81931917 with uuid 055ee4e4-37d4-4588-9c29-5c9f704b55f8 found in kube manager 2024-11-04 06:41:50,744 - INFO - Pod ctest-pod-81931917 verification passed 2024-11-04 06:41:50,754 - INFO - Pod ctest-pod-10794407 is in running state.Got IP 10.47.255.245 2024-11-04 06:41:50,831 - DEBUG - Pod ctest-pod-10794407 has vmi d73e4db2-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:50,831 - INFO - Verified pod ctest-pod-10794407 in contrail-api 2024-11-04 06:41:50,861 - DEBUG - VMI d73e4db2-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:50,862 - INFO - Verified Pod ctest-pod-10794407 in agent 10.0.0.43 2024-11-04 06:41:50,862 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=1b0fe9cd-cfb2-4e00-bf03-467118f1e810 2024-11-04 06:41:50,875 - INFO - Pod ctest-pod-10794407 with uuid 1b0fe9cd-cfb2-4e00-bf03-467118f1e810 found in kube manager 2024-11-04 06:41:50,875 - INFO - Pod ctest-pod-10794407 verification passed 2024-11-04 06:41:50,906 - INFO - Pod ctest-pod-25423100 is in running state.Got IP 10.47.255.246 2024-11-04 06:41:50,958 - DEBUG - Pod ctest-pod-25423100 has vmi d6b65fec-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:50,958 - INFO - Verified pod ctest-pod-25423100 in contrail-api 2024-11-04 06:41:50,973 - DEBUG - VMI d6b65fec-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:50,973 - INFO - Verified Pod ctest-pod-25423100 in agent 10.0.0.43 2024-11-04 06:41:50,973 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=2a62e95a-74df-4391-bfdd-9a915b5db64e 2024-11-04 06:41:50,985 - INFO - Pod ctest-pod-25423100 with uuid 2a62e95a-74df-4391-bfdd-9a915b5db64e found in kube manager 2024-11-04 06:41:50,985 - INFO - Pod ctest-pod-25423100 verification passed 2024-11-04 06:41:50,991 - INFO - Pod ctest-pod-21104748 is in running state.Got IP 10.47.255.244 2024-11-04 06:41:51,071 - DEBUG - Pod ctest-pod-21104748 has vmi d7c5b61c-9a77-11ef-a6a2-fa163eef28a2 2024-11-04 06:41:51,071 - INFO - Verified pod ctest-pod-21104748 in contrail-api 2024-11-04 06:41:51,094 - DEBUG - VMI d7c5b61c-9a77-11ef-a6a2-fa163eef28a2 is active in agent 10.0.0.43 2024-11-04 06:41:51,095 - INFO - Verified Pod ctest-pod-21104748 in agent 10.0.0.43 2024-11-04 06:41:51,095 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=5d945252-09b0-46f9-8830-c074907ed653 2024-11-04 06:41:51,109 - INFO - Pod ctest-pod-21104748 with uuid 5d945252-09b0-46f9-8830-c074907ed653 found in kube manager 2024-11-04 06:41:51,109 - INFO - Pod ctest-pod-21104748 verification passed 2024-11-04 06:41:51,109 - INFO - ================================================================================ 2024-11-04 06:41:51,109 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-04 06:41:51,109 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-04 06:41:51,372 - DEBUG - Nothing to compare xmpp stats {'10.0.0.43': {'10.0.0.24': '0'}} with 2024-11-04 06:41:51,372 - INFO - Initial checks done. Running the testcase now 2024-11-04 06:41:51,372 - INFO - 2024-11-04 06:41:51,433 - DEBUG - [Pod ctest-pod-47931204] Cmd: echo ctest-pod-47931204 > /usr/share/nginx/html/index.html, Output: 2024-11-04 06:41:51,507 - DEBUG - [Pod ctest-pod-40062168] Cmd: echo ctest-pod-40062168 > /usr/share/nginx/html/index.html, Output: 2024-11-04 06:41:51,603 - DEBUG - [Pod ctest-pod-87437915] Cmd: echo ctest-pod-87437915 > /usr/share/nginx/html/index.html, Output: 2024-11-04 06:41:51,691 - DEBUG - [Pod ctest-pod-51307838] Cmd: echo ctest-pod-51307838 > /usr/share/nginx/html/index.html, Output: 2024-11-04 06:41:51,694 - DEBUG - Service ctest-nginx-svc-65144591 not present 2024-11-04 06:41:51,694 - INFO - Creating service ctest-nginx-svc-65144591 2024-11-04 06:41:51,716 - INFO - Created Service ctest-nginx-svc-65144591 2024-11-04 06:41:51,725 - WARNING - Service UUID f2453483-9a07-4ca2-9c48-622d1ba780b1 not yet found in contrail-api 2024-11-04 06:41:52,740 - INFO - Validated that Service ctest-nginx-svc-65144591 is seen in contrail-api 2024-11-04 06:41:52,741 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=f2453483-9a07-4ca2-9c48-622d1ba780b1 2024-11-04 06:41:52,750 - INFO - Service ctest-nginx-svc-65144591 with uuid f2453483-9a07-4ca2-9c48-622d1ba780b1 found in kube manager 2024-11-04 06:41:52,751 - INFO - Service ctest-nginx-svc-65144591 verification passed 2024-11-04 06:41:53,840 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47931204 2024-11-04 06:41:53,840 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:41:53,840 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47931204 2024-11-04 06:41:53,917 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:41:53,918 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:41:53,918 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:41:53,982 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:41:53,982 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:41:53,982 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:41:53,982 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47931204': 2, 'ctest-pod-40062168': 1} 2024-11-04 06:41:54,051 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47931204 2024-11-04 06:41:54,051 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:41:54,051 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47931204 2024-11-04 06:41:54,113 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:41:54,113 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:41:54,113 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:41:54,113 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47931204': 1, 'ctest-pod-40062168': 1} 2024-11-04 06:41:54,129 - DEBUG - Network policy ingress-on-service not present 2024-11-04 06:41:54,130 - INFO - Creating Network Policy ingress-on-service 2024-11-04 06:41:54,153 - INFO - Network policy found in k8s 2024-11-04 06:41:54,153 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=85b83534-535e-40f8-ba14-29bf1b9bb3d8 2024-11-04 06:41:54,166 - INFO - Network Policy ingress-on-service with uuid 85b83534-535e-40f8-ba14-29bf1b9bb3d8 found in kube manager 2024-11-04 06:41:54,212 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-04 06:41:54,213 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-04 06:41:54,213 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=85b83534-535e-40f8-ba14-29bf1b9bb3d8 2024-11-04 06:41:54,289 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-04 06:41:56,291 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=85b83534-535e-40f8-ba14-29bf1b9bb3d8 2024-11-04 06:41:56,372 - INFO - Network policy with name ingress-on-service found in agent 2024-11-04 06:41:56,372 - INFO - Network Policy ingress-on-service verification passed 2024-11-04 06:42:01,443 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:01,443 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:01,444 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:06,497 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:06,497 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:06,497 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:11,576 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:11,576 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:11,576 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:16,628 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:16,628 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:16,628 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:21,674 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:21,675 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:21,675 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:26,743 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:26,743 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:26,743 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:31,810 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:31,811 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:31,811 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:36,872 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:36,872 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:36,872 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:41,932 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:41,933 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:41,933 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:47,003 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:47,003 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:47,003 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:47,004 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-47931204': 0, 'ctest-pod-40062168': 0} 2024-11-04 06:42:47,063 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:42:47,063 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:42:47,063 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:42:47,127 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:42:47,128 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:42:47,128 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:42:47,128 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47931204': 1, 'ctest-pod-40062168': 1} 2024-11-04 06:42:52,187 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:52,187 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:52,187 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:57,253 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:57,253 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:42:57,253 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:02,331 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:02,331 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:02,331 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:07,391 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:07,391 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:07,391 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:12,444 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:12,445 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:12,445 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:17,515 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:17,515 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:17,515 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:22,567 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:22,567 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:22,568 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:27,631 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:27,631 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:27,631 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:32,707 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:32,707 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:32,707 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:37,759 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:37,759 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:37,759 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:37,759 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-47931204': 0, 'ctest-pod-40062168': 0} 2024-11-04 06:43:39,808 - DEBUG - [Pod ctest-pod-25423100] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.159 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.095 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.447/1.159 ms 2024-11-04 06:43:39,808 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-25423100 with expectation True passed 2024-11-04 06:43:41,884 - DEBUG - [Pod ctest-pod-81931917] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.208 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.338 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.545/1.208 ms 2024-11-04 06:43:41,884 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81931917 with expectation True passed 2024-11-04 06:43:43,944 - DEBUG - [Pod ctest-pod-10794407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.885 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.347/0.885 ms 2024-11-04 06:43:43,945 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10794407 with expectation True passed 2024-11-04 06:43:44,000 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:43:44,000 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-04 06:43:44,000 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:43:44,001 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25423100 passed 2024-11-04 06:43:44,056 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:43:44,056 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-04 06:43:44,056 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:43:44,056 - INFO - wget check of of http://10.47.255.250 from ctest-pod-25423100 passed 2024-11-04 06:43:49,111 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 06:43:49,111 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 06:43:49,111 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 06:43:49,111 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81931917 passed 2024-11-04 06:43:54,162 - DEBUG - [Pod ctest-pod-21104748] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-04 06:43:54,163 - DEBUG - [Pod Pod ctest-pod-21104748] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-04 06:43:54,163 - DEBUG - [Pod Pod ctest-pod-21104748] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-04 06:43:54,163 - INFO - wget check of of http://10.47.255.251 from ctest-pod-21104748 passed 2024-11-04 06:43:54,171 - INFO - Updating Network Policy ingress-on-service 2024-11-04 06:43:59,259 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:59,260 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:43:59,260 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:04,336 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:04,336 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:04,336 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:09,398 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:09,399 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:09,399 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:14,474 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:14,474 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:14,474 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:19,539 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:19,539 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:19,539 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:24,607 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:24,608 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:24,608 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:29,671 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:29,671 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:29,671 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:34,728 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:34,728 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:34,728 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:39,801 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:39,801 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:39,801 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:44,852 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:44,852 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:44,852 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) wget: download timed out 2024-11-04 06:44:44,852 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-47931204': 0, 'ctest-pod-40062168': 0} 2024-11-04 06:44:44,922 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:44,922 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:44:44,923 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:44,972 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:44,973 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:44:44,973 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: ctest-pod-40062168 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:44,973 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47931204': 1, 'ctest-pod-40062168': 1} 2024-11-04 06:44:45,058 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:45,058 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:44:45,058 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:45,129 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:45,129 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:44:45,129 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: ctest-pod-47931204 Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 06:44:45,190 - DEBUG - [Pod ctest-pod-10794407] Cmd: wget http://10.102.188.179:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40062168 2024-11-04 06:44:45,190 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd wget http://10.102.188.179:80/ -O - -T 5 -t 1 passed 2024-11-04 06:44:45,190 - DEBUG - [Pod Pod ctest-pod-10794407] Cmd output: Connecting to 10.102.188.179:80 (10.102.188.179:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40062168 2024-11-04 06:44:45,190 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47931204': 2, 'ctest-pod-40062168': 1} 2024-11-04 06:44:47,248 - DEBUG - [Pod ctest-pod-25423100] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.312 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.499/1.312 ms 2024-11-04 06:44:47,248 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-25423100 with expectation True passed 2024-11-04 06:44:49,323 - DEBUG - [Pod ctest-pod-81931917] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.632 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.265/0.632 ms 2024-11-04 06:44:49,323 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81931917 with expectation True passed 2024-11-04 06:44:51,387 - DEBUG - [Pod ctest-pod-10794407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.140 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.435/1.140 ms 2024-11-04 06:44:51,388 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10794407 with expectation True passed 2024-11-04 06:44:51,463 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:44:51,463 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-04 06:44:51,463 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:44:51,463 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25423100 passed 2024-11-04 06:44:51,516 - DEBUG - [Pod ctest-pod-25423100] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:44:51,516 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-04 06:44:51,516 - DEBUG - [Pod Pod ctest-pod-25423100] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:44:51,516 - INFO - wget check of of http://10.47.255.250 from ctest-pod-25423100 passed 2024-11-04 06:44:56,567 - DEBUG - [Pod ctest-pod-81931917] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 06:44:56,567 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 06:44:56,567 - DEBUG - [Pod Pod ctest-pod-81931917] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 06:44:56,567 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81931917 passed 2024-11-04 06:44:56,635 - DEBUG - [Pod ctest-pod-21104748] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:44:56,636 - DEBUG - [Pod Pod ctest-pod-21104748] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-04 06:44:56,636 - DEBUG - [Pod Pod ctest-pod-21104748] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 06:44:56,636 - INFO - wget check of of http://10.47.255.251 from ctest-pod-21104748 passed 2024-11-04 06:44:56,636 - INFO - Deleting Network Policy : ingress-on-service 2024-11-04 06:44:56,636 - INFO - Deleting service : ctest-nginx-svc-65144591 2024-11-04 06:44:56,872 - DEBUG - No XMPP flaps were noticed during the test