2025-01-14 06:31:58,605 - INFO - Using existing project ['default-domain', 'k8s-default'](554ead42-7e36-4831-9f6b-c6ddc94c8e34) 2025-01-14 06:31:58,640 - DEBUG - Namespace ctest-new-default-79753615 not present 2025-01-14 06:31:58,665 - INFO - Created namespace ctest-new-default-79753615 2025-01-14 06:32:01,670 - DEBUG - Namespace ctest-non-default-14925959 not present 2025-01-14 06:32:01,678 - INFO - Created namespace ctest-non-default-14925959 2025-01-14 06:32:04,702 - DEBUG - Pod ctest-pod-42139139 not present 2025-01-14 06:32:04,702 - INFO - Creating Pod ctest-pod-42139139 2025-01-14 06:32:04,744 - DEBUG - Pod : ctest-pod-42139139 UUID is 1b4bfb70-e735-4b94-891f-fbd948beaa49 2025-01-14 06:32:04,748 - DEBUG - Pod ctest-pod-72087900 not present 2025-01-14 06:32:04,748 - INFO - Creating Pod ctest-pod-72087900 2025-01-14 06:32:04,790 - DEBUG - Pod : ctest-pod-72087900 UUID is 7bf13a36-8fe8-4519-a0a2-0dc377426280 2025-01-14 06:32:04,801 - DEBUG - Pod ctest-pod-14508997 not present 2025-01-14 06:32:04,801 - INFO - Creating Pod ctest-pod-14508997 2025-01-14 06:32:04,827 - DEBUG - Pod : ctest-pod-14508997 UUID is 8e04cc6b-5ab7-4ab1-8f7b-b22bd243cac9 2025-01-14 06:32:04,834 - DEBUG - Pod ctest-pod-03791804 not present 2025-01-14 06:32:04,834 - INFO - Creating Pod ctest-pod-03791804 2025-01-14 06:32:04,898 - DEBUG - Pod : ctest-pod-03791804 UUID is 6c61bcba-85c4-4569-b149-0abd1042e572 2025-01-14 06:32:04,901 - DEBUG - Pod ctest-pod-92372059 not present 2025-01-14 06:32:04,901 - INFO - Creating Pod ctest-pod-92372059 2025-01-14 06:32:04,923 - DEBUG - Pod : ctest-pod-92372059 UUID is f5befafd-25ce-45c1-a61c-8a8189c93400 2025-01-14 06:32:04,931 - DEBUG - Pod ctest-pod-11722791 not present 2025-01-14 06:32:04,931 - INFO - Creating Pod ctest-pod-11722791 2025-01-14 06:32:04,950 - DEBUG - Pod : ctest-pod-11722791 UUID is 1805443e-cccf-49a7-9d3c-44d3ca207ee4 2025-01-14 06:32:04,952 - DEBUG - Pod ctest-pod-98980503 not present 2025-01-14 06:32:04,952 - INFO - Creating Pod ctest-pod-98980503 2025-01-14 06:32:04,979 - DEBUG - Pod : ctest-pod-98980503 UUID is a24b17ed-d718-433e-9f3a-c81e00f51383 2025-01-14 06:32:04,982 - DEBUG - Pod ctest-pod-52705002 not present 2025-01-14 06:32:04,982 - INFO - Creating Pod ctest-pod-52705002 2025-01-14 06:32:05,020 - DEBUG - Pod : ctest-pod-52705002 UUID is 07363803-e577-4ba5-97f6-dacedf492329 2025-01-14 06:32:05,279 - INFO - Project default-domain:k8s-ctest-new-default-79753615 for Namespace ctest-new-default-79753615 is seen in contrail-api 2025-01-14 06:32:05,279 - DEBUG - Project uuid in Contrail is d66fed0f-e72c-497a-b401-282c39c5d5ec 2025-01-14 06:32:05,483 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=972f9279-2a01-4dbf-9f1b-6605d8268b5c 2025-01-14 06:32:05,496 - INFO - Namespace ctest-new-default-79753615 with uuid 972f9279-2a01-4dbf-9f1b-6605d8268b5c found in kube manager 2025-01-14 06:32:05,497 - INFO - Namespace ctest-new-default-79753615 verification passed 2025-01-14 06:32:05,726 - INFO - Project default-domain:k8s-ctest-non-default-14925959 for Namespace ctest-non-default-14925959 is seen in contrail-api 2025-01-14 06:32:05,726 - DEBUG - Project uuid in Contrail is e046318b-8790-411c-9117-508f2aa62630 2025-01-14 06:32:05,726 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=927b3856-b5c0-423b-ae2c-ce11ade7d431 2025-01-14 06:32:05,732 - INFO - Namespace ctest-non-default-14925959 with uuid 927b3856-b5c0-423b-ae2c-ce11ade7d431 found in kube manager 2025-01-14 06:32:05,732 - INFO - Namespace ctest-non-default-14925959 verification passed 2025-01-14 06:32:05,743 - DEBUG - Pod ctest-pod-42139139 not in running state.Currently in Pending 2025-01-14 06:32:10,764 - DEBUG - Pod ctest-pod-42139139 not in running state.Currently in Pending 2025-01-14 06:32:15,777 - DEBUG - Pod ctest-pod-42139139 not in running state.Currently in Pending 2025-01-14 06:32:20,786 - INFO - Pod ctest-pod-42139139 is in running state.Got IP 10.47.255.251 2025-01-14 06:32:20,845 - DEBUG - Pod ctest-pod-42139139 has vmi 467c03f8-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:20,845 - INFO - Verified pod ctest-pod-42139139 in contrail-api 2025-01-14 06:32:20,863 - DEBUG - VMI 467c03f8-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:20,864 - INFO - Verified Pod ctest-pod-42139139 in agent 10.0.0.50 2025-01-14 06:32:20,864 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1b4bfb70-e735-4b94-891f-fbd948beaa49 2025-01-14 06:32:20,869 - INFO - Pod ctest-pod-42139139 with uuid 1b4bfb70-e735-4b94-891f-fbd948beaa49 found in kube manager 2025-01-14 06:32:20,870 - INFO - Pod ctest-pod-42139139 verification passed 2025-01-14 06:32:20,876 - INFO - Pod ctest-pod-72087900 is in running state.Got IP 10.47.255.250 2025-01-14 06:32:20,892 - DEBUG - Pod ctest-pod-72087900 has vmi 46fa3976-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:20,892 - INFO - Verified pod ctest-pod-72087900 in contrail-api 2025-01-14 06:32:20,908 - DEBUG - VMI 46fa3976-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:20,909 - INFO - Verified Pod ctest-pod-72087900 in agent 10.0.0.50 2025-01-14 06:32:20,909 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=7bf13a36-8fe8-4519-a0a2-0dc377426280 2025-01-14 06:32:20,914 - INFO - Pod ctest-pod-72087900 with uuid 7bf13a36-8fe8-4519-a0a2-0dc377426280 found in kube manager 2025-01-14 06:32:20,914 - INFO - Pod ctest-pod-72087900 verification passed 2025-01-14 06:32:20,924 - INFO - Pod ctest-pod-14508997 is in running state.Got IP 10.47.255.249 2025-01-14 06:32:20,982 - DEBUG - Pod ctest-pod-14508997 has vmi 47bf3b86-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:20,982 - INFO - Verified pod ctest-pod-14508997 in contrail-api 2025-01-14 06:32:20,996 - DEBUG - VMI 47bf3b86-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:20,997 - INFO - Verified Pod ctest-pod-14508997 in agent 10.0.0.50 2025-01-14 06:32:20,997 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8e04cc6b-5ab7-4ab1-8f7b-b22bd243cac9 2025-01-14 06:32:21,003 - INFO - Pod ctest-pod-14508997 with uuid 8e04cc6b-5ab7-4ab1-8f7b-b22bd243cac9 found in kube manager 2025-01-14 06:32:21,003 - INFO - Pod ctest-pod-14508997 verification passed 2025-01-14 06:32:21,014 - INFO - Pod ctest-pod-03791804 is in running state.Got IP 10.47.255.248 2025-01-14 06:32:21,077 - DEBUG - Pod ctest-pod-03791804 has vmi 484a590a-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:21,077 - INFO - Verified pod ctest-pod-03791804 in contrail-api 2025-01-14 06:32:21,092 - DEBUG - VMI 484a590a-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:21,092 - INFO - Verified Pod ctest-pod-03791804 in agent 10.0.0.50 2025-01-14 06:32:21,092 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=6c61bcba-85c4-4569-b149-0abd1042e572 2025-01-14 06:32:21,098 - INFO - Pod ctest-pod-03791804 with uuid 6c61bcba-85c4-4569-b149-0abd1042e572 found in kube manager 2025-01-14 06:32:21,098 - INFO - Pod ctest-pod-03791804 verification passed 2025-01-14 06:32:21,105 - DEBUG - Pod ctest-pod-92372059 not in running state.Currently in Pending 2025-01-14 06:32:26,112 - INFO - Pod ctest-pod-92372059 is in running state.Got IP 10.47.255.247 2025-01-14 06:32:26,129 - DEBUG - Pod ctest-pod-92372059 has vmi 48f95e3c-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:26,129 - INFO - Verified pod ctest-pod-92372059 in contrail-api 2025-01-14 06:32:26,148 - DEBUG - VMI 48f95e3c-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:26,148 - INFO - Verified Pod ctest-pod-92372059 in agent 10.0.0.50 2025-01-14 06:32:26,148 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f5befafd-25ce-45c1-a61c-8a8189c93400 2025-01-14 06:32:26,153 - INFO - Pod ctest-pod-92372059 with uuid f5befafd-25ce-45c1-a61c-8a8189c93400 found in kube manager 2025-01-14 06:32:26,154 - INFO - Pod ctest-pod-92372059 verification passed 2025-01-14 06:32:26,160 - INFO - Pod ctest-pod-98980503 is in running state.Got IP 10.47.255.245 2025-01-14 06:32:26,221 - DEBUG - Pod ctest-pod-98980503 has vmi 4a6e59a2-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:26,221 - INFO - Verified pod ctest-pod-98980503 in contrail-api 2025-01-14 06:32:26,239 - DEBUG - VMI 4a6e59a2-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:26,239 - INFO - Verified Pod ctest-pod-98980503 in agent 10.0.0.50 2025-01-14 06:32:26,239 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a24b17ed-d718-433e-9f3a-c81e00f51383 2025-01-14 06:32:26,245 - INFO - Pod ctest-pod-98980503 with uuid a24b17ed-d718-433e-9f3a-c81e00f51383 found in kube manager 2025-01-14 06:32:26,245 - INFO - Pod ctest-pod-98980503 verification passed 2025-01-14 06:32:26,251 - INFO - Pod ctest-pod-11722791 is in running state.Got IP 10.47.255.246 2025-01-14 06:32:26,270 - DEBUG - Pod ctest-pod-11722791 has vmi 49d84868-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:26,270 - INFO - Verified pod ctest-pod-11722791 in contrail-api 2025-01-14 06:32:26,287 - DEBUG - VMI 49d84868-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:26,288 - INFO - Verified Pod ctest-pod-11722791 in agent 10.0.0.50 2025-01-14 06:32:26,288 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1805443e-cccf-49a7-9d3c-44d3ca207ee4 2025-01-14 06:32:26,293 - INFO - Pod ctest-pod-11722791 with uuid 1805443e-cccf-49a7-9d3c-44d3ca207ee4 found in kube manager 2025-01-14 06:32:26,294 - INFO - Pod ctest-pod-11722791 verification passed 2025-01-14 06:32:26,301 - INFO - Pod ctest-pod-52705002 is in running state.Got IP 10.47.255.244 2025-01-14 06:32:26,362 - DEBUG - Pod ctest-pod-52705002 has vmi 4b280852-d241-11ef-adff-fa163e428b74 2025-01-14 06:32:26,362 - INFO - Verified pod ctest-pod-52705002 in contrail-api 2025-01-14 06:32:26,382 - DEBUG - VMI 4b280852-d241-11ef-adff-fa163e428b74 is active in agent 10.0.0.50 2025-01-14 06:32:26,383 - INFO - Verified Pod ctest-pod-52705002 in agent 10.0.0.50 2025-01-14 06:32:26,383 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=07363803-e577-4ba5-97f6-dacedf492329 2025-01-14 06:32:26,389 - INFO - Pod ctest-pod-52705002 with uuid 07363803-e577-4ba5-97f6-dacedf492329 found in kube manager 2025-01-14 06:32:26,389 - INFO - Pod ctest-pod-52705002 verification passed 2025-01-14 06:32:26,389 - INFO - ================================================================================ 2025-01-14 06:32:26,389 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-14 06:32:26,389 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-14 06:32:26,654 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.22': '0'}} with 2025-01-14 06:32:26,655 - INFO - Initial checks done. Running the testcase now 2025-01-14 06:32:26,655 - INFO - 2025-01-14 06:32:26,728 - DEBUG - [Pod ctest-pod-42139139] Cmd: echo ctest-pod-42139139 > /usr/share/nginx/html/index.html, Output: 2025-01-14 06:32:26,806 - DEBUG - [Pod ctest-pod-72087900] Cmd: echo ctest-pod-72087900 > /usr/share/nginx/html/index.html, Output: 2025-01-14 06:32:26,927 - DEBUG - [Pod ctest-pod-14508997] Cmd: echo ctest-pod-14508997 > /usr/share/nginx/html/index.html, Output: 2025-01-14 06:32:26,985 - DEBUG - [Pod ctest-pod-03791804] Cmd: echo ctest-pod-03791804 > /usr/share/nginx/html/index.html, Output: 2025-01-14 06:32:26,989 - DEBUG - Service ctest-nginx-svc-52395599 not present 2025-01-14 06:32:26,990 - INFO - Creating service ctest-nginx-svc-52395599 2025-01-14 06:32:27,013 - INFO - Created Service ctest-nginx-svc-52395599 2025-01-14 06:32:27,029 - WARNING - Service UUID 4d5821d9-a462-4c9a-ba7e-f6d73d51a373 not yet found in contrail-api 2025-01-14 06:32:28,037 - INFO - Validated that Service ctest-nginx-svc-52395599 is seen in contrail-api 2025-01-14 06:32:28,038 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=4d5821d9-a462-4c9a-ba7e-f6d73d51a373 2025-01-14 06:32:28,043 - INFO - Service ctest-nginx-svc-52395599 with uuid 4d5821d9-a462-4c9a-ba7e-f6d73d51a373 found in kube manager 2025-01-14 06:32:28,043 - INFO - Service ctest-nginx-svc-52395599 verification passed 2025-01-14 06:32:29,110 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42139139 2025-01-14 06:32:29,110 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,110 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42139139 2025-01-14 06:32:29,193 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,193 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,193 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,193 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42139139': 1, 'ctest-pod-72087900': 1} 2025-01-14 06:32:29,256 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:32:29,256 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,256 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:32:29,312 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,313 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,313 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,377 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,377 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,377 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,441 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:32:29,441 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,441 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:32:29,587 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,587 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,587 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,653 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,653 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:32:29,653 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:32:29,653 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42139139': 1, 'ctest-pod-72087900': 5} 2025-01-14 06:32:29,658 - DEBUG - Network policy ingress-on-service not present 2025-01-14 06:32:29,659 - INFO - Creating Network Policy ingress-on-service 2025-01-14 06:32:29,691 - INFO - Network policy found in k8s 2025-01-14 06:32:29,691 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=aafc8c87-ead5-4a75-9e5e-f8869a2e3bd5 2025-01-14 06:32:29,705 - INFO - Network Policy ingress-on-service with uuid aafc8c87-ead5-4a75-9e5e-f8869a2e3bd5 found in kube manager 2025-01-14 06:32:29,746 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-14 06:32:29,747 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-14 06:32:29,747 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=aafc8c87-ead5-4a75-9e5e-f8869a2e3bd5 2025-01-14 06:32:29,781 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-14 06:32:31,782 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=aafc8c87-ead5-4a75-9e5e-f8869a2e3bd5 2025-01-14 06:32:31,819 - INFO - Network policy with name ingress-on-service found in agent 2025-01-14 06:32:31,819 - INFO - Network Policy ingress-on-service verification passed 2025-01-14 06:32:36,881 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:36,881 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:36,881 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:41,962 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:41,962 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:41,963 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:47,025 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:47,025 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:47,025 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:52,099 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:52,099 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:52,099 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:57,158 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:57,158 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:32:57,158 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:02,209 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:02,210 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:02,210 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:07,382 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:07,382 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:07,382 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:12,452 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:12,452 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:12,453 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:17,520 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:17,520 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:17,520 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:22,586 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:22,781 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:22,782 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:22,782 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42139139': 0, 'ctest-pod-72087900': 0} 2025-01-14 06:33:22,849 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:33:22,849 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:33:22,850 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:33:22,915 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:33:22,916 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:33:22,916 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:33:22,916 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42139139': 1, 'ctest-pod-72087900': 1} 2025-01-14 06:33:27,975 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:27,976 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:27,976 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:33,031 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:33,032 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:33,032 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:38,096 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:38,096 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:38,096 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:43,152 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:43,152 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:43,152 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:48,213 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:48,213 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:48,213 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:53,269 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:53,269 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:53,269 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:58,342 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:58,342 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:33:58,343 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:03,402 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:03,403 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:03,403 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:08,482 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:08,483 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:08,483 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:13,550 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:13,551 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:13,551 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:13,551 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42139139': 0, 'ctest-pod-72087900': 0} 2025-01-14 06:34:15,615 - DEBUG - [Pod ctest-pod-11722791] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.886 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.343/0.886 ms 2025-01-14 06:34:15,615 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-11722791 with expectation True passed 2025-01-14 06:34:17,695 - DEBUG - [Pod ctest-pod-92372059] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.995 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.376/0.995 ms 2025-01-14 06:34:17,695 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92372059 with expectation True passed 2025-01-14 06:34:18,039 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-14 06:34:25,289 - DEBUG - [Pod ctest-pod-98980503] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.454 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.201/0.454 ms 2025-01-14 06:34:25,289 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-98980503 with expectation True passed 2025-01-14 06:34:25,353 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:34:25,353 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-14 06:34:25,354 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:34:25,354 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11722791 passed 2025-01-14 06:34:25,410 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:34:25,410 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-14 06:34:25,411 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:34:25,411 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11722791 passed 2025-01-14 06:34:30,493 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-14 06:34:30,493 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-14 06:34:30,493 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-14 06:34:30,493 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92372059 passed 2025-01-14 06:34:35,568 - DEBUG - [Pod ctest-pod-52705002] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-14 06:34:35,568 - DEBUG - [Pod Pod ctest-pod-52705002] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-14 06:34:35,568 - DEBUG - [Pod Pod ctest-pod-52705002] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-14 06:34:35,568 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52705002 passed 2025-01-14 06:34:35,577 - INFO - Updating Network Policy ingress-on-service 2025-01-14 06:34:40,649 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:40,649 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:40,649 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:45,697 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:45,698 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:45,698 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:50,765 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:50,765 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:50,765 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:55,833 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:55,833 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:34:55,833 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:00,902 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:00,902 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:00,902 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:05,968 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:05,968 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:05,968 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:11,031 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:11,031 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:11,031 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:16,092 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:16,092 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:16,092 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:21,160 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:21,161 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:21,161 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:26,224 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:26,224 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:26,224 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) wget: download timed out 2025-01-14 06:35:26,224 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42139139': 0, 'ctest-pod-72087900': 0} 2025-01-14 06:35:26,306 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:35:26,306 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:35:26,306 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72087900 2025-01-14 06:35:26,364 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:35:26,364 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:35:26,365 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:35:26,365 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42139139': 1, 'ctest-pod-72087900': 1} 2025-01-14 06:35:26,418 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:35:26,418 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:35:26,418 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: ctest-pod-72087900 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:35:26,490 - DEBUG - [Pod ctest-pod-98980503] Cmd: wget http://10.100.199.171:80/ -O - -T 5 -t 1 , Output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:35:26,490 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd wget http://10.100.199.171:80/ -O - -T 5 -t 1 passed 2025-01-14 06:35:26,490 - DEBUG - [Pod Pod ctest-pod-98980503] Cmd output: ctest-pod-42139139 Connecting to 10.100.199.171:80 (10.100.199.171:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-14 06:35:26,490 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42139139': 1, 'ctest-pod-72087900': 1} 2025-01-14 06:35:28,555 - DEBUG - [Pod ctest-pod-11722791] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.368 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.172/0.368 ms 2025-01-14 06:35:28,555 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-11722791 with expectation True passed 2025-01-14 06:35:30,630 - DEBUG - [Pod ctest-pod-92372059] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.520 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.117 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.103/0.246/0.520 ms 2025-01-14 06:35:30,630 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92372059 with expectation True passed 2025-01-14 06:35:32,695 - DEBUG - [Pod ctest-pod-98980503] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.999 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.391/0.999 ms 2025-01-14 06:35:32,695 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-98980503 with expectation True passed 2025-01-14 06:35:32,768 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:35:32,768 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-14 06:35:32,768 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:35:32,768 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11722791 passed 2025-01-14 06:35:32,844 - DEBUG - [Pod ctest-pod-11722791] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:35:32,845 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-14 06:35:32,845 - DEBUG - [Pod Pod ctest-pod-11722791] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:35:32,845 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11722791 passed 2025-01-14 06:35:37,903 - DEBUG - [Pod ctest-pod-92372059] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-14 06:35:37,903 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-14 06:35:37,903 - DEBUG - [Pod Pod ctest-pod-92372059] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-14 06:35:37,903 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92372059 passed 2025-01-14 06:35:38,193 - DEBUG - [Pod ctest-pod-52705002] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:35:38,193 - DEBUG - [Pod Pod ctest-pod-52705002] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-14 06:35:38,193 - DEBUG - [Pod Pod ctest-pod-52705002] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-14 06:35:38,194 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52705002 passed 2025-01-14 06:35:38,194 - INFO - Deleting Network Policy : ingress-on-service 2025-01-14 06:35:38,195 - INFO - Deleting service : ctest-nginx-svc-52395599 2025-01-14 06:35:38,470 - DEBUG - No XMPP flaps were noticed during the test