2025-03-17 02:08:35,120 - INFO - Using existing project ['default-domain', 'k8s-default'](2433077e-c6d6-4979-9a3b-37b4f91500b3) 2025-03-17 02:08:35,154 - DEBUG - Namespace ctest-new-default-65801181 not present 2025-03-17 02:08:35,167 - INFO - Created namespace ctest-new-default-65801181 2025-03-17 02:08:38,172 - DEBUG - Namespace ctest-non-default-38946512 not present 2025-03-17 02:08:38,182 - INFO - Created namespace ctest-non-default-38946512 2025-03-17 02:08:41,219 - DEBUG - Pod ctest-pod-76463978 not present 2025-03-17 02:08:41,220 - INFO - Creating Pod ctest-pod-76463978 2025-03-17 02:08:41,276 - DEBUG - Pod : ctest-pod-76463978 UUID is db2223f9-3c92-4962-aa16-acea79d3dbc1 2025-03-17 02:08:41,279 - DEBUG - Pod ctest-pod-73536008 not present 2025-03-17 02:08:41,280 - INFO - Creating Pod ctest-pod-73536008 2025-03-17 02:08:41,315 - DEBUG - Pod : ctest-pod-73536008 UUID is fd551d8f-de20-43a1-a78d-3c9e11e86c49 2025-03-17 02:08:41,319 - DEBUG - Pod ctest-pod-43885896 not present 2025-03-17 02:08:41,319 - INFO - Creating Pod ctest-pod-43885896 2025-03-17 02:08:41,380 - DEBUG - Pod : ctest-pod-43885896 UUID is 02ce7271-5ca8-4ee6-a9b6-e60e05221258 2025-03-17 02:08:41,383 - DEBUG - Pod ctest-pod-77115249 not present 2025-03-17 02:08:41,384 - INFO - Creating Pod ctest-pod-77115249 2025-03-17 02:08:41,417 - DEBUG - Pod : ctest-pod-77115249 UUID is 6063e633-5a14-415d-8133-aff955b840ff 2025-03-17 02:08:41,420 - DEBUG - Pod ctest-pod-08810364 not present 2025-03-17 02:08:41,421 - INFO - Creating Pod ctest-pod-08810364 2025-03-17 02:08:41,447 - DEBUG - Pod : ctest-pod-08810364 UUID is 46c71e79-0c89-486f-b916-b3e9dc32232d 2025-03-17 02:08:41,449 - DEBUG - Pod ctest-pod-03599797 not present 2025-03-17 02:08:41,449 - INFO - Creating Pod ctest-pod-03599797 2025-03-17 02:08:41,471 - DEBUG - Pod : ctest-pod-03599797 UUID is 06442c30-b064-4689-8045-0c7ed3092e53 2025-03-17 02:08:41,478 - DEBUG - Pod ctest-pod-90651155 not present 2025-03-17 02:08:41,479 - INFO - Creating Pod ctest-pod-90651155 2025-03-17 02:08:41,515 - DEBUG - Pod : ctest-pod-90651155 UUID is 20007adc-7f47-4058-9565-1e8a672a45aa 2025-03-17 02:08:41,520 - DEBUG - Pod ctest-pod-72495047 not present 2025-03-17 02:08:41,521 - INFO - Creating Pod ctest-pod-72495047 2025-03-17 02:08:41,552 - DEBUG - Pod : ctest-pod-72495047 UUID is 07f1cc00-635a-457b-8fed-96bbe77962cb 2025-03-17 02:08:41,882 - INFO - Project default-domain:k8s-ctest-new-default-65801181 for Namespace ctest-new-default-65801181 is seen in contrail-api 2025-03-17 02:08:41,882 - DEBUG - Project uuid in Contrail is 2cd65fa9-ac09-44f3-b957-fd40ab4fb3ce 2025-03-17 02:08:42,116 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=caa7fad6-a475-4a9c-b1db-27e9aaaeac96 2025-03-17 02:08:42,125 - INFO - Namespace ctest-new-default-65801181 with uuid caa7fad6-a475-4a9c-b1db-27e9aaaeac96 found in kube manager 2025-03-17 02:08:42,125 - INFO - Namespace ctest-new-default-65801181 verification passed 2025-03-17 02:08:42,336 - INFO - Project default-domain:k8s-ctest-non-default-38946512 for Namespace ctest-non-default-38946512 is seen in contrail-api 2025-03-17 02:08:42,337 - DEBUG - Project uuid in Contrail is 8d5dc5a3-d2e5-47d8-a7d1-35f95855e5e1 2025-03-17 02:08:42,337 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=5ba158fc-db61-4bf0-bc5f-ba4548b8f40d 2025-03-17 02:08:42,347 - INFO - Namespace ctest-non-default-38946512 with uuid 5ba158fc-db61-4bf0-bc5f-ba4548b8f40d found in kube manager 2025-03-17 02:08:42,347 - INFO - Namespace ctest-non-default-38946512 verification passed 2025-03-17 02:08:42,353 - DEBUG - Pod ctest-pod-76463978 not in running state.Currently in Pending 2025-03-17 02:08:47,361 - DEBUG - Pod ctest-pod-76463978 not in running state.Currently in Pending 2025-03-17 02:08:52,369 - INFO - Pod ctest-pod-76463978 is in running state.Got IP 10.47.255.251 2025-03-17 02:08:52,389 - DEBUG - Pod ctest-pod-76463978 has vmi c074ecd8-02d4-11f0-9b28-fa163e971183 2025-03-17 02:08:52,389 - INFO - Verified pod ctest-pod-76463978 in contrail-api 2025-03-17 02:08:52,403 - DEBUG - VMI c074ecd8-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:08:52,403 - INFO - Verified Pod ctest-pod-76463978 in agent 10.0.0.36 2025-03-17 02:08:52,403 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=db2223f9-3c92-4962-aa16-acea79d3dbc1 2025-03-17 02:08:52,409 - INFO - Pod ctest-pod-76463978 with uuid db2223f9-3c92-4962-aa16-acea79d3dbc1 found in kube manager 2025-03-17 02:08:52,409 - INFO - Pod ctest-pod-76463978 verification passed 2025-03-17 02:08:52,415 - INFO - Pod ctest-pod-73536008 is in running state.Got IP 10.47.255.250 2025-03-17 02:08:52,476 - DEBUG - Pod ctest-pod-73536008 has vmi c1180030-02d4-11f0-9b28-fa163e971183 2025-03-17 02:08:52,476 - INFO - Verified pod ctest-pod-73536008 in contrail-api 2025-03-17 02:08:52,489 - DEBUG - VMI c1180030-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:08:52,489 - INFO - Verified Pod ctest-pod-73536008 in agent 10.0.0.36 2025-03-17 02:08:52,490 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=fd551d8f-de20-43a1-a78d-3c9e11e86c49 2025-03-17 02:08:52,497 - INFO - Pod ctest-pod-73536008 with uuid fd551d8f-de20-43a1-a78d-3c9e11e86c49 found in kube manager 2025-03-17 02:08:52,497 - INFO - Pod ctest-pod-73536008 verification passed 2025-03-17 02:08:52,503 - DEBUG - Pod ctest-pod-43885896 not in running state.Currently in Pending 2025-03-17 02:08:57,510 - INFO - Pod ctest-pod-43885896 is in running state.Got IP 10.47.255.249 2025-03-17 02:08:57,525 - DEBUG - Pod ctest-pod-43885896 has vmi c1ddd33c-02d4-11f0-9b28-fa163e971183 2025-03-17 02:08:57,525 - INFO - Verified pod ctest-pod-43885896 in contrail-api 2025-03-17 02:08:57,540 - DEBUG - VMI c1ddd33c-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:08:57,540 - INFO - Verified Pod ctest-pod-43885896 in agent 10.0.0.36 2025-03-17 02:08:57,540 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=02ce7271-5ca8-4ee6-a9b6-e60e05221258 2025-03-17 02:08:57,545 - INFO - Pod ctest-pod-43885896 with uuid 02ce7271-5ca8-4ee6-a9b6-e60e05221258 found in kube manager 2025-03-17 02:08:57,545 - INFO - Pod ctest-pod-43885896 verification passed 2025-03-17 02:08:57,551 - INFO - Pod ctest-pod-77115249 is in running state.Got IP 10.47.255.248 2025-03-17 02:08:57,609 - DEBUG - Pod ctest-pod-77115249 has vmi c2724238-02d4-11f0-9b28-fa163e971183 2025-03-17 02:08:57,609 - INFO - Verified pod ctest-pod-77115249 in contrail-api 2025-03-17 02:08:57,625 - DEBUG - VMI c2724238-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:08:57,625 - INFO - Verified Pod ctest-pod-77115249 in agent 10.0.0.36 2025-03-17 02:08:57,625 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=6063e633-5a14-415d-8133-aff955b840ff 2025-03-17 02:08:57,630 - INFO - Pod ctest-pod-77115249 with uuid 6063e633-5a14-415d-8133-aff955b840ff found in kube manager 2025-03-17 02:08:57,630 - INFO - Pod ctest-pod-77115249 verification passed 2025-03-17 02:08:57,637 - INFO - Pod ctest-pod-08810364 is in running state.Got IP 10.47.255.247 2025-03-17 02:08:57,695 - DEBUG - Pod ctest-pod-08810364 has vmi c319b860-02d4-11f0-9b28-fa163e971183 2025-03-17 02:08:57,695 - INFO - Verified pod ctest-pod-08810364 in contrail-api 2025-03-17 02:08:57,714 - DEBUG - VMI c319b860-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:08:57,714 - INFO - Verified Pod ctest-pod-08810364 in agent 10.0.0.36 2025-03-17 02:08:57,714 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=46c71e79-0c89-486f-b916-b3e9dc32232d 2025-03-17 02:08:57,720 - INFO - Pod ctest-pod-08810364 with uuid 46c71e79-0c89-486f-b916-b3e9dc32232d found in kube manager 2025-03-17 02:08:57,721 - INFO - Pod ctest-pod-08810364 verification passed 2025-03-17 02:08:57,728 - DEBUG - Pod ctest-pod-90651155 not in running state.Currently in Pending 2025-03-17 02:09:02,736 - INFO - Pod ctest-pod-90651155 is in running state.Got IP 10.47.255.245 2025-03-17 02:09:02,754 - DEBUG - Pod ctest-pod-90651155 has vmi c435916a-02d4-11f0-9b28-fa163e971183 2025-03-17 02:09:02,754 - INFO - Verified pod ctest-pod-90651155 in contrail-api 2025-03-17 02:09:02,771 - DEBUG - VMI c435916a-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:09:02,771 - INFO - Verified Pod ctest-pod-90651155 in agent 10.0.0.36 2025-03-17 02:09:02,771 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=20007adc-7f47-4058-9565-1e8a672a45aa 2025-03-17 02:09:02,778 - INFO - Pod ctest-pod-90651155 with uuid 20007adc-7f47-4058-9565-1e8a672a45aa found in kube manager 2025-03-17 02:09:02,778 - INFO - Pod ctest-pod-90651155 verification passed 2025-03-17 02:09:02,784 - INFO - Pod ctest-pod-03599797 is in running state.Got IP 10.47.255.246 2025-03-17 02:09:02,843 - DEBUG - Pod ctest-pod-03599797 has vmi c3a5460a-02d4-11f0-9b28-fa163e971183 2025-03-17 02:09:02,843 - INFO - Verified pod ctest-pod-03599797 in contrail-api 2025-03-17 02:09:02,859 - DEBUG - VMI c3a5460a-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:09:02,859 - INFO - Verified Pod ctest-pod-03599797 in agent 10.0.0.36 2025-03-17 02:09:02,860 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=06442c30-b064-4689-8045-0c7ed3092e53 2025-03-17 02:09:02,865 - INFO - Pod ctest-pod-03599797 with uuid 06442c30-b064-4689-8045-0c7ed3092e53 found in kube manager 2025-03-17 02:09:02,866 - INFO - Pod ctest-pod-03599797 verification passed 2025-03-17 02:09:02,873 - INFO - Pod ctest-pod-72495047 is in running state.Got IP 10.47.255.244 2025-03-17 02:09:02,898 - DEBUG - Pod ctest-pod-72495047 has vmi c4c18ba2-02d4-11f0-9b28-fa163e971183 2025-03-17 02:09:02,898 - INFO - Verified pod ctest-pod-72495047 in contrail-api 2025-03-17 02:09:02,915 - DEBUG - VMI c4c18ba2-02d4-11f0-9b28-fa163e971183 is active in agent 10.0.0.36 2025-03-17 02:09:02,915 - INFO - Verified Pod ctest-pod-72495047 in agent 10.0.0.36 2025-03-17 02:09:02,915 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=07f1cc00-635a-457b-8fed-96bbe77962cb 2025-03-17 02:09:02,920 - INFO - Pod ctest-pod-72495047 with uuid 07f1cc00-635a-457b-8fed-96bbe77962cb found in kube manager 2025-03-17 02:09:02,921 - INFO - Pod ctest-pod-72495047 verification passed 2025-03-17 02:09:02,921 - INFO - ================================================================================ 2025-03-17 02:09:02,921 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-17 02:09:02,921 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-17 02:09:03,183 - DEBUG - Nothing to compare xmpp stats {'10.0.0.36': {'10.0.0.12': '0'}} with 2025-03-17 02:09:03,183 - INFO - Initial checks done. Running the testcase now 2025-03-17 02:09:03,183 - INFO - 2025-03-17 02:09:03,253 - DEBUG - [Pod ctest-pod-76463978] Cmd: echo ctest-pod-76463978 > /usr/share/nginx/html/index.html, Output: 2025-03-17 02:09:03,335 - DEBUG - [Pod ctest-pod-73536008] Cmd: echo ctest-pod-73536008 > /usr/share/nginx/html/index.html, Output: 2025-03-17 02:09:03,400 - DEBUG - [Pod ctest-pod-43885896] Cmd: echo ctest-pod-43885896 > /usr/share/nginx/html/index.html, Output: 2025-03-17 02:09:03,468 - DEBUG - [Pod ctest-pod-77115249] Cmd: echo ctest-pod-77115249 > /usr/share/nginx/html/index.html, Output: 2025-03-17 02:09:03,472 - DEBUG - Service ctest-nginx-svc-53187753 not present 2025-03-17 02:09:03,472 - INFO - Creating service ctest-nginx-svc-53187753 2025-03-17 02:09:03,490 - INFO - Created Service ctest-nginx-svc-53187753 2025-03-17 02:09:03,500 - WARNING - Service UUID 538cecb7-acb7-4eff-9dfe-7c8f44cd19bf not yet found in contrail-api 2025-03-17 02:09:04,515 - INFO - Validated that Service ctest-nginx-svc-53187753 is seen in contrail-api 2025-03-17 02:09:04,516 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=538cecb7-acb7-4eff-9dfe-7c8f44cd19bf 2025-03-17 02:09:04,521 - INFO - Service ctest-nginx-svc-53187753 with uuid 538cecb7-acb7-4eff-9dfe-7c8f44cd19bf found in kube manager 2025-03-17 02:09:04,521 - INFO - Service ctest-nginx-svc-53187753 verification passed 2025-03-17 02:09:05,599 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) ctest-pod-76463978 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,599 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:05,599 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) ctest-pod-76463978 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,667 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,667 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:05,667 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,667 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76463978': 1, 'ctest-pod-73536008': 1} 2025-03-17 02:09:05,718 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,718 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:05,718 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,764 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,764 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:05,765 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,806 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,806 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:05,806 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,872 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,872 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:05,872 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:05,872 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76463978': 1, 'ctest-pod-73536008': 3} 2025-03-17 02:09:05,963 - DEBUG - Network policy ingress-on-service not present 2025-03-17 02:09:05,963 - INFO - Creating Network Policy ingress-on-service 2025-03-17 02:09:05,977 - INFO - Network policy found in k8s 2025-03-17 02:09:05,979 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bd1ff197-ddbb-4715-9138-dcdd61d51161 2025-03-17 02:09:05,991 - INFO - Network Policy ingress-on-service with uuid bd1ff197-ddbb-4715-9138-dcdd61d51161 found in kube manager 2025-03-17 02:09:06,029 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-17 02:09:06,029 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-17 02:09:06,029 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bd1ff197-ddbb-4715-9138-dcdd61d51161 2025-03-17 02:09:06,060 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-17 02:09:08,061 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bd1ff197-ddbb-4715-9138-dcdd61d51161 2025-03-17 02:09:08,098 - INFO - Network policy with name ingress-on-service found in agent 2025-03-17 02:09:08,098 - INFO - Network Policy ingress-on-service verification passed 2025-03-17 02:09:13,161 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:13,162 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:13,162 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:18,221 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:18,221 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:18,221 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:23,299 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:23,299 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:23,300 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:28,353 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:28,353 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:28,353 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:33,411 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:33,411 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:33,411 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:38,492 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:38,492 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:38,493 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:43,567 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:43,567 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:43,567 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:48,633 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:48,633 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:48,633 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:53,703 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:53,703 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:53,703 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:58,767 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:58,767 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:58,767 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:09:58,767 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76463978': 0, 'ctest-pod-73536008': 0} 2025-03-17 02:09:58,849 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:09:58,850 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:58,850 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:09:58,928 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:09:58,928 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:58,928 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:09:59,007 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:59,008 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:09:59,008 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:09:59,008 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76463978': 1, 'ctest-pod-73536008': 2} 2025-03-17 02:10:04,078 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:04,078 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:04,078 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:09,135 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:09,135 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:09,135 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:14,205 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:14,205 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:14,205 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:19,279 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:19,280 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:19,280 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:24,357 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:24,357 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:24,357 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:29,435 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:29,436 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:29,436 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:34,499 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:34,500 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:34,500 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:39,570 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:39,570 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:39,570 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:44,629 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:44,629 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:44,629 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:49,682 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:49,683 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:49,683 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:10:49,683 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76463978': 0, 'ctest-pod-73536008': 0} 2025-03-17 02:10:51,761 - DEBUG - [Pod ctest-pod-03599797] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.954 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.709/1.954 ms 2025-03-17 02:10:51,762 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-03599797 with expectation True passed 2025-03-17 02:10:53,834 - DEBUG - [Pod ctest-pod-08810364] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.999 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.388/0.999 ms 2025-03-17 02:10:53,835 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08810364 with expectation True passed 2025-03-17 02:10:55,919 - DEBUG - [Pod ctest-pod-90651155] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.238 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.471/1.238 ms 2025-03-17 02:10:55,919 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90651155 with expectation True passed 2025-03-17 02:10:55,990 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:10:55,990 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-17 02:10:55,990 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:10:55,990 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03599797 passed 2025-03-17 02:10:56,050 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:10:56,051 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-17 02:10:56,051 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:10:56,051 - INFO - wget check of of http://10.47.255.250 from ctest-pod-03599797 passed 2025-03-17 02:11:01,123 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-17 02:11:01,123 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-17 02:11:01,124 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-17 02:11:01,124 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08810364 passed 2025-03-17 02:11:06,194 - DEBUG - [Pod ctest-pod-72495047] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-17 02:11:06,194 - DEBUG - [Pod Pod ctest-pod-72495047] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-17 02:11:06,195 - DEBUG - [Pod Pod ctest-pod-72495047] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-17 02:11:06,195 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72495047 passed 2025-03-17 02:11:06,206 - INFO - Updating Network Policy ingress-on-service 2025-03-17 02:11:11,304 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:11,304 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:11,304 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:16,375 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:16,375 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:16,375 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:21,447 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:21,448 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:21,448 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:26,516 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:26,516 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:26,516 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:31,582 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:31,582 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:31,582 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:36,665 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:36,665 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:36,665 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:41,743 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:41,743 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:41,743 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:46,804 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:46,804 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:46,804 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:51,857 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:51,857 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:51,858 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:56,911 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:56,911 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:56,911 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) wget: download timed out 2025-03-17 02:11:56,911 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76463978': 0, 'ctest-pod-73536008': 0} 2025-03-17 02:11:56,984 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:56,984 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:56,984 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,054 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,054 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,054 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,111 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,112 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,112 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,112 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76463978': 1, 'ctest-pod-73536008': 2} 2025-03-17 02:11:57,203 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:11:57,203 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,203 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:11:57,279 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,279 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,279 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,340 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,340 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,340 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-73536008 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,404 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:11:57,404 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,404 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73536008 2025-03-17 02:11:57,472 - DEBUG - [Pod ctest-pod-90651155] Cmd: wget http://10.110.185.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,472 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd wget http://10.110.185.44:80/ -O - -T 5 -t 1 passed 2025-03-17 02:11:57,472 - DEBUG - [Pod Pod ctest-pod-90651155] Cmd output: ctest-pod-76463978 Connecting to 10.110.185.44:80 (10.110.185.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-17 02:11:57,472 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76463978': 1, 'ctest-pod-73536008': 4} 2025-03-17 02:11:59,538 - DEBUG - [Pod ctest-pod-03599797] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.487 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.171 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.248/0.487 ms 2025-03-17 02:11:59,538 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-03599797 with expectation True passed 2025-03-17 02:12:01,616 - DEBUG - [Pod ctest-pod-08810364] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.197 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.459/1.197 ms 2025-03-17 02:12:01,617 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08810364 with expectation True passed 2025-03-17 02:12:03,680 - DEBUG - [Pod ctest-pod-90651155] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.534 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.231/0.534 ms 2025-03-17 02:12:03,680 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90651155 with expectation True passed 2025-03-17 02:12:03,743 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:12:03,744 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-17 02:12:03,744 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:12:03,744 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03599797 passed 2025-03-17 02:12:03,824 - DEBUG - [Pod ctest-pod-03599797] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:12:03,825 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-17 02:12:03,825 - DEBUG - [Pod Pod ctest-pod-03599797] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:12:03,825 - INFO - wget check of of http://10.47.255.250 from ctest-pod-03599797 passed 2025-03-17 02:12:08,897 - DEBUG - [Pod ctest-pod-08810364] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-17 02:12:08,897 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-17 02:12:08,897 - DEBUG - [Pod Pod ctest-pod-08810364] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-17 02:12:08,897 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08810364 passed 2025-03-17 02:12:08,976 - DEBUG - [Pod ctest-pod-72495047] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:12:08,976 - DEBUG - [Pod Pod ctest-pod-72495047] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-17 02:12:08,977 - DEBUG - [Pod Pod ctest-pod-72495047] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-17 02:12:08,977 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72495047 passed 2025-03-17 02:12:08,977 - INFO - Deleting Network Policy : ingress-on-service 2025-03-17 02:12:08,977 - INFO - Deleting service : ctest-nginx-svc-53187753 2025-03-17 02:12:09,243 - DEBUG - No XMPP flaps were noticed during the test