2025-06-26 01:50:49,540 - INFO - Using existing project ['default-domain', 'k8s-default'](c56973f7-8009-4944-b6ec-82d0814f0013) 2025-06-26 01:50:49,569 - DEBUG - Namespace ctest-new-default-46505583 not present 2025-06-26 01:50:49,582 - INFO - Created namespace ctest-new-default-46505583 2025-06-26 01:50:52,588 - DEBUG - Namespace ctest-non-default-18038413 not present 2025-06-26 01:50:52,598 - INFO - Created namespace ctest-non-default-18038413 2025-06-26 01:50:55,617 - DEBUG - Pod ctest-pod-64181605 not present 2025-06-26 01:50:55,618 - INFO - Creating Pod ctest-pod-64181605 2025-06-26 01:50:55,649 - DEBUG - Pod : ctest-pod-64181605 UUID is 3ea7dc61-e7d7-4b6a-85ac-b9b8dc95786d 2025-06-26 01:50:55,657 - DEBUG - Pod ctest-pod-70534708 not present 2025-06-26 01:50:55,657 - INFO - Creating Pod ctest-pod-70534708 2025-06-26 01:50:55,701 - DEBUG - Pod : ctest-pod-70534708 UUID is 9e6602a1-20c8-4121-b61e-5696af944638 2025-06-26 01:50:55,704 - DEBUG - Pod ctest-pod-70609825 not present 2025-06-26 01:50:55,705 - INFO - Creating Pod ctest-pod-70609825 2025-06-26 01:50:55,731 - DEBUG - Pod : ctest-pod-70609825 UUID is 3c3a9e47-2b32-4878-be2a-7434b2a550c4 2025-06-26 01:50:55,739 - DEBUG - Pod ctest-pod-00149283 not present 2025-06-26 01:50:55,739 - INFO - Creating Pod ctest-pod-00149283 2025-06-26 01:50:55,762 - DEBUG - Pod : ctest-pod-00149283 UUID is 0856386c-0d3a-4d17-82de-1c2a48824f68 2025-06-26 01:50:55,765 - DEBUG - Pod ctest-pod-41042199 not present 2025-06-26 01:50:55,766 - INFO - Creating Pod ctest-pod-41042199 2025-06-26 01:50:55,803 - DEBUG - Pod : ctest-pod-41042199 UUID is fb3e5d04-8aae-4325-8453-3a9b58cd376d 2025-06-26 01:50:55,809 - DEBUG - Pod ctest-pod-54962716 not present 2025-06-26 01:50:55,809 - INFO - Creating Pod ctest-pod-54962716 2025-06-26 01:50:55,831 - DEBUG - Pod : ctest-pod-54962716 UUID is 7731f4ea-adee-4b83-9020-859d731db22d 2025-06-26 01:50:55,838 - DEBUG - Pod ctest-pod-29525500 not present 2025-06-26 01:50:55,838 - INFO - Creating Pod ctest-pod-29525500 2025-06-26 01:50:55,867 - DEBUG - Pod : ctest-pod-29525500 UUID is 278b1be0-13e2-4028-acc5-8778829a5957 2025-06-26 01:50:55,873 - DEBUG - Pod ctest-pod-66341527 not present 2025-06-26 01:50:55,873 - INFO - Creating Pod ctest-pod-66341527 2025-06-26 01:50:55,894 - DEBUG - Pod : ctest-pod-66341527 UUID is 1368c7eb-65ec-4af8-a9af-a183a11297e6 2025-06-26 01:50:56,233 - INFO - Project default-domain:k8s-ctest-new-default-46505583 for Namespace ctest-new-default-46505583 is seen in contrail-api 2025-06-26 01:50:56,233 - DEBUG - Project uuid in Contrail is 9e562217-56d6-483b-9a3d-4f17e7799039 2025-06-26 01:50:56,423 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=035dc3d1-9d05-4337-a609-738f342527a0 2025-06-26 01:50:56,429 - INFO - Namespace ctest-new-default-46505583 with uuid 035dc3d1-9d05-4337-a609-738f342527a0 found in kube manager 2025-06-26 01:50:56,429 - INFO - Namespace ctest-new-default-46505583 verification passed 2025-06-26 01:50:56,779 - INFO - Project default-domain:k8s-ctest-non-default-18038413 for Namespace ctest-non-default-18038413 is seen in contrail-api 2025-06-26 01:50:56,779 - DEBUG - Project uuid in Contrail is 5e609a1a-c257-44c4-a3cd-8783e38ee853 2025-06-26 01:50:56,779 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=1b760ade-e996-4f67-ac12-240f14218c2f 2025-06-26 01:50:56,788 - INFO - Namespace ctest-non-default-18038413 with uuid 1b760ade-e996-4f67-ac12-240f14218c2f found in kube manager 2025-06-26 01:50:56,788 - INFO - Namespace ctest-non-default-18038413 verification passed 2025-06-26 01:50:56,795 - DEBUG - Pod ctest-pod-64181605 not in running state.Currently in Pending 2025-06-26 01:51:01,802 - DEBUG - Pod ctest-pod-64181605 not in running state.Currently in Pending 2025-06-26 01:51:06,810 - DEBUG - Pod ctest-pod-64181605 not in running state.Currently in Pending 2025-06-26 01:51:11,818 - INFO - Pod ctest-pod-64181605 is in running state.Got IP 10.47.255.250 2025-06-26 01:51:11,878 - DEBUG - Pod ctest-pod-64181605 has vmi 01d868d0-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:11,878 - INFO - Verified pod ctest-pod-64181605 in contrail-api 2025-06-26 01:51:11,896 - DEBUG - VMI 01d868d0-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:11,896 - INFO - Verified Pod ctest-pod-64181605 in agent 10.0.0.57 2025-06-26 01:51:11,896 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=3ea7dc61-e7d7-4b6a-85ac-b9b8dc95786d 2025-06-26 01:51:11,904 - INFO - Pod ctest-pod-64181605 with uuid 3ea7dc61-e7d7-4b6a-85ac-b9b8dc95786d found in kube manager 2025-06-26 01:51:11,904 - INFO - Pod ctest-pod-64181605 verification passed 2025-06-26 01:51:11,911 - INFO - Pod ctest-pod-70534708 is in running state.Got IP 10.47.255.249 2025-06-26 01:51:12,012 - DEBUG - Pod ctest-pod-70534708 has vmi 028fce94-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:12,012 - INFO - Verified pod ctest-pod-70534708 in contrail-api 2025-06-26 01:51:12,027 - DEBUG - VMI 028fce94-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:12,028 - INFO - Verified Pod ctest-pod-70534708 in agent 10.0.0.57 2025-06-26 01:51:12,028 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=9e6602a1-20c8-4121-b61e-5696af944638 2025-06-26 01:51:12,034 - INFO - Pod ctest-pod-70534708 with uuid 9e6602a1-20c8-4121-b61e-5696af944638 found in kube manager 2025-06-26 01:51:12,034 - INFO - Pod ctest-pod-70534708 verification passed 2025-06-26 01:51:12,042 - INFO - Pod ctest-pod-70609825 is in running state.Got IP 10.47.255.248 2025-06-26 01:51:12,142 - DEBUG - Pod ctest-pod-70609825 has vmi 03934cd0-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:12,142 - INFO - Verified pod ctest-pod-70609825 in contrail-api 2025-06-26 01:51:12,158 - DEBUG - VMI 03934cd0-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:12,158 - INFO - Verified Pod ctest-pod-70609825 in agent 10.0.0.57 2025-06-26 01:51:12,158 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=3c3a9e47-2b32-4878-be2a-7434b2a550c4 2025-06-26 01:51:12,164 - INFO - Pod ctest-pod-70609825 with uuid 3c3a9e47-2b32-4878-be2a-7434b2a550c4 found in kube manager 2025-06-26 01:51:12,164 - INFO - Pod ctest-pod-70609825 verification passed 2025-06-26 01:51:12,171 - DEBUG - Pod ctest-pod-00149283 not in running state.Currently in Pending 2025-06-26 01:51:17,179 - INFO - Pod ctest-pod-00149283 is in running state.Got IP 10.47.255.247 2025-06-26 01:51:17,234 - DEBUG - Pod ctest-pod-00149283 has vmi 044f3918-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:17,234 - INFO - Verified pod ctest-pod-00149283 in contrail-api 2025-06-26 01:51:17,248 - DEBUG - VMI 044f3918-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:17,248 - INFO - Verified Pod ctest-pod-00149283 in agent 10.0.0.57 2025-06-26 01:51:17,249 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=0856386c-0d3a-4d17-82de-1c2a48824f68 2025-06-26 01:51:17,254 - INFO - Pod ctest-pod-00149283 with uuid 0856386c-0d3a-4d17-82de-1c2a48824f68 found in kube manager 2025-06-26 01:51:17,255 - INFO - Pod ctest-pod-00149283 verification passed 2025-06-26 01:51:17,261 - INFO - Pod ctest-pod-41042199 is in running state.Got IP 10.47.255.246 2025-06-26 01:51:17,359 - DEBUG - Pod ctest-pod-41042199 has vmi 051f1aca-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:17,359 - INFO - Verified pod ctest-pod-41042199 in contrail-api 2025-06-26 01:51:17,374 - DEBUG - VMI 051f1aca-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:17,374 - INFO - Verified Pod ctest-pod-41042199 in agent 10.0.0.57 2025-06-26 01:51:17,374 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=fb3e5d04-8aae-4325-8453-3a9b58cd376d 2025-06-26 01:51:17,379 - INFO - Pod ctest-pod-41042199 with uuid fb3e5d04-8aae-4325-8453-3a9b58cd376d found in kube manager 2025-06-26 01:51:17,379 - INFO - Pod ctest-pod-41042199 verification passed 2025-06-26 01:51:17,386 - INFO - Pod ctest-pod-29525500 is in running state.Got IP 10.47.255.244 2025-06-26 01:51:17,483 - DEBUG - Pod ctest-pod-29525500 has vmi 06eacf0c-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:17,483 - INFO - Verified pod ctest-pod-29525500 in contrail-api 2025-06-26 01:51:17,500 - DEBUG - VMI 06eacf0c-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:17,500 - INFO - Verified Pod ctest-pod-29525500 in agent 10.0.0.57 2025-06-26 01:51:17,500 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=278b1be0-13e2-4028-acc5-8778829a5957 2025-06-26 01:51:17,505 - INFO - Pod ctest-pod-29525500 with uuid 278b1be0-13e2-4028-acc5-8778829a5957 found in kube manager 2025-06-26 01:51:17,505 - INFO - Pod ctest-pod-29525500 verification passed 2025-06-26 01:51:17,512 - INFO - Pod ctest-pod-54962716 is in running state.Got IP 10.47.255.245 2025-06-26 01:51:17,607 - DEBUG - Pod ctest-pod-54962716 has vmi 061229ae-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:17,607 - INFO - Verified pod ctest-pod-54962716 in contrail-api 2025-06-26 01:51:17,623 - DEBUG - VMI 061229ae-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:17,623 - INFO - Verified Pod ctest-pod-54962716 in agent 10.0.0.57 2025-06-26 01:51:17,623 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=7731f4ea-adee-4b83-9020-859d731db22d 2025-06-26 01:51:17,629 - INFO - Pod ctest-pod-54962716 with uuid 7731f4ea-adee-4b83-9020-859d731db22d found in kube manager 2025-06-26 01:51:17,629 - INFO - Pod ctest-pod-54962716 verification passed 2025-06-26 01:51:17,636 - DEBUG - Pod ctest-pod-66341527 not in running state.Currently in Pending 2025-06-26 01:51:22,644 - INFO - Pod ctest-pod-66341527 is in running state.Got IP 10.47.255.243 2025-06-26 01:51:22,698 - DEBUG - Pod ctest-pod-66341527 has vmi 07e48dc6-5230-11f0-8cde-0242aeab162c 2025-06-26 01:51:22,698 - INFO - Verified pod ctest-pod-66341527 in contrail-api 2025-06-26 01:51:22,711 - DEBUG - VMI 07e48dc6-5230-11f0-8cde-0242aeab162c is active in agent 10.0.0.57 2025-06-26 01:51:22,711 - INFO - Verified Pod ctest-pod-66341527 in agent 10.0.0.57 2025-06-26 01:51:22,711 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=1368c7eb-65ec-4af8-a9af-a183a11297e6 2025-06-26 01:51:22,720 - INFO - Pod ctest-pod-66341527 with uuid 1368c7eb-65ec-4af8-a9af-a183a11297e6 found in kube manager 2025-06-26 01:51:22,720 - INFO - Pod ctest-pod-66341527 verification passed 2025-06-26 01:51:22,720 - INFO - ================================================================================ 2025-06-26 01:51:22,720 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-26 01:51:22,720 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-26 01:51:23,019 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.0.0.57': '3'}} with 2025-06-26 01:51:23,019 - INFO - Initial checks done. Running the testcase now 2025-06-26 01:51:23,019 - INFO - 2025-06-26 01:51:23,101 - DEBUG - [Pod ctest-pod-64181605] Cmd: echo ctest-pod-64181605 > /usr/share/nginx/html/index.html, Output: 2025-06-26 01:51:23,177 - DEBUG - [Pod ctest-pod-70534708] Cmd: echo ctest-pod-70534708 > /usr/share/nginx/html/index.html, Output: 2025-06-26 01:51:23,252 - DEBUG - [Pod ctest-pod-70609825] Cmd: echo ctest-pod-70609825 > /usr/share/nginx/html/index.html, Output: 2025-06-26 01:51:23,363 - DEBUG - [Pod ctest-pod-00149283] Cmd: echo ctest-pod-00149283 > /usr/share/nginx/html/index.html, Output: 2025-06-26 01:51:23,368 - DEBUG - Service ctest-nginx-svc-91319335 not present 2025-06-26 01:51:23,369 - INFO - Creating service ctest-nginx-svc-91319335 2025-06-26 01:51:23,393 - INFO - Created Service ctest-nginx-svc-91319335 2025-06-26 01:51:23,409 - WARNING - Service UUID 8d7248db-4ec8-4749-b8d0-35ce36df2468 not yet found in contrail-api 2025-06-26 01:51:24,419 - INFO - Validated that Service ctest-nginx-svc-91319335 is seen in contrail-api 2025-06-26 01:51:24,419 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=8d7248db-4ec8-4749-b8d0-35ce36df2468 2025-06-26 01:51:24,425 - INFO - Service ctest-nginx-svc-91319335 with uuid 8d7248db-4ec8-4749-b8d0-35ce36df2468 found in kube manager 2025-06-26 01:51:24,425 - INFO - Service ctest-nginx-svc-91319335 verification passed 2025-06-26 01:51:25,600 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,600 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:25,601 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,724 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout ctest-pod-64181605 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,724 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:25,724 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout ctest-pod-64181605 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,822 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,822 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:25,822 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,910 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,911 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:25,911 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:25,987 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70534708 2025-06-26 01:51:25,987 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:25,987 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70534708 2025-06-26 01:51:25,989 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64181605': 4, 'ctest-pod-70534708': 1} 2025-06-26 01:51:26,073 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:26,073 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:26,073 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:26,153 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:26,153 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:51:26,153 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:51:26,153 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64181605': 1, 'ctest-pod-70534708': 1} 2025-06-26 01:51:26,158 - DEBUG - Network policy ingress-on-service not present 2025-06-26 01:51:26,158 - INFO - Creating Network Policy ingress-on-service 2025-06-26 01:51:26,172 - INFO - Network policy found in k8s 2025-06-26 01:51:26,172 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=638e8650-4b42-4d76-8eb9-b1ce983a516e 2025-06-26 01:51:26,178 - INFO - Network Policy ingress-on-service with uuid 638e8650-4b42-4d76-8eb9-b1ce983a516e found in kube manager 2025-06-26 01:51:26,290 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-26 01:51:26,291 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-26 01:51:26,291 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=638e8650-4b42-4d76-8eb9-b1ce983a516e 2025-06-26 01:51:26,320 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-26 01:51:28,322 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=638e8650-4b42-4d76-8eb9-b1ce983a516e 2025-06-26 01:51:28,353 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-26 01:51:30,354 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=638e8650-4b42-4d76-8eb9-b1ce983a516e 2025-06-26 01:51:30,383 - INFO - Network policy with name ingress-on-service found in agent 2025-06-26 01:51:30,383 - INFO - Network Policy ingress-on-service verification passed 2025-06-26 01:51:35,471 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:35,471 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:35,471 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:40,565 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:40,565 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:40,565 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:45,650 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:45,651 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:45,651 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:50,751 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:50,751 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:50,752 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:55,842 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:55,842 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:51:55,842 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:00,927 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:00,927 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:00,927 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:06,007 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:06,007 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:06,007 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:11,084 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:11,084 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:11,085 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:16,176 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:16,177 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:16,177 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:21,265 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:21,265 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:21,265 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:21,265 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-64181605': 0, 'ctest-pod-70534708': 0} 2025-06-26 01:52:21,358 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:52:21,359 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:52:21,359 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:52:21,441 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-64181605 2025-06-26 01:52:21,441 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:52:21,441 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-64181605 2025-06-26 01:52:21,441 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64181605': 1, 'ctest-pod-70534708': 1} 2025-06-26 01:52:26,514 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:26,514 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:26,514 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:31,721 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:31,721 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:31,721 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:36,803 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:36,803 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:36,803 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:41,907 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:41,907 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:41,907 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:46,988 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:46,988 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:46,988 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:52,067 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:52,067 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:52,067 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:57,151 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:57,151 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:52:57,152 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:02,231 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:02,231 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:02,232 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:07,313 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:07,313 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:07,313 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:12,399 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:12,399 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:12,399 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:12,400 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-64181605': 0, 'ctest-pod-70534708': 0} 2025-06-26 01:53:14,483 - DEBUG - [Pod ctest-pod-54962716] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.409 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.860/2.409 ms 2025-06-26 01:53:14,483 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-54962716 with expectation True passed 2025-06-26 01:53:16,577 - DEBUG - [Pod ctest-pod-41042199] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.050 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.119 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.416/1.050 ms 2025-06-26 01:53:16,578 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-41042199 with expectation True passed 2025-06-26 01:53:18,687 - DEBUG - [Pod ctest-pod-29525500] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=3.359 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.081 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/1.174/3.359 ms 2025-06-26 01:53:18,687 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-29525500 with expectation True passed 2025-06-26 01:53:18,785 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:53:18,786 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-26 01:53:18,786 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:53:18,786 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54962716 passed 2025-06-26 01:53:18,875 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:53:18,876 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-06-26 01:53:18,876 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:53:18,876 - INFO - wget check of of http://10.47.255.249 from ctest-pod-54962716 passed 2025-06-26 01:53:23,955 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-06-26 01:53:23,955 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-06-26 01:53:23,955 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-06-26 01:53:23,955 - INFO - wget check of of http://10.47.255.249 from ctest-pod-41042199 passed 2025-06-26 01:53:29,053 - DEBUG - [Pod ctest-pod-66341527] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-26 01:53:29,053 - DEBUG - [Pod Pod ctest-pod-66341527] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-26 01:53:29,053 - DEBUG - [Pod Pod ctest-pod-66341527] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-26 01:53:29,053 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66341527 passed 2025-06-26 01:53:29,064 - INFO - Updating Network Policy ingress-on-service 2025-06-26 01:53:34,150 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:34,150 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:34,150 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:39,231 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:39,231 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:39,231 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:44,326 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:44,327 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:44,327 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:49,420 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:49,420 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:49,420 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:54,505 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:54,505 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:54,505 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:59,592 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:59,592 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:53:59,592 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:04,679 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:04,679 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:04,679 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:09,762 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:09,762 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:09,762 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:14,842 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:14,842 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:14,842 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:19,942 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:19,942 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:19,942 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) wget: download timed out 2025-06-26 01:54:19,942 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-64181605': 0, 'ctest-pod-70534708': 0} 2025-06-26 01:54:20,033 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,033 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:54:20,033 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,114 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-64181605 2025-06-26 01:54:20,114 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:54:20,114 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-64181605 2025-06-26 01:54:20,214 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,214 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:54:20,215 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,215 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64181605': 2, 'ctest-pod-70534708': 1} 2025-06-26 01:54:20,292 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,292 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:54:20,292 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-70534708 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,373 - DEBUG - [Pod ctest-pod-29525500] Cmd: wget http://10.105.25.147:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,373 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd wget http://10.105.25.147:80/ -O - -T 5 -t 1 passed 2025-06-26 01:54:20,373 - DEBUG - [Pod Pod ctest-pod-29525500] Cmd output: Connecting to 10.105.25.147:80 (10.105.25.147:80) ctest-pod-64181605 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-26 01:54:20,373 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64181605': 1, 'ctest-pod-70534708': 1} 2025-06-26 01:54:22,456 - DEBUG - [Pod ctest-pod-54962716] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.799 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.320/0.799 ms 2025-06-26 01:54:22,456 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-54962716 with expectation True passed 2025-06-26 01:54:24,534 - DEBUG - [Pod ctest-pod-41042199] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.226 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.074 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.793/2.226 ms 2025-06-26 01:54:24,534 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-41042199 with expectation True passed 2025-06-26 01:54:26,619 - DEBUG - [Pod ctest-pod-29525500] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.719 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.073 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.621/1.719 ms 2025-06-26 01:54:26,619 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-29525500 with expectation True passed 2025-06-26 01:54:26,697 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:54:26,697 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-26 01:54:26,697 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:54:26,697 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54962716 passed 2025-06-26 01:54:26,788 - DEBUG - [Pod ctest-pod-54962716] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:54:26,789 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-06-26 01:54:26,789 - DEBUG - [Pod Pod ctest-pod-54962716] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:54:26,789 - INFO - wget check of of http://10.47.255.249 from ctest-pod-54962716 passed 2025-06-26 01:54:31,869 - DEBUG - [Pod ctest-pod-41042199] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-06-26 01:54:31,869 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-06-26 01:54:31,869 - DEBUG - [Pod Pod ctest-pod-41042199] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-06-26 01:54:31,869 - INFO - wget check of of http://10.47.255.249 from ctest-pod-41042199 passed 2025-06-26 01:54:31,956 - DEBUG - [Pod ctest-pod-66341527] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:54:31,957 - DEBUG - [Pod Pod ctest-pod-66341527] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-26 01:54:31,957 - DEBUG - [Pod Pod ctest-pod-66341527] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-26 01:54:31,957 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66341527 passed 2025-06-26 01:54:31,957 - INFO - Deleting Network Policy : ingress-on-service 2025-06-26 01:54:31,957 - INFO - Deleting service : ctest-nginx-svc-91319335 2025-06-26 01:54:32,525 - DEBUG - No XMPP flaps were noticed during the test