2025-09-15 11:19:42,927 - INFO - Using existing project ['default-domain', 'k8s-default'](c7452f82-ea73-460a-b135-7f161da7aa83) 2025-09-15 11:19:42,942 - DEBUG - Namespace ctest-new-default-65669858 not present 2025-09-15 11:19:42,957 - INFO - Created namespace ctest-new-default-65669858 2025-09-15 11:19:45,961 - DEBUG - Namespace ctest-non-default-44528192 not present 2025-09-15 11:19:45,975 - INFO - Created namespace ctest-non-default-44528192 2025-09-15 11:19:48,990 - DEBUG - Pod ctest-pod-72921116 not present 2025-09-15 11:19:48,991 - INFO - Creating Pod ctest-pod-72921116 2025-09-15 11:19:49,017 - DEBUG - Pod : ctest-pod-72921116 UUID is 01554500-47aa-488b-bdc5-7461f156f2f5 2025-09-15 11:19:49,019 - DEBUG - Pod ctest-pod-28215519 not present 2025-09-15 11:19:49,020 - INFO - Creating Pod ctest-pod-28215519 2025-09-15 11:19:49,053 - DEBUG - Pod : ctest-pod-28215519 UUID is 4f017daf-93c6-4825-9729-1e9b4e009a43 2025-09-15 11:19:49,055 - DEBUG - Pod ctest-pod-02795956 not present 2025-09-15 11:19:49,055 - INFO - Creating Pod ctest-pod-02795956 2025-09-15 11:19:49,092 - DEBUG - Pod : ctest-pod-02795956 UUID is 81f5cab4-eda1-4253-8912-bd6002b34090 2025-09-15 11:19:49,098 - DEBUG - Pod ctest-pod-47820009 not present 2025-09-15 11:19:49,098 - INFO - Creating Pod ctest-pod-47820009 2025-09-15 11:19:49,117 - DEBUG - Pod : ctest-pod-47820009 UUID is c5a49c00-ca61-4210-9609-cc260026e093 2025-09-15 11:19:49,120 - DEBUG - Pod ctest-pod-17414706 not present 2025-09-15 11:19:49,120 - INFO - Creating Pod ctest-pod-17414706 2025-09-15 11:19:49,139 - DEBUG - Pod : ctest-pod-17414706 UUID is 49368d58-eae7-421f-ae77-6226a93b8b94 2025-09-15 11:19:49,141 - DEBUG - Pod ctest-pod-89198723 not present 2025-09-15 11:19:49,141 - INFO - Creating Pod ctest-pod-89198723 2025-09-15 11:19:49,159 - DEBUG - Pod : ctest-pod-89198723 UUID is e054fd21-07d8-464f-9680-e7f7df8dbf01 2025-09-15 11:19:49,161 - DEBUG - Pod ctest-pod-40395187 not present 2025-09-15 11:19:49,162 - INFO - Creating Pod ctest-pod-40395187 2025-09-15 11:19:49,178 - DEBUG - Pod : ctest-pod-40395187 UUID is 4975291d-8bdc-453f-bb2c-b2f49f89d623 2025-09-15 11:19:49,180 - DEBUG - Pod ctest-pod-51074199 not present 2025-09-15 11:19:49,180 - INFO - Creating Pod ctest-pod-51074199 2025-09-15 11:19:49,196 - DEBUG - Pod : ctest-pod-51074199 UUID is 41772bff-b394-40c6-8d27-2a79cf1b9159 2025-09-15 11:19:49,361 - INFO - Project default-domain:k8s-ctest-new-default-65669858 for Namespace ctest-new-default-65669858 is seen in contrail-api 2025-09-15 11:19:49,361 - DEBUG - Project uuid in Contrail is e2639e5b-9adc-4456-a3d4-e1c94769b13c 2025-09-15 11:19:49,532 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=6851477b-69c0-4eaa-88bd-3daf91c1e5ae 2025-09-15 11:19:49,537 - INFO - Namespace ctest-new-default-65669858 with uuid 6851477b-69c0-4eaa-88bd-3daf91c1e5ae found in kube manager 2025-09-15 11:19:49,537 - INFO - Namespace ctest-new-default-65669858 verification passed 2025-09-15 11:19:49,707 - INFO - Project default-domain:k8s-ctest-non-default-44528192 for Namespace ctest-non-default-44528192 is seen in contrail-api 2025-09-15 11:19:49,707 - DEBUG - Project uuid in Contrail is cde90505-3c9c-4ec1-8d56-4347881527a5 2025-09-15 11:19:49,707 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=c8c05052-2e4e-4756-b342-853503744c44 2025-09-15 11:19:49,711 - INFO - Namespace ctest-non-default-44528192 with uuid c8c05052-2e4e-4756-b342-853503744c44 found in kube manager 2025-09-15 11:19:49,711 - INFO - Namespace ctest-non-default-44528192 verification passed 2025-09-15 11:19:49,720 - DEBUG - Pod ctest-pod-72921116 not in running state.Currently in Pending 2025-09-15 11:19:54,726 - DEBUG - Pod ctest-pod-72921116 not in running state.Currently in Pending 2025-09-15 11:19:59,733 - DEBUG - Pod ctest-pod-72921116 not in running state.Currently in Pending 2025-09-15 11:20:04,740 - INFO - Pod ctest-pod-72921116 is in running state.Got IP 10.47.255.251 2025-09-15 11:20:04,751 - DEBUG - Pod ctest-pod-72921116 has vmi e53f2944-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:04,751 - INFO - Verified pod ctest-pod-72921116 in contrail-api 2025-09-15 11:20:04,763 - DEBUG - VMI e53f2944-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:04,763 - INFO - Verified Pod ctest-pod-72921116 in agent 10.0.0.137 2025-09-15 11:20:04,763 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=01554500-47aa-488b-bdc5-7461f156f2f5 2025-09-15 11:20:04,766 - INFO - Pod ctest-pod-72921116 with uuid 01554500-47aa-488b-bdc5-7461f156f2f5 found in kube manager 2025-09-15 11:20:04,767 - INFO - Pod ctest-pod-72921116 verification passed 2025-09-15 11:20:04,776 - INFO - Pod ctest-pod-28215519 is in running state.Got IP 10.47.255.250 2025-09-15 11:20:04,787 - DEBUG - Pod ctest-pod-28215519 has vmi e5b712ba-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:04,787 - INFO - Verified pod ctest-pod-28215519 in contrail-api 2025-09-15 11:20:04,798 - DEBUG - VMI e5b712ba-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:04,798 - INFO - Verified Pod ctest-pod-28215519 in agent 10.0.0.137 2025-09-15 11:20:04,798 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=4f017daf-93c6-4825-9729-1e9b4e009a43 2025-09-15 11:20:04,801 - INFO - Pod ctest-pod-28215519 with uuid 4f017daf-93c6-4825-9729-1e9b4e009a43 found in kube manager 2025-09-15 11:20:04,801 - INFO - Pod ctest-pod-28215519 verification passed 2025-09-15 11:20:04,807 - INFO - Pod ctest-pod-02795956 is in running state.Got IP 10.47.255.249 2025-09-15 11:20:04,860 - DEBUG - Pod ctest-pod-02795956 has vmi e653cbaa-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:04,860 - INFO - Verified pod ctest-pod-02795956 in contrail-api 2025-09-15 11:20:04,871 - DEBUG - VMI e653cbaa-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:04,871 - INFO - Verified Pod ctest-pod-02795956 in agent 10.0.0.137 2025-09-15 11:20:04,871 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=81f5cab4-eda1-4253-8912-bd6002b34090 2025-09-15 11:20:04,875 - INFO - Pod ctest-pod-02795956 with uuid 81f5cab4-eda1-4253-8912-bd6002b34090 found in kube manager 2025-09-15 11:20:04,875 - INFO - Pod ctest-pod-02795956 verification passed 2025-09-15 11:20:04,881 - DEBUG - Pod ctest-pod-47820009 not in running state.Currently in Pending 2025-09-15 11:20:09,888 - INFO - Pod ctest-pod-47820009 is in running state.Got IP 10.47.255.248 2025-09-15 11:20:09,902 - DEBUG - Pod ctest-pod-47820009 has vmi e6c14d38-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:09,902 - INFO - Verified pod ctest-pod-47820009 in contrail-api 2025-09-15 11:20:09,915 - DEBUG - VMI e6c14d38-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:09,915 - INFO - Verified Pod ctest-pod-47820009 in agent 10.0.0.137 2025-09-15 11:20:09,915 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c5a49c00-ca61-4210-9609-cc260026e093 2025-09-15 11:20:09,919 - INFO - Pod ctest-pod-47820009 with uuid c5a49c00-ca61-4210-9609-cc260026e093 found in kube manager 2025-09-15 11:20:09,919 - INFO - Pod ctest-pod-47820009 verification passed 2025-09-15 11:20:09,925 - INFO - Pod ctest-pod-17414706 is in running state.Got IP 10.47.255.247 2025-09-15 11:20:09,980 - DEBUG - Pod ctest-pod-17414706 has vmi e739df50-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:09,980 - INFO - Verified pod ctest-pod-17414706 in contrail-api 2025-09-15 11:20:09,992 - DEBUG - VMI e739df50-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:09,992 - INFO - Verified Pod ctest-pod-17414706 in agent 10.0.0.137 2025-09-15 11:20:09,992 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=49368d58-eae7-421f-ae77-6226a93b8b94 2025-09-15 11:20:09,995 - INFO - Pod ctest-pod-17414706 with uuid 49368d58-eae7-421f-ae77-6226a93b8b94 found in kube manager 2025-09-15 11:20:09,996 - INFO - Pod ctest-pod-17414706 verification passed 2025-09-15 11:20:10,002 - INFO - Pod ctest-pod-40395187 is in running state.Got IP 10.47.255.245 2025-09-15 11:20:10,054 - DEBUG - Pod ctest-pod-40395187 has vmi e81a4c3e-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:10,054 - INFO - Verified pod ctest-pod-40395187 in contrail-api 2025-09-15 11:20:10,064 - DEBUG - VMI e81a4c3e-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:10,065 - INFO - Verified Pod ctest-pod-40395187 in agent 10.0.0.137 2025-09-15 11:20:10,065 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=4975291d-8bdc-453f-bb2c-b2f49f89d623 2025-09-15 11:20:10,068 - INFO - Pod ctest-pod-40395187 with uuid 4975291d-8bdc-453f-bb2c-b2f49f89d623 found in kube manager 2025-09-15 11:20:10,068 - INFO - Pod ctest-pod-40395187 verification passed 2025-09-15 11:20:10,074 - INFO - Pod ctest-pod-89198723 is in running state.Got IP 10.47.255.246 2025-09-15 11:20:10,084 - DEBUG - Pod ctest-pod-89198723 has vmi e79d4e28-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:10,084 - INFO - Verified pod ctest-pod-89198723 in contrail-api 2025-09-15 11:20:10,096 - DEBUG - VMI e79d4e28-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:10,096 - INFO - Verified Pod ctest-pod-89198723 in agent 10.0.0.137 2025-09-15 11:20:10,096 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=e054fd21-07d8-464f-9680-e7f7df8dbf01 2025-09-15 11:20:10,099 - INFO - Pod ctest-pod-89198723 with uuid e054fd21-07d8-464f-9680-e7f7df8dbf01 found in kube manager 2025-09-15 11:20:10,100 - INFO - Pod ctest-pod-89198723 verification passed 2025-09-15 11:20:10,105 - INFO - Pod ctest-pod-51074199 is in running state.Got IP 10.47.255.244 2025-09-15 11:20:10,160 - DEBUG - Pod ctest-pod-51074199 has vmi e8772fb2-9225-11f0-8265-fa163ea53c0d 2025-09-15 11:20:10,160 - INFO - Verified pod ctest-pod-51074199 in contrail-api 2025-09-15 11:20:10,170 - DEBUG - VMI e8772fb2-9225-11f0-8265-fa163ea53c0d is active in agent 10.0.0.137 2025-09-15 11:20:10,171 - INFO - Verified Pod ctest-pod-51074199 in agent 10.0.0.137 2025-09-15 11:20:10,171 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=41772bff-b394-40c6-8d27-2a79cf1b9159 2025-09-15 11:20:10,174 - INFO - Pod ctest-pod-51074199 with uuid 41772bff-b394-40c6-8d27-2a79cf1b9159 found in kube manager 2025-09-15 11:20:10,174 - INFO - Pod ctest-pod-51074199 verification passed 2025-09-15 11:20:10,174 - INFO - ================================================================================ 2025-09-15 11:20:10,174 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-09-15 11:20:10,174 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-09-15 11:20:10,320 - DEBUG - Nothing to compare xmpp stats {'10.0.0.137': {'10.0.0.19': '0'}} with 2025-09-15 11:20:10,320 - INFO - Initial checks done. Running the testcase now 2025-09-15 11:20:10,320 - INFO - 2025-09-15 11:20:10,379 - DEBUG - [Pod ctest-pod-72921116] Cmd: echo ctest-pod-72921116 > /usr/share/nginx/html/index.html, Output: 2025-09-15 11:20:10,437 - DEBUG - [Pod ctest-pod-28215519] Cmd: echo ctest-pod-28215519 > /usr/share/nginx/html/index.html, Output: 2025-09-15 11:20:10,491 - DEBUG - [Pod ctest-pod-02795956] Cmd: echo ctest-pod-02795956 > /usr/share/nginx/html/index.html, Output: 2025-09-15 11:20:10,544 - DEBUG - [Pod ctest-pod-47820009] Cmd: echo ctest-pod-47820009 > /usr/share/nginx/html/index.html, Output: 2025-09-15 11:20:10,547 - DEBUG - Service ctest-nginx-svc-24911190 not present 2025-09-15 11:20:10,547 - INFO - Creating service ctest-nginx-svc-24911190 2025-09-15 11:20:10,559 - INFO - Created Service ctest-nginx-svc-24911190 2025-09-15 11:20:10,566 - WARNING - Service UUID 5aedeb8a-fb74-4fff-b124-e0a9661027cf not yet found in contrail-api 2025-09-15 11:20:11,571 - INFO - Validated that Service ctest-nginx-svc-24911190 is seen in contrail-api 2025-09-15 11:20:11,572 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=5aedeb8a-fb74-4fff-b124-e0a9661027cf 2025-09-15 11:20:11,577 - INFO - Service ctest-nginx-svc-24911190 with uuid 5aedeb8a-fb74-4fff-b124-e0a9661027cf found in kube manager 2025-09-15 11:20:11,577 - INFO - Service ctest-nginx-svc-24911190 verification passed 2025-09-15 11:20:11,634 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,634 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,634 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,691 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,692 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,692 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,741 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72921116 2025-09-15 11:20:11,741 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,741 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72921116 2025-09-15 11:20:11,800 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72921116 2025-09-15 11:20:11,800 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,800 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72921116 2025-09-15 11:20:11,854 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,854 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,854 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,918 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28215519 2025-09-15 11:20:11,918 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,918 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28215519 2025-09-15 11:20:11,918 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72921116': 5, 'ctest-pod-28215519': 1} 2025-09-15 11:20:11,985 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:11,985 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:11,985 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:12,038 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:12,038 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:20:12,038 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:20:12,039 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72921116': 1, 'ctest-pod-28215519': 1} 2025-09-15 11:20:12,042 - DEBUG - Network policy ingress-on-service not present 2025-09-15 11:20:12,042 - INFO - Creating Network Policy ingress-on-service 2025-09-15 11:20:12,057 - INFO - Network policy found in k8s 2025-09-15 11:20:12,058 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=39cc6914-848f-44b0-b7c5-bcdb9346b05f 2025-09-15 11:20:12,070 - INFO - Network Policy ingress-on-service with uuid 39cc6914-848f-44b0-b7c5-bcdb9346b05f found in kube manager 2025-09-15 11:20:12,108 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-09-15 11:20:12,108 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-09-15 11:20:12,108 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=39cc6914-848f-44b0-b7c5-bcdb9346b05f 2025-09-15 11:20:12,132 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-15 11:20:14,133 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=39cc6914-848f-44b0-b7c5-bcdb9346b05f 2025-09-15 11:20:14,158 - INFO - Network policy with name ingress-on-service found in agent 2025-09-15 11:20:14,158 - INFO - Network Policy ingress-on-service verification passed 2025-09-15 11:20:19,212 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:19,212 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:19,212 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:24,271 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:24,271 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:24,271 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:29,331 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:29,332 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:29,332 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:34,392 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:34,392 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:34,392 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:39,448 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:39,448 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:39,448 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:44,507 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:44,507 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:44,507 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:49,563 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:49,564 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:49,564 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:54,615 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:54,615 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:54,615 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:59,660 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:59,660 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:20:59,660 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:04,711 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:04,711 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:04,712 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:04,712 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72921116': 0, 'ctest-pod-28215519': 0} 2025-09-15 11:21:04,777 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:21:04,777 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:21:04,777 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:21:04,835 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:21:04,835 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:21:04,835 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:21:04,835 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72921116': 1, 'ctest-pod-28215519': 1} 2025-09-15 11:21:09,887 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:09,887 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:09,887 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:14,935 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:14,935 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:14,935 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:19,992 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:19,992 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:19,992 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:25,044 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:25,044 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:25,044 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:30,096 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:30,096 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:30,096 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:35,149 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:35,149 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:35,149 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:40,207 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:40,207 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:40,207 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:45,265 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:45,265 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:45,265 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:50,311 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:50,312 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:50,312 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:55,372 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:55,373 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:55,373 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:21:55,373 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72921116': 0, 'ctest-pod-28215519': 0} 2025-09-15 11:21:57,435 - DEBUG - [Pod ctest-pod-89198723] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.473 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.216/0.473 ms 2025-09-15 11:21:57,435 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-89198723 with expectation True passed 2025-09-15 11:21:59,489 - DEBUG - [Pod ctest-pod-17414706] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.804 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.062 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.318/0.804 ms 2025-09-15 11:21:59,489 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17414706 with expectation True passed 2025-09-15 11:22:01,540 - DEBUG - [Pod ctest-pod-40395187] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.487 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.556/1.487 ms 2025-09-15 11:22:01,540 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40395187 with expectation True passed 2025-09-15 11:22:01,598 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:22:01,598 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-15 11:22:01,599 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:22:01,599 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89198723 passed 2025-09-15 11:22:01,664 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:22:01,664 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 11:22:01,664 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:22:01,664 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89198723 passed 2025-09-15 11:22:06,720 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 11:22:06,721 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 11:22:06,721 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 11:22:06,721 - INFO - wget check of of http://10.47.255.250 from ctest-pod-17414706 passed 2025-09-15 11:22:11,773 - DEBUG - [Pod ctest-pod-51074199] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-15 11:22:11,773 - DEBUG - [Pod Pod ctest-pod-51074199] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-15 11:22:11,773 - DEBUG - [Pod Pod ctest-pod-51074199] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-15 11:22:11,773 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51074199 passed 2025-09-15 11:22:11,781 - INFO - Updating Network Policy ingress-on-service 2025-09-15 11:22:16,852 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:16,852 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:16,852 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:21,903 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:21,903 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:21,903 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:26,951 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:26,951 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:26,951 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:31,996 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:31,996 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:31,996 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:37,047 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:37,047 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:37,047 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:42,105 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:42,105 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:42,105 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:47,171 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:47,171 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:47,171 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:48,960 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-09-15 11:22:59,019 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:59,019 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:22:59,019 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:04,076 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:04,076 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:04,076 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:09,120 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:09,120 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:09,120 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) wget: download timed out 2025-09-15 11:23:09,120 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72921116': 0, 'ctest-pod-28215519': 0} 2025-09-15 11:23:09,199 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:23:09,200 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:23:09,200 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: ctest-pod-72921116 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:23:09,262 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:23:09,262 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:23:09,262 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:23:09,262 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72921116': 1, 'ctest-pod-28215519': 1} 2025-09-15 11:23:09,318 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72921116 2025-09-15 11:23:09,318 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:23:09,318 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72921116 2025-09-15 11:23:09,386 - DEBUG - [Pod ctest-pod-40395187] Cmd: wget http://10.102.159.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:23:09,386 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd wget http://10.102.159.61:80/ -O - -T 5 -t 1 passed 2025-09-15 11:23:09,387 - DEBUG - [Pod Pod ctest-pod-40395187] Cmd output: ctest-pod-28215519 Connecting to 10.102.159.61:80 (10.102.159.61:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-15 11:23:09,387 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72921116': 1, 'ctest-pod-28215519': 1} 2025-09-15 11:23:11,442 - DEBUG - [Pod ctest-pod-89198723] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.818 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.102 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.123 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.102/0.347/0.818 ms 2025-09-15 11:23:11,442 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-89198723 with expectation True passed 2025-09-15 11:23:13,497 - DEBUG - [Pod ctest-pod-17414706] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.914 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.358/0.914 ms 2025-09-15 11:23:13,497 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17414706 with expectation True passed 2025-09-15 11:23:15,547 - DEBUG - [Pod ctest-pod-40395187] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.770 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.311/0.770 ms 2025-09-15 11:23:15,547 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40395187 with expectation True passed 2025-09-15 11:23:15,606 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:23:15,606 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-15 11:23:15,606 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:23:15,606 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89198723 passed 2025-09-15 11:23:15,666 - DEBUG - [Pod ctest-pod-89198723] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:23:15,666 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-15 11:23:15,666 - DEBUG - [Pod Pod ctest-pod-89198723] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:23:15,666 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89198723 passed 2025-09-15 11:23:20,715 - DEBUG - [Pod ctest-pod-17414706] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 11:23:20,715 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 11:23:20,715 - DEBUG - [Pod Pod ctest-pod-17414706] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-15 11:23:20,715 - INFO - wget check of of http://10.47.255.250 from ctest-pod-17414706 passed 2025-09-15 11:23:20,789 - DEBUG - [Pod ctest-pod-51074199] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:23:20,789 - DEBUG - [Pod Pod ctest-pod-51074199] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-15 11:23:20,789 - DEBUG - [Pod Pod ctest-pod-51074199] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-15 11:23:20,789 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51074199 passed 2025-09-15 11:23:20,789 - INFO - Deleting Network Policy : ingress-on-service 2025-09-15 11:23:20,790 - INFO - Deleting service : ctest-nginx-svc-24911190 2025-09-15 11:23:20,978 - DEBUG - No XMPP flaps were noticed during the test