2025-04-14 15:23:53,352 - INFO - Using existing project ['default-domain', 'k8s-default'](0fc05407-d665-4205-923f-ae2ce7c6488c) 2025-04-14 15:23:53,386 - DEBUG - Namespace ctest-new-default-66677193 not present 2025-04-14 15:23:53,393 - INFO - Created namespace ctest-new-default-66677193 2025-04-14 15:23:56,398 - DEBUG - Namespace ctest-non-default-66404695 not present 2025-04-14 15:23:56,406 - INFO - Created namespace ctest-non-default-66404695 2025-04-14 15:23:59,424 - DEBUG - Pod ctest-pod-88384220 not present 2025-04-14 15:23:59,424 - INFO - Creating Pod ctest-pod-88384220 2025-04-14 15:23:59,453 - DEBUG - Pod : ctest-pod-88384220 UUID is 6bd415fe-e98e-48af-a2da-bdfa88bcc1d1 2025-04-14 15:23:59,456 - DEBUG - Pod ctest-pod-21611501 not present 2025-04-14 15:23:59,456 - INFO - Creating Pod ctest-pod-21611501 2025-04-14 15:23:59,480 - DEBUG - Pod : ctest-pod-21611501 UUID is e3669168-e797-4753-8ee2-8fc3c2ceb4eb 2025-04-14 15:23:59,485 - DEBUG - Pod ctest-pod-94731379 not present 2025-04-14 15:23:59,486 - INFO - Creating Pod ctest-pod-94731379 2025-04-14 15:23:59,505 - DEBUG - Pod : ctest-pod-94731379 UUID is c1049d1d-c993-4863-a2fe-6e6cdbc5efbf 2025-04-14 15:23:59,509 - DEBUG - Pod ctest-pod-27739890 not present 2025-04-14 15:23:59,509 - INFO - Creating Pod ctest-pod-27739890 2025-04-14 15:23:59,532 - DEBUG - Pod : ctest-pod-27739890 UUID is 0b35a624-e217-48d7-8a15-24de6107c93a 2025-04-14 15:23:59,536 - DEBUG - Pod ctest-pod-11265294 not present 2025-04-14 15:23:59,536 - INFO - Creating Pod ctest-pod-11265294 2025-04-14 15:23:59,556 - DEBUG - Pod : ctest-pod-11265294 UUID is a3055c58-8aa6-42c0-be29-f44e41ab9d5d 2025-04-14 15:23:59,559 - DEBUG - Pod ctest-pod-17920149 not present 2025-04-14 15:23:59,559 - INFO - Creating Pod ctest-pod-17920149 2025-04-14 15:23:59,581 - DEBUG - Pod : ctest-pod-17920149 UUID is 5edfa4f7-3630-40b2-abc1-be6963f7a708 2025-04-14 15:23:59,585 - DEBUG - Pod ctest-pod-19602946 not present 2025-04-14 15:23:59,586 - INFO - Creating Pod ctest-pod-19602946 2025-04-14 15:23:59,616 - DEBUG - Pod : ctest-pod-19602946 UUID is 6da8bfc9-4a24-4503-8bfd-6785bdebccf9 2025-04-14 15:23:59,619 - DEBUG - Pod ctest-pod-81227918 not present 2025-04-14 15:23:59,620 - INFO - Creating Pod ctest-pod-81227918 2025-04-14 15:23:59,642 - DEBUG - Pod : ctest-pod-81227918 UUID is 0b374156-010b-47c8-b560-d5ab5e7dba3f 2025-04-14 15:23:59,975 - INFO - Project default-domain:k8s-ctest-new-default-66677193 for Namespace ctest-new-default-66677193 is seen in contrail-api 2025-04-14 15:23:59,975 - DEBUG - Project uuid in Contrail is c9dec293-5d07-4fc5-831c-c3d69b8ceeba 2025-04-14 15:24:00,228 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=478f2389-b32e-465b-9a1b-ee9a55ceb717 2025-04-14 15:24:00,233 - INFO - Namespace ctest-new-default-66677193 with uuid 478f2389-b32e-465b-9a1b-ee9a55ceb717 found in kube manager 2025-04-14 15:24:00,233 - INFO - Namespace ctest-new-default-66677193 verification passed 2025-04-14 15:24:00,518 - INFO - Project default-domain:k8s-ctest-non-default-66404695 for Namespace ctest-non-default-66404695 is seen in contrail-api 2025-04-14 15:24:00,518 - DEBUG - Project uuid in Contrail is 35afeee0-13e5-4aba-b65f-e1cea20b95df 2025-04-14 15:24:00,518 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=ed7449e2-c791-44cb-9237-c3cddf4c1c30 2025-04-14 15:24:00,525 - INFO - Namespace ctest-non-default-66404695 with uuid ed7449e2-c791-44cb-9237-c3cddf4c1c30 found in kube manager 2025-04-14 15:24:00,525 - INFO - Namespace ctest-non-default-66404695 verification passed 2025-04-14 15:24:00,531 - DEBUG - Pod ctest-pod-88384220 not in running state.Currently in Pending 2025-04-14 15:24:05,542 - DEBUG - Pod ctest-pod-88384220 not in running state.Currently in Pending 2025-04-14 15:24:10,549 - DEBUG - Pod ctest-pod-88384220 not in running state.Currently in Pending 2025-04-14 15:24:15,557 - DEBUG - Pod ctest-pod-88384220 not in running state.Currently in Pending 2025-04-14 15:24:20,563 - DEBUG - Pod ctest-pod-88384220 not in running state.Currently in Pending 2025-04-14 15:24:25,571 - INFO - Pod ctest-pod-88384220 is in running state.Got IP 10.47.255.248 2025-04-14 15:24:25,592 - DEBUG - Pod ctest-pod-88384220 has vmi 82519f42-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:24:25,592 - INFO - Verified pod ctest-pod-88384220 in contrail-api 2025-04-14 15:24:25,604 - DEBUG - VMI 82519f42-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:24:25,604 - INFO - Verified Pod ctest-pod-88384220 in agent 10.0.0.65 2025-04-14 15:24:25,605 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=6bd415fe-e98e-48af-a2da-bdfa88bcc1d1 2025-04-14 15:24:25,609 - INFO - Pod ctest-pod-88384220 with uuid 6bd415fe-e98e-48af-a2da-bdfa88bcc1d1 found in kube manager 2025-04-14 15:24:25,609 - INFO - Pod ctest-pod-88384220 verification passed 2025-04-14 15:24:25,616 - INFO - Pod ctest-pod-21611501 is in running state.Got IP 10.47.255.247 2025-04-14 15:24:25,630 - DEBUG - Pod ctest-pod-21611501 has vmi 84717478-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:24:25,630 - INFO - Verified pod ctest-pod-21611501 in contrail-api 2025-04-14 15:24:25,642 - DEBUG - VMI 84717478-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:24:25,642 - INFO - Verified Pod ctest-pod-21611501 in agent 10.0.0.65 2025-04-14 15:24:25,642 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=e3669168-e797-4753-8ee2-8fc3c2ceb4eb 2025-04-14 15:24:25,647 - INFO - Pod ctest-pod-21611501 with uuid e3669168-e797-4753-8ee2-8fc3c2ceb4eb found in kube manager 2025-04-14 15:24:25,647 - INFO - Pod ctest-pod-21611501 verification passed 2025-04-14 15:24:25,656 - DEBUG - Pod ctest-pod-94731379 not in running state.Currently in Pending 2025-04-14 15:24:30,664 - DEBUG - Pod ctest-pod-94731379 not in running state.Currently in Pending 2025-04-14 15:24:35,672 - INFO - Pod ctest-pod-94731379 is in running state.Got IP 10.47.255.246 2025-04-14 15:24:35,689 - DEBUG - Pod ctest-pod-94731379 has vmi 887ea9b4-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:24:35,690 - INFO - Verified pod ctest-pod-94731379 in contrail-api 2025-04-14 15:24:35,705 - DEBUG - VMI 887ea9b4-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:24:35,705 - INFO - Verified Pod ctest-pod-94731379 in agent 10.0.0.65 2025-04-14 15:24:35,705 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=c1049d1d-c993-4863-a2fe-6e6cdbc5efbf 2025-04-14 15:24:35,710 - INFO - Pod ctest-pod-94731379 with uuid c1049d1d-c993-4863-a2fe-6e6cdbc5efbf found in kube manager 2025-04-14 15:24:35,711 - INFO - Pod ctest-pod-94731379 verification passed 2025-04-14 15:24:35,717 - DEBUG - Pod ctest-pod-27739890 not in running state.Currently in Pending 2025-04-14 15:24:40,724 - INFO - Pod ctest-pod-27739890 is in running state.Got IP 10.47.255.245 2025-04-14 15:24:40,740 - DEBUG - Pod ctest-pod-27739890 has vmi 8b3dae8e-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:24:40,740 - INFO - Verified pod ctest-pod-27739890 in contrail-api 2025-04-14 15:24:40,752 - DEBUG - VMI 8b3dae8e-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:24:40,752 - INFO - Verified Pod ctest-pod-27739890 in agent 10.0.0.65 2025-04-14 15:24:40,753 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=0b35a624-e217-48d7-8a15-24de6107c93a 2025-04-14 15:24:40,757 - INFO - Pod ctest-pod-27739890 with uuid 0b35a624-e217-48d7-8a15-24de6107c93a found in kube manager 2025-04-14 15:24:40,757 - INFO - Pod ctest-pod-27739890 verification passed 2025-04-14 15:24:40,763 - DEBUG - Pod ctest-pod-11265294 not in running state.Currently in Pending 2025-04-14 15:24:45,770 - DEBUG - Pod ctest-pod-11265294 not in running state.Currently in Pending 2025-04-14 15:24:50,777 - INFO - Pod ctest-pod-11265294 is in running state.Got IP 10.47.255.244 2025-04-14 15:24:50,799 - DEBUG - Pod ctest-pod-11265294 has vmi 8f34d08a-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:24:50,799 - INFO - Verified pod ctest-pod-11265294 in contrail-api 2025-04-14 15:24:50,819 - DEBUG - VMI 8f34d08a-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:24:50,820 - INFO - Verified Pod ctest-pod-11265294 in agent 10.0.0.65 2025-04-14 15:24:50,821 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=a3055c58-8aa6-42c0-be29-f44e41ab9d5d 2025-04-14 15:24:50,828 - INFO - Pod ctest-pod-11265294 with uuid a3055c58-8aa6-42c0-be29-f44e41ab9d5d found in kube manager 2025-04-14 15:24:50,828 - INFO - Pod ctest-pod-11265294 verification passed 2025-04-14 15:24:50,922 - DEBUG - Pod ctest-pod-19602946 not in running state.Currently in Pending 2025-04-14 15:24:55,930 - DEBUG - Pod ctest-pod-19602946 not in running state.Currently in Pending 2025-04-14 15:25:00,937 - INFO - Pod ctest-pod-19602946 is in running state.Got IP 10.47.255.242 2025-04-14 15:25:00,952 - DEBUG - Pod ctest-pod-19602946 has vmi 9545aefe-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:25:00,952 - INFO - Verified pod ctest-pod-19602946 in contrail-api 2025-04-14 15:25:00,967 - DEBUG - VMI 9545aefe-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:25:00,968 - INFO - Verified Pod ctest-pod-19602946 in agent 10.0.0.65 2025-04-14 15:25:00,968 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=6da8bfc9-4a24-4503-8bfd-6785bdebccf9 2025-04-14 15:25:00,973 - INFO - Pod ctest-pod-19602946 with uuid 6da8bfc9-4a24-4503-8bfd-6785bdebccf9 found in kube manager 2025-04-14 15:25:00,973 - INFO - Pod ctest-pod-19602946 verification passed 2025-04-14 15:25:00,980 - INFO - Pod ctest-pod-17920149 is in running state.Got IP 10.47.255.243 2025-04-14 15:25:00,998 - DEBUG - Pod ctest-pod-17920149 has vmi 91f60028-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:25:00,998 - INFO - Verified pod ctest-pod-17920149 in contrail-api 2025-04-14 15:25:01,016 - DEBUG - VMI 91f60028-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:25:01,017 - INFO - Verified Pod ctest-pod-17920149 in agent 10.0.0.65 2025-04-14 15:25:01,017 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=5edfa4f7-3630-40b2-abc1-be6963f7a708 2025-04-14 15:25:01,023 - INFO - Pod ctest-pod-17920149 with uuid 5edfa4f7-3630-40b2-abc1-be6963f7a708 found in kube manager 2025-04-14 15:25:01,023 - INFO - Pod ctest-pod-17920149 verification passed 2025-04-14 15:25:01,029 - INFO - Pod ctest-pod-81227918 is in running state.Got IP 10.47.255.241 2025-04-14 15:25:01,045 - DEBUG - Pod ctest-pod-81227918 has vmi 9762548a-1944-11f0-89f7-fa163ec8eaa3 2025-04-14 15:25:01,045 - INFO - Verified pod ctest-pod-81227918 in contrail-api 2025-04-14 15:25:01,061 - DEBUG - VMI 9762548a-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65 2025-04-14 15:25:01,062 - INFO - Verified Pod ctest-pod-81227918 in agent 10.0.0.65 2025-04-14 15:25:01,062 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=0b374156-010b-47c8-b560-d5ab5e7dba3f 2025-04-14 15:25:01,069 - INFO - Pod ctest-pod-81227918 with uuid 0b374156-010b-47c8-b560-d5ab5e7dba3f found in kube manager 2025-04-14 15:25:01,069 - INFO - Pod ctest-pod-81227918 verification passed 2025-04-14 15:25:01,070 - INFO - ================================================================================ 2025-04-14 15:25:01,070 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-14 15:25:01,070 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-14 15:25:01,593 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.65': '0'}} with 2025-04-14 15:25:01,593 - INFO - Initial checks done. Running the testcase now 2025-04-14 15:25:01,593 - INFO - 2025-04-14 15:25:01,638 - DEBUG - [Pod ctest-pod-88384220] Cmd: echo ctest-pod-88384220 > /usr/share/nginx/html/index.html, Output: 2025-04-14 15:25:01,702 - DEBUG - [Pod ctest-pod-21611501] Cmd: echo ctest-pod-21611501 > /usr/share/nginx/html/index.html, Output: 2025-04-14 15:25:01,749 - DEBUG - [Pod ctest-pod-94731379] Cmd: echo ctest-pod-94731379 > /usr/share/nginx/html/index.html, Output: 2025-04-14 15:25:01,810 - DEBUG - [Pod ctest-pod-27739890] Cmd: echo ctest-pod-27739890 > /usr/share/nginx/html/index.html, Output: 2025-04-14 15:25:01,814 - DEBUG - Service ctest-nginx-svc-08817363 not present 2025-04-14 15:25:01,814 - INFO - Creating service ctest-nginx-svc-08817363 2025-04-14 15:25:01,827 - INFO - Created Service ctest-nginx-svc-08817363 2025-04-14 15:25:01,836 - WARNING - Service UUID e1b914dd-68d9-4f54-93a6-599c01540dec not yet found in contrail-api 2025-04-14 15:25:02,843 - WARNING - Service UUID e1b914dd-68d9-4f54-93a6-599c01540dec not yet found in contrail-api 2025-04-14 15:25:03,854 - INFO - Validated that Service ctest-nginx-svc-08817363 is seen in contrail-api 2025-04-14 15:25:03,854 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=e1b914dd-68d9-4f54-93a6-599c01540dec 2025-04-14 15:25:03,859 - INFO - Service ctest-nginx-svc-08817363 with uuid e1b914dd-68d9-4f54-93a6-599c01540dec found in kube manager 2025-04-14 15:25:03,859 - INFO - Service ctest-nginx-svc-08817363 verification passed 2025-04-14 15:25:07,010 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,011 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,011 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,067 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,067 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,068 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,114 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,114 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,114 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,177 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: ctest-pod-21611501 Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,177 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,177 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: ctest-pod-21611501 Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,177 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88384220': 3, 'ctest-pod-21611501': 1} 2025-04-14 15:25:07,230 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout ctest-pod-21611501 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,231 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,231 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout ctest-pod-21611501 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,279 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: ctest-pod-21611501 Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,280 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,280 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: ctest-pod-21611501 Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,326 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout ctest-pod-88384220 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,326 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:25:07,326 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout ctest-pod-88384220 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:25:07,326 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88384220': 1, 'ctest-pod-21611501': 2} 2025-04-14 15:25:07,330 - DEBUG - Network policy ingress-on-service not present 2025-04-14 15:25:07,330 - INFO - Creating Network Policy ingress-on-service 2025-04-14 15:25:07,342 - INFO - Network policy found in k8s 2025-04-14 15:25:07,342 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5db84367-1a6d-42e4-9df3-5305657f0ad2 2025-04-14 15:25:07,348 - INFO - Network Policy ingress-on-service with uuid 5db84367-1a6d-42e4-9df3-5305657f0ad2 found in kube manager 2025-04-14 15:25:07,377 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-14 15:25:07,378 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-14 15:25:07,378 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5db84367-1a6d-42e4-9df3-5305657f0ad2 2025-04-14 15:25:07,406 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 15:25:09,407 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5db84367-1a6d-42e4-9df3-5305657f0ad2 2025-04-14 15:25:09,441 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 15:25:11,442 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5db84367-1a6d-42e4-9df3-5305657f0ad2 2025-04-14 15:25:11,473 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 15:25:13,473 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5db84367-1a6d-42e4-9df3-5305657f0ad2 2025-04-14 15:25:13,504 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-14 15:25:15,506 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5db84367-1a6d-42e4-9df3-5305657f0ad2 2025-04-14 15:25:15,553 - INFO - Network policy with name ingress-on-service found in agent 2025-04-14 15:25:15,554 - INFO - Network Policy ingress-on-service verification passed 2025-04-14 15:25:20,604 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:20,604 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:20,604 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:25,646 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:25,646 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:25,646 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:30,697 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:30,697 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:30,697 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:35,746 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:35,746 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:35,746 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:40,797 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:40,797 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:40,797 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:45,854 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:45,854 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:45,854 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:50,902 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:50,902 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:50,902 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:55,954 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:55,955 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:25:55,955 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:01,001 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:01,001 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:01,001 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:06,064 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:06,064 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:06,064 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:06,064 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88384220': 0, 'ctest-pod-21611501': 0} 2025-04-14 15:26:06,119 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: ctest-pod-21611501 Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:26:06,120 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:26:06,120 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: ctest-pod-21611501 Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:26:06,167 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88384220 2025-04-14 15:26:06,167 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:26:06,167 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88384220 2025-04-14 15:26:06,167 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88384220': 1, 'ctest-pod-21611501': 1} 2025-04-14 15:26:11,211 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:11,212 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:11,212 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:16,259 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:16,259 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:16,259 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:21,307 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:21,307 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:21,307 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:26,354 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:26,354 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:26,354 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:31,399 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:31,399 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:31,399 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:36,449 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:36,449 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:36,449 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:41,499 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:41,500 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:41,500 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:46,544 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:46,544 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:46,544 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:51,592 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:51,593 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:51,593 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:56,635 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:56,636 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:56,636 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:26:56,636 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88384220': 0, 'ctest-pod-21611501': 0} 2025-04-14 15:26:58,681 - DEBUG - [Pod ctest-pod-17920149] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.993 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.086 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.384/0.993 ms 2025-04-14 15:26:58,681 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-17920149 with expectation True passed 2025-04-14 15:27:00,727 - DEBUG - [Pod ctest-pod-11265294] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.184 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.069 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.445/1.184 ms 2025-04-14 15:27:00,727 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-11265294 with expectation True passed 2025-04-14 15:27:02,779 - DEBUG - [Pod ctest-pod-19602946] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.746 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.079 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.303/0.746 ms 2025-04-14 15:27:02,780 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-19602946 with expectation True passed 2025-04-14 15:27:02,827 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:27:02,827 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2025-04-14 15:27:02,827 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:27:02,827 - INFO - wget check of of http://10.47.255.248 from ctest-pod-17920149 passed 2025-04-14 15:27:02,877 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:27:02,877 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2025-04-14 15:27:02,877 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:27:02,877 - INFO - wget check of of http://10.47.255.247 from ctest-pod-17920149 passed 2025-04-14 15:27:07,919 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 15:27:07,919 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 15:27:07,919 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 15:27:07,919 - INFO - wget check of of http://10.47.255.247 from ctest-pod-11265294 passed 2025-04-14 15:27:12,970 - DEBUG - [Pod ctest-pod-81227918] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2025-04-14 15:27:12,970 - DEBUG - [Pod Pod ctest-pod-81227918] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2025-04-14 15:27:12,970 - DEBUG - [Pod Pod ctest-pod-81227918] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2025-04-14 15:27:12,970 - INFO - wget check of of http://10.47.255.248 from ctest-pod-81227918 passed 2025-04-14 15:27:12,981 - INFO - Updating Network Policy ingress-on-service 2025-04-14 15:27:18,041 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:18,041 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:18,041 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:23,087 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:23,087 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:23,087 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:28,132 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:28,133 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:28,133 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:33,186 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:33,186 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:33,186 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:38,235 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:38,235 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:38,236 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:43,291 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:43,291 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:43,291 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:48,349 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:48,350 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:48,350 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:53,397 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:53,397 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:53,397 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:58,450 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:58,451 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:27:58,451 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:28:03,501 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:28:03,501 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:28:03,501 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) wget: download timed out 2025-04-14 15:28:03,501 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88384220': 0, 'ctest-pod-21611501': 0} 2025-04-14 15:28:03,556 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21611501 2025-04-14 15:28:03,556 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:28:03,556 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21611501 2025-04-14 15:28:03,608 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:28:03,608 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:28:03,608 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:28:03,608 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88384220': 1, 'ctest-pod-21611501': 1} 2025-04-14 15:28:03,656 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21611501 2025-04-14 15:28:03,656 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:28:03,656 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21611501 2025-04-14 15:28:03,706 - DEBUG - [Pod ctest-pod-19602946] Cmd: wget http://10.109.199.122:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:28:03,706 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd wget http://10.109.199.122:80/ -O - -T 5 -t 1 passed 2025-04-14 15:28:03,706 - DEBUG - [Pod Pod ctest-pod-19602946] Cmd output: Connecting to 10.109.199.122:80 (10.109.199.122:80) ctest-pod-88384220 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-14 15:28:03,706 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88384220': 1, 'ctest-pod-21611501': 1} 2025-04-14 15:28:05,755 - DEBUG - [Pod ctest-pod-17920149] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=1.149 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.080 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.437/1.149 ms 2025-04-14 15:28:05,755 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-17920149 with expectation True passed 2025-04-14 15:28:07,828 - DEBUG - [Pod ctest-pod-11265294] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.463 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.087 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.208/0.463 ms 2025-04-14 15:28:07,829 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-11265294 with expectation True passed 2025-04-14 15:28:09,878 - DEBUG - [Pod ctest-pod-19602946] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.962 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.096 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.092 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.092/0.383/0.962 ms 2025-04-14 15:28:09,878 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-19602946 with expectation True passed 2025-04-14 15:28:09,928 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:28:09,928 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2025-04-14 15:28:09,928 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:28:09,928 - INFO - wget check of of http://10.47.255.248 from ctest-pod-17920149 passed 2025-04-14 15:28:09,975 - DEBUG - [Pod ctest-pod-17920149] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:28:09,975 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2025-04-14 15:28:09,975 - DEBUG - [Pod Pod ctest-pod-17920149] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:28:09,975 - INFO - wget check of of http://10.47.255.247 from ctest-pod-17920149 passed 2025-04-14 15:28:15,025 - DEBUG - [Pod ctest-pod-11265294] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 15:28:15,026 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 15:28:15,026 - DEBUG - [Pod Pod ctest-pod-11265294] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2025-04-14 15:28:15,026 - INFO - wget check of of http://10.47.255.247 from ctest-pod-11265294 passed 2025-04-14 15:28:15,077 - DEBUG - [Pod ctest-pod-81227918] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:28:15,077 - DEBUG - [Pod Pod ctest-pod-81227918] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2025-04-14 15:28:15,077 - DEBUG - [Pod Pod ctest-pod-81227918] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-14 15:28:15,077 - INFO - wget check of of http://10.47.255.248 from ctest-pod-81227918 passed 2025-04-14 15:28:15,078 - INFO - Deleting Network Policy : ingress-on-service 2025-04-14 15:28:15,078 - INFO - Deleting service : ctest-nginx-svc-08817363 2025-04-14 15:28:15,581 - DEBUG - No XMPP flaps were noticed during the test