2025-02-02 09:14:29,132 - INFO - Using existing project ['default-domain', 'k8s-default'](cfa74a8e-b449-4401-b6d6-a5516652838c) 2025-02-02 09:14:29,157 - DEBUG - Namespace ctest-new-default-83755707 not present 2025-02-02 09:14:29,164 - INFO - Created namespace ctest-new-default-83755707 2025-02-02 09:14:32,169 - DEBUG - Namespace ctest-non-default-55208425 not present 2025-02-02 09:14:32,235 - INFO - Created namespace ctest-non-default-55208425 2025-02-02 09:14:35,255 - DEBUG - Pod ctest-pod-55726333 not present 2025-02-02 09:14:35,256 - INFO - Creating Pod ctest-pod-55726333 2025-02-02 09:14:35,280 - DEBUG - Pod : ctest-pod-55726333 UUID is 0e630868-db82-4596-a820-e7772473609e 2025-02-02 09:14:35,292 - DEBUG - Pod ctest-pod-06787719 not present 2025-02-02 09:14:35,293 - INFO - Creating Pod ctest-pod-06787719 2025-02-02 09:14:35,331 - DEBUG - Pod : ctest-pod-06787719 UUID is 35c4c287-b2be-4b91-bdbd-b9e6675445ea 2025-02-02 09:14:35,336 - DEBUG - Pod ctest-pod-58665646 not present 2025-02-02 09:14:35,337 - INFO - Creating Pod ctest-pod-58665646 2025-02-02 09:14:35,375 - DEBUG - Pod : ctest-pod-58665646 UUID is 91862492-f309-425b-8bc7-fc7935d06ffa 2025-02-02 09:14:35,377 - DEBUG - Pod ctest-pod-93102739 not present 2025-02-02 09:14:35,378 - INFO - Creating Pod ctest-pod-93102739 2025-02-02 09:14:35,419 - DEBUG - Pod : ctest-pod-93102739 UUID is 0da3e244-df2f-4af5-9839-e24608d594c6 2025-02-02 09:14:35,422 - DEBUG - Pod ctest-pod-93026113 not present 2025-02-02 09:14:35,422 - INFO - Creating Pod ctest-pod-93026113 2025-02-02 09:14:35,452 - DEBUG - Pod : ctest-pod-93026113 UUID is f360ca47-08a9-4acb-944b-96a82db50cbe 2025-02-02 09:14:35,461 - DEBUG - Pod ctest-pod-88363424 not present 2025-02-02 09:14:35,461 - INFO - Creating Pod ctest-pod-88363424 2025-02-02 09:14:35,494 - DEBUG - Pod : ctest-pod-88363424 UUID is d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 2025-02-02 09:14:35,498 - DEBUG - Pod ctest-pod-63771810 not present 2025-02-02 09:14:35,498 - INFO - Creating Pod ctest-pod-63771810 2025-02-02 09:14:35,526 - DEBUG - Pod : ctest-pod-63771810 UUID is 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece 2025-02-02 09:14:35,536 - DEBUG - Pod ctest-pod-42322158 not present 2025-02-02 09:14:35,537 - INFO - Creating Pod ctest-pod-42322158 2025-02-02 09:14:35,566 - DEBUG - Pod : ctest-pod-42322158 UUID is 430b6435-e491-476d-a313-afad98951b9c 2025-02-02 09:14:36,180 - INFO - Project default-domain:k8s-ctest-new-default-83755707 for Namespace ctest-new-default-83755707 is seen in contrail-api 2025-02-02 09:14:36,180 - DEBUG - Project uuid in Contrail is afb205e5-c11e-4c0c-b125-6541968eae0d 2025-02-02 09:14:36,355 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=ac0532ca-d967-47bd-b0a4-ba4049abb8ec 2025-02-02 09:14:36,361 - INFO - Namespace ctest-new-default-83755707 with uuid ac0532ca-d967-47bd-b0a4-ba4049abb8ec found in kube manager 2025-02-02 09:14:36,362 - INFO - Namespace ctest-new-default-83755707 verification passed 2025-02-02 09:14:36,783 - INFO - Project default-domain:k8s-ctest-non-default-55208425 for Namespace ctest-non-default-55208425 is seen in contrail-api 2025-02-02 09:14:36,783 - DEBUG - Project uuid in Contrail is 4256f5ee-d252-442e-93bd-f9fe57ad744f 2025-02-02 09:14:36,783 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=56c19769-ae48-4f47-8c7f-1c702056bdfc 2025-02-02 09:14:36,788 - INFO - Namespace ctest-non-default-55208425 with uuid 56c19769-ae48-4f47-8c7f-1c702056bdfc found in kube manager 2025-02-02 09:14:36,788 - INFO - Namespace ctest-non-default-55208425 verification passed 2025-02-02 09:14:36,795 - DEBUG - Pod ctest-pod-55726333 not in running state.Currently in Pending 2025-02-02 09:14:41,802 - DEBUG - Pod ctest-pod-55726333 not in running state.Currently in Pending 2025-02-02 09:14:46,808 - DEBUG - Pod ctest-pod-55726333 not in running state.Currently in Pending 2025-02-02 09:14:51,814 - INFO - Pod ctest-pod-55726333 is in running state.Got IP 10.47.255.251 2025-02-02 09:14:51,827 - DEBUG - Pod ctest-pod-55726333 has vmi 20356c98-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:51,827 - INFO - Verified pod ctest-pod-55726333 in contrail-api 2025-02-02 09:14:51,843 - DEBUG - VMI 20356c98-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:51,844 - INFO - Verified Pod ctest-pod-55726333 in agent 10.0.0.23 2025-02-02 09:14:51,844 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0e630868-db82-4596-a820-e7772473609e 2025-02-02 09:14:51,849 - INFO - Pod ctest-pod-55726333 with uuid 0e630868-db82-4596-a820-e7772473609e found in kube manager 2025-02-02 09:14:51,849 - INFO - Pod ctest-pod-55726333 verification passed 2025-02-02 09:14:51,856 - INFO - Pod ctest-pod-06787719 is in running state.Got IP 10.47.255.250 2025-02-02 09:14:51,912 - DEBUG - Pod ctest-pod-06787719 has vmi 20bb897c-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:51,912 - INFO - Verified pod ctest-pod-06787719 in contrail-api 2025-02-02 09:14:51,927 - DEBUG - VMI 20bb897c-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:51,927 - INFO - Verified Pod ctest-pod-06787719 in agent 10.0.0.23 2025-02-02 09:14:51,927 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=35c4c287-b2be-4b91-bdbd-b9e6675445ea 2025-02-02 09:14:51,933 - INFO - Pod ctest-pod-06787719 with uuid 35c4c287-b2be-4b91-bdbd-b9e6675445ea found in kube manager 2025-02-02 09:14:51,933 - INFO - Pod ctest-pod-06787719 verification passed 2025-02-02 09:14:51,940 - INFO - Pod ctest-pod-58665646 is in running state.Got IP 10.47.255.249 2025-02-02 09:14:51,954 - DEBUG - Pod ctest-pod-58665646 has vmi 21836104-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:51,954 - INFO - Verified pod ctest-pod-58665646 in contrail-api 2025-02-02 09:14:51,970 - DEBUG - VMI 21836104-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:51,970 - INFO - Verified Pod ctest-pod-58665646 in agent 10.0.0.23 2025-02-02 09:14:51,971 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=91862492-f309-425b-8bc7-fc7935d06ffa 2025-02-02 09:14:51,985 - INFO - Pod ctest-pod-58665646 with uuid 91862492-f309-425b-8bc7-fc7935d06ffa found in kube manager 2025-02-02 09:14:51,985 - INFO - Pod ctest-pod-58665646 verification passed 2025-02-02 09:14:51,990 - INFO - Pod ctest-pod-93102739 is in running state.Got IP 10.47.255.248 2025-02-02 09:14:52,051 - DEBUG - Pod ctest-pod-93102739 has vmi 2216ac7a-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:52,051 - INFO - Verified pod ctest-pod-93102739 in contrail-api 2025-02-02 09:14:52,069 - DEBUG - VMI 2216ac7a-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:52,069 - INFO - Verified Pod ctest-pod-93102739 in agent 10.0.0.23 2025-02-02 09:14:52,070 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0da3e244-df2f-4af5-9839-e24608d594c6 2025-02-02 09:14:52,074 - INFO - Pod ctest-pod-93102739 with uuid 0da3e244-df2f-4af5-9839-e24608d594c6 found in kube manager 2025-02-02 09:14:52,074 - INFO - Pod ctest-pod-93102739 verification passed 2025-02-02 09:14:52,079 - DEBUG - Pod ctest-pod-93026113 not in running state.Currently in Pending 2025-02-02 09:14:57,086 - INFO - Pod ctest-pod-93026113 is in running state.Got IP 10.47.255.247 2025-02-02 09:14:57,102 - DEBUG - Pod ctest-pod-93026113 has vmi 22cf7520-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:57,102 - INFO - Verified pod ctest-pod-93026113 in contrail-api 2025-02-02 09:14:57,116 - DEBUG - VMI 22cf7520-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:57,117 - INFO - Verified Pod ctest-pod-93026113 in agent 10.0.0.23 2025-02-02 09:14:57,117 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f360ca47-08a9-4acb-944b-96a82db50cbe 2025-02-02 09:14:57,121 - INFO - Pod ctest-pod-93026113 with uuid f360ca47-08a9-4acb-944b-96a82db50cbe found in kube manager 2025-02-02 09:14:57,121 - INFO - Pod ctest-pod-93026113 verification passed 2025-02-02 09:14:57,134 - INFO - Pod ctest-pod-63771810 is in running state.Got IP 10.47.255.245 2025-02-02 09:14:57,191 - DEBUG - Pod ctest-pod-63771810 has vmi 23fdd6a8-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:57,191 - INFO - Verified pod ctest-pod-63771810 in contrail-api 2025-02-02 09:14:57,206 - DEBUG - VMI 23fdd6a8-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:57,207 - INFO - Verified Pod ctest-pod-63771810 in agent 10.0.0.23 2025-02-02 09:14:57,207 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0f7214f3-b8cb-459c-ad05-9ac05c2d8ece 2025-02-02 09:14:57,211 - INFO - Pod ctest-pod-63771810 with uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece found in kube manager 2025-02-02 09:14:57,212 - INFO - Pod ctest-pod-63771810 verification passed 2025-02-02 09:14:57,216 - INFO - Pod ctest-pod-88363424 is in running state.Got IP 10.47.255.246 2025-02-02 09:14:57,229 - DEBUG - Pod ctest-pod-88363424 has vmi 235c6c50-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:57,229 - INFO - Verified pod ctest-pod-88363424 in contrail-api 2025-02-02 09:14:57,245 - DEBUG - VMI 235c6c50-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:57,245 - INFO - Verified Pod ctest-pod-88363424 in agent 10.0.0.23 2025-02-02 09:14:57,245 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 2025-02-02 09:14:57,250 - INFO - Pod ctest-pod-88363424 with uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 found in kube manager 2025-02-02 09:14:57,250 - INFO - Pod ctest-pod-88363424 verification passed 2025-02-02 09:14:57,255 - INFO - Pod ctest-pod-42322158 is in running state.Got IP 10.47.255.244 2025-02-02 09:14:57,312 - DEBUG - Pod ctest-pod-42322158 has vmi 248d0a1c-e146-11ef-b43f-fa163e2d0b2f 2025-02-02 09:14:57,312 - INFO - Verified pod ctest-pod-42322158 in contrail-api 2025-02-02 09:14:57,326 - DEBUG - VMI 248d0a1c-e146-11ef-b43f-fa163e2d0b2f is active in agent 10.0.0.23 2025-02-02 09:14:57,327 - INFO - Verified Pod ctest-pod-42322158 in agent 10.0.0.23 2025-02-02 09:14:57,327 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=430b6435-e491-476d-a313-afad98951b9c 2025-02-02 09:14:57,331 - INFO - Pod ctest-pod-42322158 with uuid 430b6435-e491-476d-a313-afad98951b9c found in kube manager 2025-02-02 09:14:57,331 - INFO - Pod ctest-pod-42322158 verification passed 2025-02-02 09:14:57,331 - INFO - ================================================================================ 2025-02-02 09:14:57,331 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-02-02 09:14:57,331 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-02-02 09:14:57,602 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.22': '0'}} with 2025-02-02 09:14:57,602 - INFO - Initial checks done. Running the testcase now 2025-02-02 09:14:57,602 - INFO - 2025-02-02 09:14:57,665 - DEBUG - [Pod ctest-pod-55726333] Cmd: echo ctest-pod-55726333 > /usr/share/nginx/html/index.html, Output: 2025-02-02 09:14:57,755 - DEBUG - [Pod ctest-pod-06787719] Cmd: echo ctest-pod-06787719 > /usr/share/nginx/html/index.html, Output: 2025-02-02 09:14:57,812 - DEBUG - [Pod ctest-pod-58665646] Cmd: echo ctest-pod-58665646 > /usr/share/nginx/html/index.html, Output: 2025-02-02 09:14:57,884 - DEBUG - [Pod ctest-pod-93102739] Cmd: echo ctest-pod-93102739 > /usr/share/nginx/html/index.html, Output: 2025-02-02 09:14:57,887 - DEBUG - Service ctest-nginx-svc-18797779 not present 2025-02-02 09:14:57,887 - INFO - Creating service ctest-nginx-svc-18797779 2025-02-02 09:14:57,899 - INFO - Created Service ctest-nginx-svc-18797779 2025-02-02 09:14:57,908 - WARNING - Service UUID b760232c-fa08-4994-9a50-ca451fd01b4f not yet found in contrail-api 2025-02-02 09:14:58,925 - INFO - Validated that Service ctest-nginx-svc-18797779 is seen in contrail-api 2025-02-02 09:14:58,926 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=b760232c-fa08-4994-9a50-ca451fd01b4f 2025-02-02 09:14:58,930 - INFO - Service ctest-nginx-svc-18797779 with uuid b760232c-fa08-4994-9a50-ca451fd01b4f found in kube manager 2025-02-02 09:14:58,930 - INFO - Service ctest-nginx-svc-18797779 verification passed 2025-02-02 09:15:00,008 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55726333 2025-02-02 09:15:00,009 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:15:00,009 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55726333 2025-02-02 09:15:00,067 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:00,067 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:15:00,067 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:00,067 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55726333': 1, 'ctest-pod-06787719': 1} 2025-02-02 09:15:00,113 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55726333 2025-02-02 09:15:00,113 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:15:00,113 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55726333 2025-02-02 09:15:00,186 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:00,186 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:15:00,186 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:00,186 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55726333': 1, 'ctest-pod-06787719': 1} 2025-02-02 09:15:00,190 - DEBUG - Network policy ingress-on-service not present 2025-02-02 09:15:00,258 - INFO - Creating Network Policy ingress-on-service 2025-02-02 09:15:00,271 - INFO - Network policy found in k8s 2025-02-02 09:15:00,271 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=636cc2eb-86ee-426e-a6c5-4951958b1db1 2025-02-02 09:15:00,278 - INFO - Network Policy ingress-on-service with uuid 636cc2eb-86ee-426e-a6c5-4951958b1db1 found in kube manager 2025-02-02 09:15:00,315 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-02-02 09:15:00,316 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-02-02 09:15:00,316 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=636cc2eb-86ee-426e-a6c5-4951958b1db1 2025-02-02 09:15:00,348 - WARNING - Network policy with name ingress-on-service not found in agent 2025-02-02 09:15:02,350 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=636cc2eb-86ee-426e-a6c5-4951958b1db1 2025-02-02 09:15:02,389 - INFO - Network policy with name ingress-on-service found in agent 2025-02-02 09:15:02,389 - INFO - Network Policy ingress-on-service verification passed 2025-02-02 09:15:07,455 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:07,455 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:07,455 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:12,523 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:12,523 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:12,523 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:17,592 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:17,593 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:17,593 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:22,658 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:22,658 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:22,658 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:27,740 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:27,740 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:27,740 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:32,802 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:32,802 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:32,802 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:37,865 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:37,865 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:37,865 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:42,927 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:42,927 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:42,927 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:48,000 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:48,000 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:48,000 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:53,071 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:53,071 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:53,071 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:53,072 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-55726333': 0, 'ctest-pod-06787719': 0} 2025-02-02 09:15:53,137 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:53,137 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:15:53,137 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:53,199 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-55726333 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:53,200 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:15:53,200 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: ctest-pod-55726333 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:15:53,200 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55726333': 1, 'ctest-pod-06787719': 1} 2025-02-02 09:15:58,269 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:58,269 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:15:58,269 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:03,323 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:03,323 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:03,323 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:08,381 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:08,381 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:08,381 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:13,442 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:13,442 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:13,442 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:18,499 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:18,500 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:18,500 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:23,556 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:23,557 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:23,557 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:28,618 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:28,618 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:28,618 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:33,670 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:33,670 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:33,670 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:38,741 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:38,741 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:38,741 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:43,801 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:43,801 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:43,802 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:16:43,802 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-55726333': 0, 'ctest-pod-06787719': 0} 2025-02-02 09:16:45,873 - DEBUG - [Pod ctest-pod-88363424] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.610 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.124 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.268/0.610 ms 2025-02-02 09:16:45,874 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-88363424 with expectation True passed 2025-02-02 09:16:47,948 - DEBUG - [Pod ctest-pod-93026113] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.658 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.606/1.658 ms 2025-02-02 09:16:47,948 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93026113 with expectation True passed 2025-02-02 09:16:50,017 - DEBUG - [Pod ctest-pod-63771810] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.893 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.352/0.893 ms 2025-02-02 09:16:50,017 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63771810 with expectation True passed 2025-02-02 09:16:50,092 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:16:50,092 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-02 09:16:50,092 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:16:50,092 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88363424 passed 2025-02-02 09:16:50,161 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:16:50,161 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-02 09:16:50,161 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:16:50,161 - INFO - wget check of of http://10.47.255.250 from ctest-pod-88363424 passed 2025-02-02 09:16:55,226 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-02 09:16:55,226 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-02 09:16:55,226 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-02 09:16:55,226 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93026113 passed 2025-02-02 09:17:00,284 - DEBUG - [Pod ctest-pod-42322158] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-02 09:17:00,284 - DEBUG - [Pod Pod ctest-pod-42322158] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-02 09:17:00,284 - DEBUG - [Pod Pod ctest-pod-42322158] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-02 09:17:00,284 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42322158 passed 2025-02-02 09:17:00,291 - INFO - Updating Network Policy ingress-on-service 2025-02-02 09:17:05,369 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:05,370 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:05,370 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:10,435 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:10,435 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:10,435 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:15,493 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:15,493 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:15,493 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:20,556 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:20,557 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:20,557 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:25,631 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:25,631 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:25,631 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:30,682 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:30,682 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:30,683 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:35,755 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:35,755 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:35,755 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:40,813 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:40,813 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:40,813 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:45,861 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:45,862 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:45,862 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:50,913 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:50,914 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:50,914 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) wget: download timed out 2025-02-02 09:17:50,914 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-55726333': 0, 'ctest-pod-06787719': 0} 2025-02-02 09:17:50,968 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:17:50,968 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:17:50,968 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:17:51,047 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55726333 2025-02-02 09:17:51,047 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:17:51,047 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55726333 2025-02-02 09:17:51,048 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55726333': 1, 'ctest-pod-06787719': 1} 2025-02-02 09:17:51,102 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:17:51,102 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:17:51,102 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: ctest-pod-06787719 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:17:51,165 - DEBUG - [Pod ctest-pod-63771810] Cmd: wget http://10.107.186.237:80/ -O - -T 5 -t 1 , Output: ctest-pod-55726333 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:17:51,165 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd wget http://10.107.186.237:80/ -O - -T 5 -t 1 passed 2025-02-02 09:17:51,165 - DEBUG - [Pod Pod ctest-pod-63771810] Cmd output: ctest-pod-55726333 Connecting to 10.107.186.237:80 (10.107.186.237:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-02 09:17:51,165 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55726333': 1, 'ctest-pod-06787719': 1} 2025-02-02 09:17:53,214 - DEBUG - [Pod ctest-pod-88363424] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.849 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.334/0.849 ms 2025-02-02 09:17:53,214 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-88363424 with expectation True passed 2025-02-02 09:17:55,271 - DEBUG - [Pod ctest-pod-93026113] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.636 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.094/0.613/1.636 ms 2025-02-02 09:17:55,271 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93026113 with expectation True passed 2025-02-02 09:17:57,342 - DEBUG - [Pod ctest-pod-63771810] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.087 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.417/1.087 ms 2025-02-02 09:17:57,342 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63771810 with expectation True passed 2025-02-02 09:17:57,411 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:17:57,411 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-02 09:17:57,411 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:17:57,411 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88363424 passed 2025-02-02 09:17:57,470 - DEBUG - [Pod ctest-pod-88363424] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:17:57,470 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-02 09:17:57,470 - DEBUG - [Pod Pod ctest-pod-88363424] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:17:57,470 - INFO - wget check of of http://10.47.255.250 from ctest-pod-88363424 passed 2025-02-02 09:18:02,534 - DEBUG - [Pod ctest-pod-93026113] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-02 09:18:02,534 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-02 09:18:02,534 - DEBUG - [Pod Pod ctest-pod-93026113] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-02 09:18:02,534 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93026113 passed 2025-02-02 09:18:02,603 - DEBUG - [Pod ctest-pod-42322158] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:18:02,604 - DEBUG - [Pod Pod ctest-pod-42322158] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-02 09:18:02,604 - DEBUG - [Pod Pod ctest-pod-42322158] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-02 09:18:02,604 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42322158 passed 2025-02-02 09:18:02,604 - INFO - Deleting Network Policy : ingress-on-service 2025-02-02 09:18:02,604 - INFO - Deleting service : ctest-nginx-svc-18797779 2025-02-02 09:18:02,836 - DEBUG - No XMPP flaps were noticed during the test 2025-02-02 09:18:02,836 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05] 2025-02-02 09:18:02,836 - INFO - -------------------------------------------------------------------------------- 2025-02-02 09:18:02,848 - INFO - Deleting pod ctest-new-default-83755707:ctest-pod-55726333 2025-02-02 09:18:02,849 - INFO - Deleting pod ctest-new-default-83755707:ctest-pod-06787719 2025-02-02 09:18:02,849 - INFO - Deleting pod ctest-non-default-55208425:ctest-pod-58665646 2025-02-02 09:18:02,849 - INFO - Deleting pod ctest-non-default-55208425:ctest-pod-93102739 2025-02-02 09:18:02,850 - INFO - Deleting pod ctest-new-default-83755707:ctest-pod-93026113 2025-02-02 09:18:02,850 - INFO - Deleting pod ctest-new-default-83755707:ctest-pod-88363424 2025-02-02 09:18:02,850 - INFO - Deleting pod ctest-non-default-55208425:ctest-pod-63771810 2025-02-02 09:18:02,851 - INFO - Deleting pod ctest-non-default-55208425:ctest-pod-42322158 2025-02-02 09:18:02,957 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,002 - WARNING - Pod uuid 0e630868-db82-4596-a820-e7772473609e is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,004 - WARNING - Pod uuid 35c4c287-b2be-4b91-bdbd-b9e6675445ea is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,005 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,005 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,005 - WARNING - Pod uuid 91862492-f309-425b-8bc7-fc7935d06ffa is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,005 - WARNING - Pod uuid 0da3e244-df2f-4af5-9839-e24608d594c6 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:03,006 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:07,966 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:08,021 - DEBUG - Pod 0e630868-db82-4596-a820-e7772473609e is not in agent 10.0.0.23 VM list 2025-02-02 09:18:08,043 - DEBUG - VMI 20356c98-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:08,043 - INFO - Verified that pod ctest-pod-55726333 is removed in agent 2025-02-02 09:18:08,044 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:08,044 - DEBUG - Pod 0da3e244-df2f-4af5-9839-e24608d594c6 is not in agent 10.0.0.23 VM list 2025-02-02 09:18:08,045 - DEBUG - Pod 91862492-f309-425b-8bc7-fc7935d06ffa is not in agent 10.0.0.23 VM list 2025-02-02 09:18:08,047 - DEBUG - Pod 35c4c287-b2be-4b91-bdbd-b9e6675445ea is not in agent 10.0.0.23 VM list 2025-02-02 09:18:08,048 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:08,050 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:08,060 - DEBUG - VMI 21836104-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:08,060 - INFO - Verified that pod ctest-pod-58665646 is removed in agent 2025-02-02 09:18:08,061 - DEBUG - VMI 2216ac7a-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:08,061 - INFO - Verified that pod ctest-pod-93102739 is removed in agent 2025-02-02 09:18:08,061 - DEBUG - VMI 20bb897c-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:08,062 - INFO - Verified that pod ctest-pod-06787719 is removed in agent 2025-02-02 09:18:12,974 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:13,054 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:13,061 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:13,063 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:17,985 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:18,065 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:18,074 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:18,075 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:22,994 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:23,074 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:23,085 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:23,086 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:28,004 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:28,083 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:28,100 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:28,100 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:33,027 - WARNING - Pod uuid 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:33,091 - WARNING - Pod uuid d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:33,112 - WARNING - Pod uuid 430b6435-e491-476d-a313-afad98951b9c is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:33,112 - WARNING - Pod uuid f360ca47-08a9-4acb-944b-96a82db50cbe is still seen in agent 10.0.0.23 VM list 2025-02-02 09:18:38,036 - DEBUG - Pod 0f7214f3-b8cb-459c-ad05-9ac05c2d8ece is not in agent 10.0.0.23 VM list 2025-02-02 09:18:38,044 - DEBUG - VMI 23fdd6a8-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:38,044 - INFO - Verified that pod ctest-pod-63771810 is removed in agent 2025-02-02 09:18:38,100 - DEBUG - Pod d1b168a1-e90f-4eca-a0bb-ecfadd63acd0 is not in agent 10.0.0.23 VM list 2025-02-02 09:18:38,107 - DEBUG - VMI 235c6c50-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:38,107 - INFO - Verified that pod ctest-pod-88363424 is removed in agent 2025-02-02 09:18:38,124 - DEBUG - Pod f360ca47-08a9-4acb-944b-96a82db50cbe is not in agent 10.0.0.23 VM list 2025-02-02 09:18:38,126 - DEBUG - Pod 430b6435-e491-476d-a313-afad98951b9c is not in agent 10.0.0.23 VM list 2025-02-02 09:18:38,136 - DEBUG - VMI 22cf7520-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:38,136 - INFO - Verified that pod ctest-pod-93026113 is removed in agent 2025-02-02 09:18:38,137 - DEBUG - VMI 248d0a1c-e146-11ef-b43f-fa163e2d0b2f is removed from agent 10.0.0.23 2025-02-02 09:18:38,137 - INFO - Verified that pod ctest-pod-42322158 is removed in agent 2025-02-02 09:18:38,137 - INFO - Deleting namespace ctest-non-default-55208425 2025-02-02 09:18:38,153 - DEBUG - Namespace ctest-non-default-55208425 still in k8s 2025-02-02 09:18:40,162 - DEBUG - Namespace ctest-non-default-55208425 still in k8s 2025-02-02 09:18:42,167 - DEBUG - Namespace ctest-non-default-55208425 still in k8s 2025-02-02 09:18:44,172 - DEBUG - Namespace ctest-non-default-55208425 is not in k8s 2025-02-02 09:18:44,172 - DEBUG - No need to check project deletion in contrail-api 2025-02-02 09:18:44,172 - INFO - Deleting namespace ctest-new-default-83755707 2025-02-02 09:18:44,186 - DEBUG - Namespace ctest-new-default-83755707 still in k8s 2025-02-02 09:18:46,192 - DEBUG - Namespace ctest-new-default-83755707 still in k8s 2025-02-02 09:18:48,197 - DEBUG - Namespace ctest-new-default-83755707 still in k8s 2025-02-02 09:18:50,201 - DEBUG - Namespace ctest-new-default-83755707 is not in k8s 2025-02-02 09:18:50,201 - DEBUG - No need to check project deletion in contrail-api