2025-01-13 08:58:33,705 - INFO - Using existing project ['default-domain', 'k8s-default'](152c743c-8e32-4b42-ae68-5adac05c1cf1) 2025-01-13 08:58:33,725 - DEBUG - Namespace ctest-new-default-33886601 not present 2025-01-13 08:58:33,736 - INFO - Created namespace ctest-new-default-33886601 2025-01-13 08:58:36,742 - DEBUG - Namespace ctest-non-default-68440812 not present 2025-01-13 08:58:36,750 - INFO - Created namespace ctest-non-default-68440812 2025-01-13 08:58:39,783 - DEBUG - Pod ctest-pod-88754425 not present 2025-01-13 08:58:39,783 - INFO - Creating Pod ctest-pod-88754425 2025-01-13 08:58:39,834 - DEBUG - Pod : ctest-pod-88754425 UUID is 98b3604e-4381-4a87-b433-a36250a53972 2025-01-13 08:58:39,840 - DEBUG - Pod ctest-pod-63026385 not present 2025-01-13 08:58:39,841 - INFO - Creating Pod ctest-pod-63026385 2025-01-13 08:58:39,875 - DEBUG - Pod : ctest-pod-63026385 UUID is 6165451d-f9de-4da3-8559-b1b70468c73c 2025-01-13 08:58:39,882 - DEBUG - Pod ctest-pod-07266403 not present 2025-01-13 08:58:39,887 - INFO - Creating Pod ctest-pod-07266403 2025-01-13 08:58:39,938 - DEBUG - Pod : ctest-pod-07266403 UUID is 99228942-9929-48c4-8a98-03e2fc30aa3e 2025-01-13 08:58:39,944 - DEBUG - Pod ctest-pod-11247131 not present 2025-01-13 08:58:39,944 - INFO - Creating Pod ctest-pod-11247131 2025-01-13 08:58:39,968 - DEBUG - Pod : ctest-pod-11247131 UUID is 608134ae-ab62-4a19-99eb-5ff2d3e02587 2025-01-13 08:58:39,973 - DEBUG - Pod ctest-pod-12496114 not present 2025-01-13 08:58:39,973 - INFO - Creating Pod ctest-pod-12496114 2025-01-13 08:58:39,996 - DEBUG - Pod : ctest-pod-12496114 UUID is c2fe1572-e013-49da-8c7c-8b57729a4e58 2025-01-13 08:58:40,006 - DEBUG - Pod ctest-pod-51155664 not present 2025-01-13 08:58:40,006 - INFO - Creating Pod ctest-pod-51155664 2025-01-13 08:58:40,035 - DEBUG - Pod : ctest-pod-51155664 UUID is 92355a70-c9ae-4479-a942-7544986b88c7 2025-01-13 08:58:40,042 - DEBUG - Pod ctest-pod-84764349 not present 2025-01-13 08:58:40,042 - INFO - Creating Pod ctest-pod-84764349 2025-01-13 08:58:40,084 - DEBUG - Pod : ctest-pod-84764349 UUID is d6c2b58a-02d5-4741-84d3-a43f683676ad 2025-01-13 08:58:40,087 - DEBUG - Pod ctest-pod-09589848 not present 2025-01-13 08:58:40,087 - INFO - Creating Pod ctest-pod-09589848 2025-01-13 08:58:40,109 - DEBUG - Pod : ctest-pod-09589848 UUID is d1f9ee49-382e-4329-bfca-ed9ca129890f 2025-01-13 08:58:40,460 - INFO - Project default-domain:k8s-ctest-new-default-33886601 for Namespace ctest-new-default-33886601 is seen in contrail-api 2025-01-13 08:58:40,461 - DEBUG - Project uuid in Contrail is 5d012c8a-4e7a-408b-b199-3af6fa534e14 2025-01-13 08:58:40,670 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=dd21cbb0-979c-4bf4-95a5-d42d30a51200 2025-01-13 08:58:40,677 - INFO - Namespace ctest-new-default-33886601 with uuid dd21cbb0-979c-4bf4-95a5-d42d30a51200 found in kube manager 2025-01-13 08:58:40,677 - INFO - Namespace ctest-new-default-33886601 verification passed 2025-01-13 08:58:40,978 - INFO - Project default-domain:k8s-ctest-non-default-68440812 for Namespace ctest-non-default-68440812 is seen in contrail-api 2025-01-13 08:58:40,978 - DEBUG - Project uuid in Contrail is 0a926b14-3f53-4887-8860-504cc1381b05 2025-01-13 08:58:40,978 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=02d0ddd8-24f5-4208-a307-14bd911a8deb 2025-01-13 08:58:40,984 - INFO - Namespace ctest-non-default-68440812 with uuid 02d0ddd8-24f5-4208-a307-14bd911a8deb found in kube manager 2025-01-13 08:58:40,985 - INFO - Namespace ctest-non-default-68440812 verification passed 2025-01-13 08:58:40,991 - DEBUG - Pod ctest-pod-88754425 not in running state.Currently in Pending 2025-01-13 08:58:45,999 - DEBUG - Pod ctest-pod-88754425 not in running state.Currently in Pending 2025-01-13 08:58:51,009 - DEBUG - Pod ctest-pod-88754425 not in running state.Currently in Pending 2025-01-13 08:58:56,033 - INFO - Pod ctest-pod-88754425 is in running state.Got IP 10.47.255.251 2025-01-13 08:58:56,053 - DEBUG - Pod ctest-pod-88754425 has vmi 96669348-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:58:56,053 - INFO - Verified pod ctest-pod-88754425 in contrail-api 2025-01-13 08:58:56,071 - DEBUG - VMI 96669348-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:58:56,071 - INFO - Verified Pod ctest-pod-88754425 in agent 10.0.0.12 2025-01-13 08:58:56,071 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=98b3604e-4381-4a87-b433-a36250a53972 2025-01-13 08:58:56,076 - INFO - Pod ctest-pod-88754425 with uuid 98b3604e-4381-4a87-b433-a36250a53972 found in kube manager 2025-01-13 08:58:56,076 - INFO - Pod ctest-pod-88754425 verification passed 2025-01-13 08:58:56,082 - INFO - Pod ctest-pod-63026385 is in running state.Got IP 10.47.255.250 2025-01-13 08:58:56,138 - DEBUG - Pod ctest-pod-63026385 has vmi 96f40e1c-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:58:56,138 - INFO - Verified pod ctest-pod-63026385 in contrail-api 2025-01-13 08:58:56,154 - DEBUG - VMI 96f40e1c-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:58:56,154 - INFO - Verified Pod ctest-pod-63026385 in agent 10.0.0.12 2025-01-13 08:58:56,154 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=6165451d-f9de-4da3-8559-b1b70468c73c 2025-01-13 08:58:56,159 - INFO - Pod ctest-pod-63026385 with uuid 6165451d-f9de-4da3-8559-b1b70468c73c found in kube manager 2025-01-13 08:58:56,159 - INFO - Pod ctest-pod-63026385 verification passed 2025-01-13 08:58:56,166 - INFO - Pod ctest-pod-07266403 is in running state.Got IP 10.47.255.249 2025-01-13 08:58:56,184 - DEBUG - Pod ctest-pod-07266403 has vmi 97ace61c-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:58:56,184 - INFO - Verified pod ctest-pod-07266403 in contrail-api 2025-01-13 08:58:56,200 - DEBUG - VMI 97ace61c-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:58:56,200 - INFO - Verified Pod ctest-pod-07266403 in agent 10.0.0.12 2025-01-13 08:58:56,200 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=99228942-9929-48c4-8a98-03e2fc30aa3e 2025-01-13 08:58:56,205 - INFO - Pod ctest-pod-07266403 with uuid 99228942-9929-48c4-8a98-03e2fc30aa3e found in kube manager 2025-01-13 08:58:56,205 - INFO - Pod ctest-pod-07266403 verification passed 2025-01-13 08:58:56,211 - INFO - Pod ctest-pod-11247131 is in running state.Got IP 10.47.255.248 2025-01-13 08:58:56,271 - DEBUG - Pod ctest-pod-11247131 has vmi 982f6574-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:58:56,271 - INFO - Verified pod ctest-pod-11247131 in contrail-api 2025-01-13 08:58:56,287 - DEBUG - VMI 982f6574-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:58:56,287 - INFO - Verified Pod ctest-pod-11247131 in agent 10.0.0.12 2025-01-13 08:58:56,288 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=608134ae-ab62-4a19-99eb-5ff2d3e02587 2025-01-13 08:58:56,292 - INFO - Pod ctest-pod-11247131 with uuid 608134ae-ab62-4a19-99eb-5ff2d3e02587 found in kube manager 2025-01-13 08:58:56,292 - INFO - Pod ctest-pod-11247131 verification passed 2025-01-13 08:58:56,298 - DEBUG - Pod ctest-pod-12496114 not in running state.Currently in Pending 2025-01-13 08:59:01,307 - INFO - Pod ctest-pod-12496114 is in running state.Got IP 10.47.255.247 2025-01-13 08:59:01,327 - DEBUG - Pod ctest-pod-12496114 has vmi 98c85a18-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:59:01,327 - INFO - Verified pod ctest-pod-12496114 in contrail-api 2025-01-13 08:59:01,342 - DEBUG - VMI 98c85a18-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:59:01,343 - INFO - Verified Pod ctest-pod-12496114 in agent 10.0.0.12 2025-01-13 08:59:01,343 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=c2fe1572-e013-49da-8c7c-8b57729a4e58 2025-01-13 08:59:01,348 - INFO - Pod ctest-pod-12496114 with uuid c2fe1572-e013-49da-8c7c-8b57729a4e58 found in kube manager 2025-01-13 08:59:01,348 - INFO - Pod ctest-pod-12496114 verification passed 2025-01-13 08:59:01,430 - INFO - Pod ctest-pod-84764349 is in running state.Got IP 10.47.255.245 2025-01-13 08:59:01,486 - DEBUG - Pod ctest-pod-84764349 has vmi 99ca19ce-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:59:01,486 - INFO - Verified pod ctest-pod-84764349 in contrail-api 2025-01-13 08:59:01,501 - DEBUG - VMI 99ca19ce-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:59:01,501 - INFO - Verified Pod ctest-pod-84764349 in agent 10.0.0.12 2025-01-13 08:59:01,501 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=d6c2b58a-02d5-4741-84d3-a43f683676ad 2025-01-13 08:59:01,506 - INFO - Pod ctest-pod-84764349 with uuid d6c2b58a-02d5-4741-84d3-a43f683676ad found in kube manager 2025-01-13 08:59:01,506 - INFO - Pod ctest-pod-84764349 verification passed 2025-01-13 08:59:01,512 - INFO - Pod ctest-pod-51155664 is in running state.Got IP 10.47.255.246 2025-01-13 08:59:01,530 - DEBUG - Pod ctest-pod-51155664 has vmi 994f30c4-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:59:01,530 - INFO - Verified pod ctest-pod-51155664 in contrail-api 2025-01-13 08:59:01,547 - DEBUG - VMI 994f30c4-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:59:01,547 - INFO - Verified Pod ctest-pod-51155664 in agent 10.0.0.12 2025-01-13 08:59:01,547 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=92355a70-c9ae-4479-a942-7544986b88c7 2025-01-13 08:59:01,552 - INFO - Pod ctest-pod-51155664 with uuid 92355a70-c9ae-4479-a942-7544986b88c7 found in kube manager 2025-01-13 08:59:01,552 - INFO - Pod ctest-pod-51155664 verification passed 2025-01-13 08:59:01,558 - INFO - Pod ctest-pod-09589848 is in running state.Got IP 10.47.255.244 2025-01-13 08:59:01,615 - DEBUG - Pod ctest-pod-09589848 has vmi 9a83d36e-d18c-11ef-85f7-fa163ec3ad3b 2025-01-13 08:59:01,616 - INFO - Verified pod ctest-pod-09589848 in contrail-api 2025-01-13 08:59:01,633 - DEBUG - VMI 9a83d36e-d18c-11ef-85f7-fa163ec3ad3b is active in agent 10.0.0.12 2025-01-13 08:59:01,634 - INFO - Verified Pod ctest-pod-09589848 in agent 10.0.0.12 2025-01-13 08:59:01,634 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=d1f9ee49-382e-4329-bfca-ed9ca129890f 2025-01-13 08:59:01,639 - INFO - Pod ctest-pod-09589848 with uuid d1f9ee49-382e-4329-bfca-ed9ca129890f found in kube manager 2025-01-13 08:59:01,639 - INFO - Pod ctest-pod-09589848 verification passed 2025-01-13 08:59:01,639 - INFO - ================================================================================ 2025-01-13 08:59:01,639 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-13 08:59:01,639 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-13 08:59:01,932 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.17': '0'}} with 2025-01-13 08:59:01,932 - INFO - Initial checks done. Running the testcase now 2025-01-13 08:59:01,932 - INFO - 2025-01-13 08:59:02,004 - DEBUG - [Pod ctest-pod-88754425] Cmd: echo ctest-pod-88754425 > /usr/share/nginx/html/index.html, Output: 2025-01-13 08:59:02,066 - DEBUG - [Pod ctest-pod-63026385] Cmd: echo ctest-pod-63026385 > /usr/share/nginx/html/index.html, Output: 2025-01-13 08:59:02,123 - DEBUG - [Pod ctest-pod-07266403] Cmd: echo ctest-pod-07266403 > /usr/share/nginx/html/index.html, Output: 2025-01-13 08:59:02,195 - DEBUG - [Pod ctest-pod-11247131] Cmd: echo ctest-pod-11247131 > /usr/share/nginx/html/index.html, Output: 2025-01-13 08:59:02,199 - DEBUG - Service ctest-nginx-svc-32046691 not present 2025-01-13 08:59:02,200 - INFO - Creating service ctest-nginx-svc-32046691 2025-01-13 08:59:02,223 - INFO - Created Service ctest-nginx-svc-32046691 2025-01-13 08:59:02,244 - WARNING - Service UUID bc441068-c318-4259-956b-9e88dbd66be9 not yet found in contrail-api 2025-01-13 08:59:03,254 - INFO - Validated that Service ctest-nginx-svc-32046691 is seen in contrail-api 2025-01-13 08:59:03,254 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_LoadbalancerDatabaseList?x=bc441068-c318-4259-956b-9e88dbd66be9 2025-01-13 08:59:03,262 - INFO - Service ctest-nginx-svc-32046691 with uuid bc441068-c318-4259-956b-9e88dbd66be9 found in kube manager 2025-01-13 08:59:03,262 - INFO - Service ctest-nginx-svc-32046691 verification passed 2025-01-13 08:59:04,363 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) ctest-pod-63026385 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,363 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,363 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) ctest-pod-63026385 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,426 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) ctest-pod-63026385 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,426 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,426 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) ctest-pod-63026385 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,481 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 08:59:04,481 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,481 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 08:59:04,481 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88754425': 1, 'ctest-pod-63026385': 2} 2025-01-13 08:59:04,546 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,546 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,546 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,595 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,595 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,595 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,652 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,652 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,652 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,705 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,705 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,705 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,758 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,758 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,759 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,835 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,835 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:04,835 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:04,835 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88754425': 5, 'ctest-pod-63026385': 1} 2025-01-13 08:59:04,839 - DEBUG - Network policy ingress-on-service not present 2025-01-13 08:59:04,840 - INFO - Creating Network Policy ingress-on-service 2025-01-13 08:59:04,859 - INFO - Network policy found in k8s 2025-01-13 08:59:04,860 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cf8abb82-bca9-4196-8336-bb36bc44d01a 2025-01-13 08:59:04,866 - INFO - Network Policy ingress-on-service with uuid cf8abb82-bca9-4196-8336-bb36bc44d01a found in kube manager 2025-01-13 08:59:04,900 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-13 08:59:04,900 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-13 08:59:04,900 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cf8abb82-bca9-4196-8336-bb36bc44d01a 2025-01-13 08:59:04,936 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-13 08:59:06,937 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cf8abb82-bca9-4196-8336-bb36bc44d01a 2025-01-13 08:59:06,980 - INFO - Network policy with name ingress-on-service found in agent 2025-01-13 08:59:06,980 - INFO - Network Policy ingress-on-service verification passed 2025-01-13 08:59:12,047 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:12,047 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:12,047 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:17,108 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:17,108 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:17,108 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:22,170 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:22,170 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:22,170 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:27,238 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:27,238 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:27,238 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:32,305 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:32,306 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:32,306 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:37,360 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:37,360 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:37,360 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:42,417 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:42,417 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:42,417 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:47,479 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:47,479 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:47,479 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:52,534 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:52,534 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:52,534 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:57,605 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:57,605 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:57,605 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 08:59:57,605 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88754425': 0, 'ctest-pod-63026385': 0} 2025-01-13 08:59:57,671 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:57,671 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:57,671 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:57,743 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 08:59:57,743 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:57,743 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 08:59:57,800 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:57,801 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:57,801 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:57,863 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:57,864 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 08:59:57,864 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 08:59:57,864 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88754425': 3, 'ctest-pod-63026385': 1} 2025-01-13 09:00:02,928 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:02,928 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:02,928 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:07,986 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:07,986 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:07,986 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:10,795 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-13 09:00:20,863 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:20,863 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:20,864 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:25,930 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:25,931 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:25,931 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:30,982 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:30,982 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:30,982 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:36,050 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:36,050 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:36,050 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:41,114 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:41,115 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:41,115 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:46,175 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:46,175 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:46,175 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:51,247 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:51,248 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:51,248 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:56,305 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:56,305 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:56,305 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:00:56,305 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88754425': 0, 'ctest-pod-63026385': 0} 2025-01-13 09:00:58,396 - DEBUG - [Pod ctest-pod-51155664] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.913 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.364/0.913 ms 2025-01-13 09:00:58,396 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-51155664 with expectation True passed 2025-01-13 09:01:00,448 - DEBUG - [Pod ctest-pod-12496114] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.653 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.101 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.092/0.282/0.653 ms 2025-01-13 09:01:00,448 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12496114 with expectation True passed 2025-01-13 09:01:02,519 - DEBUG - [Pod ctest-pod-84764349] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.562 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.064 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.064/0.233/0.562 ms 2025-01-13 09:01:02,519 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84764349 with expectation True passed 2025-01-13 09:01:02,579 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:01:02,579 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-13 09:01:02,579 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:01:02,580 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51155664 passed 2025-01-13 09:01:02,627 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:01:02,628 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-13 09:01:02,628 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:01:02,628 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51155664 passed 2025-01-13 09:01:07,686 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-13 09:01:07,686 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-13 09:01:07,686 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-13 09:01:07,686 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12496114 passed 2025-01-13 09:01:12,765 - DEBUG - [Pod ctest-pod-09589848] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-13 09:01:12,766 - DEBUG - [Pod Pod ctest-pod-09589848] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-13 09:01:12,766 - DEBUG - [Pod Pod ctest-pod-09589848] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-13 09:01:12,766 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09589848 passed 2025-01-13 09:01:12,776 - INFO - Updating Network Policy ingress-on-service 2025-01-13 09:01:17,883 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:17,884 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:17,884 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:22,959 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:22,959 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:22,959 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:28,026 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:28,026 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:28,026 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:33,086 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:33,086 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:33,086 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:38,151 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:38,152 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:38,152 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:43,231 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:43,231 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:43,231 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:48,290 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:48,290 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:48,290 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:53,362 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:53,362 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:53,362 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:58,419 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:58,419 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:01:58,420 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:02:03,478 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:02:03,478 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:02:03,479 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) wget: download timed out 2025-01-13 09:02:03,479 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88754425': 0, 'ctest-pod-63026385': 0} 2025-01-13 09:02:03,537 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,537 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,537 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,590 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,591 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,591 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,657 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,658 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,658 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,720 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,721 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,721 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,792 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,792 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,792 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:03,850 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,851 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,851 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,915 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,916 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,916 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,916 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88754425': 6, 'ctest-pod-63026385': 1} 2025-01-13 09:02:03,983 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:03,984 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:03,984 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-88754425 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:04,053 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:04,053 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:04,053 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88754425 2025-01-13 09:02:04,110 - DEBUG - [Pod ctest-pod-84764349] Cmd: wget http://10.104.154.214:80/ -O - -T 5 -t 1 , Output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:04,110 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd wget http://10.104.154.214:80/ -O - -T 5 -t 1 passed 2025-01-13 09:02:04,110 - DEBUG - [Pod Pod ctest-pod-84764349] Cmd output: ctest-pod-63026385 Connecting to 10.104.154.214:80 (10.104.154.214:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-13 09:02:04,110 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88754425': 2, 'ctest-pod-63026385': 1} 2025-01-13 09:02:06,182 - DEBUG - [Pod ctest-pod-51155664] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.075 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.409/1.075 ms 2025-01-13 09:02:06,183 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-51155664 with expectation True passed 2025-01-13 09:02:08,251 - DEBUG - [Pod ctest-pod-12496114] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.824 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.325/0.824 ms 2025-01-13 09:02:08,251 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12496114 with expectation True passed 2025-01-13 09:02:10,306 - DEBUG - [Pod ctest-pod-84764349] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.664 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.272/0.664 ms 2025-01-13 09:02:10,307 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84764349 with expectation True passed 2025-01-13 09:02:10,377 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:02:10,377 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-13 09:02:10,377 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:02:10,377 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51155664 passed 2025-01-13 09:02:10,586 - DEBUG - [Pod ctest-pod-51155664] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:02:10,586 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-13 09:02:10,586 - DEBUG - [Pod Pod ctest-pod-51155664] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:02:10,586 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51155664 passed 2025-01-13 09:02:15,742 - DEBUG - [Pod ctest-pod-12496114] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-13 09:02:15,742 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-13 09:02:15,742 - DEBUG - [Pod Pod ctest-pod-12496114] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-13 09:02:15,742 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12496114 passed 2025-01-13 09:02:15,808 - DEBUG - [Pod ctest-pod-09589848] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:02:15,808 - DEBUG - [Pod Pod ctest-pod-09589848] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-13 09:02:15,808 - DEBUG - [Pod Pod ctest-pod-09589848] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-13 09:02:15,808 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09589848 passed 2025-01-13 09:02:15,808 - INFO - Deleting Network Policy : ingress-on-service 2025-01-13 09:02:15,809 - INFO - Deleting service : ctest-nginx-svc-32046691 2025-01-13 09:02:16,058 - DEBUG - No XMPP flaps were noticed during the test