2024-11-10 20:23:02,008 - INFO - Using existing project ['default-domain', 'k8s-default'](6f006778-4b55-486a-ba45-3a9a57d3d908) 2024-11-10 20:23:02,032 - DEBUG - Namespace ctest-new-default-14070689 not present 2024-11-10 20:23:02,046 - INFO - Created namespace ctest-new-default-14070689 2024-11-10 20:23:05,060 - DEBUG - Namespace ctest-non-default-32394019 not present 2024-11-10 20:23:05,080 - INFO - Created namespace ctest-non-default-32394019 2024-11-10 20:23:08,105 - DEBUG - Pod ctest-pod-23347512 not present 2024-11-10 20:23:08,106 - INFO - Creating Pod ctest-pod-23347512 2024-11-10 20:23:08,138 - DEBUG - Pod : ctest-pod-23347512 UUID is 617be65d-65c5-41a8-afc3-740013330bc7 2024-11-10 20:23:08,140 - DEBUG - Pod ctest-pod-03637724 not present 2024-11-10 20:23:08,141 - INFO - Creating Pod ctest-pod-03637724 2024-11-10 20:23:08,181 - DEBUG - Pod : ctest-pod-03637724 UUID is a1c91d16-41be-4636-948a-90cd658eceb4 2024-11-10 20:23:08,186 - DEBUG - Pod ctest-pod-38529497 not present 2024-11-10 20:23:08,186 - INFO - Creating Pod ctest-pod-38529497 2024-11-10 20:23:08,206 - DEBUG - Pod : ctest-pod-38529497 UUID is 06da089f-6eec-498a-8c2f-0a661764711b 2024-11-10 20:23:08,422 - DEBUG - Pod ctest-pod-62179679 not present 2024-11-10 20:23:08,423 - INFO - Creating Pod ctest-pod-62179679 2024-11-10 20:23:08,447 - DEBUG - Pod : ctest-pod-62179679 UUID is 09b1c56f-83d3-44f9-a956-6b5c7dd807a2 2024-11-10 20:23:08,453 - DEBUG - Pod ctest-pod-92343026 not present 2024-11-10 20:23:08,453 - INFO - Creating Pod ctest-pod-92343026 2024-11-10 20:23:08,473 - DEBUG - Pod : ctest-pod-92343026 UUID is bd4ae63f-18c9-4b14-8805-6bd41f6053f2 2024-11-10 20:23:08,475 - DEBUG - Pod ctest-pod-18011436 not present 2024-11-10 20:23:08,475 - INFO - Creating Pod ctest-pod-18011436 2024-11-10 20:23:08,490 - DEBUG - Pod : ctest-pod-18011436 UUID is e06a9661-024b-4a99-844f-92a999258dae 2024-11-10 20:23:08,492 - DEBUG - Pod ctest-pod-97107331 not present 2024-11-10 20:23:08,492 - INFO - Creating Pod ctest-pod-97107331 2024-11-10 20:23:08,505 - DEBUG - Pod : ctest-pod-97107331 UUID is f6b204a0-9156-4617-9247-389e39380ef6 2024-11-10 20:23:08,506 - DEBUG - Pod ctest-pod-17543938 not present 2024-11-10 20:23:08,507 - INFO - Creating Pod ctest-pod-17543938 2024-11-10 20:23:08,525 - DEBUG - Pod : ctest-pod-17543938 UUID is 69b679c3-1a07-407a-8b07-504a0f967d46 2024-11-10 20:23:08,729 - INFO - Project default-domain:k8s-ctest-new-default-14070689 for Namespace ctest-new-default-14070689 is seen in contrail-api 2024-11-10 20:23:08,729 - DEBUG - Project uuid in Contrail is 350489ac-7c3b-423d-a9c9-9b3c1f5de33f 2024-11-10 20:23:08,859 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=74115ca6-55f6-4279-b825-414529a63223 2024-11-10 20:23:08,875 - INFO - Namespace ctest-new-default-14070689 with uuid 74115ca6-55f6-4279-b825-414529a63223 found in kube manager 2024-11-10 20:23:08,875 - INFO - Namespace ctest-new-default-14070689 verification passed 2024-11-10 20:23:09,113 - INFO - Project default-domain:k8s-ctest-non-default-32394019 for Namespace ctest-non-default-32394019 is seen in contrail-api 2024-11-10 20:23:09,114 - DEBUG - Project uuid in Contrail is cc74bfb3-51f2-46d9-9bd5-4772a4e8403e 2024-11-10 20:23:09,114 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=b6df712a-80eb-4fef-b949-df324582707c 2024-11-10 20:23:09,118 - INFO - Namespace ctest-non-default-32394019 with uuid b6df712a-80eb-4fef-b949-df324582707c found in kube manager 2024-11-10 20:23:09,118 - INFO - Namespace ctest-non-default-32394019 verification passed 2024-11-10 20:23:09,125 - DEBUG - Pod ctest-pod-23347512 not in running state.Currently in Pending 2024-11-10 20:23:14,142 - DEBUG - Pod ctest-pod-23347512 not in running state.Currently in Pending 2024-11-10 20:23:19,149 - INFO - Pod ctest-pod-23347512 is in running state.Got IP 10.47.255.251 2024-11-10 20:23:19,211 - DEBUG - Pod ctest-pod-23347512 has vmi 9a9ade6e-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:19,211 - INFO - Verified pod ctest-pod-23347512 in contrail-api 2024-11-10 20:23:19,224 - DEBUG - VMI 9a9ade6e-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:19,225 - INFO - Verified Pod ctest-pod-23347512 in agent 10.0.0.22 2024-11-10 20:23:19,225 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=617be65d-65c5-41a8-afc3-740013330bc7 2024-11-10 20:23:19,230 - INFO - Pod ctest-pod-23347512 with uuid 617be65d-65c5-41a8-afc3-740013330bc7 found in kube manager 2024-11-10 20:23:19,230 - INFO - Pod ctest-pod-23347512 verification passed 2024-11-10 20:23:19,235 - DEBUG - Pod ctest-pod-03637724 not in running state.Currently in Pending 2024-11-10 20:23:24,243 - INFO - Pod ctest-pod-03637724 is in running state.Got IP 10.47.255.250 2024-11-10 20:23:24,267 - DEBUG - Pod ctest-pod-03637724 has vmi 9b1fd27c-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:24,268 - INFO - Verified pod ctest-pod-03637724 in contrail-api 2024-11-10 20:23:24,285 - DEBUG - VMI 9b1fd27c-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:24,285 - INFO - Verified Pod ctest-pod-03637724 in agent 10.0.0.22 2024-11-10 20:23:24,286 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=a1c91d16-41be-4636-948a-90cd658eceb4 2024-11-10 20:23:24,290 - INFO - Pod ctest-pod-03637724 with uuid a1c91d16-41be-4636-948a-90cd658eceb4 found in kube manager 2024-11-10 20:23:24,290 - INFO - Pod ctest-pod-03637724 verification passed 2024-11-10 20:23:24,296 - INFO - Pod ctest-pod-38529497 is in running state.Got IP 10.47.255.249 2024-11-10 20:23:24,355 - DEBUG - Pod ctest-pod-38529497 has vmi 9bd39f50-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:24,355 - INFO - Verified pod ctest-pod-38529497 in contrail-api 2024-11-10 20:23:24,367 - DEBUG - VMI 9bd39f50-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:24,368 - INFO - Verified Pod ctest-pod-38529497 in agent 10.0.0.22 2024-11-10 20:23:24,368 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=06da089f-6eec-498a-8c2f-0a661764711b 2024-11-10 20:23:24,372 - INFO - Pod ctest-pod-38529497 with uuid 06da089f-6eec-498a-8c2f-0a661764711b found in kube manager 2024-11-10 20:23:24,372 - INFO - Pod ctest-pod-38529497 verification passed 2024-11-10 20:23:24,377 - DEBUG - Pod ctest-pod-62179679 not in running state.Currently in Pending 2024-11-10 20:23:29,383 - INFO - Pod ctest-pod-62179679 is in running state.Got IP 10.47.255.248 2024-11-10 20:23:29,402 - DEBUG - Pod ctest-pod-62179679 has vmi 9c61ad7c-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:29,402 - INFO - Verified pod ctest-pod-62179679 in contrail-api 2024-11-10 20:23:29,416 - DEBUG - VMI 9c61ad7c-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:29,416 - INFO - Verified Pod ctest-pod-62179679 in agent 10.0.0.22 2024-11-10 20:23:29,416 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=09b1c56f-83d3-44f9-a956-6b5c7dd807a2 2024-11-10 20:23:29,421 - INFO - Pod ctest-pod-62179679 with uuid 09b1c56f-83d3-44f9-a956-6b5c7dd807a2 found in kube manager 2024-11-10 20:23:29,421 - INFO - Pod ctest-pod-62179679 verification passed 2024-11-10 20:23:29,427 - INFO - Pod ctest-pod-92343026 is in running state.Got IP 10.47.255.247 2024-11-10 20:23:29,487 - DEBUG - Pod ctest-pod-92343026 has vmi 9cf49268-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:29,487 - INFO - Verified pod ctest-pod-92343026 in contrail-api 2024-11-10 20:23:29,501 - DEBUG - VMI 9cf49268-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:29,501 - INFO - Verified Pod ctest-pod-92343026 in agent 10.0.0.22 2024-11-10 20:23:29,502 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=bd4ae63f-18c9-4b14-8805-6bd41f6053f2 2024-11-10 20:23:29,506 - INFO - Pod ctest-pod-92343026 with uuid bd4ae63f-18c9-4b14-8805-6bd41f6053f2 found in kube manager 2024-11-10 20:23:29,507 - INFO - Pod ctest-pod-92343026 verification passed 2024-11-10 20:23:29,522 - INFO - Pod ctest-pod-97107331 is in running state.Got IP 10.47.255.245 2024-11-10 20:23:29,543 - DEBUG - Pod ctest-pod-97107331 has vmi 9df4eec4-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:29,543 - INFO - Verified pod ctest-pod-97107331 in contrail-api 2024-11-10 20:23:29,558 - DEBUG - VMI 9df4eec4-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:29,559 - INFO - Verified Pod ctest-pod-97107331 in agent 10.0.0.22 2024-11-10 20:23:29,559 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=f6b204a0-9156-4617-9247-389e39380ef6 2024-11-10 20:23:29,564 - INFO - Pod ctest-pod-97107331 with uuid f6b204a0-9156-4617-9247-389e39380ef6 found in kube manager 2024-11-10 20:23:29,564 - INFO - Pod ctest-pod-97107331 verification passed 2024-11-10 20:23:29,569 - INFO - Pod ctest-pod-18011436 is in running state.Got IP 10.47.255.246 2024-11-10 20:23:29,635 - DEBUG - Pod ctest-pod-18011436 has vmi 9d76f8f2-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:29,635 - INFO - Verified pod ctest-pod-18011436 in contrail-api 2024-11-10 20:23:29,649 - DEBUG - VMI 9d76f8f2-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:29,650 - INFO - Verified Pod ctest-pod-18011436 in agent 10.0.0.22 2024-11-10 20:23:29,650 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=e06a9661-024b-4a99-844f-92a999258dae 2024-11-10 20:23:29,658 - INFO - Pod ctest-pod-18011436 with uuid e06a9661-024b-4a99-844f-92a999258dae found in kube manager 2024-11-10 20:23:29,659 - INFO - Pod ctest-pod-18011436 verification passed 2024-11-10 20:23:29,665 - INFO - Pod ctest-pod-17543938 is in running state.Got IP 10.47.255.244 2024-11-10 20:23:29,727 - DEBUG - Pod ctest-pod-17543938 has vmi 9e72e978-9fa1-11ef-a459-fa163ea3b440 2024-11-10 20:23:29,727 - INFO - Verified pod ctest-pod-17543938 in contrail-api 2024-11-10 20:23:29,741 - DEBUG - VMI 9e72e978-9fa1-11ef-a459-fa163ea3b440 is active in agent 10.0.0.22 2024-11-10 20:23:29,741 - INFO - Verified Pod ctest-pod-17543938 in agent 10.0.0.22 2024-11-10 20:23:29,741 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=69b679c3-1a07-407a-8b07-504a0f967d46 2024-11-10 20:23:29,747 - INFO - Pod ctest-pod-17543938 with uuid 69b679c3-1a07-407a-8b07-504a0f967d46 found in kube manager 2024-11-10 20:23:29,747 - INFO - Pod ctest-pod-17543938 verification passed 2024-11-10 20:23:29,748 - INFO - ================================================================================ 2024-11-10 20:23:29,748 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-10 20:23:29,748 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-10 20:23:29,991 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.24': '0'}} with 2024-11-10 20:23:29,991 - INFO - Initial checks done. Running the testcase now 2024-11-10 20:23:29,991 - INFO - 2024-11-10 20:23:30,049 - DEBUG - [Pod ctest-pod-23347512] Cmd: echo ctest-pod-23347512 > /usr/share/nginx/html/index.html, Output: 2024-11-10 20:23:30,119 - DEBUG - [Pod ctest-pod-03637724] Cmd: echo ctest-pod-03637724 > /usr/share/nginx/html/index.html, Output: 2024-11-10 20:23:30,169 - DEBUG - [Pod ctest-pod-38529497] Cmd: echo ctest-pod-38529497 > /usr/share/nginx/html/index.html, Output: 2024-11-10 20:23:30,232 - DEBUG - [Pod ctest-pod-62179679] Cmd: echo ctest-pod-62179679 > /usr/share/nginx/html/index.html, Output: 2024-11-10 20:23:30,236 - DEBUG - Service ctest-nginx-svc-63567056 not present 2024-11-10 20:23:30,236 - INFO - Creating service ctest-nginx-svc-63567056 2024-11-10 20:23:30,276 - INFO - Created Service ctest-nginx-svc-63567056 2024-11-10 20:23:30,286 - WARNING - Service UUID 497d1400-aa21-4a48-becb-83f9cd54343b not yet found in contrail-api 2024-11-10 20:23:31,296 - INFO - Validated that Service ctest-nginx-svc-63567056 is seen in contrail-api 2024-11-10 20:23:31,297 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=497d1400-aa21-4a48-becb-83f9cd54343b 2024-11-10 20:23:31,303 - INFO - Service ctest-nginx-svc-63567056 with uuid 497d1400-aa21-4a48-becb-83f9cd54343b found in kube manager 2024-11-10 20:23:31,303 - INFO - Service ctest-nginx-svc-63567056 verification passed 2024-11-10 20:23:32,387 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) ctest-pod-03637724 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,387 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,387 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) ctest-pod-03637724 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,502 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,502 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,502 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,582 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,582 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,582 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,650 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,650 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,650 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,707 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,707 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,707 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,766 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,766 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,766 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,766 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23347512': 1, 'ctest-pod-03637724': 5} 2024-11-10 20:23:32,830 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,830 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,830 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,891 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,891 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:23:32,891 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:23:32,891 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23347512': 1, 'ctest-pod-03637724': 1} 2024-11-10 20:23:32,895 - DEBUG - Network policy ingress-on-service not present 2024-11-10 20:23:32,895 - INFO - Creating Network Policy ingress-on-service 2024-11-10 20:23:32,906 - INFO - Network policy found in k8s 2024-11-10 20:23:32,907 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=795308d0-902e-406c-b888-093fd7e1589e 2024-11-10 20:23:32,911 - INFO - Network Policy ingress-on-service with uuid 795308d0-902e-406c-b888-093fd7e1589e found in kube manager 2024-11-10 20:23:32,944 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-10 20:23:32,945 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-10 20:23:32,945 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=795308d0-902e-406c-b888-093fd7e1589e 2024-11-10 20:23:32,980 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-10 20:23:34,980 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=795308d0-902e-406c-b888-093fd7e1589e 2024-11-10 20:23:35,016 - INFO - Network policy with name ingress-on-service found in agent 2024-11-10 20:23:35,016 - INFO - Network Policy ingress-on-service verification passed 2024-11-10 20:23:40,083 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:40,083 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:40,083 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:45,136 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:45,136 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:45,136 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:50,194 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:50,194 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:50,194 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:55,251 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:55,252 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:23:55,252 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:00,304 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:00,304 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:00,305 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:05,360 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:05,360 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:05,360 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:10,417 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:10,417 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:10,417 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:15,480 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:15,480 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:15,480 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:20,550 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:20,550 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:20,550 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:25,603 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:25,603 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:25,603 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:25,603 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23347512': 0, 'ctest-pod-03637724': 0} 2024-11-10 20:24:25,680 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23347512 2024-11-10 20:24:25,680 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:24:25,680 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23347512 2024-11-10 20:24:25,771 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:24:25,771 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:24:25,771 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:24:25,771 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23347512': 1, 'ctest-pod-03637724': 1} 2024-11-10 20:24:30,851 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:30,851 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:30,851 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:35,899 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:35,899 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:35,900 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:40,970 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:40,970 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:40,970 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:46,015 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:46,016 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:46,016 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:51,077 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:51,077 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:51,077 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:56,136 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:56,136 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:24:56,136 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:01,192 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:01,192 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:01,192 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:06,256 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:06,256 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:06,256 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:11,325 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:11,325 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:11,325 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:16,373 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:16,373 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:16,373 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:16,373 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23347512': 0, 'ctest-pod-03637724': 0} 2024-11-10 20:25:18,430 - DEBUG - [Pod ctest-pod-18011436] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.710 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.294/0.710 ms 2024-11-10 20:25:18,430 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18011436 with expectation True passed 2024-11-10 20:25:20,483 - DEBUG - [Pod ctest-pod-92343026] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.021 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.116 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.406/1.021 ms 2024-11-10 20:25:20,483 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92343026 with expectation True passed 2024-11-10 20:25:22,536 - DEBUG - [Pod ctest-pod-97107331] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.684 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.113 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.294/0.684 ms 2024-11-10 20:25:22,536 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97107331 with expectation True passed 2024-11-10 20:25:22,625 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:25:22,625 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 20:25:22,625 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:25:22,625 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18011436 passed 2024-11-10 20:25:22,690 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:25:22,690 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 20:25:22,690 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:25:22,690 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18011436 passed 2024-11-10 20:25:27,738 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 20:25:27,739 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 20:25:27,739 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 20:25:27,739 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92343026 passed 2024-11-10 20:25:32,811 - DEBUG - [Pod ctest-pod-17543938] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 20:25:32,811 - DEBUG - [Pod Pod ctest-pod-17543938] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 20:25:32,811 - DEBUG - [Pod Pod ctest-pod-17543938] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 20:25:32,811 - INFO - wget check of of http://10.47.255.251 from ctest-pod-17543938 passed 2024-11-10 20:25:32,820 - INFO - Updating Network Policy ingress-on-service 2024-11-10 20:25:37,892 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:37,892 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:37,892 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:42,957 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:42,957 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:42,957 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:48,027 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:48,028 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:48,028 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:53,083 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:53,083 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:53,083 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:58,155 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:58,156 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:25:58,156 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:03,212 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:03,212 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:03,212 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:08,268 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:08,268 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:08,268 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:13,319 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:13,319 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:13,319 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:18,416 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:18,416 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:18,416 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:23,904 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:23,904 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:23,904 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.102.227.213:80 (10.102.227.213:80) wget: download timed out 2024-11-10 20:26:23,904 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23347512': 0, 'ctest-pod-03637724': 0} 2024-11-10 20:26:23,965 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:23,965 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:26:23,965 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,015 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,015 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:26:24,015 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,073 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,073 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:26:24,073 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,073 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23347512': 2, 'ctest-pod-03637724': 1} 2024-11-10 20:26:24,133 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,133 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:26:24,133 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,190 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,190 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:26:24,190 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: ctest-pod-03637724 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,255 - DEBUG - [Pod ctest-pod-97107331] Cmd: wget http://10.102.227.213:80/ -O - -T 5 -t 1 , Output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,255 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd wget http://10.102.227.213:80/ -O - -T 5 -t 1 passed 2024-11-10 20:26:24,255 - DEBUG - [Pod Pod ctest-pod-97107331] Cmd output: ctest-pod-23347512 Connecting to 10.102.227.213:80 (10.102.227.213:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 20:26:24,255 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23347512': 1, 'ctest-pod-03637724': 2} 2024-11-10 20:26:26,320 - DEBUG - [Pod ctest-pod-18011436] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.521 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.096 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.231/0.521 ms 2024-11-10 20:26:26,320 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18011436 with expectation True passed 2024-11-10 20:26:28,376 - DEBUG - [Pod ctest-pod-92343026] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.829 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.330/0.829 ms 2024-11-10 20:26:28,376 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92343026 with expectation True passed 2024-11-10 20:26:30,425 - DEBUG - [Pod ctest-pod-97107331] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.308 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.108 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.498/1.308 ms 2024-11-10 20:26:30,425 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97107331 with expectation True passed 2024-11-10 20:26:30,477 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:26:30,477 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 20:26:30,477 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:26:30,477 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18011436 passed 2024-11-10 20:26:30,537 - DEBUG - [Pod ctest-pod-18011436] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:26:30,537 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 20:26:30,537 - DEBUG - [Pod Pod ctest-pod-18011436] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:26:30,537 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18011436 passed 2024-11-10 20:26:35,593 - DEBUG - [Pod ctest-pod-92343026] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 20:26:35,593 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 20:26:35,593 - DEBUG - [Pod Pod ctest-pod-92343026] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 20:26:35,593 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92343026 passed 2024-11-10 20:26:35,658 - DEBUG - [Pod ctest-pod-17543938] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:26:35,659 - DEBUG - [Pod Pod ctest-pod-17543938] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 20:26:35,659 - DEBUG - [Pod Pod ctest-pod-17543938] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 20:26:35,659 - INFO - wget check of of http://10.47.255.251 from ctest-pod-17543938 passed 2024-11-10 20:26:35,659 - INFO - Deleting Network Policy : ingress-on-service 2024-11-10 20:26:35,659 - INFO - Deleting service : ctest-nginx-svc-63567056 2024-11-10 20:26:35,907 - DEBUG - No XMPP flaps were noticed during the test