2024-11-04 01:01:31,581 - INFO - Using existing project ['default-domain', 'k8s-default'](b97ce457-3671-4134-806a-4a26401647bf) 2024-11-04 01:01:31,598 - DEBUG - Namespace ctest-new-default-41246371 not present 2024-11-04 01:01:32,574 - INFO - Created namespace ctest-new-default-41246371 2024-11-04 01:01:35,577 - DEBUG - Namespace ctest-non-default-00626040 not present 2024-11-04 01:01:35,585 - INFO - Created namespace ctest-non-default-00626040 2024-11-04 01:01:38,606 - DEBUG - Pod ctest-pod-58610471 not present 2024-11-04 01:01:38,607 - INFO - Creating Pod ctest-pod-58610471 2024-11-04 01:01:38,655 - DEBUG - Pod : ctest-pod-58610471 UUID is a6f5b78c-7c4e-4674-8e00-2f12a34e187d 2024-11-04 01:01:38,661 - DEBUG - Pod ctest-pod-31758157 not present 2024-11-04 01:01:38,661 - INFO - Creating Pod ctest-pod-31758157 2024-11-04 01:01:38,700 - DEBUG - Pod : ctest-pod-31758157 UUID is a9285f27-f16a-4c3f-acc4-bde271a27014 2024-11-04 01:01:38,702 - DEBUG - Pod ctest-pod-73505108 not present 2024-11-04 01:01:38,702 - INFO - Creating Pod ctest-pod-73505108 2024-11-04 01:01:38,733 - DEBUG - Pod : ctest-pod-73505108 UUID is 22f0346e-09b7-4525-89c0-b13db761f83b 2024-11-04 01:01:38,744 - DEBUG - Pod ctest-pod-21153288 not present 2024-11-04 01:01:38,745 - INFO - Creating Pod ctest-pod-21153288 2024-11-04 01:01:38,780 - DEBUG - Pod : ctest-pod-21153288 UUID is 4636d3fe-8c4b-4f3b-8d19-9687b75d4e66 2024-11-04 01:01:38,784 - DEBUG - Pod ctest-pod-76409750 not present 2024-11-04 01:01:38,784 - INFO - Creating Pod ctest-pod-76409750 2024-11-04 01:01:38,812 - DEBUG - Pod : ctest-pod-76409750 UUID is 25648639-eb26-495c-b966-d3d9ad6fc81b 2024-11-04 01:01:38,815 - DEBUG - Pod ctest-pod-68706811 not present 2024-11-04 01:01:38,816 - INFO - Creating Pod ctest-pod-68706811 2024-11-04 01:01:38,840 - DEBUG - Pod : ctest-pod-68706811 UUID is 7cc61c87-da35-470e-b714-37749a9f1d34 2024-11-04 01:01:38,843 - DEBUG - Pod ctest-pod-50033879 not present 2024-11-04 01:01:38,844 - INFO - Creating Pod ctest-pod-50033879 2024-11-04 01:01:38,869 - DEBUG - Pod : ctest-pod-50033879 UUID is d1c94a54-3198-43dc-acd9-094922e118bb 2024-11-04 01:01:38,872 - DEBUG - Pod ctest-pod-32910125 not present 2024-11-04 01:01:38,872 - INFO - Creating Pod ctest-pod-32910125 2024-11-04 01:01:38,897 - DEBUG - Pod : ctest-pod-32910125 UUID is 3cc2a0e6-3d85-41ae-b11e-2dbfd5e44830 2024-11-04 01:01:39,098 - INFO - Project default-domain:k8s-ctest-new-default-41246371 for Namespace ctest-new-default-41246371 is seen in contrail-api 2024-11-04 01:01:39,098 - DEBUG - Project uuid in Contrail is 3c38b532-744e-45cc-a532-7cc50255f05e 2024-11-04 01:01:39,232 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=4d96751d-148e-4980-9adc-2536ca9a8fae 2024-11-04 01:01:39,236 - INFO - Namespace ctest-new-default-41246371 with uuid 4d96751d-148e-4980-9adc-2536ca9a8fae found in kube manager 2024-11-04 01:01:39,236 - INFO - Namespace ctest-new-default-41246371 verification passed 2024-11-04 01:01:39,493 - INFO - Project default-domain:k8s-ctest-non-default-00626040 for Namespace ctest-non-default-00626040 is seen in contrail-api 2024-11-04 01:01:39,494 - DEBUG - Project uuid in Contrail is 37d2df5b-0d35-4ab0-8c03-134289afe15f 2024-11-04 01:01:39,494 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=e2d54d41-0731-4291-88f8-be06bd5ce596 2024-11-04 01:01:39,507 - INFO - Namespace ctest-non-default-00626040 with uuid e2d54d41-0731-4291-88f8-be06bd5ce596 found in kube manager 2024-11-04 01:01:39,507 - INFO - Namespace ctest-non-default-00626040 verification passed 2024-11-04 01:01:39,517 - DEBUG - Pod ctest-pod-58610471 not in running state.Currently in Pending 2024-11-04 01:01:44,532 - DEBUG - Pod ctest-pod-58610471 not in running state.Currently in Pending 2024-11-04 01:01:49,538 - DEBUG - Pod ctest-pod-58610471 not in running state.Currently in Pending 2024-11-04 01:01:54,544 - INFO - Pod ctest-pod-58610471 is in running state.Got IP 10.47.255.251 2024-11-04 01:01:54,601 - DEBUG - Pod ctest-pod-58610471 has vmi 5a7e9018-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:01:54,601 - INFO - Verified pod ctest-pod-58610471 in contrail-api 2024-11-04 01:01:54,619 - DEBUG - VMI 5a7e9018-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:01:54,619 - INFO - Verified Pod ctest-pod-58610471 in agent 10.0.0.23 2024-11-04 01:01:54,620 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=a6f5b78c-7c4e-4674-8e00-2f12a34e187d 2024-11-04 01:01:54,625 - INFO - Pod ctest-pod-58610471 with uuid a6f5b78c-7c4e-4674-8e00-2f12a34e187d found in kube manager 2024-11-04 01:01:54,625 - INFO - Pod ctest-pod-58610471 verification passed 2024-11-04 01:01:54,630 - INFO - Pod ctest-pod-31758157 is in running state.Got IP 10.47.255.250 2024-11-04 01:01:54,648 - DEBUG - Pod ctest-pod-31758157 has vmi 5b16eeee-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:01:54,648 - INFO - Verified pod ctest-pod-31758157 in contrail-api 2024-11-04 01:01:54,662 - DEBUG - VMI 5b16eeee-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:01:54,663 - INFO - Verified Pod ctest-pod-31758157 in agent 10.0.0.23 2024-11-04 01:01:54,663 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=a9285f27-f16a-4c3f-acc4-bde271a27014 2024-11-04 01:01:54,667 - INFO - Pod ctest-pod-31758157 with uuid a9285f27-f16a-4c3f-acc4-bde271a27014 found in kube manager 2024-11-04 01:01:54,667 - INFO - Pod ctest-pod-31758157 verification passed 2024-11-04 01:01:54,672 - INFO - Pod ctest-pod-73505108 is in running state.Got IP 10.47.255.249 2024-11-04 01:01:54,734 - DEBUG - Pod ctest-pod-73505108 has vmi 5be3e3c2-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:01:54,734 - INFO - Verified pod ctest-pod-73505108 in contrail-api 2024-11-04 01:01:54,748 - DEBUG - VMI 5be3e3c2-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:01:54,749 - INFO - Verified Pod ctest-pod-73505108 in agent 10.0.0.23 2024-11-04 01:01:54,749 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=22f0346e-09b7-4525-89c0-b13db761f83b 2024-11-04 01:01:54,753 - INFO - Pod ctest-pod-73505108 with uuid 22f0346e-09b7-4525-89c0-b13db761f83b found in kube manager 2024-11-04 01:01:54,753 - INFO - Pod ctest-pod-73505108 verification passed 2024-11-04 01:01:54,760 - INFO - Pod ctest-pod-21153288 is in running state.Got IP 10.47.255.248 2024-11-04 01:01:54,821 - DEBUG - Pod ctest-pod-21153288 has vmi 5c73c938-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:01:54,821 - INFO - Verified pod ctest-pod-21153288 in contrail-api 2024-11-04 01:01:54,836 - DEBUG - VMI 5c73c938-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:01:54,837 - INFO - Verified Pod ctest-pod-21153288 in agent 10.0.0.23 2024-11-04 01:01:54,837 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=4636d3fe-8c4b-4f3b-8d19-9687b75d4e66 2024-11-04 01:01:54,841 - INFO - Pod ctest-pod-21153288 with uuid 4636d3fe-8c4b-4f3b-8d19-9687b75d4e66 found in kube manager 2024-11-04 01:01:54,841 - INFO - Pod ctest-pod-21153288 verification passed 2024-11-04 01:01:54,847 - INFO - Pod ctest-pod-76409750 is in running state.Got IP 10.47.255.247 2024-11-04 01:01:54,869 - DEBUG - Pod ctest-pod-76409750 has vmi 5d16c3c2-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:01:54,869 - INFO - Verified pod ctest-pod-76409750 in contrail-api 2024-11-04 01:01:54,884 - DEBUG - VMI 5d16c3c2-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:01:54,884 - INFO - Verified Pod ctest-pod-76409750 in agent 10.0.0.23 2024-11-04 01:01:54,884 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=25648639-eb26-495c-b966-d3d9ad6fc81b 2024-11-04 01:01:54,889 - INFO - Pod ctest-pod-76409750 with uuid 25648639-eb26-495c-b966-d3d9ad6fc81b found in kube manager 2024-11-04 01:01:54,889 - INFO - Pod ctest-pod-76409750 verification passed 2024-11-04 01:01:54,894 - INFO - Pod ctest-pod-50033879 is in running state.Got IP 10.47.255.245 2024-11-04 01:01:54,956 - DEBUG - Pod ctest-pod-50033879 has vmi 5e3a5002-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:01:54,957 - INFO - Verified pod ctest-pod-50033879 in contrail-api 2024-11-04 01:01:54,970 - DEBUG - VMI 5e3a5002-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:01:54,970 - INFO - Verified Pod ctest-pod-50033879 in agent 10.0.0.23 2024-11-04 01:01:54,970 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=d1c94a54-3198-43dc-acd9-094922e118bb 2024-11-04 01:01:54,975 - INFO - Pod ctest-pod-50033879 with uuid d1c94a54-3198-43dc-acd9-094922e118bb found in kube manager 2024-11-04 01:01:54,975 - INFO - Pod ctest-pod-50033879 verification passed 2024-11-04 01:01:54,982 - DEBUG - Pod ctest-pod-68706811 not in running state.Currently in Pending 2024-11-04 01:01:59,990 - INFO - Pod ctest-pod-68706811 is in running state.Got IP 10.47.255.246 2024-11-04 01:02:00,015 - DEBUG - Pod ctest-pod-68706811 has vmi 5da4bc2c-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:02:00,015 - INFO - Verified pod ctest-pod-68706811 in contrail-api 2024-11-04 01:02:00,033 - DEBUG - VMI 5da4bc2c-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:02:00,034 - INFO - Verified Pod ctest-pod-68706811 in agent 10.0.0.23 2024-11-04 01:02:00,034 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=7cc61c87-da35-470e-b714-37749a9f1d34 2024-11-04 01:02:00,040 - INFO - Pod ctest-pod-68706811 with uuid 7cc61c87-da35-470e-b714-37749a9f1d34 found in kube manager 2024-11-04 01:02:00,040 - INFO - Pod ctest-pod-68706811 verification passed 2024-11-04 01:02:00,047 - INFO - Pod ctest-pod-32910125 is in running state.Got IP 10.47.255.244 2024-11-04 01:02:00,110 - DEBUG - Pod ctest-pod-32910125 has vmi 5ecdf7c6-9a48-11ef-856f-fa163ebb4271 2024-11-04 01:02:00,110 - INFO - Verified pod ctest-pod-32910125 in contrail-api 2024-11-04 01:02:00,125 - DEBUG - VMI 5ecdf7c6-9a48-11ef-856f-fa163ebb4271 is active in agent 10.0.0.23 2024-11-04 01:02:00,125 - INFO - Verified Pod ctest-pod-32910125 in agent 10.0.0.23 2024-11-04 01:02:00,126 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=3cc2a0e6-3d85-41ae-b11e-2dbfd5e44830 2024-11-04 01:02:00,131 - INFO - Pod ctest-pod-32910125 with uuid 3cc2a0e6-3d85-41ae-b11e-2dbfd5e44830 found in kube manager 2024-11-04 01:02:00,131 - INFO - Pod ctest-pod-32910125 verification passed 2024-11-04 01:02:00,131 - INFO - ================================================================================ 2024-11-04 01:02:00,131 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-04 01:02:00,131 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-04 01:02:00,385 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.24': '0'}} with 2024-11-04 01:02:00,385 - INFO - Initial checks done. Running the testcase now 2024-11-04 01:02:00,385 - INFO - 2024-11-04 01:02:00,457 - DEBUG - [Pod ctest-pod-58610471] Cmd: echo ctest-pod-58610471 > /usr/share/nginx/html/index.html, Output: 2024-11-04 01:02:00,534 - DEBUG - [Pod ctest-pod-31758157] Cmd: echo ctest-pod-31758157 > /usr/share/nginx/html/index.html, Output: 2024-11-04 01:02:00,598 - DEBUG - [Pod ctest-pod-73505108] Cmd: echo ctest-pod-73505108 > /usr/share/nginx/html/index.html, Output: 2024-11-04 01:02:00,664 - DEBUG - [Pod ctest-pod-21153288] Cmd: echo ctest-pod-21153288 > /usr/share/nginx/html/index.html, Output: 2024-11-04 01:02:00,669 - DEBUG - Service ctest-nginx-svc-61269529 not present 2024-11-04 01:02:00,669 - INFO - Creating service ctest-nginx-svc-61269529 2024-11-04 01:02:00,693 - INFO - Created Service ctest-nginx-svc-61269529 2024-11-04 01:02:00,706 - WARNING - Service UUID 22154300-4f90-4b48-9011-83e7333489f2 not yet found in contrail-api 2024-11-04 01:02:01,712 - WARNING - Service UUID 22154300-4f90-4b48-9011-83e7333489f2 not yet found in contrail-api 2024-11-04 01:02:02,725 - INFO - Validated that Service ctest-nginx-svc-61269529 is seen in contrail-api 2024-11-04 01:02:02,726 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=22154300-4f90-4b48-9011-83e7333489f2 2024-11-04 01:02:02,731 - INFO - Service ctest-nginx-svc-61269529 with uuid 22154300-4f90-4b48-9011-83e7333489f2 found in kube manager 2024-11-04 01:02:02,731 - INFO - Service ctest-nginx-svc-61269529 verification passed 2024-11-04 01:02:03,814 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31758157 2024-11-04 01:02:03,814 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:02:03,814 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31758157 2024-11-04 01:02:04,213 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:02:04,213 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:02:04,213 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:02:04,213 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58610471': 1, 'ctest-pod-31758157': 1} 2024-11-04 01:02:04,283 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:02:04,283 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:02:04,283 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:02:04,358 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:02:04,358 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:02:04,358 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:02:04,440 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31758157 2024-11-04 01:02:04,441 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:02:04,441 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-31758157 2024-11-04 01:02:04,506 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58610471 2024-11-04 01:02:04,506 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:02:04,506 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58610471 2024-11-04 01:02:04,506 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58610471': 1, 'ctest-pod-31758157': 3} 2024-11-04 01:02:04,508 - DEBUG - Network policy ingress-on-service not present 2024-11-04 01:02:04,509 - INFO - Creating Network Policy ingress-on-service 2024-11-04 01:02:04,524 - INFO - Network policy found in k8s 2024-11-04 01:02:04,524 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cb1e74f1-f2cc-42f1-9a77-d6f5ec67beeb 2024-11-04 01:02:04,531 - INFO - Network Policy ingress-on-service with uuid cb1e74f1-f2cc-42f1-9a77-d6f5ec67beeb found in kube manager 2024-11-04 01:02:04,575 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-04 01:02:04,575 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-04 01:02:04,576 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cb1e74f1-f2cc-42f1-9a77-d6f5ec67beeb 2024-11-04 01:02:04,612 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-04 01:02:06,613 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cb1e74f1-f2cc-42f1-9a77-d6f5ec67beeb 2024-11-04 01:02:08,160 - INFO - Network policy with name ingress-on-service found in agent 2024-11-04 01:02:08,161 - INFO - Network Policy ingress-on-service verification passed 2024-11-04 01:02:13,228 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:13,228 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:13,229 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:18,987 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:18,987 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:18,987 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:24,062 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:24,062 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:24,062 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:29,109 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:29,109 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:29,109 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:34,172 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:34,172 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:34,172 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:39,237 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:39,237 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:39,237 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:45,923 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:45,924 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:45,924 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:50,996 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:50,996 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:50,996 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:56,070 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:56,071 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:02:56,071 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:01,144 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:01,144 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:01,144 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:01,144 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58610471': 0, 'ctest-pod-31758157': 0} 2024-11-04 01:03:01,218 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:03:01,218 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:03:01,218 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:03:01,280 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:03:01,280 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:03:01,280 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:03:01,280 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58610471': 1, 'ctest-pod-31758157': 1} 2024-11-04 01:03:06,343 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:06,343 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:06,343 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:11,419 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:11,419 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:11,419 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:16,479 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:16,480 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:16,480 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:21,543 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:21,543 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:21,543 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:26,754 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:26,754 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:26,754 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:31,823 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:31,823 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:31,823 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:36,879 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:36,879 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:36,879 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:41,949 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:41,949 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:41,949 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:47,526 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:47,526 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:47,526 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:52,584 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:52,584 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:52,584 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:03:52,584 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58610471': 0, 'ctest-pod-31758157': 0} 2024-11-04 01:03:54,669 - DEBUG - [Pod ctest-pod-68706811] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.681 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.106 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.290/0.681 ms 2024-11-04 01:03:55,966 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-68706811 with expectation True passed 2024-11-04 01:03:58,042 - DEBUG - [Pod ctest-pod-76409750] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.172 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.437/1.172 ms 2024-11-04 01:03:58,042 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76409750 with expectation True passed 2024-11-04 01:04:00,137 - DEBUG - [Pod ctest-pod-50033879] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.713 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.062 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.288/0.713 ms 2024-11-04 01:04:00,137 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50033879 with expectation True passed 2024-11-04 01:04:00,210 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:04:00,210 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-04 01:04:00,210 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:04:00,210 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68706811 passed 2024-11-04 01:04:00,270 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:04:00,270 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-04 01:04:00,270 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:04:00,270 - INFO - wget check of of http://10.47.255.250 from ctest-pod-68706811 passed 2024-11-04 01:04:05,326 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 01:04:05,326 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 01:04:05,327 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 01:04:05,327 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76409750 passed 2024-11-04 01:04:10,388 - DEBUG - [Pod ctest-pod-32910125] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-04 01:04:10,388 - DEBUG - [Pod Pod ctest-pod-32910125] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-04 01:04:10,388 - DEBUG - [Pod Pod ctest-pod-32910125] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-04 01:04:10,388 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32910125 passed 2024-11-04 01:04:10,400 - INFO - Updating Network Policy ingress-on-service 2024-11-04 01:04:15,466 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:15,466 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:15,466 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:21,543 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:21,543 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:21,543 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:26,615 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:26,615 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:26,615 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:31,667 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:31,667 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:31,667 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:36,735 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:36,735 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:36,735 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:42,219 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:42,219 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:42,219 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:47,275 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:47,275 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:47,275 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:52,344 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:52,344 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:52,344 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:57,418 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:57,418 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:04:57,418 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:05:03,362 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:05:03,362 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:05:03,362 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) wget: download timed out 2024-11-04 01:05:03,362 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58610471': 0, 'ctest-pod-31758157': 0} 2024-11-04 01:05:03,436 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58610471 2024-11-04 01:05:03,436 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:05:03,436 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58610471 2024-11-04 01:05:03,509 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,509 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:05:03,509 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,572 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,572 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:05:03,572 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,573 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58610471': 2, 'ctest-pod-31758157': 1} 2024-11-04 01:05:03,638 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,639 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:05:03,639 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,707 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,707 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:05:03,707 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: ctest-pod-58610471 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,773 - DEBUG - [Pod ctest-pod-50033879] Cmd: wget http://10.100.80.161:80/ -O - -T 5 -t 1 , Output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,774 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd wget http://10.100.80.161:80/ -O - -T 5 -t 1 passed 2024-11-04 01:05:03,774 - DEBUG - [Pod Pod ctest-pod-50033879] Cmd output: ctest-pod-31758157 Connecting to 10.100.80.161:80 (10.100.80.161:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-04 01:05:03,774 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58610471': 2, 'ctest-pod-31758157': 1} 2024-11-04 01:05:05,852 - DEBUG - [Pod ctest-pod-68706811] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.495 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.114 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.560/1.495 ms 2024-11-04 01:05:05,852 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-68706811 with expectation True passed 2024-11-04 01:05:07,920 - DEBUG - [Pod ctest-pod-76409750] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.286 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.151/0.286 ms 2024-11-04 01:05:07,920 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76409750 with expectation True passed 2024-11-04 01:05:09,983 - DEBUG - [Pod ctest-pod-50033879] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.649 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.270/0.649 ms 2024-11-04 01:05:09,983 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50033879 with expectation True passed 2024-11-04 01:05:10,049 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:05:10,049 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-04 01:05:10,049 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:05:10,049 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68706811 passed 2024-11-04 01:05:10,108 - DEBUG - [Pod ctest-pod-68706811] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:05:10,109 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-04 01:05:10,109 - DEBUG - [Pod Pod ctest-pod-68706811] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:05:10,109 - INFO - wget check of of http://10.47.255.250 from ctest-pod-68706811 passed 2024-11-04 01:05:15,178 - DEBUG - [Pod ctest-pod-76409750] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 01:05:15,178 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 01:05:15,179 - DEBUG - [Pod Pod ctest-pod-76409750] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-04 01:05:15,179 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76409750 passed 2024-11-04 01:05:15,253 - DEBUG - [Pod ctest-pod-32910125] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:05:15,253 - DEBUG - [Pod Pod ctest-pod-32910125] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-04 01:05:15,253 - DEBUG - [Pod Pod ctest-pod-32910125] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-04 01:05:15,253 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32910125 passed 2024-11-04 01:05:15,254 - INFO - Deleting Network Policy : ingress-on-service 2024-11-04 01:05:15,254 - INFO - Deleting service : ctest-nginx-svc-61269529 2024-11-04 01:05:15,522 - DEBUG - No XMPP flaps were noticed during the test