2024-09-18 00:50:13,839 - INFO - Using existing project ['default-domain', 'k8s-default'](b1b4c853-715d-4970-87af-44387d6bc590) 2024-09-18 00:50:13,861 - DEBUG - Namespace ctest-new-default-65037265 not present 2024-09-18 00:50:13,873 - INFO - Created namespace ctest-new-default-65037265 2024-09-18 00:50:16,878 - DEBUG - Namespace ctest-non-default-76230090 not present 2024-09-18 00:50:16,885 - INFO - Created namespace ctest-non-default-76230090 2024-09-18 00:50:19,906 - DEBUG - Pod ctest-pod-02983566 not present 2024-09-18 00:50:19,906 - INFO - Creating Pod ctest-pod-02983566 2024-09-18 00:50:19,972 - DEBUG - Pod : ctest-pod-02983566 UUID is e7f997bc-fb44-42dd-9507-f30eb3226786 2024-09-18 00:50:19,977 - DEBUG - Pod ctest-pod-46197429 not present 2024-09-18 00:50:19,978 - INFO - Creating Pod ctest-pod-46197429 2024-09-18 00:50:20,414 - DEBUG - Pod : ctest-pod-46197429 UUID is 01f76de4-fe19-462b-b76e-353700ad5a69 2024-09-18 00:50:20,423 - DEBUG - Pod ctest-pod-84436212 not present 2024-09-18 00:50:20,423 - INFO - Creating Pod ctest-pod-84436212 2024-09-18 00:50:20,466 - DEBUG - Pod : ctest-pod-84436212 UUID is 5bff7f5d-d4cb-4c52-a9f9-c9622236db8b 2024-09-18 00:50:20,470 - DEBUG - Pod ctest-pod-66671982 not present 2024-09-18 00:50:20,470 - INFO - Creating Pod ctest-pod-66671982 2024-09-18 00:50:20,496 - DEBUG - Pod : ctest-pod-66671982 UUID is c5ebab39-3f43-454f-8208-3a9275044133 2024-09-18 00:50:20,501 - DEBUG - Pod ctest-pod-99683942 not present 2024-09-18 00:50:20,501 - INFO - Creating Pod ctest-pod-99683942 2024-09-18 00:50:20,523 - DEBUG - Pod : ctest-pod-99683942 UUID is fe0a6588-769e-4166-a47f-096e2c0a1d2c 2024-09-18 00:50:20,526 - DEBUG - Pod ctest-pod-45970574 not present 2024-09-18 00:50:20,526 - INFO - Creating Pod ctest-pod-45970574 2024-09-18 00:50:20,555 - DEBUG - Pod : ctest-pod-45970574 UUID is 85028813-ff6b-4a22-a902-b1359dfd5233 2024-09-18 00:50:20,558 - DEBUG - Pod ctest-pod-38263797 not present 2024-09-18 00:50:20,558 - INFO - Creating Pod ctest-pod-38263797 2024-09-18 00:50:20,581 - DEBUG - Pod : ctest-pod-38263797 UUID is 7b04267b-9541-4018-ae2e-8d37c618d84a 2024-09-18 00:50:20,583 - DEBUG - Pod ctest-pod-83836230 not present 2024-09-18 00:50:20,584 - INFO - Creating Pod ctest-pod-83836230 2024-09-18 00:50:20,607 - DEBUG - Pod : ctest-pod-83836230 UUID is 35708340-7050-4205-9b63-cac817803b12 2024-09-18 00:50:20,787 - INFO - Project default-domain:k8s-ctest-new-default-65037265 for Namespace ctest-new-default-65037265 is seen in contrail-api 2024-09-18 00:50:20,787 - DEBUG - Project uuid in Contrail is 640a8cd5-4c00-4f1d-aca2-c7e23917bbae 2024-09-18 00:50:20,977 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=da4c0743-c5cf-4bbb-a4b6-15d08327b9b0 2024-09-18 00:50:20,981 - INFO - Namespace ctest-new-default-65037265 with uuid da4c0743-c5cf-4bbb-a4b6-15d08327b9b0 found in kube manager 2024-09-18 00:50:20,981 - INFO - Namespace ctest-new-default-65037265 verification passed 2024-09-18 00:50:21,201 - INFO - Project default-domain:k8s-ctest-non-default-76230090 for Namespace ctest-non-default-76230090 is seen in contrail-api 2024-09-18 00:50:21,201 - DEBUG - Project uuid in Contrail is bc98624b-d041-4341-921f-24ca03a54cd5 2024-09-18 00:50:21,201 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=25a67864-a1ee-475e-b680-33d107d7daf8 2024-09-18 00:50:21,206 - INFO - Namespace ctest-non-default-76230090 with uuid 25a67864-a1ee-475e-b680-33d107d7daf8 found in kube manager 2024-09-18 00:50:21,206 - INFO - Namespace ctest-non-default-76230090 verification passed 2024-09-18 00:50:21,212 - DEBUG - Pod ctest-pod-02983566 not in running state.Currently in Pending 2024-09-18 00:50:26,220 - DEBUG - Pod ctest-pod-02983566 not in running state.Currently in Pending 2024-09-18 00:50:31,240 - DEBUG - Pod ctest-pod-02983566 not in running state.Currently in Pending 2024-09-18 00:50:36,249 - INFO - Pod ctest-pod-02983566 is in running state.Got IP 10.47.255.251 2024-09-18 00:50:36,316 - DEBUG - Pod ctest-pod-02983566 has vmi fc1ab4b2-7557-11ef-85cc-fa163e034102 2024-09-18 00:50:36,316 - INFO - Verified pod ctest-pod-02983566 in contrail-api 2024-09-18 00:50:36,331 - DEBUG - VMI fc1ab4b2-7557-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:36,332 - INFO - Verified Pod ctest-pod-02983566 in agent 10.0.0.41 2024-09-18 00:50:36,332 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=e7f997bc-fb44-42dd-9507-f30eb3226786 2024-09-18 00:50:36,337 - INFO - Pod ctest-pod-02983566 with uuid e7f997bc-fb44-42dd-9507-f30eb3226786 found in kube manager 2024-09-18 00:50:36,337 - INFO - Pod ctest-pod-02983566 verification passed 2024-09-18 00:50:36,342 - INFO - Pod ctest-pod-46197429 is in running state.Got IP 10.47.255.250 2024-09-18 00:50:36,367 - DEBUG - Pod ctest-pod-46197429 has vmi fcb0df8c-7557-11ef-85cc-fa163e034102 2024-09-18 00:50:36,367 - INFO - Verified pod ctest-pod-46197429 in contrail-api 2024-09-18 00:50:36,381 - DEBUG - VMI fcb0df8c-7557-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:36,381 - INFO - Verified Pod ctest-pod-46197429 in agent 10.0.0.41 2024-09-18 00:50:36,381 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=01f76de4-fe19-462b-b76e-353700ad5a69 2024-09-18 00:50:36,386 - INFO - Pod ctest-pod-46197429 with uuid 01f76de4-fe19-462b-b76e-353700ad5a69 found in kube manager 2024-09-18 00:50:36,387 - INFO - Pod ctest-pod-46197429 verification passed 2024-09-18 00:50:36,393 - INFO - Pod ctest-pod-84436212 is in running state.Got IP 10.47.255.249 2024-09-18 00:50:36,459 - DEBUG - Pod ctest-pod-84436212 has vmi fd6fb95c-7557-11ef-85cc-fa163e034102 2024-09-18 00:50:36,459 - INFO - Verified pod ctest-pod-84436212 in contrail-api 2024-09-18 00:50:36,475 - DEBUG - VMI fd6fb95c-7557-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:36,475 - INFO - Verified Pod ctest-pod-84436212 in agent 10.0.0.41 2024-09-18 00:50:36,475 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=5bff7f5d-d4cb-4c52-a9f9-c9622236db8b 2024-09-18 00:50:36,482 - INFO - Pod ctest-pod-84436212 with uuid 5bff7f5d-d4cb-4c52-a9f9-c9622236db8b found in kube manager 2024-09-18 00:50:36,483 - INFO - Pod ctest-pod-84436212 verification passed 2024-09-18 00:50:36,490 - INFO - Pod ctest-pod-66671982 is in running state.Got IP 10.47.255.248 2024-09-18 00:50:38,024 - DEBUG - Pod ctest-pod-66671982 has vmi fdf77e00-7557-11ef-85cc-fa163e034102 2024-09-18 00:50:38,024 - INFO - Verified pod ctest-pod-66671982 in contrail-api 2024-09-18 00:50:38,041 - DEBUG - VMI fdf77e00-7557-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:38,043 - INFO - Verified Pod ctest-pod-66671982 in agent 10.0.0.41 2024-09-18 00:50:38,043 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=c5ebab39-3f43-454f-8208-3a9275044133 2024-09-18 00:50:38,051 - INFO - Pod ctest-pod-66671982 with uuid c5ebab39-3f43-454f-8208-3a9275044133 found in kube manager 2024-09-18 00:50:38,051 - INFO - Pod ctest-pod-66671982 verification passed 2024-09-18 00:50:38,061 - INFO - Pod ctest-pod-99683942 is in running state.Got IP 10.47.255.247 2024-09-18 00:50:38,089 - DEBUG - Pod ctest-pod-99683942 has vmi feae2ef2-7557-11ef-85cc-fa163e034102 2024-09-18 00:50:38,089 - INFO - Verified pod ctest-pod-99683942 in contrail-api 2024-09-18 00:50:38,104 - DEBUG - VMI feae2ef2-7557-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:38,104 - INFO - Verified Pod ctest-pod-99683942 in agent 10.0.0.41 2024-09-18 00:50:38,104 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=fe0a6588-769e-4166-a47f-096e2c0a1d2c 2024-09-18 00:50:38,109 - INFO - Pod ctest-pod-99683942 with uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c found in kube manager 2024-09-18 00:50:38,110 - INFO - Pod ctest-pod-99683942 verification passed 2024-09-18 00:50:38,124 - INFO - Pod ctest-pod-38263797 is in running state.Got IP 10.47.255.245 2024-09-18 00:50:38,145 - DEBUG - Pod ctest-pod-38263797 has vmi 008d9140-7558-11ef-85cc-fa163e034102 2024-09-18 00:50:38,146 - INFO - Verified pod ctest-pod-38263797 in contrail-api 2024-09-18 00:50:38,165 - DEBUG - VMI 008d9140-7558-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:38,165 - INFO - Verified Pod ctest-pod-38263797 in agent 10.0.0.41 2024-09-18 00:50:38,165 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=7b04267b-9541-4018-ae2e-8d37c618d84a 2024-09-18 00:50:38,174 - INFO - Pod ctest-pod-38263797 with uuid 7b04267b-9541-4018-ae2e-8d37c618d84a found in kube manager 2024-09-18 00:50:38,174 - INFO - Pod ctest-pod-38263797 verification passed 2024-09-18 00:50:38,184 - INFO - Pod ctest-pod-45970574 is in running state.Got IP 10.47.255.246 2024-09-18 00:50:38,248 - DEBUG - Pod ctest-pod-45970574 has vmi ff3f0f26-7557-11ef-85cc-fa163e034102 2024-09-18 00:50:38,248 - INFO - Verified pod ctest-pod-45970574 in contrail-api 2024-09-18 00:50:38,265 - DEBUG - VMI ff3f0f26-7557-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:38,265 - INFO - Verified Pod ctest-pod-45970574 in agent 10.0.0.41 2024-09-18 00:50:38,266 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=85028813-ff6b-4a22-a902-b1359dfd5233 2024-09-18 00:50:38,270 - INFO - Pod ctest-pod-45970574 with uuid 85028813-ff6b-4a22-a902-b1359dfd5233 found in kube manager 2024-09-18 00:50:38,271 - INFO - Pod ctest-pod-45970574 verification passed 2024-09-18 00:50:38,276 - DEBUG - Pod ctest-pod-83836230 not in running state.Currently in Pending 2024-09-18 00:50:43,283 - INFO - Pod ctest-pod-83836230 is in running state.Got IP 10.47.255.244 2024-09-18 00:50:43,300 - DEBUG - Pod ctest-pod-83836230 has vmi 0125d1a8-7558-11ef-85cc-fa163e034102 2024-09-18 00:50:43,300 - INFO - Verified pod ctest-pod-83836230 in contrail-api 2024-09-18 00:50:43,313 - DEBUG - VMI 0125d1a8-7558-11ef-85cc-fa163e034102 is active in agent 10.0.0.41 2024-09-18 00:50:43,314 - INFO - Verified Pod ctest-pod-83836230 in agent 10.0.0.41 2024-09-18 00:50:43,314 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=35708340-7050-4205-9b63-cac817803b12 2024-09-18 00:50:43,322 - INFO - Pod ctest-pod-83836230 with uuid 35708340-7050-4205-9b63-cac817803b12 found in kube manager 2024-09-18 00:50:43,322 - INFO - Pod ctest-pod-83836230 verification passed 2024-09-18 00:50:43,323 - INFO - ================================================================================ 2024-09-18 00:50:43,323 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-18 00:50:43,323 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-18 00:50:43,555 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.23': '0'}} with 2024-09-18 00:50:43,555 - INFO - Initial checks done. Running the testcase now 2024-09-18 00:50:43,555 - INFO - 2024-09-18 00:50:43,617 - DEBUG - [Pod ctest-pod-02983566] Cmd: echo ctest-pod-02983566 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:50:43,668 - DEBUG - [Pod ctest-pod-46197429] Cmd: echo ctest-pod-46197429 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:50:43,715 - DEBUG - [Pod ctest-pod-84436212] Cmd: echo ctest-pod-84436212 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:50:43,778 - DEBUG - [Pod ctest-pod-66671982] Cmd: echo ctest-pod-66671982 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:50:43,782 - DEBUG - Service ctest-nginx-svc-20919877 not present 2024-09-18 00:50:43,782 - INFO - Creating service ctest-nginx-svc-20919877 2024-09-18 00:50:43,808 - INFO - Created Service ctest-nginx-svc-20919877 2024-09-18 00:50:43,812 - WARNING - Service UUID f14969db-2bc4-4936-8f6a-15e069312ae8 not yet found in contrail-api 2024-09-18 00:50:44,823 - INFO - Validated that Service ctest-nginx-svc-20919877 is seen in contrail-api 2024-09-18 00:50:44,823 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=f14969db-2bc4-4936-8f6a-15e069312ae8 2024-09-18 00:50:44,828 - INFO - Service ctest-nginx-svc-20919877 with uuid f14969db-2bc4-4936-8f6a-15e069312ae8 found in kube manager 2024-09-18 00:50:44,828 - INFO - Service ctest-nginx-svc-20919877 verification passed 2024-09-18 00:50:47,913 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) ctest-pod-46197429 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:47,914 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:50:47,914 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) ctest-pod-46197429 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:47,980 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:47,981 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:50:47,981 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,051 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46197429 2024-09-18 00:50:48,051 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:50:48,051 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46197429 2024-09-18 00:50:48,116 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,116 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:50:48,116 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,116 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-02983566': 1, 'ctest-pod-46197429': 3} 2024-09-18 00:50:48,171 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,172 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:50:48,172 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,248 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,248 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:50:48,248 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:50:48,248 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-02983566': 1, 'ctest-pod-46197429': 1} 2024-09-18 00:50:48,251 - DEBUG - Network policy ingress-on-service not present 2024-09-18 00:50:48,252 - INFO - Creating Network Policy ingress-on-service 2024-09-18 00:50:48,262 - INFO - Network policy found in k8s 2024-09-18 00:50:48,262 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2e88731e-262a-4464-aef3-733c09b66a0b 2024-09-18 00:50:48,275 - INFO - Network Policy ingress-on-service with uuid 2e88731e-262a-4464-aef3-733c09b66a0b found in kube manager 2024-09-18 00:50:48,319 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-18 00:50:48,319 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-18 00:50:48,320 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2e88731e-262a-4464-aef3-733c09b66a0b 2024-09-18 00:50:48,361 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-18 00:50:50,362 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2e88731e-262a-4464-aef3-733c09b66a0b 2024-09-18 00:50:50,404 - INFO - Network policy with name ingress-on-service found in agent 2024-09-18 00:50:50,404 - INFO - Network Policy ingress-on-service verification passed 2024-09-18 00:50:55,478 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:50:55,478 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:50:55,478 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:00,542 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:00,542 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:00,542 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:05,610 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:05,610 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:05,610 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:10,667 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:10,667 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:10,667 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:16,981 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:16,981 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:16,981 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:22,041 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:22,041 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:22,041 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:27,115 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:27,115 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:27,115 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:32,166 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:32,167 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:32,167 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:37,219 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:37,219 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:37,219 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:43,072 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:43,072 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:43,072 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:43,072 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-02983566': 0, 'ctest-pod-46197429': 0} 2024-09-18 00:51:43,131 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:51:43,131 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:51:43,131 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:51:43,187 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:51:43,187 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:51:43,187 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:51:43,188 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-02983566': 1, 'ctest-pod-46197429': 1} 2024-09-18 00:51:48,256 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:48,256 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:48,256 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:53,311 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:53,311 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:53,311 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:58,366 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:58,366 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:51:58,366 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:03,422 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:03,422 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:03,423 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:08,478 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:08,478 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:08,478 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:13,526 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:13,526 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:13,526 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:18,591 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:18,591 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:18,591 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:23,642 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:23,642 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:23,642 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:28,710 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:28,710 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:28,710 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:33,764 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:33,764 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:33,764 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:33,764 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-02983566': 0, 'ctest-pod-46197429': 0} 2024-09-18 00:52:35,831 - DEBUG - [Pod ctest-pod-45970574] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.427 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.064 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.064/0.519/1.427 ms 2024-09-18 00:52:35,831 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-45970574 with expectation True passed 2024-09-18 00:52:37,890 - DEBUG - [Pod ctest-pod-99683942] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.539 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.229/0.539 ms 2024-09-18 00:52:37,890 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99683942 with expectation True passed 2024-09-18 00:52:39,963 - DEBUG - [Pod ctest-pod-38263797] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.320 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.489/1.320 ms 2024-09-18 00:52:39,963 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-38263797 with expectation True passed 2024-09-18 00:52:40,024 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:52:40,024 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:52:40,024 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:52:40,024 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45970574 passed 2024-09-18 00:52:40,084 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:52:40,084 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:52:40,084 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:52:40,084 - INFO - wget check of of http://10.47.255.250 from ctest-pod-45970574 passed 2024-09-18 00:52:45,702 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:52:45,702 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:52:45,702 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:52:45,702 - INFO - wget check of of http://10.47.255.250 from ctest-pod-99683942 passed 2024-09-18 00:52:50,756 - DEBUG - [Pod ctest-pod-83836230] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 00:52:50,756 - DEBUG - [Pod Pod ctest-pod-83836230] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 00:52:50,756 - DEBUG - [Pod Pod ctest-pod-83836230] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 00:52:50,756 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83836230 passed 2024-09-18 00:52:50,764 - INFO - Updating Network Policy ingress-on-service 2024-09-18 00:52:55,816 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:55,816 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:52:55,816 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:00,874 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:01,285 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:01,285 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:06,416 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:06,416 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:06,416 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:11,468 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:11,468 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:11,468 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:16,530 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:16,530 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:16,530 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:21,590 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:21,590 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:21,590 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:26,666 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:26,667 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:26,667 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:31,726 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:31,726 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:31,726 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:36,788 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:36,788 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:36,788 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:41,846 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:41,846 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:41,846 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) wget: download timed out 2024-09-18 00:53:41,846 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-02983566': 0, 'ctest-pod-46197429': 0} 2024-09-18 00:53:41,912 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:41,912 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:53:41,912 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:41,967 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46197429 2024-09-18 00:53:41,967 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:53:41,967 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46197429 2024-09-18 00:53:41,967 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-02983566': 1, 'ctest-pod-46197429': 1} 2024-09-18 00:53:42,026 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:42,026 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:53:42,027 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:42,074 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:42,074 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:53:42,074 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: ctest-pod-02983566 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:42,146 - DEBUG - [Pod ctest-pod-38263797] Cmd: wget http://10.108.208.13:80/ -O - -T 5 -t 1 , Output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:42,146 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd wget http://10.108.208.13:80/ -O - -T 5 -t 1 passed 2024-09-18 00:53:42,146 - DEBUG - [Pod Pod ctest-pod-38263797] Cmd output: ctest-pod-46197429 Connecting to 10.108.208.13:80 (10.108.208.13:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:53:42,146 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-02983566': 2, 'ctest-pod-46197429': 1} 2024-09-18 00:53:44,204 - DEBUG - [Pod ctest-pod-45970574] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.955 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.372/0.955 ms 2024-09-18 00:53:44,204 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-45970574 with expectation True passed 2024-09-18 00:53:46,254 - DEBUG - [Pod ctest-pod-99683942] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.679 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.274/0.679 ms 2024-09-18 00:53:46,254 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99683942 with expectation True passed 2024-09-18 00:53:48,325 - DEBUG - [Pod ctest-pod-38263797] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.002 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.716/2.002 ms 2024-09-18 00:53:48,325 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-38263797 with expectation True passed 2024-09-18 00:53:48,769 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:53:48,769 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:53:48,769 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:53:48,769 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45970574 passed 2024-09-18 00:53:48,828 - DEBUG - [Pod ctest-pod-45970574] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:53:48,828 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:53:48,828 - DEBUG - [Pod Pod ctest-pod-45970574] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:53:48,828 - INFO - wget check of of http://10.47.255.250 from ctest-pod-45970574 passed 2024-09-18 00:53:53,902 - DEBUG - [Pod ctest-pod-99683942] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:53:53,902 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:53:53,902 - DEBUG - [Pod Pod ctest-pod-99683942] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:53:53,902 - INFO - wget check of of http://10.47.255.250 from ctest-pod-99683942 passed 2024-09-18 00:53:53,970 - DEBUG - [Pod ctest-pod-83836230] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:53:53,970 - DEBUG - [Pod Pod ctest-pod-83836230] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:53:53,970 - DEBUG - [Pod Pod ctest-pod-83836230] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:53:53,970 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83836230 passed 2024-09-18 00:53:53,970 - INFO - Deleting Network Policy : ingress-on-service 2024-09-18 00:53:53,970 - INFO - Deleting service : ctest-nginx-svc-20919877 2024-09-18 00:53:54,215 - DEBUG - No XMPP flaps were noticed during the test 2024-09-18 00:53:54,215 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2024-09-18 00:53:54,215 - INFO - -------------------------------------------------------------------------------- 2024-09-18 00:53:54,221 - INFO - Deleting pod ctest-new-default-65037265:ctest-pod-02983566 2024-09-18 00:53:54,221 - INFO - Deleting pod ctest-new-default-65037265:ctest-pod-46197429 2024-09-18 00:53:54,222 - INFO - Deleting pod ctest-non-default-76230090:ctest-pod-84436212 2024-09-18 00:53:54,222 - INFO - Deleting pod ctest-non-default-76230090:ctest-pod-66671982 2024-09-18 00:53:54,222 - INFO - Deleting pod ctest-new-default-65037265:ctest-pod-99683942 2024-09-18 00:53:54,223 - INFO - Deleting pod ctest-new-default-65037265:ctest-pod-45970574 2024-09-18 00:53:54,223 - INFO - Deleting pod ctest-non-default-76230090:ctest-pod-38263797 2024-09-18 00:53:54,224 - INFO - Deleting pod ctest-non-default-76230090:ctest-pod-83836230 2024-09-18 00:53:54,252 - WARNING - Pod uuid e7f997bc-fb44-42dd-9507-f30eb3226786 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,327 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,329 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,372 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,373 - WARNING - Pod uuid 5bff7f5d-d4cb-4c52-a9f9-c9622236db8b is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,374 - WARNING - Pod uuid 01f76de4-fe19-462b-b76e-353700ad5a69 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,374 - WARNING - Pod uuid c5ebab39-3f43-454f-8208-3a9275044133 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:54,374 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,262 - WARNING - Pod uuid e7f997bc-fb44-42dd-9507-f30eb3226786 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,352 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,352 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,422 - DEBUG - Pod 01f76de4-fe19-462b-b76e-353700ad5a69 is not in agent 10.0.0.41 VM list 2024-09-18 00:53:59,423 - DEBUG - Pod 5bff7f5d-d4cb-4c52-a9f9-c9622236db8b is not in agent 10.0.0.41 VM list 2024-09-18 00:53:59,428 - WARNING - Pod uuid c5ebab39-3f43-454f-8208-3a9275044133 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,429 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,429 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:53:59,436 - DEBUG - VMI fd6fb95c-7557-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:53:59,436 - INFO - Verified that pod ctest-pod-84436212 is removed in agent 2024-09-18 00:53:59,437 - DEBUG - VMI fcb0df8c-7557-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:53:59,437 - INFO - Verified that pod ctest-pod-46197429 is removed in agent 2024-09-18 00:54:04,271 - DEBUG - Pod e7f997bc-fb44-42dd-9507-f30eb3226786 is not in agent 10.0.0.41 VM list 2024-09-18 00:54:04,278 - DEBUG - VMI fc1ab4b2-7557-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:54:04,278 - INFO - Verified that pod ctest-pod-02983566 is removed in agent 2024-09-18 00:54:04,366 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:04,367 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:04,445 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:04,446 - DEBUG - Pod c5ebab39-3f43-454f-8208-3a9275044133 is not in agent 10.0.0.41 VM list 2024-09-18 00:54:04,448 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:04,454 - DEBUG - VMI fdf77e00-7557-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:54:04,454 - INFO - Verified that pod ctest-pod-66671982 is removed in agent 2024-09-18 00:54:09,378 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:09,380 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:09,455 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:09,456 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:14,391 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:14,392 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:14,469 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:14,470 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:19,403 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:19,404 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:19,481 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:19,482 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:24,423 - WARNING - Pod uuid 85028813-ff6b-4a22-a902-b1359dfd5233 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:24,424 - WARNING - Pod uuid fe0a6588-769e-4166-a47f-096e2c0a1d2c is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:24,495 - WARNING - Pod uuid 7b04267b-9541-4018-ae2e-8d37c618d84a is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:24,498 - WARNING - Pod uuid 35708340-7050-4205-9b63-cac817803b12 is still seen in agent 10.0.0.41 VM list 2024-09-18 00:54:29,437 - DEBUG - Pod fe0a6588-769e-4166-a47f-096e2c0a1d2c is not in agent 10.0.0.41 VM list 2024-09-18 00:54:29,438 - DEBUG - Pod 85028813-ff6b-4a22-a902-b1359dfd5233 is not in agent 10.0.0.41 VM list 2024-09-18 00:54:29,446 - DEBUG - VMI ff3f0f26-7557-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:54:29,446 - INFO - Verified that pod ctest-pod-45970574 is removed in agent 2024-09-18 00:54:29,448 - DEBUG - VMI feae2ef2-7557-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:54:29,448 - INFO - Verified that pod ctest-pod-99683942 is removed in agent 2024-09-18 00:54:29,509 - DEBUG - Pod 7b04267b-9541-4018-ae2e-8d37c618d84a is not in agent 10.0.0.41 VM list 2024-09-18 00:54:29,512 - DEBUG - Pod 35708340-7050-4205-9b63-cac817803b12 is not in agent 10.0.0.41 VM list 2024-09-18 00:54:29,522 - DEBUG - VMI 0125d1a8-7558-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:54:29,522 - INFO - Verified that pod ctest-pod-83836230 is removed in agent 2024-09-18 00:54:29,523 - DEBUG - VMI 008d9140-7558-11ef-85cc-fa163e034102 is removed from agent 10.0.0.41 2024-09-18 00:54:29,523 - INFO - Verified that pod ctest-pod-38263797 is removed in agent 2024-09-18 00:54:29,523 - INFO - Deleting namespace ctest-non-default-76230090 2024-09-18 00:54:29,541 - DEBUG - Namespace ctest-non-default-76230090 still in k8s 2024-09-18 00:54:31,549 - DEBUG - Namespace ctest-non-default-76230090 still in k8s 2024-09-18 00:54:33,554 - DEBUG - Namespace ctest-non-default-76230090 still in k8s 2024-09-18 00:54:35,557 - DEBUG - Namespace ctest-non-default-76230090 is not in k8s 2024-09-18 00:54:35,558 - DEBUG - No need to check project deletion in contrail-api 2024-09-18 00:54:35,558 - INFO - Deleting namespace ctest-new-default-65037265 2024-09-18 00:54:35,566 - DEBUG - Namespace ctest-new-default-65037265 still in k8s 2024-09-18 00:54:37,571 - DEBUG - Namespace ctest-new-default-65037265 still in k8s 2024-09-18 00:54:39,576 - DEBUG - Namespace ctest-new-default-65037265 still in k8s 2024-09-18 00:54:41,579 - DEBUG - Namespace ctest-new-default-65037265 is not in k8s 2024-09-18 00:54:41,579 - DEBUG - No need to check project deletion in contrail-api