2026-02-09 17:14:30,269 - INFO - Using existing project ['default-domain', 'k8s-default'](291ce39a-e78f-4cae-bea3-ee244a41a6f2) 2026-02-09 17:14:30,287 - DEBUG - Namespace ctest-new-default-14196421 not present 2026-02-09 17:14:30,297 - INFO - Created namespace ctest-new-default-14196421 2026-02-09 17:14:33,301 - DEBUG - Namespace ctest-non-default-30496832 not present 2026-02-09 17:14:33,313 - INFO - Created namespace ctest-non-default-30496832 2026-02-09 17:14:36,335 - DEBUG - Pod ctest-pod-08952532 not present 2026-02-09 17:14:36,335 - INFO - Creating Pod ctest-pod-08952532 2026-02-09 17:14:36,370 - DEBUG - Pod : ctest-pod-08952532 UUID is 00955777-659a-4cbb-9c07-2fb154476b5c 2026-02-09 17:14:36,382 - DEBUG - Pod ctest-pod-05221751 not present 2026-02-09 17:14:36,387 - INFO - Creating Pod ctest-pod-05221751 2026-02-09 17:14:36,424 - DEBUG - Pod : ctest-pod-05221751 UUID is 96507058-edde-45a3-8c6e-c6ea4b9783ed 2026-02-09 17:14:36,440 - DEBUG - Pod ctest-pod-98279297 not present 2026-02-09 17:14:36,441 - INFO - Creating Pod ctest-pod-98279297 2026-02-09 17:14:36,506 - DEBUG - Pod : ctest-pod-98279297 UUID is 47dd45dd-e5d4-47a4-8b9e-f23f3c600635 2026-02-09 17:14:36,512 - DEBUG - Pod ctest-pod-59789309 not present 2026-02-09 17:14:36,512 - INFO - Creating Pod ctest-pod-59789309 2026-02-09 17:14:36,536 - DEBUG - Pod : ctest-pod-59789309 UUID is f6a7b20d-d5ae-4b5d-bcce-98e793ead8af 2026-02-09 17:14:36,538 - DEBUG - Pod ctest-pod-97673319 not present 2026-02-09 17:14:36,539 - INFO - Creating Pod ctest-pod-97673319 2026-02-09 17:14:36,570 - DEBUG - Pod : ctest-pod-97673319 UUID is 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf 2026-02-09 17:14:36,573 - DEBUG - Pod ctest-pod-33811179 not present 2026-02-09 17:14:36,574 - INFO - Creating Pod ctest-pod-33811179 2026-02-09 17:14:36,597 - DEBUG - Pod : ctest-pod-33811179 UUID is a1e48fcb-726e-45b6-81df-178a4f6c8904 2026-02-09 17:14:36,601 - DEBUG - Pod ctest-pod-78771638 not present 2026-02-09 17:14:36,602 - INFO - Creating Pod ctest-pod-78771638 2026-02-09 17:14:36,632 - DEBUG - Pod : ctest-pod-78771638 UUID is 12985868-5cb4-471c-af46-cff18b1ef47f 2026-02-09 17:14:36,635 - DEBUG - Pod ctest-pod-71202615 not present 2026-02-09 17:14:36,635 - INFO - Creating Pod ctest-pod-71202615 2026-02-09 17:14:36,660 - DEBUG - Pod : ctest-pod-71202615 UUID is 967935e7-7c2e-4678-800b-0e00197ebc22 2026-02-09 17:14:36,922 - INFO - Project default-domain:k8s-ctest-new-default-14196421 for Namespace ctest-new-default-14196421 is seen in contrail-api 2026-02-09 17:14:36,922 - DEBUG - Project uuid in Contrail is e7aad71d-7548-4069-9dc6-02ffc196ce2b 2026-02-09 17:14:37,076 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=84b86107-f0f1-4a03-936d-1959c7c7af76 2026-02-09 17:14:37,080 - INFO - Namespace ctest-new-default-14196421 with uuid 84b86107-f0f1-4a03-936d-1959c7c7af76 found in kube manager 2026-02-09 17:14:37,080 - INFO - Namespace ctest-new-default-14196421 verification passed 2026-02-09 17:14:37,313 - INFO - Project default-domain:k8s-ctest-non-default-30496832 for Namespace ctest-non-default-30496832 is seen in contrail-api 2026-02-09 17:14:37,313 - DEBUG - Project uuid in Contrail is 63cd0098-bca7-405a-a932-5652cc8ab9da 2026-02-09 17:14:37,313 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=8f5626f1-477c-4fb3-9c3f-f7f7fda5b8e2 2026-02-09 17:14:37,317 - INFO - Namespace ctest-non-default-30496832 with uuid 8f5626f1-477c-4fb3-9c3f-f7f7fda5b8e2 found in kube manager 2026-02-09 17:14:37,318 - INFO - Namespace ctest-non-default-30496832 verification passed 2026-02-09 17:14:37,324 - DEBUG - Pod ctest-pod-08952532 not in running state.Currently in Pending 2026-02-09 17:14:42,334 - DEBUG - Pod ctest-pod-08952532 not in running state.Currently in Pending 2026-02-09 17:14:47,342 - DEBUG - Pod ctest-pod-08952532 not in running state.Currently in Pending 2026-02-09 17:14:52,352 - INFO - Pod ctest-pod-08952532 is in running state.Got IP 10.47.255.251 2026-02-09 17:14:52,365 - DEBUG - Pod ctest-pod-08952532 has vmi d03b2f2e-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:52,366 - INFO - Verified pod ctest-pod-08952532 in contrail-api 2026-02-09 17:14:52,378 - DEBUG - VMI d03b2f2e-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:52,379 - INFO - Verified Pod ctest-pod-08952532 in agent 10.0.0.23 2026-02-09 17:14:52,379 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=00955777-659a-4cbb-9c07-2fb154476b5c 2026-02-09 17:14:52,383 - INFO - Pod ctest-pod-08952532 with uuid 00955777-659a-4cbb-9c07-2fb154476b5c found in kube manager 2026-02-09 17:14:52,383 - INFO - Pod ctest-pod-08952532 verification passed 2026-02-09 17:14:52,389 - INFO - Pod ctest-pod-05221751 is in running state.Got IP 10.47.255.250 2026-02-09 17:14:52,445 - DEBUG - Pod ctest-pod-05221751 has vmi d0ac0cee-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:52,445 - INFO - Verified pod ctest-pod-05221751 in contrail-api 2026-02-09 17:14:52,459 - DEBUG - VMI d0ac0cee-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:52,459 - INFO - Verified Pod ctest-pod-05221751 in agent 10.0.0.23 2026-02-09 17:14:52,459 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=96507058-edde-45a3-8c6e-c6ea4b9783ed 2026-02-09 17:14:52,463 - INFO - Pod ctest-pod-05221751 with uuid 96507058-edde-45a3-8c6e-c6ea4b9783ed found in kube manager 2026-02-09 17:14:52,464 - INFO - Pod ctest-pod-05221751 verification passed 2026-02-09 17:14:52,472 - INFO - Pod ctest-pod-98279297 is in running state.Got IP 10.47.255.249 2026-02-09 17:14:52,485 - DEBUG - Pod ctest-pod-98279297 has vmi d132e660-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:52,485 - INFO - Verified pod ctest-pod-98279297 in contrail-api 2026-02-09 17:14:52,496 - DEBUG - VMI d132e660-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:52,496 - INFO - Verified Pod ctest-pod-98279297 in agent 10.0.0.23 2026-02-09 17:14:52,496 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=47dd45dd-e5d4-47a4-8b9e-f23f3c600635 2026-02-09 17:14:52,500 - INFO - Pod ctest-pod-98279297 with uuid 47dd45dd-e5d4-47a4-8b9e-f23f3c600635 found in kube manager 2026-02-09 17:14:52,500 - INFO - Pod ctest-pod-98279297 verification passed 2026-02-09 17:14:52,506 - INFO - Pod ctest-pod-59789309 is in running state.Got IP 10.47.255.248 2026-02-09 17:14:52,560 - DEBUG - Pod ctest-pod-59789309 has vmi d1a08e22-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:52,560 - INFO - Verified pod ctest-pod-59789309 in contrail-api 2026-02-09 17:14:52,573 - DEBUG - VMI d1a08e22-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:52,573 - INFO - Verified Pod ctest-pod-59789309 in agent 10.0.0.23 2026-02-09 17:14:52,573 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=f6a7b20d-d5ae-4b5d-bcce-98e793ead8af 2026-02-09 17:14:52,578 - INFO - Pod ctest-pod-59789309 with uuid f6a7b20d-d5ae-4b5d-bcce-98e793ead8af found in kube manager 2026-02-09 17:14:52,578 - INFO - Pod ctest-pod-59789309 verification passed 2026-02-09 17:14:52,586 - INFO - Pod ctest-pod-97673319 is in running state.Got IP 10.47.255.247 2026-02-09 17:14:52,641 - DEBUG - Pod ctest-pod-97673319 has vmi d20d7bb8-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:52,641 - INFO - Verified pod ctest-pod-97673319 in contrail-api 2026-02-09 17:14:52,654 - DEBUG - VMI d20d7bb8-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:52,655 - INFO - Verified Pod ctest-pod-97673319 in agent 10.0.0.23 2026-02-09 17:14:52,655 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=2be01c8c-9582-4d7e-8817-8fb8ecb81dcf 2026-02-09 17:14:52,659 - INFO - Pod ctest-pod-97673319 with uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf found in kube manager 2026-02-09 17:14:52,659 - INFO - Pod ctest-pod-97673319 verification passed 2026-02-09 17:14:52,668 - DEBUG - Pod ctest-pod-78771638 not in running state.Currently in Pending 2026-02-09 17:14:57,675 - INFO - Pod ctest-pod-78771638 is in running state.Got IP 10.47.255.245 2026-02-09 17:14:57,685 - DEBUG - Pod ctest-pod-78771638 has vmi d2f056d6-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:57,686 - INFO - Verified pod ctest-pod-78771638 in contrail-api 2026-02-09 17:14:57,696 - DEBUG - VMI d2f056d6-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:57,696 - INFO - Verified Pod ctest-pod-78771638 in agent 10.0.0.23 2026-02-09 17:14:57,696 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=12985868-5cb4-471c-af46-cff18b1ef47f 2026-02-09 17:14:57,700 - INFO - Pod ctest-pod-78771638 with uuid 12985868-5cb4-471c-af46-cff18b1ef47f found in kube manager 2026-02-09 17:14:57,700 - INFO - Pod ctest-pod-78771638 verification passed 2026-02-09 17:14:57,707 - INFO - Pod ctest-pod-33811179 is in running state.Got IP 10.47.255.246 2026-02-09 17:14:57,761 - DEBUG - Pod ctest-pod-33811179 has vmi d28532f2-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:57,761 - INFO - Verified pod ctest-pod-33811179 in contrail-api 2026-02-09 17:14:57,773 - DEBUG - VMI d28532f2-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:57,773 - INFO - Verified Pod ctest-pod-33811179 in agent 10.0.0.23 2026-02-09 17:14:57,773 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=a1e48fcb-726e-45b6-81df-178a4f6c8904 2026-02-09 17:14:57,777 - INFO - Pod ctest-pod-33811179 with uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 found in kube manager 2026-02-09 17:14:57,777 - INFO - Pod ctest-pod-33811179 verification passed 2026-02-09 17:14:57,783 - INFO - Pod ctest-pod-71202615 is in running state.Got IP 10.47.255.244 2026-02-09 17:14:57,795 - DEBUG - Pod ctest-pod-71202615 has vmi d366b308-05da-11f1-baf2-fa163e3f3bcf 2026-02-09 17:14:57,795 - INFO - Verified pod ctest-pod-71202615 in contrail-api 2026-02-09 17:14:57,806 - DEBUG - VMI d366b308-05da-11f1-baf2-fa163e3f3bcf is active in agent 10.0.0.23 2026-02-09 17:14:57,806 - INFO - Verified Pod ctest-pod-71202615 in agent 10.0.0.23 2026-02-09 17:14:57,807 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=967935e7-7c2e-4678-800b-0e00197ebc22 2026-02-09 17:14:57,810 - INFO - Pod ctest-pod-71202615 with uuid 967935e7-7c2e-4678-800b-0e00197ebc22 found in kube manager 2026-02-09 17:14:57,810 - INFO - Pod ctest-pod-71202615 verification passed 2026-02-09 17:14:57,810 - INFO - ================================================================================ 2026-02-09 17:14:57,810 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-02-09 17:14:57,810 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-02-09 17:14:58,034 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.33': '0'}} with 2026-02-09 17:14:58,034 - INFO - Initial checks done. Running the testcase now 2026-02-09 17:14:58,034 - INFO - 2026-02-09 17:14:58,090 - DEBUG - [Pod ctest-pod-08952532] Cmd: echo ctest-pod-08952532 > /usr/share/nginx/html/index.html, Output: 2026-02-09 17:14:58,154 - DEBUG - [Pod ctest-pod-05221751] Cmd: echo ctest-pod-05221751 > /usr/share/nginx/html/index.html, Output: 2026-02-09 17:14:58,210 - DEBUG - [Pod ctest-pod-98279297] Cmd: echo ctest-pod-98279297 > /usr/share/nginx/html/index.html, Output: 2026-02-09 17:14:58,271 - DEBUG - [Pod ctest-pod-59789309] Cmd: echo ctest-pod-59789309 > /usr/share/nginx/html/index.html, Output: 2026-02-09 17:14:58,280 - DEBUG - Service ctest-nginx-svc-19729039 not present 2026-02-09 17:14:58,281 - INFO - Creating service ctest-nginx-svc-19729039 2026-02-09 17:14:58,307 - INFO - Created Service ctest-nginx-svc-19729039 2026-02-09 17:14:58,316 - WARNING - Service UUID b8b6f391-6e18-4155-a169-10b91d0aa7bb not yet found in contrail-api 2026-02-09 17:14:59,322 - INFO - Validated that Service ctest-nginx-svc-19729039 is seen in contrail-api 2026-02-09 17:14:59,322 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=b8b6f391-6e18-4155-a169-10b91d0aa7bb 2026-02-09 17:14:59,326 - INFO - Service ctest-nginx-svc-19729039 with uuid b8b6f391-6e18-4155-a169-10b91d0aa7bb found in kube manager 2026-02-09 17:14:59,326 - INFO - Service ctest-nginx-svc-19729039 verification passed 2026-02-09 17:15:00,387 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-08952532 2026-02-09 17:15:00,387 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:00,387 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-08952532 2026-02-09 17:15:00,440 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05221751 2026-02-09 17:15:00,440 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:00,440 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05221751 2026-02-09 17:15:00,440 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08952532': 1, 'ctest-pod-05221751': 1} 2026-02-09 17:15:00,496 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-05221751 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:00,496 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:00,496 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: ctest-pod-05221751 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:00,553 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) ctest-pod-08952532 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:00,553 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:00,553 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) ctest-pod-08952532 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:00,553 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08952532': 1, 'ctest-pod-05221751': 1} 2026-02-09 17:15:00,556 - DEBUG - Network policy ingress-on-service not present 2026-02-09 17:15:00,556 - INFO - Creating Network Policy ingress-on-service 2026-02-09 17:15:00,575 - INFO - Network policy found in k8s 2026-02-09 17:15:00,575 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f2db2072-e71d-478c-bcec-de2516c799ee 2026-02-09 17:15:00,584 - INFO - Network Policy ingress-on-service with uuid f2db2072-e71d-478c-bcec-de2516c799ee found in kube manager 2026-02-09 17:15:00,623 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-02-09 17:15:00,623 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-02-09 17:15:00,624 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f2db2072-e71d-478c-bcec-de2516c799ee 2026-02-09 17:15:00,655 - WARNING - Network policy with name ingress-on-service not found in agent 2026-02-09 17:15:02,656 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f2db2072-e71d-478c-bcec-de2516c799ee 2026-02-09 17:15:02,679 - INFO - Network policy with name ingress-on-service found in agent 2026-02-09 17:15:02,680 - INFO - Network Policy ingress-on-service verification passed 2026-02-09 17:15:07,743 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:07,743 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:07,744 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:12,796 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:12,796 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:12,796 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:17,846 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:17,846 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:17,846 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:22,894 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:22,894 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:22,894 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:27,947 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:27,947 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:27,947 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:32,994 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:32,994 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:32,994 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:38,041 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:38,041 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:38,041 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:43,090 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:43,090 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:43,090 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:48,142 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:48,143 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:48,143 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:53,195 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:53,195 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:53,195 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:53,195 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-08952532': 0, 'ctest-pod-05221751': 0} 2026-02-09 17:15:53,260 - DEBUG - [Pod ctest-pod-33811179] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-05221751 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:53,260 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:53,260 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd output: ctest-pod-05221751 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:53,317 - DEBUG - [Pod ctest-pod-33811179] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-05221751 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:53,317 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:53,317 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd output: ctest-pod-05221751 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:53,373 - DEBUG - [Pod ctest-pod-33811179] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-08952532 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:53,373 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 passed 2026-02-09 17:15:53,373 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd output: ctest-pod-08952532 Connecting to 10.96.191.251:80 (10.96.191.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-09 17:15:53,373 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-08952532': 1, 'ctest-pod-05221751': 2} 2026-02-09 17:15:58,410 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:58,410 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:15:58,410 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:03,464 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:03,464 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:03,464 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:08,528 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:08,528 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:08,528 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:13,575 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:13,575 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:13,575 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:18,628 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:18,628 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:18,628 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:23,679 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:23,679 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:23,679 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:28,728 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:28,728 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:28,728 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:33,780 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:33,780 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:33,780 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:38,831 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:38,831 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:38,831 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:43,898 - DEBUG - [Pod ctest-pod-78771638] Cmd: wget http://10.96.191.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:43,898 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd wget http://10.96.191.251:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:43,898 - DEBUG - [Pod Pod ctest-pod-78771638] Cmd output: Connecting to 10.96.191.251:80 (10.96.191.251:80) wget: download timed out 2026-02-09 17:16:43,898 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-08952532': 0, 'ctest-pod-05221751': 0} 2026-02-09 17:16:45,955 - DEBUG - [Pod ctest-pod-33811179] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.908 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.362/0.908 ms 2026-02-09 17:16:45,955 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-33811179 with expectation True passed 2026-02-09 17:16:48,004 - DEBUG - [Pod ctest-pod-97673319] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.246 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.115 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.484/1.246 ms 2026-02-09 17:16:48,004 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97673319 with expectation True passed 2026-02-09 17:16:50,057 - DEBUG - [Pod ctest-pod-78771638] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.762 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.133 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.324/0.762 ms 2026-02-09 17:16:50,057 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78771638 with expectation True passed 2026-02-09 17:16:50,109 - DEBUG - [Pod ctest-pod-33811179] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:50,109 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:50,109 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:50,109 - INFO - wget check of of http://10.47.255.251 from ctest-pod-33811179 passed 2026-02-09 17:16:50,169 - DEBUG - [Pod ctest-pod-33811179] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:50,169 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:50,169 - DEBUG - [Pod Pod ctest-pod-33811179] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:50,169 - INFO - wget check of of http://10.47.255.250 from ctest-pod-33811179 passed 2026-02-09 17:16:50,225 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:50,225 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:50,225 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:50,225 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:16:52,281 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:52,281 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:52,281 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:52,281 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:16:54,337 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:54,337 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:54,337 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:54,337 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:16:56,408 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:56,408 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:56,408 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:56,408 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:16:58,467 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:58,467 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:16:58,467 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:16:58,467 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:00,517 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:00,517 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:17:00,517 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:00,517 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:02,573 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:02,574 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:17:02,574 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:02,574 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:04,642 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:04,642 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:17:04,642 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:04,642 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:06,698 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:06,699 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:17:06,699 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:06,699 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:08,749 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:08,749 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:17:08,749 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:08,749 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:10,813 - DEBUG - [Pod ctest-pod-97673319] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:10,813 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-09 17:17:10,813 - DEBUG - [Pod Pod ctest-pod-97673319] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-09 17:17:10,813 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-97673319 failed 2026-02-09 17:17:10,818 - INFO - Deleting Network Policy : ingress-on-service 2026-02-09 17:17:10,819 - INFO - Deleting service : ctest-nginx-svc-19729039 2026-02-09 17:17:11,050 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Feb 9 17:17:10 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1) 2860 assert self.validate_wget(self.client2_pod_ns1, url2) 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False) 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7f64c4f52af0>> self.client1_pod_ns1 = url2 = 'http://10.47.255.250' expectation undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) AssertionError 2026-02-09 17:17:11,057 - DEBUG - No XMPP flaps were noticed during the test 2026-02-09 17:17:11,057 - INFO -
2026-02-09 17:17:11,057 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:14]
2026-02-09 17:17:11,057 - INFO - -------------------------------------------------------------------------------- 2026-02-09 17:17:11,061 - INFO - Deleting pod ctest-new-default-14196421:ctest-pod-08952532 2026-02-09 17:17:11,061 - INFO - Deleting pod ctest-new-default-14196421:ctest-pod-05221751 2026-02-09 17:17:11,062 - INFO - Deleting pod ctest-non-default-30496832:ctest-pod-98279297 2026-02-09 17:17:11,062 - INFO - Deleting pod ctest-non-default-30496832:ctest-pod-59789309 2026-02-09 17:17:11,062 - INFO - Deleting pod ctest-new-default-14196421:ctest-pod-97673319 2026-02-09 17:17:11,063 - INFO - Deleting pod ctest-new-default-14196421:ctest-pod-33811179 2026-02-09 17:17:11,063 - INFO - Deleting pod ctest-non-default-30496832:ctest-pod-78771638 2026-02-09 17:17:11,063 - INFO - Deleting pod ctest-non-default-30496832:ctest-pod-71202615 2026-02-09 17:17:11,156 - WARNING - Pod uuid f6a7b20d-d5ae-4b5d-bcce-98e793ead8af is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,202 - WARNING - Pod uuid 96507058-edde-45a3-8c6e-c6ea4b9783ed is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,203 - WARNING - Pod uuid 47dd45dd-e5d4-47a4-8b9e-f23f3c600635 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,204 - WARNING - Pod uuid 00955777-659a-4cbb-9c07-2fb154476b5c is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,204 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,204 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,205 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:11,205 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:16,163 - DEBUG - Pod f6a7b20d-d5ae-4b5d-bcce-98e793ead8af is not in agent 10.0.0.23 VM list 2026-02-09 17:17:16,168 - DEBUG - VMI d1a08e22-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:16,169 - INFO - Verified that pod ctest-pod-59789309 is removed in agent 2026-02-09 17:17:16,227 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:16,228 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:16,228 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:16,229 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:16,230 - DEBUG - Pod 96507058-edde-45a3-8c6e-c6ea4b9783ed is not in agent 10.0.0.23 VM list 2026-02-09 17:17:16,231 - DEBUG - Pod 00955777-659a-4cbb-9c07-2fb154476b5c is not in agent 10.0.0.23 VM list 2026-02-09 17:17:16,232 - DEBUG - Pod 47dd45dd-e5d4-47a4-8b9e-f23f3c600635 is not in agent 10.0.0.23 VM list 2026-02-09 17:17:16,241 - DEBUG - VMI d132e660-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:16,241 - INFO - Verified that pod ctest-pod-98279297 is removed in agent 2026-02-09 17:17:16,242 - DEBUG - VMI d03b2f2e-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:16,242 - INFO - Verified that pod ctest-pod-08952532 is removed in agent 2026-02-09 17:17:16,243 - DEBUG - VMI d0ac0cee-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:16,243 - INFO - Verified that pod ctest-pod-05221751 is removed in agent 2026-02-09 17:17:21,245 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:21,247 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:21,247 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:21,247 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:26,259 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:26,260 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:26,261 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:26,261 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:31,277 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:31,278 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:31,279 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:31,280 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:36,297 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:36,298 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:36,300 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:36,300 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:41,356 - WARNING - Pod uuid 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:41,358 - WARNING - Pod uuid 12985868-5cb4-471c-af46-cff18b1ef47f is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:41,358 - WARNING - Pod uuid a1e48fcb-726e-45b6-81df-178a4f6c8904 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:41,359 - WARNING - Pod uuid 967935e7-7c2e-4678-800b-0e00197ebc22 is still seen in agent 10.0.0.23 VM list 2026-02-09 17:17:46,371 - DEBUG - Pod 2be01c8c-9582-4d7e-8817-8fb8ecb81dcf is not in agent 10.0.0.23 VM list 2026-02-09 17:17:46,374 - DEBUG - Pod a1e48fcb-726e-45b6-81df-178a4f6c8904 is not in agent 10.0.0.23 VM list 2026-02-09 17:17:46,375 - DEBUG - Pod 967935e7-7c2e-4678-800b-0e00197ebc22 is not in agent 10.0.0.23 VM list 2026-02-09 17:17:46,376 - DEBUG - Pod 12985868-5cb4-471c-af46-cff18b1ef47f is not in agent 10.0.0.23 VM list 2026-02-09 17:17:46,386 - DEBUG - VMI d2f056d6-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:46,386 - INFO - Verified that pod ctest-pod-78771638 is removed in agent 2026-02-09 17:17:46,388 - DEBUG - VMI d366b308-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:46,388 - INFO - Verified that pod ctest-pod-71202615 is removed in agent 2026-02-09 17:17:46,388 - DEBUG - VMI d28532f2-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:46,388 - INFO - Verified that pod ctest-pod-33811179 is removed in agent 2026-02-09 17:17:46,388 - DEBUG - VMI d20d7bb8-05da-11f1-baf2-fa163e3f3bcf is removed from agent 10.0.0.23 2026-02-09 17:17:46,389 - INFO - Verified that pod ctest-pod-97673319 is removed in agent 2026-02-09 17:17:46,389 - INFO - Deleting namespace ctest-non-default-30496832 2026-02-09 17:17:46,404 - DEBUG - Namespace ctest-non-default-30496832 still in k8s 2026-02-09 17:17:48,410 - DEBUG - Namespace ctest-non-default-30496832 still in k8s 2026-02-09 17:17:50,414 - DEBUG - Namespace ctest-non-default-30496832 still in k8s 2026-02-09 17:17:52,417 - DEBUG - Namespace ctest-non-default-30496832 is not in k8s 2026-02-09 17:17:52,418 - DEBUG - No need to check project deletion in contrail-api 2026-02-09 17:17:52,418 - INFO - Deleting namespace ctest-new-default-14196421 2026-02-09 17:17:52,433 - DEBUG - Namespace ctest-new-default-14196421 still in k8s 2026-02-09 17:17:54,437 - DEBUG - Namespace ctest-new-default-14196421 still in k8s 2026-02-09 17:17:56,441 - DEBUG - Namespace ctest-new-default-14196421 still in k8s 2026-02-09 17:17:58,444 - DEBUG - Namespace ctest-new-default-14196421 is not in k8s 2026-02-09 17:17:58,444 - DEBUG - No need to check project deletion in contrail-api