2026-10-29 18:12:39,227 - INFO - Using existing project ['default-domain', 'k8s-default'](a74bdbb6-b51a-41f1-995e-bc6d2e014243) 2026-10-29 18:12:39,269 - DEBUG - Namespace ctest-new-default-41938291 not present 2026-10-29 18:12:39,286 - INFO - Created namespace ctest-new-default-41938291 2026-10-29 18:12:42,292 - DEBUG - Namespace ctest-non-default-55549432 not present 2026-10-29 18:12:42,303 - INFO - Created namespace ctest-non-default-55549432 2026-10-29 18:12:45,333 - DEBUG - Pod ctest-pod-56314423 not present 2026-10-29 18:12:45,334 - INFO - Creating Pod ctest-pod-56314423 2026-10-29 18:12:45,382 - DEBUG - Pod : ctest-pod-56314423 UUID is 9ef68dac-cb5c-4739-9884-252441ed518a 2026-10-29 18:12:45,392 - DEBUG - Pod ctest-pod-49587557 not present 2026-10-29 18:12:45,393 - INFO - Creating Pod ctest-pod-49587557 2026-10-29 18:12:45,439 - DEBUG - Pod : ctest-pod-49587557 UUID is 62d62f01-d9f6-4c8a-a8cd-41a4b352816c 2026-10-29 18:12:45,443 - DEBUG - Pod ctest-pod-98918697 not present 2026-10-29 18:12:45,443 - INFO - Creating Pod ctest-pod-98918697 2026-10-29 18:12:45,502 - DEBUG - Pod : ctest-pod-98918697 UUID is f65f92b7-7aaf-4eb2-95fc-d8bf8d33bc85 2026-10-29 18:12:45,506 - DEBUG - Pod ctest-pod-23191063 not present 2026-10-29 18:12:45,507 - INFO - Creating Pod ctest-pod-23191063 2026-10-29 18:12:45,543 - DEBUG - Pod : ctest-pod-23191063 UUID is 8dabe24d-2afc-4a45-8967-ca45cd88c572 2026-10-29 18:12:45,546 - DEBUG - Pod ctest-pod-78580791 not present 2026-10-29 18:12:45,547 - INFO - Creating Pod ctest-pod-78580791 2026-10-29 18:12:45,572 - DEBUG - Pod : ctest-pod-78580791 UUID is 6c447209-690c-4e45-8539-9a02f5630cfc 2026-10-29 18:12:45,576 - DEBUG - Pod ctest-pod-58300038 not present 2026-10-29 18:12:45,576 - INFO - Creating Pod ctest-pod-58300038 2026-10-29 18:12:45,611 - DEBUG - Pod : ctest-pod-58300038 UUID is f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 2026-10-29 18:12:45,614 - DEBUG - Pod ctest-pod-29348971 not present 2026-10-29 18:12:45,615 - INFO - Creating Pod ctest-pod-29348971 2026-10-29 18:12:45,671 - DEBUG - Pod : ctest-pod-29348971 UUID is 989812d6-8a9a-4357-bbc6-f6aa75394e36 2026-10-29 18:12:45,676 - DEBUG - Pod ctest-pod-17747753 not present 2026-10-29 18:12:45,678 - INFO - Creating Pod ctest-pod-17747753 2026-10-29 18:12:45,726 - DEBUG - Pod : ctest-pod-17747753 UUID is 1c618e49-dadd-4799-8c8d-83cd91fc2c84 2026-10-29 18:12:45,977 - INFO - Project default-domain:k8s-ctest-new-default-41938291 for Namespace ctest-new-default-41938291 is seen in contrail-api 2026-10-29 18:12:45,977 - DEBUG - Project uuid in Contrail is 0496504e-d526-46f6-8e37-b8d323740510 2026-10-29 18:12:46,193 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=3b5e18cc-18dc-4995-9b99-7e61b96ea546 2026-10-29 18:12:46,198 - INFO - Namespace ctest-new-default-41938291 with uuid 3b5e18cc-18dc-4995-9b99-7e61b96ea546 found in kube manager 2026-10-29 18:12:46,198 - INFO - Namespace ctest-new-default-41938291 verification passed 2026-10-29 18:12:46,472 - INFO - Project default-domain:k8s-ctest-non-default-55549432 for Namespace ctest-non-default-55549432 is seen in contrail-api 2026-10-29 18:12:46,473 - DEBUG - Project uuid in Contrail is b24aea2c-f30e-4ff5-b727-c1349086334a 2026-10-29 18:12:46,473 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=9b604caf-8100-4d55-8db1-0cc16bef61f5 2026-10-29 18:12:46,477 - INFO - Namespace ctest-non-default-55549432 with uuid 9b604caf-8100-4d55-8db1-0cc16bef61f5 found in kube manager 2026-10-29 18:12:46,478 - INFO - Namespace ctest-non-default-55549432 verification passed 2026-10-29 18:12:46,486 - DEBUG - Pod ctest-pod-56314423 not in running state.Currently in Pending 2026-10-29 18:12:51,503 - DEBUG - Pod ctest-pod-56314423 not in running state.Currently in Pending 2026-10-29 18:12:56,513 - INFO - Pod ctest-pod-56314423 is in running state.Got IP 10.47.255.251 2026-10-29 18:12:56,573 - DEBUG - Pod ctest-pod-56314423 has vmi 5850684a-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:12:56,573 - INFO - Verified pod ctest-pod-56314423 in contrail-api 2026-10-29 18:12:56,590 - DEBUG - VMI 5850684a-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:12:56,591 - INFO - Verified Pod ctest-pod-56314423 in agent 10.0.0.129 2026-10-29 18:12:56,591 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9ef68dac-cb5c-4739-9884-252441ed518a 2026-10-29 18:12:56,596 - INFO - Pod ctest-pod-56314423 with uuid 9ef68dac-cb5c-4739-9884-252441ed518a found in kube manager 2026-10-29 18:12:56,596 - INFO - Pod ctest-pod-56314423 verification passed 2026-10-29 18:12:56,604 - DEBUG - Pod ctest-pod-49587557 not in running state.Currently in Pending 2026-10-29 18:13:01,614 - INFO - Pod ctest-pod-49587557 is in running state.Got IP 10.47.255.250 2026-10-29 18:13:01,631 - DEBUG - Pod ctest-pod-49587557 has vmi 58dbb3f0-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:01,631 - INFO - Verified pod ctest-pod-49587557 in contrail-api 2026-10-29 18:13:01,652 - DEBUG - VMI 58dbb3f0-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:01,653 - INFO - Verified Pod ctest-pod-49587557 in agent 10.0.0.129 2026-10-29 18:13:01,653 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=62d62f01-d9f6-4c8a-a8cd-41a4b352816c 2026-10-29 18:13:01,662 - INFO - Pod ctest-pod-49587557 with uuid 62d62f01-d9f6-4c8a-a8cd-41a4b352816c found in kube manager 2026-10-29 18:13:01,662 - INFO - Pod ctest-pod-49587557 verification passed 2026-10-29 18:13:01,676 - INFO - Pod ctest-pod-98918697 is in running state.Got IP 10.47.255.249 2026-10-29 18:13:01,705 - DEBUG - Pod ctest-pod-98918697 has vmi 59b07914-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:01,706 - INFO - Verified pod ctest-pod-98918697 in contrail-api 2026-10-29 18:13:01,724 - DEBUG - VMI 59b07914-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:01,725 - INFO - Verified Pod ctest-pod-98918697 in agent 10.0.0.129 2026-10-29 18:13:01,725 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f65f92b7-7aaf-4eb2-95fc-d8bf8d33bc85 2026-10-29 18:13:01,733 - INFO - Pod ctest-pod-98918697 with uuid f65f92b7-7aaf-4eb2-95fc-d8bf8d33bc85 found in kube manager 2026-10-29 18:13:01,734 - INFO - Pod ctest-pod-98918697 verification passed 2026-10-29 18:13:01,745 - INFO - Pod ctest-pod-23191063 is in running state.Got IP 10.47.255.248 2026-10-29 18:13:01,809 - DEBUG - Pod ctest-pod-23191063 has vmi 5a4d7b10-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:01,810 - INFO - Verified pod ctest-pod-23191063 in contrail-api 2026-10-29 18:13:01,831 - DEBUG - VMI 5a4d7b10-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:01,831 - INFO - Verified Pod ctest-pod-23191063 in agent 10.0.0.129 2026-10-29 18:13:01,831 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8dabe24d-2afc-4a45-8967-ca45cd88c572 2026-10-29 18:13:01,840 - INFO - Pod ctest-pod-23191063 with uuid 8dabe24d-2afc-4a45-8967-ca45cd88c572 found in kube manager 2026-10-29 18:13:01,840 - INFO - Pod ctest-pod-23191063 verification passed 2026-10-29 18:13:01,856 - INFO - Pod ctest-pod-78580791 is in running state.Got IP 10.47.255.247 2026-10-29 18:13:01,880 - DEBUG - Pod ctest-pod-78580791 has vmi 5aeb278e-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:01,880 - INFO - Verified pod ctest-pod-78580791 in contrail-api 2026-10-29 18:13:01,902 - DEBUG - VMI 5aeb278e-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:01,902 - INFO - Verified Pod ctest-pod-78580791 in agent 10.0.0.129 2026-10-29 18:13:01,903 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=6c447209-690c-4e45-8539-9a02f5630cfc 2026-10-29 18:13:01,911 - INFO - Pod ctest-pod-78580791 with uuid 6c447209-690c-4e45-8539-9a02f5630cfc found in kube manager 2026-10-29 18:13:01,911 - INFO - Pod ctest-pod-78580791 verification passed 2026-10-29 18:13:01,927 - INFO - Pod ctest-pod-29348971 is in running state.Got IP 10.47.255.245 2026-10-29 18:13:01,952 - DEBUG - Pod ctest-pod-29348971 has vmi 5c27a550-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:01,953 - INFO - Verified pod ctest-pod-29348971 in contrail-api 2026-10-29 18:13:01,973 - DEBUG - VMI 5c27a550-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:01,974 - INFO - Verified Pod ctest-pod-29348971 in agent 10.0.0.129 2026-10-29 18:13:01,974 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=989812d6-8a9a-4357-bbc6-f6aa75394e36 2026-10-29 18:13:01,988 - INFO - Pod ctest-pod-29348971 with uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 found in kube manager 2026-10-29 18:13:01,989 - INFO - Pod ctest-pod-29348971 verification passed 2026-10-29 18:13:02,006 - INFO - Pod ctest-pod-58300038 is in running state.Got IP 10.47.255.246 2026-10-29 18:13:02,065 - DEBUG - Pod ctest-pod-58300038 has vmi 5b959d18-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:02,065 - INFO - Verified pod ctest-pod-58300038 in contrail-api 2026-10-29 18:13:02,081 - DEBUG - VMI 5b959d18-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:02,081 - INFO - Verified Pod ctest-pod-58300038 in agent 10.0.0.129 2026-10-29 18:13:02,082 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 2026-10-29 18:13:02,087 - INFO - Pod ctest-pod-58300038 with uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 found in kube manager 2026-10-29 18:13:02,088 - INFO - Pod ctest-pod-58300038 verification passed 2026-10-29 18:13:02,096 - INFO - Pod ctest-pod-17747753 is in running state.Got IP 10.47.255.244 2026-10-29 18:13:02,113 - DEBUG - Pod ctest-pod-17747753 has vmi 5cade854-d3c4-11f1-b68b-fa163e115591 2026-10-29 18:13:02,113 - INFO - Verified pod ctest-pod-17747753 in contrail-api 2026-10-29 18:13:02,134 - DEBUG - VMI 5cade854-d3c4-11f1-b68b-fa163e115591 is active in agent 10.0.0.129 2026-10-29 18:13:02,134 - INFO - Verified Pod ctest-pod-17747753 in agent 10.0.0.129 2026-10-29 18:13:02,134 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1c618e49-dadd-4799-8c8d-83cd91fc2c84 2026-10-29 18:13:02,138 - INFO - Pod ctest-pod-17747753 with uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 found in kube manager 2026-10-29 18:13:02,138 - INFO - Pod ctest-pod-17747753 verification passed 2026-10-29 18:13:02,139 - INFO - ================================================================================ 2026-10-29 18:13:02,139 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-10-29 18:13:02,139 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-10-29 18:13:02,474 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.0.0.22': '0'}} with 2026-10-29 18:13:02,475 - INFO - Initial checks done. Running the testcase now 2026-10-29 18:13:02,475 - INFO - 2026-10-29 18:13:02,553 - DEBUG - [Pod ctest-pod-56314423] Cmd: echo ctest-pod-56314423 > /usr/share/nginx/html/index.html, Output: 2026-10-29 18:13:02,629 - DEBUG - [Pod ctest-pod-49587557] Cmd: echo ctest-pod-49587557 > /usr/share/nginx/html/index.html, Output: 2026-10-29 18:13:02,706 - DEBUG - [Pod ctest-pod-98918697] Cmd: echo ctest-pod-98918697 > /usr/share/nginx/html/index.html, Output: 2026-10-29 18:13:02,789 - DEBUG - [Pod ctest-pod-23191063] Cmd: echo ctest-pod-23191063 > /usr/share/nginx/html/index.html, Output: 2026-10-29 18:13:02,797 - DEBUG - Service ctest-nginx-svc-75681728 not present 2026-10-29 18:13:02,798 - INFO - Creating service ctest-nginx-svc-75681728 2026-10-29 18:13:02,838 - INFO - Created Service ctest-nginx-svc-75681728 2026-10-29 18:13:02,851 - WARNING - Service UUID 05bdb329-ed6b-463b-8a4e-94ac14b0ca6b not yet found in contrail-api 2026-10-29 18:13:03,879 - INFO - Validated that Service ctest-nginx-svc-75681728 is seen in contrail-api 2026-10-29 18:13:03,879 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=05bdb329-ed6b-463b-8a4e-94ac14b0ca6b 2026-10-29 18:13:03,886 - INFO - Service ctest-nginx-svc-75681728 with uuid 05bdb329-ed6b-463b-8a4e-94ac14b0ca6b found in kube manager 2026-10-29 18:13:03,886 - INFO - Service ctest-nginx-svc-75681728 verification passed 2026-10-29 18:13:04,978 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) ctest-pod-56314423 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:04,978 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:04,978 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) ctest-pod-56314423 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,065 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,065 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:05,065 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,066 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56314423': 1, 'ctest-pod-49587557': 1} 2026-10-29 18:13:05,148 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-49587557 2026-10-29 18:13:05,148 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:05,148 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-49587557 2026-10-29 18:13:05,250 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,250 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:05,251 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,329 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,330 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:05,330 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:05,330 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56314423': 1, 'ctest-pod-49587557': 2} 2026-10-29 18:13:05,337 - DEBUG - Network policy ingress-on-service not present 2026-10-29 18:13:05,339 - INFO - Creating Network Policy ingress-on-service 2026-10-29 18:13:05,366 - INFO - Network policy found in k8s 2026-10-29 18:13:05,367 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=80324a06-c017-474e-a74a-c312d8ffa810 2026-10-29 18:13:05,377 - INFO - Network Policy ingress-on-service with uuid 80324a06-c017-474e-a74a-c312d8ffa810 found in kube manager 2026-10-29 18:13:05,434 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-10-29 18:13:05,435 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-10-29 18:13:05,435 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=80324a06-c017-474e-a74a-c312d8ffa810 2026-10-29 18:13:05,484 - WARNING - Network policy with name ingress-on-service not found in agent 2026-10-29 18:13:07,484 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=80324a06-c017-474e-a74a-c312d8ffa810 2026-10-29 18:13:07,523 - INFO - Network policy with name ingress-on-service found in agent 2026-10-29 18:13:07,524 - INFO - Network Policy ingress-on-service verification passed 2026-10-29 18:13:12,743 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:12,744 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:12,744 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:17,816 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:17,816 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:17,817 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:22,889 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:22,889 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:22,889 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:27,970 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:27,970 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:27,970 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:33,046 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:33,046 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:33,046 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:38,113 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:38,113 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:38,113 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:43,182 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:43,182 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:43,182 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:48,248 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:48,249 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:48,249 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:53,330 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:53,331 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:53,331 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:58,391 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:58,391 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:13:58,391 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:13:58,391 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56314423': 0, 'ctest-pod-49587557': 0} 2026-10-29 18:13:58,496 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:58,497 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:58,497 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:58,566 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:58,567 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:13:58,567 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:13:58,567 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56314423': 1, 'ctest-pod-49587557': 1} 2026-10-29 18:14:03,651 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:03,651 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:03,651 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:08,717 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:08,717 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:08,717 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:13,799 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:13,799 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:13,799 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:16,266 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2026-10-29 18:14:26,672 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:26,672 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:26,672 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:31,748 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:31,748 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:31,748 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:36,803 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:36,803 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:36,804 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:41,875 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:41,875 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:41,875 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:46,945 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:46,945 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:46,945 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:52,024 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:52,024 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:52,024 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:57,092 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:57,093 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:14:57,093 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:14:57,093 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56314423': 0, 'ctest-pod-49587557': 0} 2026-10-29 18:14:59,186 - DEBUG - [Pod ctest-pod-58300038] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=2.728 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.102 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.106 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.102/0.978/2.728 ms 2026-10-29 18:14:59,186 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-58300038 with expectation True passed 2026-10-29 18:15:01,307 - DEBUG - [Pod ctest-pod-78580791] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.018 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.398/1.018 ms 2026-10-29 18:15:01,308 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78580791 with expectation True passed 2026-10-29 18:15:03,369 - DEBUG - [Pod ctest-pod-29348971] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.779 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.130 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.129 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.129/0.346/0.779 ms 2026-10-29 18:15:03,369 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29348971 with expectation True passed 2026-10-29 18:15:03,456 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:15:03,456 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-10-29 18:15:03,456 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-56314423 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:15:03,456 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58300038 passed 2026-10-29 18:15:03,540 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:15:03,540 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-10-29 18:15:03,540 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-49587557 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:15:03,540 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58300038 passed 2026-10-29 18:15:08,609 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-10-29 18:15:08,609 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-10-29 18:15:08,609 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-10-29 18:15:08,609 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78580791 passed 2026-10-29 18:15:13,679 - DEBUG - [Pod ctest-pod-17747753] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-10-29 18:15:13,679 - DEBUG - [Pod Pod ctest-pod-17747753] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed. 2026-10-29 18:15:13,679 - DEBUG - [Pod Pod ctest-pod-17747753] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-10-29 18:15:13,679 - INFO - wget check of of http://10.47.255.251 from ctest-pod-17747753 passed 2026-10-29 18:15:13,693 - INFO - Updating Network Policy ingress-on-service 2026-10-29 18:15:18,767 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:18,767 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:18,767 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:23,838 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:23,838 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:23,838 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:28,919 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:28,919 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:28,919 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:34,014 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:34,017 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:34,017 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:39,118 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:39,119 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:39,119 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:44,185 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:44,185 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:44,185 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:49,255 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:49,255 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:49,255 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:54,330 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:54,330 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:54,331 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:59,407 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:15:59,408 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:15:59,408 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:16:04,488 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:16:04,488 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 failed. 2026-10-29 18:16:04,488 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.109.46.98:80 (10.109.46.98:80) wget: download timed out 2026-10-29 18:16:04,488 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56314423': 0, 'ctest-pod-49587557': 0} 2026-10-29 18:16:04,557 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,557 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:16:04,557 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,629 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,629 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:16:04,629 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,720 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,720 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:16:04,720 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,721 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56314423': 2, 'ctest-pod-49587557': 1} 2026-10-29 18:16:04,811 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,811 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:16:04,811 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,896 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,896 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:16:04,896 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: ctest-pod-56314423 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,984 - DEBUG - [Pod ctest-pod-29348971] Cmd: wget http://10.109.46.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,984 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd wget http://10.109.46.98:80/ -O - -T 5 -t 1 passed 2026-10-29 18:16:04,984 - DEBUG - [Pod Pod ctest-pod-29348971] Cmd output: ctest-pod-49587557 Connecting to 10.109.46.98:80 (10.109.46.98:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:04,984 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56314423': 2, 'ctest-pod-49587557': 1} 2026-10-29 18:16:07,056 - DEBUG - [Pod ctest-pod-58300038] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.144 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.130 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.119 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.119/0.464/1.144 ms 2026-10-29 18:16:07,056 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-58300038 with expectation True passed 2026-10-29 18:16:09,123 - DEBUG - [Pod ctest-pod-78580791] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.871 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.126 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.134 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.126/0.377/0.871 ms 2026-10-29 18:16:09,123 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78580791 with expectation True passed 2026-10-29 18:16:11,193 - DEBUG - [Pod ctest-pod-29348971] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.307 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.106 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.140 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.106/0.517/1.307 ms 2026-10-29 18:16:11,193 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29348971 with expectation True passed 2026-10-29 18:16:11,271 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:11,271 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-10-29 18:16:11,271 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-56314423 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:11,271 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58300038 passed 2026-10-29 18:16:11,346 - DEBUG - [Pod ctest-pod-58300038] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-49587557 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:11,346 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-10-29 18:16:11,346 - DEBUG - [Pod Pod ctest-pod-58300038] Cmd output: ctest-pod-49587557 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:11,346 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58300038 passed 2026-10-29 18:16:16,443 - DEBUG - [Pod ctest-pod-78580791] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-10-29 18:16:16,443 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-10-29 18:16:16,443 - DEBUG - [Pod Pod ctest-pod-78580791] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-10-29 18:16:16,443 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78580791 passed 2026-10-29 18:16:16,526 - DEBUG - [Pod ctest-pod-17747753] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-56314423 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:16,527 - DEBUG - [Pod Pod ctest-pod-17747753] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-10-29 18:16:16,527 - DEBUG - [Pod Pod ctest-pod-17747753] Cmd output: ctest-pod-56314423 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-10-29 18:16:16,527 - INFO - wget check of of http://10.47.255.251 from ctest-pod-17747753 passed 2026-10-29 18:16:16,527 - INFO - Deleting Network Policy : ingress-on-service 2026-10-29 18:16:16,530 - INFO - Deleting service : ctest-nginx-svc-75681728 2026-10-29 18:16:16,880 - DEBUG - No XMPP flaps were noticed during the test 2026-10-29 18:16:16,881 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14] 2026-10-29 18:16:16,881 - INFO - -------------------------------------------------------------------------------- 2026-10-29 18:16:16,890 - INFO - Deleting pod ctest-new-default-41938291:ctest-pod-56314423 2026-10-29 18:16:16,892 - INFO - Deleting pod ctest-new-default-41938291:ctest-pod-49587557 2026-10-29 18:16:16,892 - INFO - Deleting pod ctest-non-default-55549432:ctest-pod-98918697 2026-10-29 18:16:16,893 - INFO - Deleting pod ctest-non-default-55549432:ctest-pod-23191063 2026-10-29 18:16:16,894 - INFO - Deleting pod ctest-new-default-41938291:ctest-pod-78580791 2026-10-29 18:16:16,894 - INFO - Deleting pod ctest-new-default-41938291:ctest-pod-58300038 2026-10-29 18:16:16,895 - INFO - Deleting pod ctest-non-default-55549432:ctest-pod-29348971 2026-10-29 18:16:16,896 - INFO - Deleting pod ctest-non-default-55549432:ctest-pod-17747753 2026-10-29 18:16:17,198 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,198 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,199 - WARNING - Pod uuid 8dabe24d-2afc-4a45-8967-ca45cd88c572 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,200 - WARNING - Pod uuid 62d62f01-d9f6-4c8a-a8cd-41a4b352816c is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,201 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,201 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,203 - WARNING - Pod uuid f65f92b7-7aaf-4eb2-95fc-d8bf8d33bc85 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:17,203 - WARNING - Pod uuid 9ef68dac-cb5c-4739-9884-252441ed518a is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:22,244 - DEBUG - Pod 9ef68dac-cb5c-4739-9884-252441ed518a is not in agent 10.0.0.129 VM list 2026-10-29 18:16:22,248 - DEBUG - Pod 62d62f01-d9f6-4c8a-a8cd-41a4b352816c is not in agent 10.0.0.129 VM list 2026-10-29 18:16:22,249 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:22,249 - DEBUG - Pod f65f92b7-7aaf-4eb2-95fc-d8bf8d33bc85 is not in agent 10.0.0.129 VM list 2026-10-29 18:16:22,251 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:22,251 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:22,252 - DEBUG - Pod 8dabe24d-2afc-4a45-8967-ca45cd88c572 is not in agent 10.0.0.129 VM list 2026-10-29 18:16:22,253 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:22,276 - DEBUG - VMI 5850684a-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:22,276 - INFO - Verified that pod ctest-pod-56314423 is removed in agent 2026-10-29 18:16:22,278 - DEBUG - VMI 58dbb3f0-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:22,278 - INFO - Verified that pod ctest-pod-49587557 is removed in agent 2026-10-29 18:16:22,278 - DEBUG - VMI 5a4d7b10-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:22,278 - INFO - Verified that pod ctest-pod-23191063 is removed in agent 2026-10-29 18:16:22,279 - DEBUG - VMI 59b07914-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:22,279 - INFO - Verified that pod ctest-pod-98918697 is removed in agent 2026-10-29 18:16:27,269 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:27,273 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:27,273 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:27,274 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:32,363 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:32,366 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:32,366 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:32,367 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:37,392 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:37,393 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:37,394 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:37,395 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:42,436 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:42,439 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:42,440 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:42,440 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:47,482 - WARNING - Pod uuid 989812d6-8a9a-4357-bbc6-f6aa75394e36 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:47,484 - WARNING - Pod uuid 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:47,486 - WARNING - Pod uuid f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:47,487 - WARNING - Pod uuid 6c447209-690c-4e45-8539-9a02f5630cfc is still seen in agent 10.0.0.129 VM list 2026-10-29 18:16:52,512 - DEBUG - Pod f5e9dfd4-8cc2-4706-b611-9c3ac2cafd83 is not in agent 10.0.0.129 VM list 2026-10-29 18:16:52,515 - DEBUG - Pod 989812d6-8a9a-4357-bbc6-f6aa75394e36 is not in agent 10.0.0.129 VM list 2026-10-29 18:16:52,516 - DEBUG - Pod 6c447209-690c-4e45-8539-9a02f5630cfc is not in agent 10.0.0.129 VM list 2026-10-29 18:16:52,517 - DEBUG - Pod 1c618e49-dadd-4799-8c8d-83cd91fc2c84 is not in agent 10.0.0.129 VM list 2026-10-29 18:16:52,552 - DEBUG - VMI 5aeb278e-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:52,552 - INFO - Verified that pod ctest-pod-78580791 is removed in agent 2026-10-29 18:16:52,555 - DEBUG - VMI 5c27a550-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:52,555 - INFO - Verified that pod ctest-pod-29348971 is removed in agent 2026-10-29 18:16:52,557 - DEBUG - VMI 5b959d18-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:52,557 - INFO - Verified that pod ctest-pod-58300038 is removed in agent 2026-10-29 18:16:52,558 - DEBUG - VMI 5cade854-d3c4-11f1-b68b-fa163e115591 is removed from agent 10.0.0.129 2026-10-29 18:16:52,558 - INFO - Verified that pod ctest-pod-17747753 is removed in agent 2026-10-29 18:16:52,559 - INFO - Deleting namespace ctest-non-default-55549432 2026-10-29 18:16:52,597 - DEBUG - Namespace ctest-non-default-55549432 still in k8s 2026-10-29 18:16:54,604 - DEBUG - Namespace ctest-non-default-55549432 still in k8s 2026-10-29 18:16:56,611 - DEBUG - Namespace ctest-non-default-55549432 still in k8s 2026-10-29 18:16:58,616 - DEBUG - Namespace ctest-non-default-55549432 is not in k8s 2026-10-29 18:16:58,616 - DEBUG - No need to check project deletion in contrail-api 2026-10-29 18:16:58,616 - INFO - Deleting namespace ctest-new-default-41938291 2026-10-29 18:16:58,632 - DEBUG - Namespace ctest-new-default-41938291 still in k8s 2026-10-29 18:17:00,640 - DEBUG - Namespace ctest-new-default-41938291 still in k8s 2026-10-29 18:17:02,649 - DEBUG - Namespace ctest-new-default-41938291 still in k8s 2026-10-29 18:17:04,658 - DEBUG - Namespace ctest-new-default-41938291 is not in k8s 2026-10-29 18:17:04,658 - DEBUG - No need to check project deletion in contrail-api