2026-02-10 05:52:29,407 - INFO - Using existing project ['default-domain', 'k8s-default'](df18905b-4265-4c26-9bbf-d41341865a29) 2026-02-10 05:52:29,423 - DEBUG - Namespace ctest-new-default-27122900 not present 2026-02-10 05:52:29,431 - INFO - Created namespace ctest-new-default-27122900 2026-02-10 05:52:32,435 - DEBUG - Namespace ctest-non-default-48823924 not present 2026-02-10 05:52:32,445 - INFO - Created namespace ctest-non-default-48823924 2026-02-10 05:52:35,462 - DEBUG - Pod ctest-pod-29061819 not present 2026-02-10 05:52:35,462 - INFO - Creating Pod ctest-pod-29061819 2026-02-10 05:52:35,501 - DEBUG - Pod : ctest-pod-29061819 UUID is 0f70b135-e7cb-4da1-97ad-f9555de4351d 2026-02-10 05:52:35,509 - DEBUG - Pod ctest-pod-91236060 not present 2026-02-10 05:52:35,510 - INFO - Creating Pod ctest-pod-91236060 2026-02-10 05:52:35,542 - DEBUG - Pod : ctest-pod-91236060 UUID is 9981c639-56b4-4d9a-82dc-c67d5df5ab72 2026-02-10 05:52:35,544 - DEBUG - Pod ctest-pod-05978133 not present 2026-02-10 05:52:35,544 - INFO - Creating Pod ctest-pod-05978133 2026-02-10 05:52:35,583 - DEBUG - Pod : ctest-pod-05978133 UUID is b9c7183b-6e7a-4153-b1b9-176740a2e409 2026-02-10 05:52:35,588 - DEBUG - Pod ctest-pod-03183439 not present 2026-02-10 05:52:35,589 - INFO - Creating Pod ctest-pod-03183439 2026-02-10 05:52:35,612 - DEBUG - Pod : ctest-pod-03183439 UUID is e87059fb-181a-4108-aee0-782f3ac06046 2026-02-10 05:52:35,614 - DEBUG - Pod ctest-pod-40578991 not present 2026-02-10 05:52:35,615 - INFO - Creating Pod ctest-pod-40578991 2026-02-10 05:52:35,637 - DEBUG - Pod : ctest-pod-40578991 UUID is 775b888b-a6f4-42f1-a4c8-cc95e21ad13d 2026-02-10 05:52:35,639 - DEBUG - Pod ctest-pod-84901145 not present 2026-02-10 05:52:35,639 - INFO - Creating Pod ctest-pod-84901145 2026-02-10 05:52:35,660 - DEBUG - Pod : ctest-pod-84901145 UUID is 1c1ce9ff-be54-450e-a874-d0df15258628 2026-02-10 05:52:35,662 - DEBUG - Pod ctest-pod-20827808 not present 2026-02-10 05:52:35,662 - INFO - Creating Pod ctest-pod-20827808 2026-02-10 05:52:35,681 - DEBUG - Pod : ctest-pod-20827808 UUID is bf70c978-009b-4ef8-a2c8-a2c79e921d3d 2026-02-10 05:52:35,683 - DEBUG - Pod ctest-pod-64519683 not present 2026-02-10 05:52:35,683 - INFO - Creating Pod ctest-pod-64519683 2026-02-10 05:52:35,714 - DEBUG - Pod : ctest-pod-64519683 UUID is c586041d-de7c-4212-983a-a4320cad78bd 2026-02-10 05:52:35,855 - INFO - Project default-domain:k8s-ctest-new-default-27122900 for Namespace ctest-new-default-27122900 is seen in contrail-api 2026-02-10 05:52:35,855 - DEBUG - Project uuid in Contrail is c4461996-042f-4af5-8e83-53bc14c034ab 2026-02-10 05:52:36,015 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NamespaceDatabaseList?namespace_uuid=b03f79f4-942f-4010-b32a-8f19944ee48f 2026-02-10 05:52:36,019 - INFO - Namespace ctest-new-default-27122900 with uuid b03f79f4-942f-4010-b32a-8f19944ee48f found in kube manager 2026-02-10 05:52:36,019 - INFO - Namespace ctest-new-default-27122900 verification passed 2026-02-10 05:52:36,209 - INFO - Project default-domain:k8s-ctest-non-default-48823924 for Namespace ctest-non-default-48823924 is seen in contrail-api 2026-02-10 05:52:36,209 - DEBUG - Project uuid in Contrail is 0b47869e-cf63-4d9f-b1f0-bb509e2804ed 2026-02-10 05:52:36,209 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NamespaceDatabaseList?namespace_uuid=ae142383-aec2-420d-90f3-f47700ceaa20 2026-02-10 05:52:36,217 - INFO - Namespace ctest-non-default-48823924 with uuid ae142383-aec2-420d-90f3-f47700ceaa20 found in kube manager 2026-02-10 05:52:36,217 - INFO - Namespace ctest-non-default-48823924 verification passed 2026-02-10 05:52:36,223 - DEBUG - Pod ctest-pod-29061819 not in running state.Currently in Pending 2026-02-10 05:52:41,230 - DEBUG - Pod ctest-pod-29061819 not in running state.Currently in Pending 2026-02-10 05:52:46,239 - INFO - Pod ctest-pod-29061819 is in running state.Got IP 10.47.255.251 2026-02-10 05:52:46,296 - DEBUG - Pod ctest-pod-29061819 has vmi b3d79132-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:46,296 - INFO - Verified pod ctest-pod-29061819 in contrail-api 2026-02-10 05:52:46,306 - DEBUG - VMI b3d79132-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:46,306 - INFO - Verified Pod ctest-pod-29061819 in agent 10.0.0.50 2026-02-10 05:52:46,306 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=0f70b135-e7cb-4da1-97ad-f9555de4351d 2026-02-10 05:52:46,311 - INFO - Pod ctest-pod-29061819 with uuid 0f70b135-e7cb-4da1-97ad-f9555de4351d found in kube manager 2026-02-10 05:52:46,311 - INFO - Pod ctest-pod-29061819 verification passed 2026-02-10 05:52:46,318 - DEBUG - Pod ctest-pod-91236060 not in running state.Currently in Pending 2026-02-10 05:52:51,325 - INFO - Pod ctest-pod-91236060 is in running state.Got IP 10.47.255.250 2026-02-10 05:52:51,338 - DEBUG - Pod ctest-pod-91236060 has vmi b44daf70-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:51,338 - INFO - Verified pod ctest-pod-91236060 in contrail-api 2026-02-10 05:52:51,349 - DEBUG - VMI b44daf70-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:51,349 - INFO - Verified Pod ctest-pod-91236060 in agent 10.0.0.50 2026-02-10 05:52:51,349 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=9981c639-56b4-4d9a-82dc-c67d5df5ab72 2026-02-10 05:52:51,353 - INFO - Pod ctest-pod-91236060 with uuid 9981c639-56b4-4d9a-82dc-c67d5df5ab72 found in kube manager 2026-02-10 05:52:51,353 - INFO - Pod ctest-pod-91236060 verification passed 2026-02-10 05:52:51,360 - INFO - Pod ctest-pod-05978133 is in running state.Got IP 10.47.255.249 2026-02-10 05:52:51,412 - DEBUG - Pod ctest-pod-05978133 has vmi b4da7842-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:51,412 - INFO - Verified pod ctest-pod-05978133 in contrail-api 2026-02-10 05:52:51,422 - DEBUG - VMI b4da7842-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:51,423 - INFO - Verified Pod ctest-pod-05978133 in agent 10.0.0.50 2026-02-10 05:52:51,423 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=b9c7183b-6e7a-4153-b1b9-176740a2e409 2026-02-10 05:52:51,426 - INFO - Pod ctest-pod-05978133 with uuid b9c7183b-6e7a-4153-b1b9-176740a2e409 found in kube manager 2026-02-10 05:52:51,426 - INFO - Pod ctest-pod-05978133 verification passed 2026-02-10 05:52:51,434 - INFO - Pod ctest-pod-03183439 is in running state.Got IP 10.47.255.248 2026-02-10 05:52:51,444 - DEBUG - Pod ctest-pod-03183439 has vmi b54d43a4-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:51,444 - INFO - Verified pod ctest-pod-03183439 in contrail-api 2026-02-10 05:52:51,455 - DEBUG - VMI b54d43a4-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:51,455 - INFO - Verified Pod ctest-pod-03183439 in agent 10.0.0.50 2026-02-10 05:52:51,455 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=e87059fb-181a-4108-aee0-782f3ac06046 2026-02-10 05:52:51,459 - INFO - Pod ctest-pod-03183439 with uuid e87059fb-181a-4108-aee0-782f3ac06046 found in kube manager 2026-02-10 05:52:51,459 - INFO - Pod ctest-pod-03183439 verification passed 2026-02-10 05:52:51,464 - INFO - Pod ctest-pod-40578991 is in running state.Got IP 10.47.255.247 2026-02-10 05:52:51,516 - DEBUG - Pod ctest-pod-40578991 has vmi b5cdf21a-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:51,516 - INFO - Verified pod ctest-pod-40578991 in contrail-api 2026-02-10 05:52:51,533 - DEBUG - VMI b5cdf21a-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:51,533 - INFO - Verified Pod ctest-pod-40578991 in agent 10.0.0.50 2026-02-10 05:52:51,533 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=775b888b-a6f4-42f1-a4c8-cc95e21ad13d 2026-02-10 05:52:51,537 - INFO - Pod ctest-pod-40578991 with uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d found in kube manager 2026-02-10 05:52:51,537 - INFO - Pod ctest-pod-40578991 verification passed 2026-02-10 05:52:51,544 - INFO - Pod ctest-pod-20827808 is in running state.Got IP 10.47.255.245 2026-02-10 05:52:51,555 - DEBUG - Pod ctest-pod-20827808 has vmi b6a809c8-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:51,555 - INFO - Verified pod ctest-pod-20827808 in contrail-api 2026-02-10 05:52:51,567 - DEBUG - VMI b6a809c8-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:51,567 - INFO - Verified Pod ctest-pod-20827808 in agent 10.0.0.50 2026-02-10 05:52:51,567 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=bf70c978-009b-4ef8-a2c8-a2c79e921d3d 2026-02-10 05:52:51,571 - INFO - Pod ctest-pod-20827808 with uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d found in kube manager 2026-02-10 05:52:51,571 - INFO - Pod ctest-pod-20827808 verification passed 2026-02-10 05:52:51,577 - INFO - Pod ctest-pod-84901145 is in running state.Got IP 10.47.255.246 2026-02-10 05:52:51,630 - DEBUG - Pod ctest-pod-84901145 has vmi b63ec710-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:51,630 - INFO - Verified pod ctest-pod-84901145 in contrail-api 2026-02-10 05:52:51,641 - DEBUG - VMI b63ec710-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:51,642 - INFO - Verified Pod ctest-pod-84901145 in agent 10.0.0.50 2026-02-10 05:52:51,642 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=1c1ce9ff-be54-450e-a874-d0df15258628 2026-02-10 05:52:51,645 - INFO - Pod ctest-pod-84901145 with uuid 1c1ce9ff-be54-450e-a874-d0df15258628 found in kube manager 2026-02-10 05:52:51,645 - INFO - Pod ctest-pod-84901145 verification passed 2026-02-10 05:52:51,651 - DEBUG - Pod ctest-pod-64519683 not in running state.Currently in Pending 2026-02-10 05:52:56,659 - INFO - Pod ctest-pod-64519683 is in running state.Got IP 10.47.255.244 2026-02-10 05:52:56,669 - DEBUG - Pod ctest-pod-64519683 has vmi b71609b4-0644-11f1-b89c-fa163ea930d4 2026-02-10 05:52:56,669 - INFO - Verified pod ctest-pod-64519683 in contrail-api 2026-02-10 05:52:56,681 - DEBUG - VMI b71609b4-0644-11f1-b89c-fa163ea930d4 is active in agent 10.0.0.50 2026-02-10 05:52:56,681 - INFO - Verified Pod ctest-pod-64519683 in agent 10.0.0.50 2026-02-10 05:52:56,682 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=c586041d-de7c-4212-983a-a4320cad78bd 2026-02-10 05:52:56,685 - INFO - Pod ctest-pod-64519683 with uuid c586041d-de7c-4212-983a-a4320cad78bd found in kube manager 2026-02-10 05:52:56,685 - INFO - Pod ctest-pod-64519683 verification passed 2026-02-10 05:52:56,685 - INFO - ================================================================================ 2026-02-10 05:52:56,685 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-02-10 05:52:56,685 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-02-10 05:52:56,915 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.73': '0'}} with 2026-02-10 05:52:56,916 - INFO - Initial checks done. Running the testcase now 2026-02-10 05:52:56,916 - INFO - 2026-02-10 05:52:56,969 - DEBUG - [Pod ctest-pod-29061819] Cmd: echo ctest-pod-29061819 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:52:57,025 - DEBUG - [Pod ctest-pod-91236060] Cmd: echo ctest-pod-91236060 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:52:57,075 - DEBUG - [Pod ctest-pod-05978133] Cmd: echo ctest-pod-05978133 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:52:57,146 - DEBUG - [Pod ctest-pod-03183439] Cmd: echo ctest-pod-03183439 > /usr/share/nginx/html/index.html, Output: 2026-02-10 05:52:57,149 - DEBUG - Service ctest-nginx-svc-76862646 not present 2026-02-10 05:52:57,150 - INFO - Creating service ctest-nginx-svc-76862646 2026-02-10 05:52:57,165 - INFO - Created Service ctest-nginx-svc-76862646 2026-02-10 05:52:57,173 - WARNING - Service UUID 6a5dae03-fa30-4810-b375-4d6b265d5db0 not yet found in contrail-api 2026-02-10 05:52:58,179 - INFO - Validated that Service ctest-nginx-svc-76862646 is seen in contrail-api 2026-02-10 05:52:58,179 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_LoadbalancerDatabaseList?x=6a5dae03-fa30-4810-b375-4d6b265d5db0 2026-02-10 05:52:58,183 - INFO - Service ctest-nginx-svc-76862646 with uuid 6a5dae03-fa30-4810-b375-4d6b265d5db0 found in kube manager 2026-02-10 05:52:58,183 - INFO - Service ctest-nginx-svc-76862646 verification passed 2026-02-10 05:52:58,235 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,235 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,235 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,291 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,291 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,291 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,349 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,349 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,349 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,399 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,399 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,399 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,437 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,437 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,437 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,489 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,489 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,489 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,540 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-91236060 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,540 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,540 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: ctest-pod-91236060 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,540 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-29061819': 6, 'ctest-pod-91236060': 1} 2026-02-10 05:52:58,596 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,596 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,596 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,643 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,644 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,644 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-29061819 2026-02-10 05:52:58,693 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-91236060 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,693 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:52:58,693 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: ctest-pod-91236060 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:52:58,694 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-29061819': 2, 'ctest-pod-91236060': 1} 2026-02-10 05:52:58,696 - DEBUG - Network policy ingress-on-service not present 2026-02-10 05:52:58,697 - INFO - Creating Network Policy ingress-on-service 2026-02-10 05:52:58,708 - INFO - Network policy found in k8s 2026-02-10 05:52:58,708 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9e7d527c-e213-48c4-8156-98415db162b5 2026-02-10 05:52:58,712 - INFO - Network Policy ingress-on-service with uuid 9e7d527c-e213-48c4-8156-98415db162b5 found in kube manager 2026-02-10 05:52:58,736 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-02-10 05:52:58,736 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-02-10 05:52:58,736 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9e7d527c-e213-48c4-8156-98415db162b5 2026-02-10 05:52:58,758 - WARNING - Network policy with name ingress-on-service not found in agent 2026-02-10 05:53:00,758 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9e7d527c-e213-48c4-8156-98415db162b5 2026-02-10 05:53:00,784 - INFO - Network policy with name ingress-on-service found in agent 2026-02-10 05:53:00,784 - INFO - Network Policy ingress-on-service verification passed 2026-02-10 05:53:05,833 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:05,834 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:05,834 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:10,882 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:10,882 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:10,882 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:15,934 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:15,934 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:15,934 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:20,982 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:20,982 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:20,982 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:26,040 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:26,041 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:26,041 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:31,098 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:31,098 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:31,098 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:36,145 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:36,146 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:36,146 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:41,190 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:41,190 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:41,190 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:46,238 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:46,238 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:46,238 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:51,307 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:51,307 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:51,307 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:51,307 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-29061819': 0, 'ctest-pod-91236060': 0} 2026-02-10 05:53:51,362 - DEBUG - [Pod ctest-pod-84901145] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-91236060 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:53:51,362 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:53:51,362 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd output: ctest-pod-91236060 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:53:51,408 - DEBUG - [Pod ctest-pod-84901145] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:53:51,409 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 passed 2026-02-10 05:53:51,409 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd output: ctest-pod-29061819 Connecting to 10.105.239.43:80 (10.105.239.43:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 05:53:51,409 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-29061819': 1, 'ctest-pod-91236060': 1} 2026-02-10 05:53:56,454 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:56,454 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:53:56,454 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:01,502 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:01,502 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:01,502 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:06,546 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:06,546 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:06,546 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:11,591 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:11,591 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:11,591 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:16,641 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:16,641 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:16,641 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:21,687 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:21,687 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:21,687 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:26,739 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:26,740 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:26,740 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:31,787 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:31,876 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:31,877 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:36,930 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:36,930 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:36,930 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:41,983 - DEBUG - [Pod ctest-pod-20827808] Cmd: wget http://10.105.239.43:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:41,983 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd wget http://10.105.239.43:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:41,983 - DEBUG - [Pod Pod ctest-pod-20827808] Cmd output: Connecting to 10.105.239.43:80 (10.105.239.43:80) wget: download timed out 2026-02-10 05:54:41,983 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-29061819': 0, 'ctest-pod-91236060': 0} 2026-02-10 05:54:44,029 - DEBUG - [Pod ctest-pod-84901145] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.514 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.222/0.514 ms 2026-02-10 05:54:44,029 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-84901145 with expectation True passed 2026-02-10 05:54:46,078 - DEBUG - [Pod ctest-pod-40578991] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.270 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.141/0.270 ms 2026-02-10 05:54:46,078 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40578991 with expectation True passed 2026-02-10 05:54:48,130 - DEBUG - [Pod ctest-pod-20827808] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.369 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.169/0.369 ms 2026-02-10 05:54:48,130 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20827808 with expectation True passed 2026-02-10 05:54:48,181 - DEBUG - [Pod ctest-pod-84901145] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:48,181 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:48,181 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:48,181 - INFO - wget check of of http://10.47.255.251 from ctest-pod-84901145 passed 2026-02-10 05:54:48,228 - DEBUG - [Pod ctest-pod-84901145] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:48,228 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:48,228 - DEBUG - [Pod Pod ctest-pod-84901145] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:48,228 - INFO - wget check of of http://10.47.255.250 from ctest-pod-84901145 passed 2026-02-10 05:54:48,279 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:48,279 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:48,279 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:48,279 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:54:50,333 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:50,334 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:50,334 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:50,334 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:54:52,385 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:52,385 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:52,385 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:52,385 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:54:54,436 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:54,436 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:54,436 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:54,436 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:54:56,484 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:56,484 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:56,484 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:56,484 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:54:58,544 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:58,544 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:54:58,544 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:54:58,545 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:55:00,590 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:00,590 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:55:00,590 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:00,590 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:55:02,644 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:02,644 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:55:02,644 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:02,644 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:55:04,697 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:04,697 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:55:04,697 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:04,697 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:55:06,753 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:06,753 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:55:06,753 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:06,753 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:55:08,792 - DEBUG - [Pod ctest-pod-40578991] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:08,792 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 05:55:08,792 - DEBUG - [Pod Pod ctest-pod-40578991] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 05:55:08,792 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-40578991 failed 2026-02-10 05:55:08,798 - INFO - Deleting Network Policy : ingress-on-service 2026-02-10 05:55:08,798 - INFO - Deleting service : ctest-nginx-svc-76862646 2026-02-10 05:55:09,039 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Tue Feb 10 05:55:08 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1) 2860 assert self.validate_wget(self.client2_pod_ns1, url2) 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False) 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7fa0a2728ac0>> self.client1_pod_ns1 = url2 = 'http://10.47.255.250' expectation undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) AssertionError 2026-02-10 05:55:09,046 - DEBUG - No XMPP flaps were noticed during the test 2026-02-10 05:55:09,046 - INFO -
2026-02-10 05:55:09,046 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:13]
2026-02-10 05:55:09,046 - INFO - -------------------------------------------------------------------------------- 2026-02-10 05:55:09,050 - INFO - Deleting pod ctest-new-default-27122900:ctest-pod-29061819 2026-02-10 05:55:09,051 - INFO - Deleting pod ctest-new-default-27122900:ctest-pod-91236060 2026-02-10 05:55:09,051 - INFO - Deleting pod ctest-non-default-48823924:ctest-pod-05978133 2026-02-10 05:55:09,052 - INFO - Deleting pod ctest-non-default-48823924:ctest-pod-03183439 2026-02-10 05:55:09,052 - INFO - Deleting pod ctest-new-default-27122900:ctest-pod-40578991 2026-02-10 05:55:09,052 - INFO - Deleting pod ctest-new-default-27122900:ctest-pod-84901145 2026-02-10 05:55:09,053 - INFO - Deleting pod ctest-non-default-48823924:ctest-pod-20827808 2026-02-10 05:55:09,053 - INFO - Deleting pod ctest-non-default-48823924:ctest-pod-64519683 2026-02-10 05:55:09,135 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,169 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,170 - WARNING - Pod uuid b9c7183b-6e7a-4153-b1b9-176740a2e409 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,171 - WARNING - Pod uuid 9981c639-56b4-4d9a-82dc-c67d5df5ab72 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,171 - WARNING - Pod uuid e87059fb-181a-4108-aee0-782f3ac06046 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,171 - WARNING - Pod uuid 0f70b135-e7cb-4da1-97ad-f9555de4351d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,172 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:09,172 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:14,143 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:14,200 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:14,201 - DEBUG - Pod 0f70b135-e7cb-4da1-97ad-f9555de4351d is not in agent 10.0.0.50 VM list 2026-02-10 05:55:14,203 - DEBUG - Pod 9981c639-56b4-4d9a-82dc-c67d5df5ab72 is not in agent 10.0.0.50 VM list 2026-02-10 05:55:14,204 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:14,205 - DEBUG - Pod b9c7183b-6e7a-4153-b1b9-176740a2e409 is not in agent 10.0.0.50 VM list 2026-02-10 05:55:14,206 - DEBUG - Pod e87059fb-181a-4108-aee0-782f3ac06046 is not in agent 10.0.0.50 VM list 2026-02-10 05:55:14,207 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:14,232 - DEBUG - VMI b44daf70-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:14,233 - INFO - Verified that pod ctest-pod-91236060 is removed in agent 2026-02-10 05:55:14,234 - DEBUG - VMI b3d79132-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:14,234 - INFO - Verified that pod ctest-pod-29061819 is removed in agent 2026-02-10 05:55:14,235 - DEBUG - VMI b4da7842-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:14,235 - INFO - Verified that pod ctest-pod-05978133 is removed in agent 2026-02-10 05:55:14,235 - DEBUG - VMI b54d43a4-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:14,236 - INFO - Verified that pod ctest-pod-03183439 is removed in agent 2026-02-10 05:55:19,150 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:19,207 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:19,211 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:19,217 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:24,157 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:24,214 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:24,218 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:24,222 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:29,163 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:29,221 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:29,225 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:29,229 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:34,169 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:34,233 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:34,233 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:34,240 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:39,182 - WARNING - Pod uuid 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:39,243 - WARNING - Pod uuid 1c1ce9ff-be54-450e-a874-d0df15258628 is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:39,244 - WARNING - Pod uuid bf70c978-009b-4ef8-a2c8-a2c79e921d3d is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:39,246 - WARNING - Pod uuid c586041d-de7c-4212-983a-a4320cad78bd is still seen in agent 10.0.0.50 VM list 2026-02-10 05:55:44,188 - DEBUG - Pod 775b888b-a6f4-42f1-a4c8-cc95e21ad13d is not in agent 10.0.0.50 VM list 2026-02-10 05:55:44,194 - DEBUG - VMI b5cdf21a-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:44,194 - INFO - Verified that pod ctest-pod-40578991 is removed in agent 2026-02-10 05:55:44,255 - DEBUG - Pod 1c1ce9ff-be54-450e-a874-d0df15258628 is not in agent 10.0.0.50 VM list 2026-02-10 05:55:44,258 - DEBUG - Pod c586041d-de7c-4212-983a-a4320cad78bd is not in agent 10.0.0.50 VM list 2026-02-10 05:55:44,259 - DEBUG - Pod bf70c978-009b-4ef8-a2c8-a2c79e921d3d is not in agent 10.0.0.50 VM list 2026-02-10 05:55:44,267 - DEBUG - VMI b6a809c8-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:44,267 - INFO - Verified that pod ctest-pod-20827808 is removed in agent 2026-02-10 05:55:44,269 - DEBUG - VMI b71609b4-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:44,269 - INFO - Verified that pod ctest-pod-64519683 is removed in agent 2026-02-10 05:55:44,269 - DEBUG - VMI b63ec710-0644-11f1-b89c-fa163ea930d4 is removed from agent 10.0.0.50 2026-02-10 05:55:44,269 - INFO - Verified that pod ctest-pod-84901145 is removed in agent 2026-02-10 05:55:44,269 - INFO - Deleting namespace ctest-non-default-48823924 2026-02-10 05:55:44,281 - DEBUG - Namespace ctest-non-default-48823924 still in k8s 2026-02-10 05:55:46,285 - DEBUG - Namespace ctest-non-default-48823924 still in k8s 2026-02-10 05:55:48,290 - DEBUG - Namespace ctest-non-default-48823924 still in k8s 2026-02-10 05:55:50,294 - DEBUG - Namespace ctest-non-default-48823924 is not in k8s 2026-02-10 05:55:50,294 - DEBUG - No need to check project deletion in contrail-api 2026-02-10 05:55:50,294 - INFO - Deleting namespace ctest-new-default-27122900 2026-02-10 05:55:50,315 - DEBUG - Namespace ctest-new-default-27122900 still in k8s 2026-02-10 05:55:52,320 - DEBUG - Namespace ctest-new-default-27122900 still in k8s 2026-02-10 05:55:54,325 - DEBUG - Namespace ctest-new-default-27122900 still in k8s 2026-02-10 05:55:56,332 - DEBUG - Namespace ctest-new-default-27122900 is not in k8s 2026-02-10 05:55:56,332 - DEBUG - No need to check project deletion in contrail-api