2026-01-05 01:54:54,436 - INFO - Using existing project ['default-domain', 'k8s-default'](7a1746d7-4cf5-4188-b08a-ca5810ec3fd6) 2026-01-05 01:54:54,459 - DEBUG - Namespace ctest-new-default-08102596 not present 2026-01-05 01:54:54,474 - INFO - Created namespace ctest-new-default-08102596 2026-01-05 01:54:57,477 - DEBUG - Namespace ctest-non-default-01753560 not present 2026-01-05 01:54:57,483 - INFO - Created namespace ctest-non-default-01753560 2026-01-05 01:55:00,506 - DEBUG - Pod ctest-pod-39614718 not present 2026-01-05 01:55:00,506 - INFO - Creating Pod ctest-pod-39614718 2026-01-05 01:55:00,543 - DEBUG - Pod : ctest-pod-39614718 UUID is 0e3cf0ce-c1ff-42f7-878a-dc4857f50b9b 2026-01-05 01:55:00,545 - DEBUG - Pod ctest-pod-29441201 not present 2026-01-05 01:55:00,545 - INFO - Creating Pod ctest-pod-29441201 2026-01-05 01:55:00,572 - DEBUG - Pod : ctest-pod-29441201 UUID is c52a6636-9692-469e-9413-075fa941de49 2026-01-05 01:55:00,579 - DEBUG - Pod ctest-pod-92262342 not present 2026-01-05 01:55:00,579 - INFO - Creating Pod ctest-pod-92262342 2026-01-05 01:55:00,609 - DEBUG - Pod : ctest-pod-92262342 UUID is 4b55a3e0-e21f-4395-9053-cb15a432a31a 2026-01-05 01:55:00,612 - DEBUG - Pod ctest-pod-10903617 not present 2026-01-05 01:55:00,613 - INFO - Creating Pod ctest-pod-10903617 2026-01-05 01:55:00,649 - DEBUG - Pod : ctest-pod-10903617 UUID is 5b4224df-d01d-4583-b926-d41f3fdd16cf 2026-01-05 01:55:00,651 - DEBUG - Pod ctest-pod-65381559 not present 2026-01-05 01:55:00,652 - INFO - Creating Pod ctest-pod-65381559 2026-01-05 01:55:00,671 - DEBUG - Pod : ctest-pod-65381559 UUID is 08bb83be-288c-482f-aa5b-639c75f4688a 2026-01-05 01:55:00,675 - DEBUG - Pod ctest-pod-49675596 not present 2026-01-05 01:55:00,675 - INFO - Creating Pod ctest-pod-49675596 2026-01-05 01:55:00,695 - DEBUG - Pod : ctest-pod-49675596 UUID is 84bf0a40-b104-46c3-9bfd-b9e378e7e35d 2026-01-05 01:55:00,697 - DEBUG - Pod ctest-pod-04839778 not present 2026-01-05 01:55:00,697 - INFO - Creating Pod ctest-pod-04839778 2026-01-05 01:55:00,743 - DEBUG - Pod : ctest-pod-04839778 UUID is dc7e4346-f2a8-4444-84c8-de3e1197b506 2026-01-05 01:55:00,746 - DEBUG - Pod ctest-pod-15836840 not present 2026-01-05 01:55:00,747 - INFO - Creating Pod ctest-pod-15836840 2026-01-05 01:55:00,770 - DEBUG - Pod : ctest-pod-15836840 UUID is b74b3b85-9a63-4b61-93b7-0c8256563003 2026-01-05 01:55:01,108 - INFO - Project default-domain:k8s-ctest-new-default-08102596 for Namespace ctest-new-default-08102596 is seen in contrail-api 2026-01-05 01:55:01,108 - DEBUG - Project uuid in Contrail is 9d05164c-8d0e-4ce3-993e-401845b82caf 2026-01-05 01:55:01,249 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=0ef65d12-e314-4807-9e10-f835006b6cf7 2026-01-05 01:55:01,263 - INFO - Namespace ctest-new-default-08102596 with uuid 0ef65d12-e314-4807-9e10-f835006b6cf7 found in kube manager 2026-01-05 01:55:01,263 - INFO - Namespace ctest-new-default-08102596 verification passed 2026-01-05 01:55:01,449 - INFO - Project default-domain:k8s-ctest-non-default-01753560 for Namespace ctest-non-default-01753560 is seen in contrail-api 2026-01-05 01:55:01,449 - DEBUG - Project uuid in Contrail is 89bdd47b-0093-49dd-b9d0-66a478b2dca4 2026-01-05 01:55:01,449 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=bf0b5b79-c22e-4c78-ba5f-a9eb4800c421 2026-01-05 01:55:01,455 - INFO - Namespace ctest-non-default-01753560 with uuid bf0b5b79-c22e-4c78-ba5f-a9eb4800c421 found in kube manager 2026-01-05 01:55:01,455 - INFO - Namespace ctest-non-default-01753560 verification passed 2026-01-05 01:55:01,461 - DEBUG - Pod ctest-pod-39614718 not in running state.Currently in Pending 2026-01-05 01:55:06,475 - DEBUG - Pod ctest-pod-39614718 not in running state.Currently in Pending 2026-01-05 01:55:11,481 - INFO - Pod ctest-pod-39614718 is in running state.Got IP 10.47.255.251 2026-01-05 01:55:11,492 - DEBUG - Pod ctest-pod-39614718 has vmi 8c764944-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:11,492 - INFO - Verified pod ctest-pod-39614718 in contrail-api 2026-01-05 01:55:11,502 - DEBUG - VMI 8c764944-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:11,502 - INFO - Verified Pod ctest-pod-39614718 in agent 10.0.0.241 2026-01-05 01:55:11,502 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=0e3cf0ce-c1ff-42f7-878a-dc4857f50b9b 2026-01-05 01:55:11,505 - INFO - Pod ctest-pod-39614718 with uuid 0e3cf0ce-c1ff-42f7-878a-dc4857f50b9b found in kube manager 2026-01-05 01:55:11,506 - INFO - Pod ctest-pod-39614718 verification passed 2026-01-05 01:55:11,511 - INFO - Pod ctest-pod-29441201 is in running state.Got IP 10.47.255.250 2026-01-05 01:55:11,564 - DEBUG - Pod ctest-pod-29441201 has vmi 8cdfdf62-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:11,564 - INFO - Verified pod ctest-pod-29441201 in contrail-api 2026-01-05 01:55:11,573 - DEBUG - VMI 8cdfdf62-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:11,573 - INFO - Verified Pod ctest-pod-29441201 in agent 10.0.0.241 2026-01-05 01:55:11,573 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c52a6636-9692-469e-9413-075fa941de49 2026-01-05 01:55:11,577 - INFO - Pod ctest-pod-29441201 with uuid c52a6636-9692-469e-9413-075fa941de49 found in kube manager 2026-01-05 01:55:11,577 - INFO - Pod ctest-pod-29441201 verification passed 2026-01-05 01:55:11,582 - DEBUG - Pod ctest-pod-92262342 not in running state.Currently in Pending 2026-01-05 01:55:16,589 - INFO - Pod ctest-pod-92262342 is in running state.Got IP 10.47.255.249 2026-01-05 01:55:16,600 - DEBUG - Pod ctest-pod-92262342 has vmi 8d717094-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:16,600 - INFO - Verified pod ctest-pod-92262342 in contrail-api 2026-01-05 01:55:16,611 - DEBUG - VMI 8d717094-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:16,612 - INFO - Verified Pod ctest-pod-92262342 in agent 10.0.0.241 2026-01-05 01:55:16,612 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=4b55a3e0-e21f-4395-9053-cb15a432a31a 2026-01-05 01:55:16,615 - INFO - Pod ctest-pod-92262342 with uuid 4b55a3e0-e21f-4395-9053-cb15a432a31a found in kube manager 2026-01-05 01:55:16,615 - INFO - Pod ctest-pod-92262342 verification passed 2026-01-05 01:55:16,621 - INFO - Pod ctest-pod-10903617 is in running state.Got IP 10.47.255.248 2026-01-05 01:55:16,676 - DEBUG - Pod ctest-pod-10903617 has vmi 8dda6fb8-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:16,676 - INFO - Verified pod ctest-pod-10903617 in contrail-api 2026-01-05 01:55:16,686 - DEBUG - VMI 8dda6fb8-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:16,687 - INFO - Verified Pod ctest-pod-10903617 in agent 10.0.0.241 2026-01-05 01:55:16,687 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=5b4224df-d01d-4583-b926-d41f3fdd16cf 2026-01-05 01:55:16,690 - INFO - Pod ctest-pod-10903617 with uuid 5b4224df-d01d-4583-b926-d41f3fdd16cf found in kube manager 2026-01-05 01:55:16,690 - INFO - Pod ctest-pod-10903617 verification passed 2026-01-05 01:55:16,696 - DEBUG - Pod ctest-pod-65381559 not in running state.Currently in Pending 2026-01-05 01:55:21,706 - INFO - Pod ctest-pod-65381559 is in running state.Got IP 10.47.255.247 2026-01-05 01:55:21,720 - DEBUG - Pod ctest-pod-65381559 has vmi 8e498e02-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:21,720 - INFO - Verified pod ctest-pod-65381559 in contrail-api 2026-01-05 01:55:21,733 - DEBUG - VMI 8e498e02-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:21,733 - INFO - Verified Pod ctest-pod-65381559 in agent 10.0.0.241 2026-01-05 01:55:21,733 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=08bb83be-288c-482f-aa5b-639c75f4688a 2026-01-05 01:55:21,736 - INFO - Pod ctest-pod-65381559 with uuid 08bb83be-288c-482f-aa5b-639c75f4688a found in kube manager 2026-01-05 01:55:21,736 - INFO - Pod ctest-pod-65381559 verification passed 2026-01-05 01:55:21,743 - INFO - Pod ctest-pod-04839778 is in running state.Got IP 10.47.255.245 2026-01-05 01:55:21,797 - DEBUG - Pod ctest-pod-04839778 has vmi 8f1f4128-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:21,797 - INFO - Verified pod ctest-pod-04839778 in contrail-api 2026-01-05 01:55:21,811 - DEBUG - VMI 8f1f4128-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:21,811 - INFO - Verified Pod ctest-pod-04839778 in agent 10.0.0.241 2026-01-05 01:55:21,811 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=dc7e4346-f2a8-4444-84c8-de3e1197b506 2026-01-05 01:55:21,819 - INFO - Pod ctest-pod-04839778 with uuid dc7e4346-f2a8-4444-84c8-de3e1197b506 found in kube manager 2026-01-05 01:55:21,819 - INFO - Pod ctest-pod-04839778 verification passed 2026-01-05 01:55:21,828 - INFO - Pod ctest-pod-49675596 is in running state.Got IP 10.47.255.246 2026-01-05 01:55:21,841 - DEBUG - Pod ctest-pod-49675596 has vmi 8eadd92a-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:21,841 - INFO - Verified pod ctest-pod-49675596 in contrail-api 2026-01-05 01:55:21,853 - DEBUG - VMI 8eadd92a-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:21,853 - INFO - Verified Pod ctest-pod-49675596 in agent 10.0.0.241 2026-01-05 01:55:21,854 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=84bf0a40-b104-46c3-9bfd-b9e378e7e35d 2026-01-05 01:55:21,857 - INFO - Pod ctest-pod-49675596 with uuid 84bf0a40-b104-46c3-9bfd-b9e378e7e35d found in kube manager 2026-01-05 01:55:21,858 - INFO - Pod ctest-pod-49675596 verification passed 2026-01-05 01:55:21,865 - INFO - Pod ctest-pod-15836840 is in running state.Got IP 10.47.255.244 2026-01-05 01:55:21,920 - DEBUG - Pod ctest-pod-15836840 has vmi 8f86bfa6-e9d9-11f0-a434-fa163e7e31e9 2026-01-05 01:55:21,920 - INFO - Verified pod ctest-pod-15836840 in contrail-api 2026-01-05 01:55:21,932 - DEBUG - VMI 8f86bfa6-e9d9-11f0-a434-fa163e7e31e9 is active in agent 10.0.0.241 2026-01-05 01:55:21,932 - INFO - Verified Pod ctest-pod-15836840 in agent 10.0.0.241 2026-01-05 01:55:21,933 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=b74b3b85-9a63-4b61-93b7-0c8256563003 2026-01-05 01:55:21,936 - INFO - Pod ctest-pod-15836840 with uuid b74b3b85-9a63-4b61-93b7-0c8256563003 found in kube manager 2026-01-05 01:55:21,937 - INFO - Pod ctest-pod-15836840 verification passed 2026-01-05 01:55:21,937 - INFO - ================================================================================ 2026-01-05 01:55:21,937 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-01-05 01:55:21,938 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-01-05 01:55:22,105 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.19': '0'}} with 2026-01-05 01:55:22,105 - INFO - Initial checks done. Running the testcase now 2026-01-05 01:55:22,105 - INFO - 2026-01-05 01:55:22,161 - DEBUG - [Pod ctest-pod-39614718] Cmd: echo ctest-pod-39614718 > /usr/share/nginx/html/index.html, Output: 2026-01-05 01:55:22,239 - DEBUG - [Pod ctest-pod-29441201] Cmd: echo ctest-pod-29441201 > /usr/share/nginx/html/index.html, Output: 2026-01-05 01:55:22,308 - DEBUG - [Pod ctest-pod-92262342] Cmd: echo ctest-pod-92262342 > /usr/share/nginx/html/index.html, Output: 2026-01-05 01:55:22,363 - DEBUG - [Pod ctest-pod-10903617] Cmd: echo ctest-pod-10903617 > /usr/share/nginx/html/index.html, Output: 2026-01-05 01:55:22,365 - DEBUG - Service ctest-nginx-svc-00246404 not present 2026-01-05 01:55:22,366 - INFO - Creating service ctest-nginx-svc-00246404 2026-01-05 01:55:22,390 - INFO - Created Service ctest-nginx-svc-00246404 2026-01-05 01:55:22,396 - WARNING - Service UUID 6bc0ca93-7df5-49df-8c16-52ebc4cfcd3c not yet found in contrail-api 2026-01-05 01:55:23,412 - INFO - Validated that Service ctest-nginx-svc-00246404 is seen in contrail-api 2026-01-05 01:55:23,412 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=6bc0ca93-7df5-49df-8c16-52ebc4cfcd3c 2026-01-05 01:55:23,416 - INFO - Service ctest-nginx-svc-00246404 with uuid 6bc0ca93-7df5-49df-8c16-52ebc4cfcd3c found in kube manager 2026-01-05 01:55:23,416 - INFO - Service ctest-nginx-svc-00246404 verification passed 2026-01-05 01:55:24,511 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39614718 2026-01-05 01:55:24,511 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,511 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39614718 2026-01-05 01:55:24,575 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,575 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,575 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,631 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,631 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,631 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,631 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39614718': 2, 'ctest-pod-29441201': 1} 2026-01-05 01:55:24,687 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,687 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,687 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,752 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,752 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,752 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,820 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,820 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,820 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,890 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,890 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,890 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,946 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:24,946 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:24,947 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:25,007 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:25,007 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:55:25,007 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:55:25,007 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39614718': 5, 'ctest-pod-29441201': 1} 2026-01-05 01:55:25,010 - DEBUG - Network policy ingress-on-service not present 2026-01-05 01:55:25,010 - INFO - Creating Network Policy ingress-on-service 2026-01-05 01:55:25,023 - INFO - Network policy found in k8s 2026-01-05 01:55:25,023 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=657deeda-520e-4954-9ef4-78682d06d826 2026-01-05 01:55:25,030 - INFO - Network Policy ingress-on-service with uuid 657deeda-520e-4954-9ef4-78682d06d826 found in kube manager 2026-01-05 01:55:25,072 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-01-05 01:55:25,072 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-01-05 01:55:25,072 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=657deeda-520e-4954-9ef4-78682d06d826 2026-01-05 01:55:25,098 - WARNING - Network policy with name ingress-on-service not found in agent 2026-01-05 01:55:27,100 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=657deeda-520e-4954-9ef4-78682d06d826 2026-01-05 01:55:27,129 - INFO - Network policy with name ingress-on-service found in agent 2026-01-05 01:55:27,129 - INFO - Network Policy ingress-on-service verification passed 2026-01-05 01:55:29,475 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2026-01-05 01:55:39,534 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:39,534 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:39,534 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:44,595 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:44,595 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:44,595 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:49,642 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:49,642 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:49,642 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:54,701 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:54,702 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:54,702 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:59,757 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:59,757 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:55:59,757 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:04,830 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:04,830 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:04,830 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:09,882 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:09,882 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:09,882 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:14,948 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:14,948 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:14,948 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:20,004 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:20,005 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:20,005 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:25,059 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:25,059 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:25,059 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:25,059 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-39614718': 0, 'ctest-pod-29441201': 0} 2026-01-05 01:56:25,107 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:56:25,108 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:56:25,108 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:56:25,159 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39614718 2026-01-05 01:56:25,159 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:56:25,159 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39614718 2026-01-05 01:56:25,159 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39614718': 1, 'ctest-pod-29441201': 1} 2026-01-05 01:56:30,207 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:30,207 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:30,207 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:35,262 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:35,263 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:35,263 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:40,310 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:40,310 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:40,310 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:45,354 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:45,354 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:45,354 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:50,406 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:50,406 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:50,406 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:55,454 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:55,454 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:56:55,454 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:00,493 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:00,493 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:00,494 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:05,537 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:05,537 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:05,537 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:10,588 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:10,588 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:10,588 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:15,650 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:15,651 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:15,651 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:15,651 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-39614718': 0, 'ctest-pod-29441201': 0} 2026-01-05 01:57:17,697 - DEBUG - [Pod ctest-pod-49675596] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.982 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.381/0.982 ms 2026-01-05 01:57:17,698 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49675596 with expectation True passed 2026-01-05 01:57:19,752 - DEBUG - [Pod ctest-pod-65381559] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.829 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.332/0.829 ms 2026-01-05 01:57:19,752 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65381559 with expectation True passed 2026-01-05 01:57:21,798 - DEBUG - [Pod ctest-pod-04839778] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.637 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.113 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.277/0.637 ms 2026-01-05 01:57:21,798 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04839778 with expectation True passed 2026-01-05 01:57:21,854 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:57:21,854 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-01-05 01:57:21,854 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:57:21,854 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49675596 passed 2026-01-05 01:57:21,907 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:57:21,907 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-01-05 01:57:21,907 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:57:21,907 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49675596 passed 2026-01-05 01:57:26,958 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-05 01:57:26,958 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-05 01:57:26,958 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-05 01:57:26,958 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65381559 passed 2026-01-05 01:57:32,011 - DEBUG - [Pod ctest-pod-15836840] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-01-05 01:57:32,011 - DEBUG - [Pod Pod ctest-pod-15836840] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-01-05 01:57:32,011 - DEBUG - [Pod Pod ctest-pod-15836840] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-01-05 01:57:32,011 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15836840 passed 2026-01-05 01:57:32,020 - INFO - Updating Network Policy ingress-on-service 2026-01-05 01:57:37,089 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:37,089 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:37,089 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:42,130 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:42,130 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:42,130 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:47,177 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:47,178 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:47,178 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:52,230 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:52,230 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:52,230 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:57,282 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:57,282 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:57:57,282 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:02,334 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:02,334 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:02,335 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:07,377 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:07,377 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:07,377 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:12,429 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:12,429 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:12,430 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:17,482 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:17,482 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:17,482 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:22,550 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:22,550 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:22,550 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.108.61.88:80 (10.108.61.88:80) wget: download timed out 2026-01-05 01:58:22,550 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-39614718': 0, 'ctest-pod-29441201': 0} 2026-01-05 01:58:22,611 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,611 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,611 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,669 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,669 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,669 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,730 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,731 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,731 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,767 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,767 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,767 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,811 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,811 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,811 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,812 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39614718': 1, 'ctest-pod-29441201': 4} 2026-01-05 01:58:22,875 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,875 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,875 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-29441201 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,922 - DEBUG - [Pod ctest-pod-04839778] Cmd: wget http://10.108.61.88:80/ -O - -T 5 -t 1 , Output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,923 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd wget http://10.108.61.88:80/ -O - -T 5 -t 1 passed 2026-01-05 01:58:22,923 - DEBUG - [Pod Pod ctest-pod-04839778] Cmd output: ctest-pod-39614718 Connecting to 10.108.61.88:80 (10.108.61.88:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-05 01:58:22,923 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-39614718': 1, 'ctest-pod-29441201': 1} 2026-01-05 01:58:24,969 - DEBUG - [Pod ctest-pod-49675596] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.748 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.307/0.748 ms 2026-01-05 01:58:24,969 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49675596 with expectation True passed 2026-01-05 01:58:27,021 - DEBUG - [Pod ctest-pod-65381559] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.088 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.418/1.088 ms 2026-01-05 01:58:27,022 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65381559 with expectation True passed 2026-01-05 01:58:29,069 - DEBUG - [Pod ctest-pod-04839778] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.584 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.120 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.262/0.584 ms 2026-01-05 01:58:29,070 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04839778 with expectation True passed 2026-01-05 01:58:29,125 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:58:29,126 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-01-05 01:58:29,126 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:58:29,126 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49675596 passed 2026-01-05 01:58:29,183 - DEBUG - [Pod ctest-pod-49675596] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:58:29,183 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-01-05 01:58:29,183 - DEBUG - [Pod Pod ctest-pod-49675596] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:58:29,183 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49675596 passed 2026-01-05 01:58:34,230 - DEBUG - [Pod ctest-pod-65381559] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-05 01:58:34,230 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-05 01:58:34,230 - DEBUG - [Pod Pod ctest-pod-65381559] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-05 01:58:34,230 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65381559 passed 2026-01-05 01:58:34,283 - DEBUG - [Pod ctest-pod-15836840] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:58:34,283 - DEBUG - [Pod Pod ctest-pod-15836840] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-01-05 01:58:34,284 - DEBUG - [Pod Pod ctest-pod-15836840] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-05 01:58:34,284 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15836840 passed 2026-01-05 01:58:34,284 - INFO - Deleting Network Policy : ingress-on-service 2026-01-05 01:58:34,284 - INFO - Deleting service : ctest-nginx-svc-00246404 2026-01-05 01:58:34,532 - DEBUG - No XMPP flaps were noticed during the test