2026-11-03 03:54:38,693 - INFO - Using existing project ['default-domain', 'k8s-default'](9007c438-6642-4498-a4ca-a71c7cc0021d)
2026-11-03 03:54:38,714 - DEBUG - Namespace ctest-new-default-75186109 not present
2026-11-03 03:54:38,721 - INFO - Created namespace ctest-new-default-75186109
2026-11-03 03:54:41,724 - DEBUG - Namespace ctest-non-default-07824767 not present
2026-11-03 03:54:41,730 - INFO - Created namespace ctest-non-default-07824767
2026-11-03 03:54:44,749 - DEBUG - Pod ctest-pod-94863636 not present
2026-11-03 03:54:44,750 - INFO - Creating Pod ctest-pod-94863636
2026-11-03 03:54:44,789 - DEBUG - Pod : ctest-pod-94863636 UUID is 09f27fba-f5d6-4b23-933b-96881357f4fe
2026-11-03 03:54:44,796 - DEBUG - Pod ctest-pod-92299124 not present
2026-11-03 03:54:44,797 - INFO - Creating Pod ctest-pod-92299124
2026-11-03 03:54:44,831 - DEBUG - Pod : ctest-pod-92299124 UUID is 7470af4f-8f4d-4fa4-b24f-607742a6a169
2026-11-03 03:54:44,833 - DEBUG - Pod ctest-pod-09435270 not present
2026-11-03 03:54:44,833 - INFO - Creating Pod ctest-pod-09435270
2026-11-03 03:54:44,856 - DEBUG - Pod : ctest-pod-09435270 UUID is 41f4eae7-427f-45c4-845d-56497c7b2e2d
2026-11-03 03:54:44,858 - DEBUG - Pod ctest-pod-01663931 not present
2026-11-03 03:54:44,859 - INFO - Creating Pod ctest-pod-01663931
2026-11-03 03:54:44,881 - DEBUG - Pod : ctest-pod-01663931 UUID is 8e8a5162-8833-4ee1-8985-3fa0a1ef25ac
2026-11-03 03:54:44,883 - DEBUG - Pod ctest-pod-45676131 not present
2026-11-03 03:54:44,884 - INFO - Creating Pod ctest-pod-45676131
2026-11-03 03:54:44,904 - DEBUG - Pod : ctest-pod-45676131 UUID is acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8
2026-11-03 03:54:44,906 - DEBUG - Pod ctest-pod-46773187 not present
2026-11-03 03:54:44,907 - INFO - Creating Pod ctest-pod-46773187
2026-11-03 03:54:44,930 - DEBUG - Pod : ctest-pod-46773187 UUID is 9eb54942-1a6e-4894-b755-2c6469cfb292
2026-11-03 03:54:44,939 - DEBUG - Pod ctest-pod-74846898 not present
2026-11-03 03:54:44,939 - INFO - Creating Pod ctest-pod-74846898
2026-11-03 03:54:44,957 - DEBUG - Pod : ctest-pod-74846898 UUID is 3468d67f-f3de-401f-a5ac-02272f325aca
2026-11-03 03:54:44,961 - DEBUG - Pod ctest-pod-68395806 not present
2026-11-03 03:54:44,961 - INFO - Creating Pod ctest-pod-68395806
2026-11-03 03:54:44,980 - DEBUG - Pod : ctest-pod-68395806 UUID is 5da91bc1-3205-4769-9d4d-dd935a2329d9
2026-11-03 03:54:45,202 - INFO - Project default-domain:k8s-ctest-new-default-75186109 for Namespace ctest-new-default-75186109 is seen in contrail-api
2026-11-03 03:54:45,202 - DEBUG - Project uuid in Contrail is 43da7b27-3aeb-4947-8696-fa19b0ff12f3
2026-11-03 03:54:45,349 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=ac1c1ad6-856b-4fb6-8232-ad57720b7f3d
2026-11-03 03:54:45,353 - INFO - Namespace ctest-new-default-75186109 with uuid ac1c1ad6-856b-4fb6-8232-ad57720b7f3d found in kube manager
2026-11-03 03:54:45,353 - INFO - Namespace ctest-new-default-75186109 verification passed
2026-11-03 03:54:45,522 - INFO - Project default-domain:k8s-ctest-non-default-07824767 for Namespace ctest-non-default-07824767 is seen in contrail-api
2026-11-03 03:54:45,522 - DEBUG - Project uuid in Contrail is 48bf8070-a8aa-49c6-bd3f-b81e33a5640d
2026-11-03 03:54:45,522 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=b9632c14-3c52-4f9e-942d-35a47ffff77e
2026-11-03 03:54:45,527 - INFO - Namespace ctest-non-default-07824767 with uuid b9632c14-3c52-4f9e-942d-35a47ffff77e found in kube manager
2026-11-03 03:54:45,527 - INFO - Namespace ctest-non-default-07824767 verification passed
2026-11-03 03:54:45,533 - DEBUG - Pod ctest-pod-94863636 not in running state.Currently in Pending
2026-11-03 03:54:50,541 - DEBUG - Pod ctest-pod-94863636 not in running state.Currently in Pending
2026-11-03 03:54:55,549 - DEBUG - Pod ctest-pod-94863636 not in running state.Currently in Pending
2026-11-03 03:55:00,556 - INFO - Pod ctest-pod-94863636 is in running state.Got IP 10.47.255.251
2026-11-03 03:55:00,607 - DEBUG - Pod ctest-pod-94863636 has vmi 4f497ca4-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:00,607 - INFO - Verified pod ctest-pod-94863636 in contrail-api
2026-11-03 03:55:00,620 - DEBUG - VMI 4f497ca4-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:00,620 - INFO - Verified Pod ctest-pod-94863636 in agent 10.0.0.250
2026-11-03 03:55:00,620 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=09f27fba-f5d6-4b23-933b-96881357f4fe
2026-11-03 03:55:00,624 - INFO - Pod ctest-pod-94863636 with uuid 09f27fba-f5d6-4b23-933b-96881357f4fe found in kube manager
2026-11-03 03:55:00,624 - INFO - Pod ctest-pod-94863636 verification passed
2026-11-03 03:55:00,629 - INFO - Pod ctest-pod-92299124 is in running state.Got IP 10.47.255.250
2026-11-03 03:55:00,640 - DEBUG - Pod ctest-pod-92299124 has vmi 4fc37216-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:00,640 - INFO - Verified pod ctest-pod-92299124 in contrail-api
2026-11-03 03:55:00,654 - DEBUG - VMI 4fc37216-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:00,654 - INFO - Verified Pod ctest-pod-92299124 in agent 10.0.0.250
2026-11-03 03:55:00,654 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=7470af4f-8f4d-4fa4-b24f-607742a6a169
2026-11-03 03:55:00,657 - INFO - Pod ctest-pod-92299124 with uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 found in kube manager
2026-11-03 03:55:00,657 - INFO - Pod ctest-pod-92299124 verification passed
2026-11-03 03:55:00,663 - INFO - Pod ctest-pod-09435270 is in running state.Got IP 10.47.255.249
2026-11-03 03:55:00,715 - DEBUG - Pod ctest-pod-09435270 has vmi 5048355a-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:00,715 - INFO - Verified pod ctest-pod-09435270 in contrail-api
2026-11-03 03:55:00,726 - DEBUG - VMI 5048355a-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:00,726 - INFO - Verified Pod ctest-pod-09435270 in agent 10.0.0.250
2026-11-03 03:55:00,727 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=41f4eae7-427f-45c4-845d-56497c7b2e2d
2026-11-03 03:55:00,730 - INFO - Pod ctest-pod-09435270 with uuid 41f4eae7-427f-45c4-845d-56497c7b2e2d found in kube manager
2026-11-03 03:55:00,730 - INFO - Pod ctest-pod-09435270 verification passed
2026-11-03 03:55:00,736 - INFO - Pod ctest-pod-01663931 is in running state.Got IP 10.47.255.248
2026-11-03 03:55:00,746 - DEBUG - Pod ctest-pod-01663931 has vmi 50ce5bc6-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:00,746 - INFO - Verified pod ctest-pod-01663931 in contrail-api
2026-11-03 03:55:00,757 - DEBUG - VMI 50ce5bc6-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:00,757 - INFO - Verified Pod ctest-pod-01663931 in agent 10.0.0.250
2026-11-03 03:55:00,757 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8e8a5162-8833-4ee1-8985-3fa0a1ef25ac
2026-11-03 03:55:00,761 - INFO - Pod ctest-pod-01663931 with uuid 8e8a5162-8833-4ee1-8985-3fa0a1ef25ac found in kube manager
2026-11-03 03:55:00,761 - INFO - Pod ctest-pod-01663931 verification passed
2026-11-03 03:55:00,766 - INFO - Pod ctest-pod-45676131 is in running state.Got IP 10.47.255.247
2026-11-03 03:55:00,817 - DEBUG - Pod ctest-pod-45676131 has vmi 51610502-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:00,817 - INFO - Verified pod ctest-pod-45676131 in contrail-api
2026-11-03 03:55:00,830 - DEBUG - VMI 51610502-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:00,830 - INFO - Verified Pod ctest-pod-45676131 in agent 10.0.0.250
2026-11-03 03:55:00,830 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8
2026-11-03 03:55:00,833 - INFO - Pod ctest-pod-45676131 with uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 found in kube manager
2026-11-03 03:55:00,833 - INFO - Pod ctest-pod-45676131 verification passed
2026-11-03 03:55:00,840 - INFO - Pod ctest-pod-74846898 is in running state.Got IP 10.47.255.245
2026-11-03 03:55:00,891 - DEBUG - Pod ctest-pod-74846898 has vmi 522a07fe-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:00,891 - INFO - Verified pod ctest-pod-74846898 in contrail-api
2026-11-03 03:55:00,904 - DEBUG - VMI 522a07fe-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:00,904 - INFO - Verified Pod ctest-pod-74846898 in agent 10.0.0.250
2026-11-03 03:55:00,904 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=3468d67f-f3de-401f-a5ac-02272f325aca
2026-11-03 03:55:00,908 - INFO - Pod ctest-pod-74846898 with uuid 3468d67f-f3de-401f-a5ac-02272f325aca found in kube manager
2026-11-03 03:55:00,908 - INFO - Pod ctest-pod-74846898 verification passed
2026-11-03 03:55:00,913 - DEBUG - Pod ctest-pod-46773187 not in running state.Currently in Pending
2026-11-03 03:55:05,920 - INFO - Pod ctest-pod-46773187 is in running state.Got IP 10.47.255.246
2026-11-03 03:55:05,934 - DEBUG - Pod ctest-pod-46773187 has vmi 51ca5340-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:05,934 - INFO - Verified pod ctest-pod-46773187 in contrail-api
2026-11-03 03:55:05,951 - DEBUG - VMI 51ca5340-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:05,952 - INFO - Verified Pod ctest-pod-46773187 in agent 10.0.0.250
2026-11-03 03:55:05,952 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9eb54942-1a6e-4894-b755-2c6469cfb292
2026-11-03 03:55:05,958 - INFO - Pod ctest-pod-46773187 with uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 found in kube manager
2026-11-03 03:55:05,958 - INFO - Pod ctest-pod-46773187 verification passed
2026-11-03 03:55:05,973 - INFO - Pod ctest-pod-68395806 is in running state.Got IP 10.47.255.244
2026-11-03 03:55:05,993 - DEBUG - Pod ctest-pod-68395806 has vmi 52914b80-d73a-11f1-8a66-fa163ed7b2b8
2026-11-03 03:55:05,993 - INFO - Verified pod ctest-pod-68395806 in contrail-api
2026-11-03 03:55:06,007 - DEBUG - VMI 52914b80-d73a-11f1-8a66-fa163ed7b2b8 is active in agent 10.0.0.250
2026-11-03 03:55:06,008 - INFO - Verified Pod ctest-pod-68395806 in agent 10.0.0.250
2026-11-03 03:55:06,008 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=5da91bc1-3205-4769-9d4d-dd935a2329d9
2026-11-03 03:55:06,012 - INFO - Pod ctest-pod-68395806 with uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 found in kube manager
2026-11-03 03:55:06,012 - INFO - Pod ctest-pod-68395806 verification passed
2026-11-03 03:55:06,012 - INFO - ================================================================================
2026-11-03 03:55:06,012 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2026-11-03 03:55:06,012 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2026-11-03 03:55:06,292 - DEBUG - Nothing to compare xmpp stats {'10.0.0.250': {'10.0.0.22': '0'}} with
2026-11-03 03:55:06,292 - INFO - Initial checks done. Running the testcase now
2026-11-03 03:55:06,292 - INFO -
2026-11-03 03:55:06,354 - DEBUG - [Pod ctest-pod-94863636] Cmd: echo ctest-pod-94863636 > /usr/share/nginx/html/index.html, Output:
2026-11-03 03:55:06,421 - DEBUG - [Pod ctest-pod-92299124] Cmd: echo ctest-pod-92299124 > /usr/share/nginx/html/index.html, Output:
2026-11-03 03:55:06,485 - DEBUG - [Pod ctest-pod-09435270] Cmd: echo ctest-pod-09435270 > /usr/share/nginx/html/index.html, Output:
2026-11-03 03:55:06,558 - DEBUG - [Pod ctest-pod-01663931] Cmd: echo ctest-pod-01663931 > /usr/share/nginx/html/index.html, Output:
2026-11-03 03:55:06,561 - DEBUG - Service ctest-nginx-svc-17771684 not present
2026-11-03 03:55:06,562 - INFO - Creating service ctest-nginx-svc-17771684
2026-11-03 03:55:06,578 - INFO - Created Service ctest-nginx-svc-17771684
2026-11-03 03:55:06,594 - WARNING - Service UUID 6aa06ca6-ee26-469a-baed-f70f3e459fbd not yet found in contrail-api
2026-11-03 03:55:07,646 - INFO - Validated that Service ctest-nginx-svc-17771684 is seen in contrail-api
2026-11-03 03:55:07,647 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=6aa06ca6-ee26-469a-baed-f70f3e459fbd
2026-11-03 03:55:07,651 - INFO - Service ctest-nginx-svc-17771684 with uuid 6aa06ca6-ee26-469a-baed-f70f3e459fbd found in kube manager
2026-11-03 03:55:07,652 - INFO - Service ctest-nginx-svc-17771684 verification passed
2026-11-03 03:55:07,716 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,717 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:55:07,717 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,779 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,779 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:55:07,780 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,854 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,854 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:55:07,854 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,854 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94863636': 2, 'ctest-pod-92299124': 1}
2026-11-03 03:55:07,910 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-92299124
2026-11-03 03:55:07,910 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:55:07,910 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-92299124
2026-11-03 03:55:07,973 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:07,973 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:55:07,973 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:08,043 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
ctest-pod-94863636
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:08,043 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:55:08,043 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
ctest-pod-94863636
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:55:08,043 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94863636': 1, 'ctest-pod-92299124': 2}
2026-11-03 03:55:08,046 - DEBUG - Network policy ingress-on-service not present
2026-11-03 03:55:08,046 - INFO - Creating Network Policy ingress-on-service
2026-11-03 03:55:08,059 - INFO - Network policy found in k8s
2026-11-03 03:55:08,060 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7e27350-3eb1-48b2-b3e6-dfdf759c389f
2026-11-03 03:55:08,065 - INFO - Network Policy ingress-on-service with uuid d7e27350-3eb1-48b2-b3e6-dfdf759c389f found in kube manager
2026-11-03 03:55:08,098 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2026-11-03 03:55:08,098 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2026-11-03 03:55:08,098 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7e27350-3eb1-48b2-b3e6-dfdf759c389f
2026-11-03 03:55:08,130 - WARNING - Network policy with name ingress-on-service not found in agent
2026-11-03 03:55:10,131 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7e27350-3eb1-48b2-b3e6-dfdf759c389f
2026-11-03 03:55:10,162 - INFO - Network policy with name ingress-on-service found in agent
2026-11-03 03:55:10,162 - INFO - Network Policy ingress-on-service verification passed
2026-11-03 03:55:15,221 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:15,221 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:15,221 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:20,279 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:20,279 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:20,279 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:25,339 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:25,339 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:25,339 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:30,390 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:30,390 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:30,390 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:35,446 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:35,446 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:35,446 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:40,505 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:40,506 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:40,506 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:45,558 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:45,558 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:45,558 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:50,616 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:50,616 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:50,616 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:55,675 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:55,675 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:55:55,675 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:55:59,723 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2026-11-03 03:56:09,794 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:09,794 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:09,794 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:09,794 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94863636': 0, 'ctest-pod-92299124': 0}
2026-11-03 03:56:09,856 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:56:09,856 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:56:09,856 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:56:09,910 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:56:09,911 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:56:09,911 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:56:09,966 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:56:09,966 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:56:09,966 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:56:10,031 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:56:10,031 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:56:10,031 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:56:10,093 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:56:10,093 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:56:10,093 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:56:10,093 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94863636': 4, 'ctest-pod-92299124': 1}
2026-11-03 03:56:15,150 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:15,151 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:15,151 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:20,212 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:20,212 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:20,212 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:25,279 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:25,279 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:25,280 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:30,330 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:30,330 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:30,330 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:35,387 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:35,387 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:35,387 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:40,438 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:40,438 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:40,438 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:45,514 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:45,514 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:45,514 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:50,591 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:50,591 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:50,591 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:55,658 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:56:55,658 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:56:55,658 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:00,764 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:00,764 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:00,764 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:00,764 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94863636': 0, 'ctest-pod-92299124': 0}
2026-11-03 03:57:02,818 - DEBUG - [Pod ctest-pod-46773187] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.406 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.527/1.406 ms
2026-11-03 03:57:02,818 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-46773187 with expectation True passed
2026-11-03 03:57:04,879 - DEBUG - [Pod ctest-pod-45676131] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.594 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.116 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.262/0.594 ms
2026-11-03 03:57:04,879 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-45676131 with expectation True passed
2026-11-03 03:57:06,942 - DEBUG - [Pod ctest-pod-74846898] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.852 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.091/0.350/0.852 ms
2026-11-03 03:57:06,942 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-74846898 with expectation True passed
2026-11-03 03:57:07,007 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:57:07,007 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-11-03 03:57:07,007 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94863636
2026-11-03 03:57:07,007 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46773187 passed
2026-11-03 03:57:07,078 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:57:07,078 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-11-03 03:57:07,078 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-92299124
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:57:07,078 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46773187 passed
2026-11-03 03:57:12,145 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-11-03 03:57:12,145 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-11-03 03:57:12,145 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-11-03 03:57:12,145 - INFO - wget check of of http://10.47.255.250 from ctest-pod-45676131 passed
2026-11-03 03:57:17,200 - DEBUG - [Pod ctest-pod-68395806] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-11-03 03:57:17,201 - DEBUG - [Pod Pod ctest-pod-68395806] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed.
2026-11-03 03:57:17,201 - DEBUG - [Pod Pod ctest-pod-68395806] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-11-03 03:57:17,201 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68395806 passed
2026-11-03 03:57:17,211 - INFO - Updating Network Policy ingress-on-service
2026-11-03 03:57:22,274 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:22,274 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:22,274 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:27,334 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:27,335 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:27,335 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:32,387 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:32,387 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:32,387 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:37,443 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:37,443 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:37,443 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:42,506 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:42,507 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:42,507 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:47,572 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:47,572 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:47,572 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:52,634 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:52,634 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:52,634 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:57,687 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:57:57,687 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:57:57,687 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:58:02,743 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:58:02,743 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:58:02,743 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:58:07,802 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:58:07,802 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 failed.
2026-11-03 03:58:07,802 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.109.146.119:80 (10.109.146.119:80)
wget: download timed out
2026-11-03 03:58:07,802 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-94863636': 0, 'ctest-pod-92299124': 0}
2026-11-03 03:58:07,855 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:07,855 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:07,855 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:07,927 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:07,927 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:07,927 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:07,991 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:07,992 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:07,992 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:07,992 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94863636': 1, 'ctest-pod-92299124': 2}
2026-11-03 03:58:08,057 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,057 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,057 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,115 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,115 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,115 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,187 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,187 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,187 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,254 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,254 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,254 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,326 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,326 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,326 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,394 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,394 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,394 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-94863636
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,459 - DEBUG - [Pod ctest-pod-74846898] Cmd: wget http://10.109.146.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,459 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd wget http://10.109.146.119:80/ -O - -T 5 -t 1 passed
2026-11-03 03:58:08,459 - DEBUG - [Pod Pod ctest-pod-74846898] Cmd output: ctest-pod-92299124
Connecting to 10.109.146.119:80 (10.109.146.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:08,459 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-94863636': 6, 'ctest-pod-92299124': 1}
2026-11-03 03:58:10,519 - DEBUG - [Pod ctest-pod-46773187] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.522 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.231/0.522 ms
2026-11-03 03:58:10,519 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-46773187 with expectation True passed
2026-11-03 03:58:12,586 - DEBUG - [Pod ctest-pod-45676131] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.838 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.675/1.838 ms
2026-11-03 03:58:12,586 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-45676131 with expectation True passed
2026-11-03 03:58:14,643 - DEBUG - [Pod ctest-pod-74846898] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.486 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.222/0.486 ms
2026-11-03 03:58:14,643 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-74846898 with expectation True passed
2026-11-03 03:58:14,705 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:14,705 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-11-03 03:58:14,705 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-94863636
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:14,705 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46773187 passed
2026-11-03 03:58:14,777 - DEBUG - [Pod ctest-pod-46773187] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-92299124
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:14,777 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-11-03 03:58:14,777 - DEBUG - [Pod Pod ctest-pod-46773187] Cmd output: ctest-pod-92299124
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:14,777 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46773187 passed
2026-11-03 03:58:19,830 - DEBUG - [Pod ctest-pod-45676131] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-11-03 03:58:19,830 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-11-03 03:58:19,830 - DEBUG - [Pod Pod ctest-pod-45676131] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-11-03 03:58:19,830 - INFO - wget check of of http://10.47.255.250 from ctest-pod-45676131 passed
2026-11-03 03:58:19,886 - DEBUG - [Pod ctest-pod-68395806] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-94863636
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:19,886 - DEBUG - [Pod Pod ctest-pod-68395806] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-11-03 03:58:19,886 - DEBUG - [Pod Pod ctest-pod-68395806] Cmd output: ctest-pod-94863636
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-11-03 03:58:19,886 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68395806 passed
2026-11-03 03:58:19,887 - INFO - Deleting Network Policy : ingress-on-service
2026-11-03 03:58:19,887 - INFO - Deleting service : ctest-nginx-svc-17771684
2026-11-03 03:58:20,058 - DEBUG - No XMPP flaps were noticed during the test
2026-11-03 03:58:20,058 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2026-11-03 03:58:20,058 - INFO - --------------------------------------------------------------------------------
2026-11-03 03:58:20,063 - INFO - Deleting pod ctest-new-default-75186109:ctest-pod-94863636
2026-11-03 03:58:20,063 - INFO - Deleting pod ctest-new-default-75186109:ctest-pod-92299124
2026-11-03 03:58:20,064 - INFO - Deleting pod ctest-non-default-07824767:ctest-pod-09435270
2026-11-03 03:58:20,064 - INFO - Deleting pod ctest-non-default-07824767:ctest-pod-01663931
2026-11-03 03:58:20,064 - INFO - Deleting pod ctest-new-default-75186109:ctest-pod-45676131
2026-11-03 03:58:20,064 - INFO - Deleting pod ctest-new-default-75186109:ctest-pod-46773187
2026-11-03 03:58:20,065 - INFO - Deleting pod ctest-non-default-07824767:ctest-pod-74846898
2026-11-03 03:58:20,065 - INFO - Deleting pod ctest-non-default-07824767:ctest-pod-68395806
2026-11-03 03:58:20,108 - WARNING - Pod uuid 09f27fba-f5d6-4b23-933b-96881357f4fe is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,192 - WARNING - Pod uuid 41f4eae7-427f-45c4-845d-56497c7b2e2d is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,258 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,259 - WARNING - Pod uuid 8e8a5162-8833-4ee1-8985-3fa0a1ef25ac is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,259 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,261 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,261 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:20,261 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:25,115 - DEBUG - Pod 09f27fba-f5d6-4b23-933b-96881357f4fe is not in agent 10.0.0.250 VM list
2026-11-03 03:58:25,122 - DEBUG - VMI 4f497ca4-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:25,122 - INFO - Verified that pod ctest-pod-94863636 is removed in agent
2026-11-03 03:58:25,201 - DEBUG - Pod 41f4eae7-427f-45c4-845d-56497c7b2e2d is not in agent 10.0.0.250 VM list
2026-11-03 03:58:25,205 - DEBUG - VMI 5048355a-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:25,205 - INFO - Verified that pod ctest-pod-09435270 is removed in agent
2026-11-03 03:58:25,289 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:25,290 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:25,291 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:25,291 - DEBUG - Pod 8e8a5162-8833-4ee1-8985-3fa0a1ef25ac is not in agent 10.0.0.250 VM list
2026-11-03 03:58:25,292 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:25,292 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:25,298 - DEBUG - VMI 50ce5bc6-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:25,298 - INFO - Verified that pod ctest-pod-01663931 is removed in agent
2026-11-03 03:58:30,309 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:30,310 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:30,311 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:30,312 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:30,312 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:35,330 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:35,331 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:35,332 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:35,334 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:35,335 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:40,349 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:40,350 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:40,351 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:40,351 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:40,351 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:45,367 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:45,367 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:45,367 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:45,369 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:45,369 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:50,430 - WARNING - Pod uuid 7470af4f-8f4d-4fa4-b24f-607742a6a169 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:50,431 - WARNING - Pod uuid 9eb54942-1a6e-4894-b755-2c6469cfb292 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:50,431 - WARNING - Pod uuid 5da91bc1-3205-4769-9d4d-dd935a2329d9 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:50,432 - WARNING - Pod uuid acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:50,433 - WARNING - Pod uuid 3468d67f-f3de-401f-a5ac-02272f325aca is still seen in agent 10.0.0.250 VM list
2026-11-03 03:58:55,451 - DEBUG - Pod 5da91bc1-3205-4769-9d4d-dd935a2329d9 is not in agent 10.0.0.250 VM list
2026-11-03 03:58:55,452 - DEBUG - Pod 7470af4f-8f4d-4fa4-b24f-607742a6a169 is not in agent 10.0.0.250 VM list
2026-11-03 03:58:55,455 - DEBUG - Pod acd4ce6c-5af5-4ce2-933a-eb2eba82a7f8 is not in agent 10.0.0.250 VM list
2026-11-03 03:58:55,457 - DEBUG - Pod 3468d67f-f3de-401f-a5ac-02272f325aca is not in agent 10.0.0.250 VM list
2026-11-03 03:58:55,457 - DEBUG - Pod 9eb54942-1a6e-4894-b755-2c6469cfb292 is not in agent 10.0.0.250 VM list
2026-11-03 03:58:55,475 - DEBUG - VMI 4fc37216-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:55,475 - INFO - Verified that pod ctest-pod-92299124 is removed in agent
2026-11-03 03:58:55,476 - DEBUG - VMI 52914b80-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:55,476 - INFO - Verified that pod ctest-pod-68395806 is removed in agent
2026-11-03 03:58:55,478 - DEBUG - VMI 51610502-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:55,478 - INFO - Verified that pod ctest-pod-45676131 is removed in agent
2026-11-03 03:58:55,479 - DEBUG - VMI 522a07fe-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:55,479 - INFO - Verified that pod ctest-pod-74846898 is removed in agent
2026-11-03 03:58:55,479 - DEBUG - VMI 51ca5340-d73a-11f1-8a66-fa163ed7b2b8 is removed from agent 10.0.0.250
2026-11-03 03:58:55,479 - INFO - Verified that pod ctest-pod-46773187 is removed in agent
2026-11-03 03:58:55,480 - INFO - Deleting namespace ctest-non-default-07824767
2026-11-03 03:58:55,502 - DEBUG - Namespace ctest-non-default-07824767 still in k8s
2026-11-03 03:58:57,507 - DEBUG - Namespace ctest-non-default-07824767 still in k8s
2026-11-03 03:58:59,512 - DEBUG - Namespace ctest-non-default-07824767 still in k8s
2026-11-03 03:59:01,520 - DEBUG - Namespace ctest-non-default-07824767 is not in k8s
2026-11-03 03:59:01,521 - DEBUG - No need to check project deletion in contrail-api
2026-11-03 03:59:01,521 - INFO - Deleting namespace ctest-new-default-75186109
2026-11-03 03:59:01,544 - DEBUG - Namespace ctest-new-default-75186109 still in k8s
2026-11-03 03:59:03,549 - DEBUG - Namespace ctest-new-default-75186109 still in k8s
2026-11-03 03:59:05,556 - DEBUG - Namespace ctest-new-default-75186109 still in k8s
2026-11-03 03:59:07,560 - DEBUG - Namespace ctest-new-default-75186109 is not in k8s
2026-11-03 03:59:07,560 - DEBUG - No need to check project deletion in contrail-api