2025-03-13 02:13:23,505 - INFO - Using existing project ['default-domain', 'k8s-default'](b4ef722d-dac4-45a8-a477-60403d029a2d)
2025-03-13 02:13:23,526 - DEBUG - Namespace ctest-new-default-96285897 not present
2025-03-13 02:13:23,534 - INFO - Created namespace ctest-new-default-96285897
2025-03-13 02:13:26,539 - DEBUG - Namespace ctest-non-default-46709964 not present
2025-03-13 02:13:26,551 - INFO - Created namespace ctest-non-default-46709964
2025-03-13 02:13:29,582 - DEBUG - Pod ctest-pod-42767171 not present
2025-03-13 02:13:29,583 - INFO - Creating Pod ctest-pod-42767171
2025-03-13 02:13:29,609 - DEBUG - Pod : ctest-pod-42767171 UUID is e161cd9d-3781-4a63-99bb-b49ef4cf00b8
2025-03-13 02:13:29,613 - DEBUG - Pod ctest-pod-02780847 not present
2025-03-13 02:13:29,613 - INFO - Creating Pod ctest-pod-02780847
2025-03-13 02:13:29,642 - DEBUG - Pod : ctest-pod-02780847 UUID is 9a671614-a665-4968-b7b3-6848230d2c7d
2025-03-13 02:13:29,646 - DEBUG - Pod ctest-pod-25959907 not present
2025-03-13 02:13:29,646 - INFO - Creating Pod ctest-pod-25959907
2025-03-13 02:13:29,679 - DEBUG - Pod : ctest-pod-25959907 UUID is 7a307c5e-997a-4b0d-aa76-28b98f3a7cab
2025-03-13 02:13:29,682 - DEBUG - Pod ctest-pod-40848663 not present
2025-03-13 02:13:29,682 - INFO - Creating Pod ctest-pod-40848663
2025-03-13 02:13:29,721 - DEBUG - Pod : ctest-pod-40848663 UUID is 1777a0e4-87b6-49c5-868a-09305e475a2d
2025-03-13 02:13:29,732 - DEBUG - Pod ctest-pod-62801315 not present
2025-03-13 02:13:29,733 - INFO - Creating Pod ctest-pod-62801315
2025-03-13 02:13:29,757 - DEBUG - Pod : ctest-pod-62801315 UUID is 9041ae7f-26cf-40c6-ba58-15273245f98e
2025-03-13 02:13:29,759 - DEBUG - Pod ctest-pod-71280157 not present
2025-03-13 02:13:29,760 - INFO - Creating Pod ctest-pod-71280157
2025-03-13 02:13:29,780 - DEBUG - Pod : ctest-pod-71280157 UUID is 505c254f-186f-4243-aded-708c2a33b08f
2025-03-13 02:13:29,783 - DEBUG - Pod ctest-pod-17104237 not present
2025-03-13 02:13:29,784 - INFO - Creating Pod ctest-pod-17104237
2025-03-13 02:13:29,802 - DEBUG - Pod : ctest-pod-17104237 UUID is 5926fd40-968b-4211-be70-d40ba8179884
2025-03-13 02:13:29,804 - DEBUG - Pod ctest-pod-36529129 not present
2025-03-13 02:13:29,804 - INFO - Creating Pod ctest-pod-36529129
2025-03-13 02:13:29,821 - DEBUG - Pod : ctest-pod-36529129 UUID is a883b562-9d48-4f17-8771-6aa4c550f5e1
2025-03-13 02:13:30,089 - INFO - Project default-domain:k8s-ctest-new-default-96285897 for Namespace ctest-new-default-96285897 is seen in contrail-api
2025-03-13 02:13:30,089 - DEBUG - Project uuid in Contrail is cf9d9956-cfde-4e13-b745-9468ca719277
2025-03-13 02:13:30,288 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=892b48bf-d202-4772-8f58-6fd81f40cb6d
2025-03-13 02:13:30,293 - INFO - Namespace ctest-new-default-96285897 with uuid 892b48bf-d202-4772-8f58-6fd81f40cb6d found in kube manager
2025-03-13 02:13:30,293 - INFO - Namespace ctest-new-default-96285897 verification passed
2025-03-13 02:13:30,482 - INFO - Project default-domain:k8s-ctest-non-default-46709964 for Namespace ctest-non-default-46709964 is seen in contrail-api
2025-03-13 02:13:30,482 - DEBUG - Project uuid in Contrail is 658a34bd-1c41-4466-8606-4e6e6470d1bd
2025-03-13 02:13:30,482 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=3df1a3e0-6fc9-4a5a-92ef-5899c4b10e02
2025-03-13 02:13:30,489 - INFO - Namespace ctest-non-default-46709964 with uuid 3df1a3e0-6fc9-4a5a-92ef-5899c4b10e02 found in kube manager
2025-03-13 02:13:30,489 - INFO - Namespace ctest-non-default-46709964 verification passed
2025-03-13 02:13:30,510 - DEBUG - Pod ctest-pod-42767171 not in running state.Currently in Pending
2025-03-13 02:13:35,521 - DEBUG - Pod ctest-pod-42767171 not in running state.Currently in Pending
2025-03-13 02:13:40,530 - DEBUG - Pod ctest-pod-42767171 not in running state.Currently in Pending
2025-03-13 02:13:45,537 - INFO - Pod ctest-pod-42767171 is in running state.Got IP 10.47.255.251
2025-03-13 02:13:45,553 - DEBUG - Pod ctest-pod-42767171 has vmi c297e46a-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:45,554 - INFO - Verified pod ctest-pod-42767171 in contrail-api
2025-03-13 02:13:45,570 - DEBUG - VMI c297e46a-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:45,571 - INFO - Verified Pod ctest-pod-42767171 in agent 10.0.0.28
2025-03-13 02:13:45,571 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=e161cd9d-3781-4a63-99bb-b49ef4cf00b8
2025-03-13 02:13:45,576 - INFO - Pod ctest-pod-42767171 with uuid e161cd9d-3781-4a63-99bb-b49ef4cf00b8 found in kube manager
2025-03-13 02:13:45,576 - INFO - Pod ctest-pod-42767171 verification passed
2025-03-13 02:13:45,582 - INFO - Pod ctest-pod-02780847 is in running state.Got IP 10.47.255.250
2025-03-13 02:13:45,641 - DEBUG - Pod ctest-pod-02780847 has vmi c3238218-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:45,641 - INFO - Verified pod ctest-pod-02780847 in contrail-api
2025-03-13 02:13:45,657 - DEBUG - VMI c3238218-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:45,657 - INFO - Verified Pod ctest-pod-02780847 in agent 10.0.0.28
2025-03-13 02:13:45,657 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=9a671614-a665-4968-b7b3-6848230d2c7d
2025-03-13 02:13:45,663 - INFO - Pod ctest-pod-02780847 with uuid 9a671614-a665-4968-b7b3-6848230d2c7d found in kube manager
2025-03-13 02:13:45,663 - INFO - Pod ctest-pod-02780847 verification passed
2025-03-13 02:13:45,676 - INFO - Pod ctest-pod-25959907 is in running state.Got IP 10.47.255.249
2025-03-13 02:13:45,693 - DEBUG - Pod ctest-pod-25959907 has vmi c3e917ee-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:45,693 - INFO - Verified pod ctest-pod-25959907 in contrail-api
2025-03-13 02:13:45,709 - DEBUG - VMI c3e917ee-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:45,709 - INFO - Verified Pod ctest-pod-25959907 in agent 10.0.0.28
2025-03-13 02:13:45,710 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=7a307c5e-997a-4b0d-aa76-28b98f3a7cab
2025-03-13 02:13:45,714 - INFO - Pod ctest-pod-25959907 with uuid 7a307c5e-997a-4b0d-aa76-28b98f3a7cab found in kube manager
2025-03-13 02:13:45,714 - INFO - Pod ctest-pod-25959907 verification passed
2025-03-13 02:13:45,722 - INFO - Pod ctest-pod-40848663 is in running state.Got IP 10.47.255.248
2025-03-13 02:13:45,789 - DEBUG - Pod ctest-pod-40848663 has vmi c47a6bfe-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:45,789 - INFO - Verified pod ctest-pod-40848663 in contrail-api
2025-03-13 02:13:45,805 - DEBUG - VMI c47a6bfe-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:45,806 - INFO - Verified Pod ctest-pod-40848663 in agent 10.0.0.28
2025-03-13 02:13:45,806 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=1777a0e4-87b6-49c5-868a-09305e475a2d
2025-03-13 02:13:45,811 - INFO - Pod ctest-pod-40848663 with uuid 1777a0e4-87b6-49c5-868a-09305e475a2d found in kube manager
2025-03-13 02:13:45,811 - INFO - Pod ctest-pod-40848663 verification passed
2025-03-13 02:13:45,817 - DEBUG - Pod ctest-pod-62801315 not in running state.Currently in Pending
2025-03-13 02:13:50,826 - INFO - Pod ctest-pod-62801315 is in running state.Got IP 10.47.255.247
2025-03-13 02:13:50,861 - DEBUG - Pod ctest-pod-62801315 has vmi c5138e74-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:50,861 - INFO - Verified pod ctest-pod-62801315 in contrail-api
2025-03-13 02:13:50,875 - DEBUG - VMI c5138e74-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:50,875 - INFO - Verified Pod ctest-pod-62801315 in agent 10.0.0.28
2025-03-13 02:13:50,876 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=9041ae7f-26cf-40c6-ba58-15273245f98e
2025-03-13 02:13:50,880 - INFO - Pod ctest-pod-62801315 with uuid 9041ae7f-26cf-40c6-ba58-15273245f98e found in kube manager
2025-03-13 02:13:50,881 - INFO - Pod ctest-pod-62801315 verification passed
2025-03-13 02:13:50,886 - INFO - Pod ctest-pod-17104237 is in running state.Got IP 10.47.255.245
2025-03-13 02:13:50,942 - DEBUG - Pod ctest-pod-17104237 has vmi c61b98b6-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:50,942 - INFO - Verified pod ctest-pod-17104237 in contrail-api
2025-03-13 02:13:50,956 - DEBUG - VMI c61b98b6-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:50,957 - INFO - Verified Pod ctest-pod-17104237 in agent 10.0.0.28
2025-03-13 02:13:50,957 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=5926fd40-968b-4211-be70-d40ba8179884
2025-03-13 02:13:50,962 - INFO - Pod ctest-pod-17104237 with uuid 5926fd40-968b-4211-be70-d40ba8179884 found in kube manager
2025-03-13 02:13:50,962 - INFO - Pod ctest-pod-17104237 verification passed
2025-03-13 02:13:51,045 - INFO - Pod ctest-pod-71280157 is in running state.Got IP 10.47.255.246
2025-03-13 02:13:51,059 - DEBUG - Pod ctest-pod-71280157 has vmi c59a9e6e-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:51,060 - INFO - Verified pod ctest-pod-71280157 in contrail-api
2025-03-13 02:13:51,076 - DEBUG - VMI c59a9e6e-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:51,076 - INFO - Verified Pod ctest-pod-71280157 in agent 10.0.0.28
2025-03-13 02:13:51,077 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=505c254f-186f-4243-aded-708c2a33b08f
2025-03-13 02:13:51,081 - INFO - Pod ctest-pod-71280157 with uuid 505c254f-186f-4243-aded-708c2a33b08f found in kube manager
2025-03-13 02:13:51,081 - INFO - Pod ctest-pod-71280157 verification passed
2025-03-13 02:13:51,087 - INFO - Pod ctest-pod-36529129 is in running state.Got IP 10.47.255.244
2025-03-13 02:13:51,146 - DEBUG - Pod ctest-pod-36529129 has vmi c6a5386e-ffb0-11ef-af8a-fa163e56332f
2025-03-13 02:13:51,146 - INFO - Verified pod ctest-pod-36529129 in contrail-api
2025-03-13 02:13:51,165 - DEBUG - VMI c6a5386e-ffb0-11ef-af8a-fa163e56332f is active in agent 10.0.0.28
2025-03-13 02:13:51,165 - INFO - Verified Pod ctest-pod-36529129 in agent 10.0.0.28
2025-03-13 02:13:51,166 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=a883b562-9d48-4f17-8771-6aa4c550f5e1
2025-03-13 02:13:51,173 - INFO - Pod ctest-pod-36529129 with uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 found in kube manager
2025-03-13 02:13:51,173 - INFO - Pod ctest-pod-36529129 verification passed
2025-03-13 02:13:51,174 - INFO - ================================================================================
2025-03-13 02:13:51,174 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-13 02:13:51,174 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-13 02:13:51,432 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.12': '0'}} with
2025-03-13 02:13:51,432 - INFO - Initial checks done. Running the testcase now
2025-03-13 02:13:51,433 - INFO -
2025-03-13 02:13:51,498 - DEBUG - [Pod ctest-pod-42767171] Cmd: echo ctest-pod-42767171 > /usr/share/nginx/html/index.html, Output:
2025-03-13 02:13:51,559 - DEBUG - [Pod ctest-pod-02780847] Cmd: echo ctest-pod-02780847 > /usr/share/nginx/html/index.html, Output:
2025-03-13 02:13:51,620 - DEBUG - [Pod ctest-pod-25959907] Cmd: echo ctest-pod-25959907 > /usr/share/nginx/html/index.html, Output:
2025-03-13 02:13:51,681 - DEBUG - [Pod ctest-pod-40848663] Cmd: echo ctest-pod-40848663 > /usr/share/nginx/html/index.html, Output:
2025-03-13 02:13:51,684 - DEBUG - Service ctest-nginx-svc-91572409 not present
2025-03-13 02:13:51,685 - INFO - Creating service ctest-nginx-svc-91572409
2025-03-13 02:13:51,704 - INFO - Created Service ctest-nginx-svc-91572409
2025-03-13 02:13:51,721 - WARNING - Service UUID f4bec7c0-ab1d-46be-b106-246d2147d826 not yet found in contrail-api
2025-03-13 02:13:52,730 - INFO - Validated that Service ctest-nginx-svc-91572409 is seen in contrail-api
2025-03-13 02:13:52,730 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=f4bec7c0-ab1d-46be-b106-246d2147d826
2025-03-13 02:13:52,739 - INFO - Service ctest-nginx-svc-91572409 with uuid f4bec7c0-ab1d-46be-b106-246d2147d826 found in kube manager
2025-03-13 02:13:52,739 - INFO - Service ctest-nginx-svc-91572409 verification passed
2025-03-13 02:13:53,826 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
ctest-pod-02780847
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:53,826 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:53,826 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
ctest-pod-02780847
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:53,880 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:53,880 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:53,880 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:53,880 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42767171': 1, 'ctest-pod-02780847': 1}
2025-03-13 02:13:53,945 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:53,945 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:53,945 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,008 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,008 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:54,008 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,067 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,067 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:54,067 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,122 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-02780847
2025-03-13 02:13:54,122 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:54,122 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-02780847
2025-03-13 02:13:54,190 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,191 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:13:54,191 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:13:54,191 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42767171': 1, 'ctest-pod-02780847': 4}
2025-03-13 02:13:54,194 - DEBUG - Network policy ingress-on-service not present
2025-03-13 02:13:54,194 - INFO - Creating Network Policy ingress-on-service
2025-03-13 02:13:54,208 - INFO - Network policy found in k8s
2025-03-13 02:13:54,209 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=56c2ab4c-0d71-41a0-8453-158afc1090e6
2025-03-13 02:13:54,216 - INFO - Network Policy ingress-on-service with uuid 56c2ab4c-0d71-41a0-8453-158afc1090e6 found in kube manager
2025-03-13 02:13:54,251 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-13 02:13:54,251 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-13 02:13:54,251 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=56c2ab4c-0d71-41a0-8453-158afc1090e6
2025-03-13 02:13:54,284 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-13 02:13:56,285 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=56c2ab4c-0d71-41a0-8453-158afc1090e6
2025-03-13 02:13:56,318 - INFO - Network policy with name ingress-on-service found in agent
2025-03-13 02:13:56,318 - INFO - Network Policy ingress-on-service verification passed
2025-03-13 02:14:01,370 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:01,371 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:01,371 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:06,438 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:06,438 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:06,438 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:11,501 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:11,502 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:11,502 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:16,558 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:16,558 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:16,558 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:21,621 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:21,621 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:21,621 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:26,674 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:26,674 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:26,674 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:31,742 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:31,742 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:31,743 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:36,809 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:36,809 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:36,809 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:41,880 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:41,881 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:41,881 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:46,937 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:46,937 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:46,937 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:46,937 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42767171': 0, 'ctest-pod-02780847': 0}
2025-03-13 02:14:46,994 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767171
2025-03-13 02:14:46,995 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:14:46,995 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767171
2025-03-13 02:14:47,083 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,083 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:14:47,083 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,145 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767171
2025-03-13 02:14:47,145 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:14:47,145 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767171
2025-03-13 02:14:47,208 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,208 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:14:47,208 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,270 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,270 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:14:47,270 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,337 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,337 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:14:47,337 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:14:47,337 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42767171': 5, 'ctest-pod-02780847': 1}
2025-03-13 02:14:52,409 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:52,409 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:52,409 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:57,459 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:57,459 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:14:57,459 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:02,527 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:02,528 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:02,528 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:07,578 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:07,578 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:07,578 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:12,637 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:12,637 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:12,637 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:17,701 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:17,701 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:17,701 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:22,770 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:22,770 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:22,770 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:27,842 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:27,842 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:27,842 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:32,914 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:32,914 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:32,914 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:37,977 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:37,977 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:37,977 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:37,978 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42767171': 0, 'ctest-pod-02780847': 0}
2025-03-13 02:15:40,042 - DEBUG - [Pod ctest-pod-71280157] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.041 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.400/1.041 ms
2025-03-13 02:15:40,042 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-71280157 with expectation True passed
2025-03-13 02:15:42,103 - DEBUG - [Pod ctest-pod-62801315] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.732 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.061 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.061/0.291/0.732 ms
2025-03-13 02:15:42,103 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62801315 with expectation True passed
2025-03-13 02:15:44,162 - DEBUG - [Pod ctest-pod-17104237] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.250 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.466/1.250 ms
2025-03-13 02:15:44,162 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17104237 with expectation True passed
2025-03-13 02:15:44,231 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:15:44,231 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-13 02:15:44,231 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:15:44,231 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71280157 passed
2025-03-13 02:15:44,293 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:15:44,293 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-13 02:15:44,293 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:15:44,293 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71280157 passed
2025-03-13 02:15:49,353 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-13 02:15:49,354 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-13 02:15:49,354 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-13 02:15:49,354 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62801315 passed
2025-03-13 02:15:54,410 - DEBUG - [Pod ctest-pod-36529129] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-13 02:15:54,410 - DEBUG - [Pod Pod ctest-pod-36529129] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-13 02:15:54,410 - DEBUG - [Pod Pod ctest-pod-36529129] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-13 02:15:54,410 - INFO - wget check of of http://10.47.255.251 from ctest-pod-36529129 passed
2025-03-13 02:15:54,421 - INFO - Updating Network Policy ingress-on-service
2025-03-13 02:15:59,490 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:59,490 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:15:59,490 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:04,554 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:04,554 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:04,554 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:09,622 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:09,622 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:09,622 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:14,692 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:14,692 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:14,692 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:19,758 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:19,758 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:19,759 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:24,831 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:24,831 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:24,831 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:29,881 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:29,882 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:29,882 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:34,951 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:34,951 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:34,951 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:40,013 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:40,014 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:40,014 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:45,074 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:45,074 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:45,074 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
wget: download timed out
2025-03-13 02:16:45,074 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42767171': 0, 'ctest-pod-02780847': 0}
2025-03-13 02:16:45,146 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:16:45,147 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:16:45,147 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:16:45,216 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:16:45,216 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:16:45,216 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-02780847
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:16:45,285 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:16:45,285 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:16:45,285 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: ctest-pod-42767171
Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-13 02:16:45,285 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42767171': 1, 'ctest-pod-02780847': 2}
2025-03-13 02:16:45,351 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767171
2025-03-13 02:16:45,351 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:16:45,351 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767171
2025-03-13 02:16:45,408 - DEBUG - [Pod ctest-pod-17104237] Cmd: wget http://10.110.148.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-02780847
2025-03-13 02:16:45,408 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd wget http://10.110.148.233:80/ -O - -T 5 -t 1 passed
2025-03-13 02:16:45,408 - DEBUG - [Pod Pod ctest-pod-17104237] Cmd output: Connecting to 10.110.148.233:80 (10.110.148.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-02780847
2025-03-13 02:16:45,409 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42767171': 1, 'ctest-pod-02780847': 1}
2025-03-13 02:16:47,462 - DEBUG - [Pod ctest-pod-71280157] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.473 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.206/0.473 ms
2025-03-13 02:16:47,462 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-71280157 with expectation True passed
2025-03-13 02:16:49,522 - DEBUG - [Pod ctest-pod-62801315] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.241 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.462/1.241 ms
2025-03-13 02:16:49,522 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62801315 with expectation True passed
2025-03-13 02:16:51,569 - DEBUG - [Pod ctest-pod-17104237] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.623 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.587/1.623 ms
2025-03-13 02:16:51,570 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17104237 with expectation True passed
2025-03-13 02:16:51,628 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:16:51,628 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-13 02:16:51,628 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:16:51,628 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71280157 passed
2025-03-13 02:16:51,691 - DEBUG - [Pod ctest-pod-71280157] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:16:51,691 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-13 02:16:51,691 - DEBUG - [Pod Pod ctest-pod-71280157] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:16:51,691 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71280157 passed
2025-03-13 02:16:56,738 - DEBUG - [Pod ctest-pod-62801315] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-13 02:16:56,738 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-13 02:16:56,738 - DEBUG - [Pod Pod ctest-pod-62801315] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-13 02:16:56,738 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62801315 passed
2025-03-13 02:16:56,797 - DEBUG - [Pod ctest-pod-36529129] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:16:56,798 - DEBUG - [Pod Pod ctest-pod-36529129] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-13 02:16:56,798 - DEBUG - [Pod Pod ctest-pod-36529129] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-13 02:16:56,798 - INFO - wget check of of http://10.47.255.251 from ctest-pod-36529129 passed
2025-03-13 02:16:56,798 - INFO - Deleting Network Policy : ingress-on-service
2025-03-13 02:16:56,798 - INFO - Deleting service : ctest-nginx-svc-91572409
2025-03-13 02:16:57,047 - DEBUG - No XMPP flaps were noticed during the test
2025-03-13 02:16:57,047 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-13 02:16:57,048 - INFO - --------------------------------------------------------------------------------
2025-03-13 02:16:57,053 - INFO - Deleting pod ctest-new-default-96285897:ctest-pod-42767171
2025-03-13 02:16:57,054 - INFO - Deleting pod ctest-new-default-96285897:ctest-pod-02780847
2025-03-13 02:16:57,054 - INFO - Deleting pod ctest-non-default-46709964:ctest-pod-25959907
2025-03-13 02:16:57,055 - INFO - Deleting pod ctest-non-default-46709964:ctest-pod-40848663
2025-03-13 02:16:57,055 - INFO - Deleting pod ctest-new-default-96285897:ctest-pod-62801315
2025-03-13 02:16:57,055 - INFO - Deleting pod ctest-new-default-96285897:ctest-pod-71280157
2025-03-13 02:16:57,056 - INFO - Deleting pod ctest-non-default-46709964:ctest-pod-17104237
2025-03-13 02:16:57,056 - INFO - Deleting pod ctest-non-default-46709964:ctest-pod-36529129
2025-03-13 02:16:57,186 - WARNING - Pod uuid 1777a0e4-87b6-49c5-868a-09305e475a2d is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,187 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,188 - WARNING - Pod uuid 7a307c5e-997a-4b0d-aa76-28b98f3a7cab is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,188 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,189 - WARNING - Pod uuid 9a671614-a665-4968-b7b3-6848230d2c7d is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,190 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,190 - WARNING - Pod uuid e161cd9d-3781-4a63-99bb-b49ef4cf00b8 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:16:57,190 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:02,225 - DEBUG - Pod e161cd9d-3781-4a63-99bb-b49ef4cf00b8 is not in agent 10.0.0.28 VM list
2025-03-13 02:17:02,227 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:02,228 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:02,229 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:02,229 - DEBUG - Pod 1777a0e4-87b6-49c5-868a-09305e475a2d is not in agent 10.0.0.28 VM list
2025-03-13 02:17:02,231 - DEBUG - Pod 7a307c5e-997a-4b0d-aa76-28b98f3a7cab is not in agent 10.0.0.28 VM list
2025-03-13 02:17:02,232 - DEBUG - Pod 9a671614-a665-4968-b7b3-6848230d2c7d is not in agent 10.0.0.28 VM list
2025-03-13 02:17:02,237 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:02,249 - DEBUG - VMI c47a6bfe-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:02,249 - INFO - Verified that pod ctest-pod-40848663 is removed in agent
2025-03-13 02:17:02,250 - DEBUG - VMI c297e46a-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:02,250 - INFO - Verified that pod ctest-pod-42767171 is removed in agent
2025-03-13 02:17:02,252 - DEBUG - VMI c3238218-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:02,252 - INFO - Verified that pod ctest-pod-02780847 is removed in agent
2025-03-13 02:17:02,253 - DEBUG - VMI c3e917ee-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:02,253 - INFO - Verified that pod ctest-pod-25959907 is removed in agent
2025-03-13 02:17:07,242 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:07,245 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:07,247 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:07,247 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:12,264 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:12,264 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:12,266 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:12,266 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:17,288 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:17,288 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:17,290 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:17,291 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:22,309 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:22,310 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:22,311 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:22,312 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:27,393 - WARNING - Pod uuid 505c254f-186f-4243-aded-708c2a33b08f is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:27,394 - WARNING - Pod uuid 9041ae7f-26cf-40c6-ba58-15273245f98e is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:27,395 - WARNING - Pod uuid a883b562-9d48-4f17-8771-6aa4c550f5e1 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:27,396 - WARNING - Pod uuid 5926fd40-968b-4211-be70-d40ba8179884 is still seen in agent 10.0.0.28 VM list
2025-03-13 02:17:32,415 - DEBUG - Pod 5926fd40-968b-4211-be70-d40ba8179884 is not in agent 10.0.0.28 VM list
2025-03-13 02:17:32,417 - DEBUG - Pod 9041ae7f-26cf-40c6-ba58-15273245f98e is not in agent 10.0.0.28 VM list
2025-03-13 02:17:32,418 - DEBUG - Pod 505c254f-186f-4243-aded-708c2a33b08f is not in agent 10.0.0.28 VM list
2025-03-13 02:17:32,422 - DEBUG - Pod a883b562-9d48-4f17-8771-6aa4c550f5e1 is not in agent 10.0.0.28 VM list
2025-03-13 02:17:32,435 - DEBUG - VMI c59a9e6e-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:32,435 - INFO - Verified that pod ctest-pod-71280157 is removed in agent
2025-03-13 02:17:32,436 - DEBUG - VMI c61b98b6-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:32,436 - INFO - Verified that pod ctest-pod-17104237 is removed in agent
2025-03-13 02:17:32,438 - DEBUG - VMI c5138e74-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:32,438 - INFO - Verified that pod ctest-pod-62801315 is removed in agent
2025-03-13 02:17:32,438 - DEBUG - VMI c6a5386e-ffb0-11ef-af8a-fa163e56332f is removed from agent 10.0.0.28
2025-03-13 02:17:32,438 - INFO - Verified that pod ctest-pod-36529129 is removed in agent
2025-03-13 02:17:32,438 - INFO - Deleting namespace ctest-non-default-46709964
2025-03-13 02:17:32,465 - DEBUG - Namespace ctest-non-default-46709964 still in k8s
2025-03-13 02:17:34,473 - DEBUG - Namespace ctest-non-default-46709964 still in k8s
2025-03-13 02:17:36,480 - DEBUG - Namespace ctest-non-default-46709964 still in k8s
2025-03-13 02:17:38,484 - DEBUG - Namespace ctest-non-default-46709964 is not in k8s
2025-03-13 02:17:38,484 - DEBUG - No need to check project deletion in contrail-api
2025-03-13 02:17:38,484 - INFO - Deleting namespace ctest-new-default-96285897
2025-03-13 02:17:38,496 - DEBUG - Namespace ctest-new-default-96285897 still in k8s
2025-03-13 02:17:40,501 - DEBUG - Namespace ctest-new-default-96285897 still in k8s
2025-03-13 02:17:42,506 - DEBUG - Namespace ctest-new-default-96285897 still in k8s
2025-03-13 02:17:44,511 - DEBUG - Namespace ctest-new-default-96285897 is not in k8s
2025-03-13 02:17:44,511 - DEBUG - No need to check project deletion in contrail-api