2024-09-17 23:00:19,879 - INFO - Using existing project ['default-domain', 'k8s-default'](e667c1b6-62f3-4301-8035-04e37f838bb5)
2024-09-17 23:00:19,896 - DEBUG - Namespace ctest-new-default-39862922 not present
2024-09-17 23:00:19,905 - INFO - Created namespace ctest-new-default-39862922
2024-09-17 23:00:22,909 - DEBUG - Namespace ctest-non-default-66198919 not present
2024-09-17 23:00:22,921 - INFO - Created namespace ctest-non-default-66198919
2024-09-17 23:00:25,941 - DEBUG - Pod ctest-pod-00285175 not present
2024-09-17 23:00:25,941 - INFO - Creating Pod ctest-pod-00285175
2024-09-17 23:00:25,955 - DEBUG - Node for Pod ctest-pod-00285175 not yet populated
2024-09-17 23:00:28,964 - DEBUG - Pod : ctest-pod-00285175 UUID is 6b73ddb6-1c18-432b-8895-0d76b94f2e29
2024-09-17 23:00:28,967 - DEBUG - Pod ctest-pod-83621101 not present
2024-09-17 23:00:28,967 - INFO - Creating Pod ctest-pod-83621101
2024-09-17 23:00:28,999 - DEBUG - Pod : ctest-pod-83621101 UUID is 2532a119-0d69-4dfc-b935-524922c9a953
2024-09-17 23:00:29,004 - DEBUG - Pod ctest-pod-24734192 not present
2024-09-17 23:00:29,005 - INFO - Creating Pod ctest-pod-24734192
2024-09-17 23:00:29,026 - DEBUG - Pod : ctest-pod-24734192 UUID is 59e5d228-5fc7-41da-8ad4-9e4eda653e7e
2024-09-17 23:00:29,033 - DEBUG - Pod ctest-pod-53029074 not present
2024-09-17 23:00:29,033 - INFO - Creating Pod ctest-pod-53029074
2024-09-17 23:00:29,054 - DEBUG - Pod : ctest-pod-53029074 UUID is 27934ba6-e263-4022-b2ce-9b0a3b3a860d
2024-09-17 23:00:29,058 - DEBUG - Pod ctest-pod-06759297 not present
2024-09-17 23:00:29,058 - INFO - Creating Pod ctest-pod-06759297
2024-09-17 23:00:29,076 - DEBUG - Pod : ctest-pod-06759297 UUID is f283c44d-59cf-49b6-aa3f-f692fbd5070c
2024-09-17 23:00:29,078 - DEBUG - Pod ctest-pod-18752473 not present
2024-09-17 23:00:29,078 - INFO - Creating Pod ctest-pod-18752473
2024-09-17 23:00:29,108 - DEBUG - Pod : ctest-pod-18752473 UUID is a823f394-a689-443c-a0c8-e483987a9c21
2024-09-17 23:00:29,110 - DEBUG - Pod ctest-pod-35550134 not present
2024-09-17 23:00:29,111 - INFO - Creating Pod ctest-pod-35550134
2024-09-17 23:00:29,125 - DEBUG - Pod : ctest-pod-35550134 UUID is 80696dec-f91d-4b03-b75c-ad341ed6be2a
2024-09-17 23:00:29,128 - DEBUG - Pod ctest-pod-59073192 not present
2024-09-17 23:00:29,128 - INFO - Creating Pod ctest-pod-59073192
2024-09-17 23:00:29,161 - DEBUG - Pod : ctest-pod-59073192 UUID is aa0533d0-521a-4756-a948-cfc528e57443
2024-09-17 23:00:29,401 - INFO - Project default-domain:k8s-ctest-new-default-39862922 for Namespace ctest-new-default-39862922 is seen in contrail-api
2024-09-17 23:00:29,401 - DEBUG - Project uuid in Contrail is 9ba45a1b-224d-4ad8-9fac-cafea6b557ce
2024-09-17 23:00:29,579 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=ad62d55c-198a-4a28-8d1d-423d6a98abcb
2024-09-17 23:00:29,590 - INFO - Namespace ctest-new-default-39862922 with uuid ad62d55c-198a-4a28-8d1d-423d6a98abcb found in kube manager
2024-09-17 23:00:29,590 - INFO - Namespace ctest-new-default-39862922 verification passed
2024-09-17 23:00:29,811 - INFO - Project default-domain:k8s-ctest-non-default-66198919 for Namespace ctest-non-default-66198919 is seen in contrail-api
2024-09-17 23:00:29,811 - DEBUG - Project uuid in Contrail is f89962ec-3f3c-42f1-8f88-5a4db01d026c
2024-09-17 23:00:29,811 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=4e1bd728-af6e-4d96-8ad4-5b07ae6fdb0d
2024-09-17 23:00:29,816 - INFO - Namespace ctest-non-default-66198919 with uuid 4e1bd728-af6e-4d96-8ad4-5b07ae6fdb0d found in kube manager
2024-09-17 23:00:29,817 - INFO - Namespace ctest-non-default-66198919 verification passed
2024-09-17 23:00:29,822 - DEBUG - Pod ctest-pod-00285175 not in running state.Currently in Pending
2024-09-17 23:00:34,828 - DEBUG - Pod ctest-pod-00285175 not in running state.Currently in Pending
2024-09-17 23:00:39,834 - INFO - Pod ctest-pod-00285175 is in running state.Got IP 10.47.255.251
2024-09-17 23:00:39,895 - DEBUG - Pod ctest-pod-00285175 has vmi a145af38-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:39,895 - INFO - Verified pod ctest-pod-00285175 in contrail-api
2024-09-17 23:00:39,912 - DEBUG - VMI a145af38-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:39,912 - INFO - Verified Pod ctest-pod-00285175 in agent 10.0.0.45
2024-09-17 23:00:39,913 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=6b73ddb6-1c18-432b-8895-0d76b94f2e29
2024-09-17 23:00:39,918 - INFO - Pod ctest-pod-00285175 with uuid 6b73ddb6-1c18-432b-8895-0d76b94f2e29 found in kube manager
2024-09-17 23:00:39,919 - INFO - Pod ctest-pod-00285175 verification passed
2024-09-17 23:00:39,929 - INFO - Pod ctest-pod-83621101 is in running state.Got IP 10.47.255.250
2024-09-17 23:00:39,947 - DEBUG - Pod ctest-pod-83621101 has vmi a2418448-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:39,947 - INFO - Verified pod ctest-pod-83621101 in contrail-api
2024-09-17 23:00:39,958 - DEBUG - VMI a2418448-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:39,959 - INFO - Verified Pod ctest-pod-83621101 in agent 10.0.0.45
2024-09-17 23:00:39,959 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=2532a119-0d69-4dfc-b935-524922c9a953
2024-09-17 23:00:39,964 - INFO - Pod ctest-pod-83621101 with uuid 2532a119-0d69-4dfc-b935-524922c9a953 found in kube manager
2024-09-17 23:00:39,964 - INFO - Pod ctest-pod-83621101 verification passed
2024-09-17 23:00:39,970 - DEBUG - Pod ctest-pod-24734192 not in running state.Currently in Pending
2024-09-17 23:00:44,976 - INFO - Pod ctest-pod-24734192 is in running state.Got IP 10.47.255.249
2024-09-17 23:00:45,035 - DEBUG - Pod ctest-pod-24734192 has vmi a315be52-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:45,035 - INFO - Verified pod ctest-pod-24734192 in contrail-api
2024-09-17 23:00:45,049 - DEBUG - VMI a315be52-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:45,049 - INFO - Verified Pod ctest-pod-24734192 in agent 10.0.0.45
2024-09-17 23:00:45,049 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=59e5d228-5fc7-41da-8ad4-9e4eda653e7e
2024-09-17 23:00:45,055 - INFO - Pod ctest-pod-24734192 with uuid 59e5d228-5fc7-41da-8ad4-9e4eda653e7e found in kube manager
2024-09-17 23:00:45,055 - INFO - Pod ctest-pod-24734192 verification passed
2024-09-17 23:00:45,062 - INFO - Pod ctest-pod-53029074 is in running state.Got IP 10.47.255.248
2024-09-17 23:00:45,081 - DEBUG - Pod ctest-pod-53029074 has vmi a3aa49c8-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:45,081 - INFO - Verified pod ctest-pod-53029074 in contrail-api
2024-09-17 23:00:45,095 - DEBUG - VMI a3aa49c8-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:45,095 - INFO - Verified Pod ctest-pod-53029074 in agent 10.0.0.45
2024-09-17 23:00:45,095 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=27934ba6-e263-4022-b2ce-9b0a3b3a860d
2024-09-17 23:00:45,100 - INFO - Pod ctest-pod-53029074 with uuid 27934ba6-e263-4022-b2ce-9b0a3b3a860d found in kube manager
2024-09-17 23:00:45,100 - INFO - Pod ctest-pod-53029074 verification passed
2024-09-17 23:00:45,107 - INFO - Pod ctest-pod-06759297 is in running state.Got IP 10.47.255.247
2024-09-17 23:00:45,169 - DEBUG - Pod ctest-pod-06759297 has vmi a44756c8-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:45,169 - INFO - Verified pod ctest-pod-06759297 in contrail-api
2024-09-17 23:00:45,183 - DEBUG - VMI a44756c8-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:45,183 - INFO - Verified Pod ctest-pod-06759297 in agent 10.0.0.45
2024-09-17 23:00:45,183 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=f283c44d-59cf-49b6-aa3f-f692fbd5070c
2024-09-17 23:00:45,189 - INFO - Pod ctest-pod-06759297 with uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c found in kube manager
2024-09-17 23:00:45,189 - INFO - Pod ctest-pod-06759297 verification passed
2024-09-17 23:00:45,198 - DEBUG - Pod ctest-pod-35550134 not in running state.Currently in Pending
2024-09-17 23:00:50,212 - INFO - Pod ctest-pod-35550134 is in running state.Got IP 10.47.255.245
2024-09-17 23:00:50,231 - DEBUG - Pod ctest-pod-35550134 has vmi a5617840-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:50,231 - INFO - Verified pod ctest-pod-35550134 in contrail-api
2024-09-17 23:00:50,243 - DEBUG - VMI a5617840-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:50,244 - INFO - Verified Pod ctest-pod-35550134 in agent 10.0.0.45
2024-09-17 23:00:50,244 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=80696dec-f91d-4b03-b75c-ad341ed6be2a
2024-09-17 23:00:50,248 - INFO - Pod ctest-pod-35550134 with uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a found in kube manager
2024-09-17 23:00:50,248 - INFO - Pod ctest-pod-35550134 verification passed
2024-09-17 23:00:50,253 - INFO - Pod ctest-pod-18752473 is in running state.Got IP 10.47.255.246
2024-09-17 23:00:50,318 - DEBUG - Pod ctest-pod-18752473 has vmi a4db6bec-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:50,318 - INFO - Verified pod ctest-pod-18752473 in contrail-api
2024-09-17 23:00:50,331 - DEBUG - VMI a4db6bec-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:50,332 - INFO - Verified Pod ctest-pod-18752473 in agent 10.0.0.45
2024-09-17 23:00:50,332 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=a823f394-a689-443c-a0c8-e483987a9c21
2024-09-17 23:00:50,336 - INFO - Pod ctest-pod-18752473 with uuid a823f394-a689-443c-a0c8-e483987a9c21 found in kube manager
2024-09-17 23:00:50,336 - INFO - Pod ctest-pod-18752473 verification passed
2024-09-17 23:00:50,341 - INFO - Pod ctest-pod-59073192 is in running state.Got IP 10.47.255.244
2024-09-17 23:00:50,411 - DEBUG - Pod ctest-pod-59073192 has vmi a5e1cdba-7548-11ef-ad66-fa163e97b3be
2024-09-17 23:00:50,411 - INFO - Verified pod ctest-pod-59073192 in contrail-api
2024-09-17 23:00:50,426 - DEBUG - VMI a5e1cdba-7548-11ef-ad66-fa163e97b3be is active in agent 10.0.0.45
2024-09-17 23:00:50,426 - INFO - Verified Pod ctest-pod-59073192 in agent 10.0.0.45
2024-09-17 23:00:50,426 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=aa0533d0-521a-4756-a948-cfc528e57443
2024-09-17 23:00:50,430 - INFO - Pod ctest-pod-59073192 with uuid aa0533d0-521a-4756-a948-cfc528e57443 found in kube manager
2024-09-17 23:00:50,430 - INFO - Pod ctest-pod-59073192 verification passed
2024-09-17 23:00:50,430 - INFO - ================================================================================
2024-09-17 23:00:50,431 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-17 23:00:50,431 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-17 23:00:50,671 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.31': '0'}} with
2024-09-17 23:00:50,671 - INFO - Initial checks done. Running the testcase now
2024-09-17 23:00:50,671 - INFO -
2024-09-17 23:00:50,722 - DEBUG - [Pod ctest-pod-00285175] Cmd: echo ctest-pod-00285175 > /usr/share/nginx/html/index.html, Output:
2024-09-17 23:00:50,803 - DEBUG - [Pod ctest-pod-83621101] Cmd: echo ctest-pod-83621101 > /usr/share/nginx/html/index.html, Output:
2024-09-17 23:00:50,860 - DEBUG - [Pod ctest-pod-24734192] Cmd: echo ctest-pod-24734192 > /usr/share/nginx/html/index.html, Output:
2024-09-17 23:00:50,912 - DEBUG - [Pod ctest-pod-53029074] Cmd: echo ctest-pod-53029074 > /usr/share/nginx/html/index.html, Output:
2024-09-17 23:00:50,914 - DEBUG - Service ctest-nginx-svc-78424144 not present
2024-09-17 23:00:50,915 - INFO - Creating service ctest-nginx-svc-78424144
2024-09-17 23:00:50,929 - INFO - Created Service ctest-nginx-svc-78424144
2024-09-17 23:00:50,943 - WARNING - Service UUID db4c98d3-880d-49e4-ae1e-db177deadb29 not yet found in contrail-api
2024-09-17 23:00:51,951 - INFO - Validated that Service ctest-nginx-svc-78424144 is seen in contrail-api
2024-09-17 23:00:51,952 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_LoadbalancerDatabaseList?x=db4c98d3-880d-49e4-ae1e-db177deadb29
2024-09-17 23:00:51,959 - INFO - Service ctest-nginx-svc-78424144 with uuid db4c98d3-880d-49e4-ae1e-db177deadb29 found in kube manager
2024-09-17 23:00:51,959 - INFO - Service ctest-nginx-svc-78424144 verification passed
2024-09-17 23:00:53,044 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:00:53,044 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,044 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:00:53,099 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
ctest-pod-00285175
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:00:53,099 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,099 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
ctest-pod-00285175
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:00:53,099 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00285175': 1, 'ctest-pod-83621101': 1}
2024-09-17 23:00:53,168 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00285175
2024-09-17 23:00:53,168 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,168 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00285175
2024-09-17 23:00:53,235 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:00:53,235 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,235 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:00:53,300 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:00:53,300 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,300 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:00:53,366 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00285175
2024-09-17 23:00:53,366 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,366 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00285175
2024-09-17 23:00:53,429 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:00:53,429 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:00:53,429 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:00:53,429 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00285175': 4, 'ctest-pod-83621101': 1}
2024-09-17 23:00:53,433 - DEBUG - Network policy ingress-on-service not present
2024-09-17 23:00:53,433 - INFO - Creating Network Policy ingress-on-service
2024-09-17 23:00:53,443 - INFO - Network policy found in k8s
2024-09-17 23:00:53,444 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9687b387-3996-4d34-b6fa-17e93d079bd1
2024-09-17 23:00:53,448 - INFO - Network Policy ingress-on-service with uuid 9687b387-3996-4d34-b6fa-17e93d079bd1 found in kube manager
2024-09-17 23:00:53,488 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-17 23:00:53,488 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-17 23:00:53,489 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9687b387-3996-4d34-b6fa-17e93d079bd1
2024-09-17 23:00:53,520 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-17 23:00:55,521 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9687b387-3996-4d34-b6fa-17e93d079bd1
2024-09-17 23:00:55,550 - INFO - Network policy with name ingress-on-service found in agent
2024-09-17 23:00:55,550 - INFO - Network Policy ingress-on-service verification passed
2024-09-17 23:01:00,609 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:00,609 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:00,610 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:05,685 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:05,685 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:05,685 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:10,750 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:10,750 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:10,750 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:15,822 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:15,822 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:15,822 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:20,884 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:20,884 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:20,884 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:25,947 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:25,947 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:25,947 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:31,009 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:31,010 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:31,010 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:36,066 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:36,066 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:36,066 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:41,138 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:41,138 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:41,139 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:45,045 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-09-17 23:01:55,428 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:55,428 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:55,428 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:01:55,428 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00285175': 0, 'ctest-pod-83621101': 0}
2024-09-17 23:01:55,498 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:01:55,499 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:01:55,499 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:01:55,557 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:01:55,557 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:01:55,557 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:01:55,557 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00285175': 1, 'ctest-pod-83621101': 1}
2024-09-17 23:02:00,612 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:00,612 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:00,612 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:05,671 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:05,671 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:05,671 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:10,744 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:10,745 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:10,745 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:15,798 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:15,799 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:15,799 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:20,852 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:20,852 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:20,852 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:25,910 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:25,910 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:25,910 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:30,960 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:30,961 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:30,961 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:36,021 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:36,021 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:36,021 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:41,085 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:41,085 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:41,085 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:46,145 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:46,145 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:46,145 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:02:46,145 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00285175': 0, 'ctest-pod-83621101': 0}
2024-09-17 23:02:48,200 - DEBUG - [Pod ctest-pod-18752473] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.326 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.488/1.326 ms
2024-09-17 23:02:48,200 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18752473 with expectation True passed
2024-09-17 23:02:50,267 - DEBUG - [Pod ctest-pod-06759297] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.885 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.343/0.885 ms
2024-09-17 23:02:50,268 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-06759297 with expectation True passed
2024-09-17 23:02:52,340 - DEBUG - [Pod ctest-pod-35550134] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.380 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.061 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.061/0.175/0.380 ms
2024-09-17 23:02:52,341 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35550134 with expectation True passed
2024-09-17 23:02:52,405 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:02:52,405 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-17 23:02:52,405 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:02:52,405 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18752473 passed
2024-09-17 23:02:52,473 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:02:52,473 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-17 23:02:52,474 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:02:52,474 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18752473 passed
2024-09-17 23:02:57,538 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 23:02:57,538 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 23:02:57,538 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 23:02:57,538 - INFO - wget check of of http://10.47.255.250 from ctest-pod-06759297 passed
2024-09-17 23:03:02,628 - DEBUG - [Pod ctest-pod-59073192] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-17 23:03:02,628 - DEBUG - [Pod Pod ctest-pod-59073192] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-17 23:03:02,628 - DEBUG - [Pod Pod ctest-pod-59073192] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-17 23:03:02,628 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59073192 passed
2024-09-17 23:03:02,636 - INFO - Updating Network Policy ingress-on-service
2024-09-17 23:03:07,714 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:07,714 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:07,714 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:12,780 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:12,781 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:12,781 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:17,833 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:17,833 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:17,833 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:22,908 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:22,908 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:22,908 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:27,971 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:27,971 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:27,971 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:33,038 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:33,038 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:33,038 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:38,091 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:38,092 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:38,092 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:43,141 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:43,141 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:43,141 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:48,196 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:48,196 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:48,197 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:53,254 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:53,254 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:53,254 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
wget: download timed out
2024-09-17 23:03:53,254 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00285175': 0, 'ctest-pod-83621101': 0}
2024-09-17 23:03:53,327 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-83621101
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,327 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:03:53,327 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: ctest-pod-83621101
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,395 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,395 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:03:53,395 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,396 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00285175': 1, 'ctest-pod-83621101': 1}
2024-09-17 23:03:53,470 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:03:53,470 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:03:53,470 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-83621101
2024-09-17 23:03:53,534 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-83621101
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,534 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:03:53,534 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: ctest-pod-83621101
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,596 - DEBUG - [Pod ctest-pod-35550134] Cmd: wget http://10.96.229.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,596 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd wget http://10.96.229.56:80/ -O - -T 5 -t 1 passed
2024-09-17 23:03:53,596 - DEBUG - [Pod Pod ctest-pod-35550134] Cmd output: ctest-pod-00285175
Connecting to 10.96.229.56:80 (10.96.229.56:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-17 23:03:53,596 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00285175': 1, 'ctest-pod-83621101': 2}
2024-09-17 23:03:55,649 - DEBUG - [Pod ctest-pod-18752473] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.119 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.421/1.119 ms
2024-09-17 23:03:55,649 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18752473 with expectation True passed
2024-09-17 23:03:57,716 - DEBUG - [Pod ctest-pod-06759297] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.649 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.264/0.649 ms
2024-09-17 23:03:57,716 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-06759297 with expectation True passed
2024-09-17 23:03:59,777 - DEBUG - [Pod ctest-pod-35550134] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.729 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.061 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.061/0.287/0.729 ms
2024-09-17 23:03:59,777 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35550134 with expectation True passed
2024-09-17 23:03:59,844 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:03:59,844 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-17 23:03:59,844 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:03:59,844 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18752473 passed
2024-09-17 23:03:59,906 - DEBUG - [Pod ctest-pod-18752473] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:03:59,906 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-17 23:03:59,906 - DEBUG - [Pod Pod ctest-pod-18752473] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:03:59,906 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18752473 passed
2024-09-17 23:04:04,965 - DEBUG - [Pod ctest-pod-06759297] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 23:04:04,965 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 23:04:04,965 - DEBUG - [Pod Pod ctest-pod-06759297] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-17 23:04:04,965 - INFO - wget check of of http://10.47.255.250 from ctest-pod-06759297 passed
2024-09-17 23:04:05,039 - DEBUG - [Pod ctest-pod-59073192] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:04:05,039 - DEBUG - [Pod Pod ctest-pod-59073192] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-17 23:04:05,039 - DEBUG - [Pod Pod ctest-pod-59073192] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-17 23:04:05,039 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59073192 passed
2024-09-17 23:04:05,039 - INFO - Deleting Network Policy : ingress-on-service
2024-09-17 23:04:05,039 - INFO - Deleting service : ctest-nginx-svc-78424144
2024-09-17 23:04:05,279 - DEBUG - No XMPP flaps were noticed during the test
2024-09-17 23:04:05,279 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2024-09-17 23:04:05,279 - INFO - --------------------------------------------------------------------------------
2024-09-17 23:04:05,285 - INFO - Deleting pod ctest-new-default-39862922:ctest-pod-00285175
2024-09-17 23:04:05,285 - INFO - Deleting pod ctest-new-default-39862922:ctest-pod-83621101
2024-09-17 23:04:05,286 - INFO - Deleting pod ctest-non-default-66198919:ctest-pod-24734192
2024-09-17 23:04:05,286 - INFO - Deleting pod ctest-non-default-66198919:ctest-pod-53029074
2024-09-17 23:04:05,287 - INFO - Deleting pod ctest-new-default-39862922:ctest-pod-06759297
2024-09-17 23:04:05,287 - INFO - Deleting pod ctest-new-default-39862922:ctest-pod-18752473
2024-09-17 23:04:05,287 - INFO - Deleting pod ctest-non-default-66198919:ctest-pod-35550134
2024-09-17 23:04:05,288 - INFO - Deleting pod ctest-non-default-66198919:ctest-pod-59073192
2024-09-17 23:04:05,317 - WARNING - Pod uuid 6b73ddb6-1c18-432b-8895-0d76b94f2e29 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,382 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,383 - WARNING - Pod uuid 59e5d228-5fc7-41da-8ad4-9e4eda653e7e is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,383 - WARNING - Pod uuid 2532a119-0d69-4dfc-b935-524922c9a953 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,430 - WARNING - Pod uuid 27934ba6-e263-4022-b2ce-9b0a3b3a860d is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,431 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,432 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:05,432 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:10,325 - DEBUG - Pod 6b73ddb6-1c18-432b-8895-0d76b94f2e29 is not in agent 10.0.0.45 VM list
2024-09-17 23:04:10,331 - DEBUG - VMI a145af38-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:10,331 - INFO - Verified that pod ctest-pod-00285175 is removed in agent
2024-09-17 23:04:10,399 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:10,401 - DEBUG - Pod 2532a119-0d69-4dfc-b935-524922c9a953 is not in agent 10.0.0.45 VM list
2024-09-17 23:04:10,402 - DEBUG - Pod 59e5d228-5fc7-41da-8ad4-9e4eda653e7e is not in agent 10.0.0.45 VM list
2024-09-17 23:04:10,410 - DEBUG - VMI a315be52-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:10,410 - INFO - Verified that pod ctest-pod-24734192 is removed in agent
2024-09-17 23:04:10,411 - DEBUG - VMI a2418448-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:10,411 - INFO - Verified that pod ctest-pod-83621101 is removed in agent
2024-09-17 23:04:10,448 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:10,448 - DEBUG - Pod 27934ba6-e263-4022-b2ce-9b0a3b3a860d is not in agent 10.0.0.45 VM list
2024-09-17 23:04:10,451 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:10,451 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:10,456 - DEBUG - VMI a3aa49c8-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:10,456 - INFO - Verified that pod ctest-pod-53029074 is removed in agent
2024-09-17 23:04:15,409 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:15,465 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:15,466 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:15,467 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:20,418 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:20,479 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:20,481 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:20,481 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:25,426 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:25,493 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:25,495 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:25,495 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:30,436 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:30,508 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:30,508 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:30,511 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:35,487 - WARNING - Pod uuid a823f394-a689-443c-a0c8-e483987a9c21 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:35,523 - WARNING - Pod uuid 80696dec-f91d-4b03-b75c-ad341ed6be2a is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:35,524 - WARNING - Pod uuid aa0533d0-521a-4756-a948-cfc528e57443 is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:35,525 - WARNING - Pod uuid f283c44d-59cf-49b6-aa3f-f692fbd5070c is still seen in agent 10.0.0.45 VM list
2024-09-17 23:04:40,495 - DEBUG - Pod a823f394-a689-443c-a0c8-e483987a9c21 is not in agent 10.0.0.45 VM list
2024-09-17 23:04:40,500 - DEBUG - VMI a4db6bec-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:40,500 - INFO - Verified that pod ctest-pod-18752473 is removed in agent
2024-09-17 23:04:40,537 - DEBUG - Pod 80696dec-f91d-4b03-b75c-ad341ed6be2a is not in agent 10.0.0.45 VM list
2024-09-17 23:04:40,540 - DEBUG - Pod f283c44d-59cf-49b6-aa3f-f692fbd5070c is not in agent 10.0.0.45 VM list
2024-09-17 23:04:40,541 - DEBUG - Pod aa0533d0-521a-4756-a948-cfc528e57443 is not in agent 10.0.0.45 VM list
2024-09-17 23:04:40,552 - DEBUG - VMI a5617840-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:40,552 - INFO - Verified that pod ctest-pod-35550134 is removed in agent
2024-09-17 23:04:40,553 - DEBUG - VMI a44756c8-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:40,553 - INFO - Verified that pod ctest-pod-06759297 is removed in agent
2024-09-17 23:04:40,554 - DEBUG - VMI a5e1cdba-7548-11ef-ad66-fa163e97b3be is removed from agent 10.0.0.45
2024-09-17 23:04:40,554 - INFO - Verified that pod ctest-pod-59073192 is removed in agent
2024-09-17 23:04:40,554 - INFO - Deleting namespace ctest-non-default-66198919
2024-09-17 23:04:40,563 - DEBUG - Namespace ctest-non-default-66198919 still in k8s
2024-09-17 23:04:42,567 - DEBUG - Namespace ctest-non-default-66198919 still in k8s
2024-09-17 23:04:44,572 - DEBUG - Namespace ctest-non-default-66198919 still in k8s
2024-09-17 23:04:46,576 - DEBUG - Namespace ctest-non-default-66198919 is not in k8s
2024-09-17 23:04:46,576 - DEBUG - No need to check project deletion in contrail-api
2024-09-17 23:04:46,576 - INFO - Deleting namespace ctest-new-default-39862922
2024-09-17 23:04:46,583 - DEBUG - Namespace ctest-new-default-39862922 still in k8s
2024-09-17 23:04:48,587 - DEBUG - Namespace ctest-new-default-39862922 still in k8s
2024-09-17 23:04:50,593 - DEBUG - Namespace ctest-new-default-39862922 still in k8s
2024-09-17 23:04:52,596 - DEBUG - Namespace ctest-new-default-39862922 is not in k8s
2024-09-17 23:04:52,596 - DEBUG - No need to check project deletion in contrail-api