2024-09-04 13:36:44,003 - INFO - Using existing project ['default-domain', 'k8s-default'](65686e01-891c-4751-807f-97580b2d363f)
2024-09-04 13:36:44,021 - DEBUG - Namespace ctest-new-default-21276553 not present
2024-09-04 13:36:44,037 - INFO - Created namespace ctest-new-default-21276553
2024-09-04 13:36:47,043 - DEBUG - Namespace ctest-non-default-76235374 not present
2024-09-04 13:36:47,055 - INFO - Created namespace ctest-non-default-76235374
2024-09-04 13:36:50,075 - DEBUG - Pod ctest-pod-21546002 not present
2024-09-04 13:36:50,075 - INFO - Creating Pod ctest-pod-21546002
2024-09-04 13:36:50,103 - DEBUG - Pod : ctest-pod-21546002 UUID is 911e0ab8-38d2-408b-97e0-27554e18f199
2024-09-04 13:36:50,109 - DEBUG - Pod ctest-pod-77892843 not present
2024-09-04 13:36:50,110 - INFO - Creating Pod ctest-pod-77892843
2024-09-04 13:36:50,139 - DEBUG - Pod : ctest-pod-77892843 UUID is bc10562a-043e-4a74-ae62-aa0f4d02d2f8
2024-09-04 13:36:50,141 - DEBUG - Pod ctest-pod-83484321 not present
2024-09-04 13:36:50,141 - INFO - Creating Pod ctest-pod-83484321
2024-09-04 13:36:50,169 - DEBUG - Pod : ctest-pod-83484321 UUID is a3467ca2-dbf5-47cb-b2ca-874b9865fd6c
2024-09-04 13:36:50,173 - DEBUG - Pod ctest-pod-61797374 not present
2024-09-04 13:36:50,174 - INFO - Creating Pod ctest-pod-61797374
2024-09-04 13:36:50,213 - DEBUG - Pod : ctest-pod-61797374 UUID is ca5a574a-92e7-462c-beb2-65de090545a4
2024-09-04 13:36:50,216 - DEBUG - Pod ctest-pod-89758384 not present
2024-09-04 13:36:50,216 - INFO - Creating Pod ctest-pod-89758384
2024-09-04 13:36:50,236 - DEBUG - Pod : ctest-pod-89758384 UUID is c18a6be6-c3d9-413e-82ed-cdc582f54b9c
2024-09-04 13:36:50,238 - DEBUG - Pod ctest-pod-92081454 not present
2024-09-04 13:36:50,238 - INFO - Creating Pod ctest-pod-92081454
2024-09-04 13:36:50,258 - DEBUG - Pod : ctest-pod-92081454 UUID is eda77566-a9a3-4118-aa1f-3a1a00dadb4a
2024-09-04 13:36:50,260 - DEBUG - Pod ctest-pod-05416416 not present
2024-09-04 13:36:50,260 - INFO - Creating Pod ctest-pod-05416416
2024-09-04 13:36:50,280 - DEBUG - Pod : ctest-pod-05416416 UUID is 8fc0dab2-7e79-4ef7-bddb-2e03df25f227
2024-09-04 13:36:50,282 - DEBUG - Pod ctest-pod-22971746 not present
2024-09-04 13:36:50,283 - INFO - Creating Pod ctest-pod-22971746
2024-09-04 13:36:50,299 - DEBUG - Pod : ctest-pod-22971746 UUID is 883ddf9d-96a6-4254-81da-d10678d096f1
2024-09-04 13:36:50,450 - INFO - Project default-domain:k8s-ctest-new-default-21276553 for Namespace ctest-new-default-21276553 is seen in contrail-api
2024-09-04 13:36:50,451 - DEBUG - Project uuid in Contrail is 73585a4f-5f48-443c-bfea-83adadde5300
2024-09-04 13:36:50,591 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=12d7c8d9-e611-4a20-8fb3-1d23a11b1f40
2024-09-04 13:36:50,599 - INFO - Namespace ctest-new-default-21276553 with uuid 12d7c8d9-e611-4a20-8fb3-1d23a11b1f40 found in kube manager
2024-09-04 13:36:50,599 - INFO - Namespace ctest-new-default-21276553 verification passed
2024-09-04 13:36:50,787 - INFO - Project default-domain:k8s-ctest-non-default-76235374 for Namespace ctest-non-default-76235374 is seen in contrail-api
2024-09-04 13:36:50,787 - DEBUG - Project uuid in Contrail is e3920859-f86a-4be0-bdbe-ea222f82dbbd
2024-09-04 13:36:50,787 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=8d7d863f-320e-4eb4-b15e-890005272cd7
2024-09-04 13:36:50,791 - INFO - Namespace ctest-non-default-76235374 with uuid 8d7d863f-320e-4eb4-b15e-890005272cd7 found in kube manager
2024-09-04 13:36:50,791 - INFO - Namespace ctest-non-default-76235374 verification passed
2024-09-04 13:36:50,798 - DEBUG - Pod ctest-pod-21546002 not in running state.Currently in Pending
2024-09-04 13:36:55,803 - DEBUG - Pod ctest-pod-21546002 not in running state.Currently in Pending
2024-09-04 13:37:00,809 - INFO - Pod ctest-pod-21546002 is in running state.Got IP 10.47.255.251
2024-09-04 13:37:00,860 - DEBUG - Pod ctest-pod-21546002 has vmi be0a31b0-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:00,860 - INFO - Verified pod ctest-pod-21546002 in contrail-api
2024-09-04 13:37:00,872 - DEBUG - VMI be0a31b0-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:00,872 - INFO - Verified Pod ctest-pod-21546002 in agent 10.0.0.28
2024-09-04 13:37:00,872 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=911e0ab8-38d2-408b-97e0-27554e18f199
2024-09-04 13:37:00,877 - INFO - Pod ctest-pod-21546002 with uuid 911e0ab8-38d2-408b-97e0-27554e18f199 found in kube manager
2024-09-04 13:37:00,877 - INFO - Pod ctest-pod-21546002 verification passed
2024-09-04 13:37:00,882 - INFO - Pod ctest-pod-77892843 is in running state.Got IP 10.47.255.250
2024-09-04 13:37:00,892 - DEBUG - Pod ctest-pod-77892843 has vmi be7660f6-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:00,892 - INFO - Verified pod ctest-pod-77892843 in contrail-api
2024-09-04 13:37:00,902 - DEBUG - VMI be7660f6-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:00,902 - INFO - Verified Pod ctest-pod-77892843 in agent 10.0.0.28
2024-09-04 13:37:00,902 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=bc10562a-043e-4a74-ae62-aa0f4d02d2f8
2024-09-04 13:37:00,906 - INFO - Pod ctest-pod-77892843 with uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 found in kube manager
2024-09-04 13:37:00,906 - INFO - Pod ctest-pod-77892843 verification passed
2024-09-04 13:37:00,912 - DEBUG - Pod ctest-pod-83484321 not in running state.Currently in Pending
2024-09-04 13:37:05,919 - INFO - Pod ctest-pod-83484321 is in running state.Got IP 10.47.255.249
2024-09-04 13:37:05,934 - DEBUG - Pod ctest-pod-83484321 has vmi befeeeb2-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:05,934 - INFO - Verified pod ctest-pod-83484321 in contrail-api
2024-09-04 13:37:05,947 - DEBUG - VMI befeeeb2-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:05,947 - INFO - Verified Pod ctest-pod-83484321 in agent 10.0.0.28
2024-09-04 13:37:05,948 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a3467ca2-dbf5-47cb-b2ca-874b9865fd6c
2024-09-04 13:37:05,953 - INFO - Pod ctest-pod-83484321 with uuid a3467ca2-dbf5-47cb-b2ca-874b9865fd6c found in kube manager
2024-09-04 13:37:05,953 - INFO - Pod ctest-pod-83484321 verification passed
2024-09-04 13:37:05,959 - INFO - Pod ctest-pod-61797374 is in running state.Got IP 10.47.255.248
2024-09-04 13:37:06,018 - DEBUG - Pod ctest-pod-61797374 has vmi bf696012-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:06,019 - INFO - Verified pod ctest-pod-61797374 in contrail-api
2024-09-04 13:37:06,031 - DEBUG - VMI bf696012-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:06,032 - INFO - Verified Pod ctest-pod-61797374 in agent 10.0.0.28
2024-09-04 13:37:06,032 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ca5a574a-92e7-462c-beb2-65de090545a4
2024-09-04 13:37:06,037 - INFO - Pod ctest-pod-61797374 with uuid ca5a574a-92e7-462c-beb2-65de090545a4 found in kube manager
2024-09-04 13:37:06,037 - INFO - Pod ctest-pod-61797374 verification passed
2024-09-04 13:37:06,042 - DEBUG - Pod ctest-pod-89758384 not in running state.Currently in Pending
2024-09-04 13:37:11,049 - INFO - Pod ctest-pod-89758384 is in running state.Got IP 10.47.255.247
2024-09-04 13:37:11,061 - DEBUG - Pod ctest-pod-89758384 has vmi bfea5866-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:11,061 - INFO - Verified pod ctest-pod-89758384 in contrail-api
2024-09-04 13:37:11,075 - DEBUG - VMI bfea5866-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:11,075 - INFO - Verified Pod ctest-pod-89758384 in agent 10.0.0.28
2024-09-04 13:37:11,075 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c18a6be6-c3d9-413e-82ed-cdc582f54b9c
2024-09-04 13:37:11,079 - INFO - Pod ctest-pod-89758384 with uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c found in kube manager
2024-09-04 13:37:11,079 - INFO - Pod ctest-pod-89758384 verification passed
2024-09-04 13:37:11,084 - INFO - Pod ctest-pod-05416416 is in running state.Got IP 10.47.255.245
2024-09-04 13:37:11,136 - DEBUG - Pod ctest-pod-05416416 has vmi c0ba1b1e-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:11,137 - INFO - Verified pod ctest-pod-05416416 in contrail-api
2024-09-04 13:37:11,149 - DEBUG - VMI c0ba1b1e-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:11,149 - INFO - Verified Pod ctest-pod-05416416 in agent 10.0.0.28
2024-09-04 13:37:11,149 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8fc0dab2-7e79-4ef7-bddb-2e03df25f227
2024-09-04 13:37:11,153 - INFO - Pod ctest-pod-05416416 with uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 found in kube manager
2024-09-04 13:37:11,153 - INFO - Pod ctest-pod-05416416 verification passed
2024-09-04 13:37:11,158 - INFO - Pod ctest-pod-92081454 is in running state.Got IP 10.47.255.246
2024-09-04 13:37:11,168 - DEBUG - Pod ctest-pod-92081454 has vmi c04e8e08-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:11,168 - INFO - Verified pod ctest-pod-92081454 in contrail-api
2024-09-04 13:37:11,180 - DEBUG - VMI c04e8e08-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:11,180 - INFO - Verified Pod ctest-pod-92081454 in agent 10.0.0.28
2024-09-04 13:37:11,181 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=eda77566-a9a3-4118-aa1f-3a1a00dadb4a
2024-09-04 13:37:11,184 - INFO - Pod ctest-pod-92081454 with uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a found in kube manager
2024-09-04 13:37:11,185 - INFO - Pod ctest-pod-92081454 verification passed
2024-09-04 13:37:11,189 - INFO - Pod ctest-pod-22971746 is in running state.Got IP 10.47.255.244
2024-09-04 13:37:11,240 - DEBUG - Pod ctest-pod-22971746 has vmi c11b1874-6ac2-11ef-aaf8-fa163e8a8dc8
2024-09-04 13:37:11,241 - INFO - Verified pod ctest-pod-22971746 in contrail-api
2024-09-04 13:37:11,253 - DEBUG - VMI c11b1874-6ac2-11ef-aaf8-fa163e8a8dc8 is active in agent 10.0.0.28
2024-09-04 13:37:11,253 - INFO - Verified Pod ctest-pod-22971746 in agent 10.0.0.28
2024-09-04 13:37:11,253 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=883ddf9d-96a6-4254-81da-d10678d096f1
2024-09-04 13:37:11,257 - INFO - Pod ctest-pod-22971746 with uuid 883ddf9d-96a6-4254-81da-d10678d096f1 found in kube manager
2024-09-04 13:37:11,257 - INFO - Pod ctest-pod-22971746 verification passed
2024-09-04 13:37:11,257 - INFO - ================================================================================
2024-09-04 13:37:11,257 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-04 13:37:11,257 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-04 13:37:11,484 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.22': '0'}} with
2024-09-04 13:37:11,484 - INFO - Initial checks done. Running the testcase now
2024-09-04 13:37:11,484 - INFO -
2024-09-04 13:37:11,546 - DEBUG - [Pod ctest-pod-21546002] Cmd: echo ctest-pod-21546002 > /usr/share/nginx/html/index.html, Output:
2024-09-04 13:37:11,601 - DEBUG - [Pod ctest-pod-77892843] Cmd: echo ctest-pod-77892843 > /usr/share/nginx/html/index.html, Output:
2024-09-04 13:37:11,658 - DEBUG - [Pod ctest-pod-83484321] Cmd: echo ctest-pod-83484321 > /usr/share/nginx/html/index.html, Output:
2024-09-04 13:37:11,733 - DEBUG - [Pod ctest-pod-61797374] Cmd: echo ctest-pod-61797374 > /usr/share/nginx/html/index.html, Output:
2024-09-04 13:37:11,736 - DEBUG - Service ctest-nginx-svc-22170316 not present
2024-09-04 13:37:11,736 - INFO - Creating service ctest-nginx-svc-22170316
2024-09-04 13:37:11,769 - INFO - Created Service ctest-nginx-svc-22170316
2024-09-04 13:37:11,777 - WARNING - Service UUID be14e1bf-196b-4221-9042-4fb138eb9b20 not yet found in contrail-api
2024-09-04 13:37:12,785 - INFO - Validated that Service ctest-nginx-svc-22170316 is seen in contrail-api
2024-09-04 13:37:12,785 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=be14e1bf-196b-4221-9042-4fb138eb9b20
2024-09-04 13:37:12,792 - INFO - Service ctest-nginx-svc-22170316 with uuid be14e1bf-196b-4221-9042-4fb138eb9b20 found in kube manager
2024-09-04 13:37:12,792 - INFO - Service ctest-nginx-svc-22170316 verification passed
2024-09-04 13:37:12,854 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21546002
2024-09-04 13:37:12,854 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:12,854 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21546002
2024-09-04 13:37:12,922 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:12,922 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:12,922 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:12,982 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21546002
2024-09-04 13:37:12,983 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:12,983 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21546002
2024-09-04 13:37:13,042 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,042 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:13,042 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,104 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,104 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:13,104 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,104 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21546002': 4, 'ctest-pod-77892843': 1}
2024-09-04 13:37:13,179 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,179 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:13,179 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,252 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,252 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:37:13,252 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:37:13,253 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21546002': 1, 'ctest-pod-77892843': 1}
2024-09-04 13:37:13,255 - DEBUG - Network policy ingress-on-service not present
2024-09-04 13:37:13,256 - INFO - Creating Network Policy ingress-on-service
2024-09-04 13:37:13,266 - INFO - Network policy found in k8s
2024-09-04 13:37:13,266 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ab9a3f7f-5cfb-473c-8b0b-2c259e2974ae
2024-09-04 13:37:13,270 - INFO - Network Policy ingress-on-service with uuid ab9a3f7f-5cfb-473c-8b0b-2c259e2974ae found in kube manager
2024-09-04 13:37:13,300 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-04 13:37:13,300 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-04 13:37:13,301 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ab9a3f7f-5cfb-473c-8b0b-2c259e2974ae
2024-09-04 13:37:13,330 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-04 13:37:15,331 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ab9a3f7f-5cfb-473c-8b0b-2c259e2974ae
2024-09-04 13:37:15,361 - INFO - Network policy with name ingress-on-service found in agent
2024-09-04 13:37:15,361 - INFO - Network Policy ingress-on-service verification passed
2024-09-04 13:37:20,419 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:20,420 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:20,420 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:25,480 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:25,480 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:25,480 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:30,542 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:30,542 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:30,542 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:35,592 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:35,592 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:35,592 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:40,637 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:40,637 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:40,637 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:45,700 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:45,700 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:45,700 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:50,751 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:50,751 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:50,751 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:55,820 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:55,820 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:37:55,820 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:00,863 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:00,863 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:00,863 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:05,924 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:05,924 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:05,924 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:05,924 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21546002': 0, 'ctest-pod-77892843': 0}
2024-09-04 13:38:05,991 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:38:05,991 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:38:05,991 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:38:06,050 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:38:06,050 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:38:06,050 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:38:06,050 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21546002': 1, 'ctest-pod-77892843': 1}
2024-09-04 13:38:11,095 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:11,095 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:11,095 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:16,142 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:16,142 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:16,144 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:21,200 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:21,200 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:21,200 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:26,269 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:26,269 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:26,269 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:31,335 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:31,335 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:31,335 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:36,385 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:36,385 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:36,385 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:41,439 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:41,439 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:41,439 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:46,501 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:46,501 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:46,501 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:51,577 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:51,577 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:51,577 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:56,634 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:56,634 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:56,634 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:38:56,634 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21546002': 0, 'ctest-pod-77892843': 0}
2024-09-04 13:38:58,679 - DEBUG - [Pod ctest-pod-92081454] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.558 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.240/0.558 ms
2024-09-04 13:38:58,679 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92081454 with expectation True passed
2024-09-04 13:39:00,734 - DEBUG - [Pod ctest-pod-89758384] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.479 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.217/0.479 ms
2024-09-04 13:39:00,735 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-89758384 with expectation True passed
2024-09-04 13:39:02,802 - DEBUG - [Pod ctest-pod-05416416] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.555 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.239/0.555 ms
2024-09-04 13:39:02,802 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05416416 with expectation True passed
2024-09-04 13:39:02,872 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:39:02,872 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 13:39:02,872 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:39:02,872 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92081454 passed
2024-09-04 13:39:02,937 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:39:02,937 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-04 13:39:02,937 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:39:02,937 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92081454 passed
2024-09-04 13:39:07,987 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 13:39:07,987 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 13:39:07,988 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 13:39:07,988 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89758384 passed
2024-09-04 13:39:13,048 - DEBUG - [Pod ctest-pod-22971746] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 13:39:13,048 - DEBUG - [Pod Pod ctest-pod-22971746] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 13:39:13,049 - DEBUG - [Pod Pod ctest-pod-22971746] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 13:39:13,049 - INFO - wget check of of http://10.47.255.251 from ctest-pod-22971746 passed
2024-09-04 13:39:13,065 - INFO - Updating Network Policy ingress-on-service
2024-09-04 13:39:18,129 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:18,129 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:18,129 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:23,195 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:23,195 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:23,195 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:28,251 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:28,252 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:28,252 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:33,317 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:33,317 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:33,317 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:38,388 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:38,388 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:38,388 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:43,233 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-09-04 13:39:53,297 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:53,297 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:53,297 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:58,348 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:58,348 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:39:58,349 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:03,396 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:03,396 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:03,396 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:08,459 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:08,459 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:08,459 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:13,513 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:13,513 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:13,513 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
wget: download timed out
2024-09-04 13:40:13,513 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21546002': 0, 'ctest-pod-77892843': 0}
2024-09-04 13:40:13,578 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21546002
2024-09-04 13:40:13,578 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:40:13,578 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21546002
2024-09-04 13:40:13,634 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,634 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:40:13,634 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,695 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,695 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:40:13,695 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: ctest-pod-21546002
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,752 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-77892843
2024-09-04 13:40:13,753 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:40:13,753 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-77892843
2024-09-04 13:40:13,753 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21546002': 3, 'ctest-pod-77892843': 1}
2024-09-04 13:40:13,824 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
ctest-pod-21546002
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,824 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:40:13,824 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: Connecting to 10.109.227.24:80 (10.109.227.24:80)
ctest-pod-21546002
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,897 - DEBUG - [Pod ctest-pod-05416416] Cmd: wget http://10.109.227.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,897 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd wget http://10.109.227.24:80/ -O - -T 5 -t 1 passed
2024-09-04 13:40:13,897 - DEBUG - [Pod Pod ctest-pod-05416416] Cmd output: ctest-pod-77892843
Connecting to 10.109.227.24:80 (10.109.227.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 13:40:13,897 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21546002': 1, 'ctest-pod-77892843': 1}
2024-09-04 13:40:15,963 - DEBUG - [Pod ctest-pod-92081454] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.467 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.202/0.467 ms
2024-09-04 13:40:15,963 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92081454 with expectation True passed
2024-09-04 13:40:18,031 - DEBUG - [Pod ctest-pod-89758384] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.939 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.365/0.939 ms
2024-09-04 13:40:18,031 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-89758384 with expectation True passed
2024-09-04 13:40:20,087 - DEBUG - [Pod ctest-pod-05416416] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.716 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.285/0.716 ms
2024-09-04 13:40:20,087 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05416416 with expectation True passed
2024-09-04 13:40:20,143 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:40:20,143 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 13:40:20,143 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:40:20,143 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92081454 passed
2024-09-04 13:40:20,189 - DEBUG - [Pod ctest-pod-92081454] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:40:20,189 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-04 13:40:20,189 - DEBUG - [Pod Pod ctest-pod-92081454] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:40:20,190 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92081454 passed
2024-09-04 13:40:25,252 - DEBUG - [Pod ctest-pod-89758384] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 13:40:25,252 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 13:40:25,252 - DEBUG - [Pod Pod ctest-pod-89758384] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 13:40:25,252 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89758384 passed
2024-09-04 13:40:25,301 - DEBUG - [Pod ctest-pod-22971746] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:40:25,301 - DEBUG - [Pod Pod ctest-pod-22971746] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 13:40:25,301 - DEBUG - [Pod Pod ctest-pod-22971746] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 13:40:25,301 - INFO - wget check of of http://10.47.255.251 from ctest-pod-22971746 passed
2024-09-04 13:40:25,302 - INFO - Deleting Network Policy : ingress-on-service
2024-09-04 13:40:25,302 - INFO - Deleting service : ctest-nginx-svc-22170316
2024-09-04 13:40:25,526 - DEBUG - No XMPP flaps were noticed during the test
2024-09-04 13:40:25,527 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2024-09-04 13:40:25,527 - INFO - --------------------------------------------------------------------------------
2024-09-04 13:40:25,532 - INFO - Deleting pod ctest-new-default-21276553:ctest-pod-21546002
2024-09-04 13:40:25,532 - INFO - Deleting pod ctest-new-default-21276553:ctest-pod-77892843
2024-09-04 13:40:25,532 - INFO - Deleting pod ctest-non-default-76235374:ctest-pod-83484321
2024-09-04 13:40:25,533 - INFO - Deleting pod ctest-non-default-76235374:ctest-pod-61797374
2024-09-04 13:40:25,533 - INFO - Deleting pod ctest-new-default-21276553:ctest-pod-89758384
2024-09-04 13:40:25,533 - INFO - Deleting pod ctest-new-default-21276553:ctest-pod-92081454
2024-09-04 13:40:25,534 - INFO - Deleting pod ctest-non-default-76235374:ctest-pod-05416416
2024-09-04 13:40:25,534 - INFO - Deleting pod ctest-non-default-76235374:ctest-pod-22971746
2024-09-04 13:40:25,691 - WARNING - Pod uuid 911e0ab8-38d2-408b-97e0-27554e18f199 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,693 - WARNING - Pod uuid a3467ca2-dbf5-47cb-b2ca-874b9865fd6c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,694 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,694 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,698 - WARNING - Pod uuid ca5a574a-92e7-462c-beb2-65de090545a4 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,699 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,701 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:25,703 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:30,721 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:30,723 - DEBUG - Pod ca5a574a-92e7-462c-beb2-65de090545a4 is not in agent 10.0.0.28 VM list
2024-09-04 13:40:30,724 - DEBUG - Pod a3467ca2-dbf5-47cb-b2ca-874b9865fd6c is not in agent 10.0.0.28 VM list
2024-09-04 13:40:30,725 - DEBUG - Pod 911e0ab8-38d2-408b-97e0-27554e18f199 is not in agent 10.0.0.28 VM list
2024-09-04 13:40:30,726 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:30,730 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:30,730 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:30,730 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:30,741 - DEBUG - VMI bf696012-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:40:30,741 - INFO - Verified that pod ctest-pod-61797374 is removed in agent
2024-09-04 13:40:30,742 - DEBUG - VMI be0a31b0-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:40:30,742 - INFO - Verified that pod ctest-pod-21546002 is removed in agent
2024-09-04 13:40:30,742 - DEBUG - VMI befeeeb2-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:40:30,742 - INFO - Verified that pod ctest-pod-83484321 is removed in agent
2024-09-04 13:40:35,730 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:35,745 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:35,747 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:35,747 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:35,748 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:40,738 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:40,772 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:40,774 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:40,775 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:40,776 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:45,745 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:45,795 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:45,796 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:45,797 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:45,797 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:50,753 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:50,812 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:50,813 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:50,814 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:50,814 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:55,783 - WARNING - Pod uuid c18a6be6-c3d9-413e-82ed-cdc582f54b9c is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:55,831 - WARNING - Pod uuid 883ddf9d-96a6-4254-81da-d10678d096f1 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:55,831 - WARNING - Pod uuid bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:55,833 - WARNING - Pod uuid eda77566-a9a3-4118-aa1f-3a1a00dadb4a is still seen in agent 10.0.0.28 VM list
2024-09-04 13:40:55,833 - WARNING - Pod uuid 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is still seen in agent 10.0.0.28 VM list
2024-09-04 13:41:00,791 - DEBUG - Pod c18a6be6-c3d9-413e-82ed-cdc582f54b9c is not in agent 10.0.0.28 VM list
2024-09-04 13:41:00,797 - DEBUG - VMI bfea5866-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:41:00,797 - INFO - Verified that pod ctest-pod-89758384 is removed in agent
2024-09-04 13:41:00,851 - DEBUG - Pod 8fc0dab2-7e79-4ef7-bddb-2e03df25f227 is not in agent 10.0.0.28 VM list
2024-09-04 13:41:00,852 - DEBUG - Pod eda77566-a9a3-4118-aa1f-3a1a00dadb4a is not in agent 10.0.0.28 VM list
2024-09-04 13:41:00,855 - DEBUG - Pod 883ddf9d-96a6-4254-81da-d10678d096f1 is not in agent 10.0.0.28 VM list
2024-09-04 13:41:00,856 - DEBUG - Pod bc10562a-043e-4a74-ae62-aa0f4d02d2f8 is not in agent 10.0.0.28 VM list
2024-09-04 13:41:00,869 - DEBUG - VMI c04e8e08-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:41:00,869 - INFO - Verified that pod ctest-pod-92081454 is removed in agent
2024-09-04 13:41:00,870 - DEBUG - VMI c0ba1b1e-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:41:00,870 - INFO - Verified that pod ctest-pod-05416416 is removed in agent
2024-09-04 13:41:00,871 - DEBUG - VMI c11b1874-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:41:00,871 - INFO - Verified that pod ctest-pod-22971746 is removed in agent
2024-09-04 13:41:00,872 - DEBUG - VMI be7660f6-6ac2-11ef-aaf8-fa163e8a8dc8 is removed from agent 10.0.0.28
2024-09-04 13:41:00,872 - INFO - Verified that pod ctest-pod-77892843 is removed in agent
2024-09-04 13:41:00,872 - INFO - Deleting namespace ctest-non-default-76235374
2024-09-04 13:41:00,885 - DEBUG - Namespace ctest-non-default-76235374 still in k8s
2024-09-04 13:41:02,890 - DEBUG - Namespace ctest-non-default-76235374 still in k8s
2024-09-04 13:41:04,896 - DEBUG - Namespace ctest-non-default-76235374 still in k8s
2024-09-04 13:41:06,903 - DEBUG - Namespace ctest-non-default-76235374 is not in k8s
2024-09-04 13:41:06,904 - DEBUG - No need to check project deletion in contrail-api
2024-09-04 13:41:06,904 - INFO - Deleting namespace ctest-new-default-21276553
2024-09-04 13:41:06,922 - DEBUG - Namespace ctest-new-default-21276553 still in k8s
2024-09-04 13:41:08,927 - DEBUG - Namespace ctest-new-default-21276553 still in k8s
2024-09-04 13:41:10,932 - DEBUG - Namespace ctest-new-default-21276553 still in k8s
2024-09-04 13:41:12,939 - DEBUG - Namespace ctest-new-default-21276553 is not in k8s
2024-09-04 13:41:12,939 - DEBUG - No need to check project deletion in contrail-api