2024-09-12 01:57:36,928 - INFO - Using existing project ['default-domain', 'k8s-default'](d55cb5b7-fac0-4cb9-8da8-05d332fe5722)
2024-09-12 01:57:36,977 - DEBUG - Namespace ctest-new-default-50530652 not present
2024-09-12 01:57:36,992 - INFO - Created namespace ctest-new-default-50530652
2024-09-12 01:57:40,003 - DEBUG - Namespace ctest-non-default-91512143 not present
2024-09-12 01:57:40,024 - INFO - Created namespace ctest-non-default-91512143
2024-09-12 01:57:43,044 - DEBUG - Pod ctest-pod-71369645 not present
2024-09-12 01:57:43,044 - INFO - Creating Pod ctest-pod-71369645
2024-09-12 01:57:43,061 - DEBUG - Pod : ctest-pod-71369645 UUID is b75b06fa-593f-44c7-beb2-2748f492f89f
2024-09-12 01:57:43,065 - DEBUG - Pod ctest-pod-56628959 not present
2024-09-12 01:57:43,065 - INFO - Creating Pod ctest-pod-56628959
2024-09-12 01:57:43,099 - DEBUG - Pod : ctest-pod-56628959 UUID is f772e2cb-c186-4b60-8d00-5489e5f2c316
2024-09-12 01:57:43,109 - DEBUG - Pod ctest-pod-53405532 not present
2024-09-12 01:57:43,109 - INFO - Creating Pod ctest-pod-53405532
2024-09-12 01:57:43,131 - DEBUG - Pod : ctest-pod-53405532 UUID is 2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45
2024-09-12 01:57:43,138 - DEBUG - Pod ctest-pod-62284179 not present
2024-09-12 01:57:43,138 - INFO - Creating Pod ctest-pod-62284179
2024-09-12 01:57:43,154 - DEBUG - Pod : ctest-pod-62284179 UUID is a468c416-c6ee-4958-b9ac-6d4e319dd031
2024-09-12 01:57:43,163 - DEBUG - Pod ctest-pod-44443422 not present
2024-09-12 01:57:43,164 - INFO - Creating Pod ctest-pod-44443422
2024-09-12 01:57:43,189 - DEBUG - Pod : ctest-pod-44443422 UUID is 8aace0d7-df8c-407b-91d8-a2b00071db67
2024-09-12 01:57:43,199 - DEBUG - Pod ctest-pod-69533668 not present
2024-09-12 01:57:43,199 - INFO - Creating Pod ctest-pod-69533668
2024-09-12 01:57:43,217 - DEBUG - Pod : ctest-pod-69533668 UUID is a5c8533d-2ae9-4052-a699-c143570da37e
2024-09-12 01:57:43,220 - DEBUG - Pod ctest-pod-89105801 not present
2024-09-12 01:57:43,221 - INFO - Creating Pod ctest-pod-89105801
2024-09-12 01:57:43,245 - DEBUG - Pod : ctest-pod-89105801 UUID is 28704b95-a4aa-495d-98e1-115892caf892
2024-09-12 01:57:43,250 - DEBUG - Pod ctest-pod-39120651 not present
2024-09-12 01:57:43,250 - INFO - Creating Pod ctest-pod-39120651
2024-09-12 01:57:43,288 - DEBUG - Pod : ctest-pod-39120651 UUID is 42cdf242-3bfa-415e-bd6f-1e91338e91c9
2024-09-12 01:57:43,715 - INFO - Project default-domain:k8s-ctest-new-default-50530652 for Namespace ctest-new-default-50530652 is seen in contrail-api
2024-09-12 01:57:43,715 - DEBUG - Project uuid in Contrail is 41269d2f-6f87-4904-afe6-49c8706a6ca3
2024-09-12 01:57:44,148 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=0f9a8fd0-7837-4462-88e8-4ad6e4522074
2024-09-12 01:57:44,182 - INFO - Namespace ctest-new-default-50530652 with uuid 0f9a8fd0-7837-4462-88e8-4ad6e4522074 found in kube manager
2024-09-12 01:57:44,183 - INFO - Namespace ctest-new-default-50530652 verification passed
2024-09-12 01:57:44,597 - INFO - Project default-domain:k8s-ctest-non-default-91512143 for Namespace ctest-non-default-91512143 is seen in contrail-api
2024-09-12 01:57:44,597 - DEBUG - Project uuid in Contrail is cd3ca519-cbb6-4a5d-aa38-0e1245b6f77d
2024-09-12 01:57:44,597 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=96d47109-567a-4396-a5c6-b4a2ab10b9d2
2024-09-12 01:57:44,609 - INFO - Namespace ctest-non-default-91512143 with uuid 96d47109-567a-4396-a5c6-b4a2ab10b9d2 found in kube manager
2024-09-12 01:57:44,609 - INFO - Namespace ctest-non-default-91512143 verification passed
2024-09-12 01:57:44,618 - DEBUG - Pod ctest-pod-71369645 not in running state.Currently in Pending
2024-09-12 01:57:49,631 - DEBUG - Pod ctest-pod-71369645 not in running state.Currently in Pending
2024-09-12 01:57:54,638 - DEBUG - Pod ctest-pod-71369645 not in running state.Currently in Pending
2024-09-12 01:57:59,647 - INFO - Pod ctest-pod-71369645 is in running state.Got IP 10.47.255.250
2024-09-12 01:57:59,711 - DEBUG - Pod ctest-pod-71369645 has vmi 68711294-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:57:59,712 - INFO - Verified pod ctest-pod-71369645 in contrail-api
2024-09-12 01:57:59,728 - DEBUG - VMI 68711294-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:57:59,729 - INFO - Verified Pod ctest-pod-71369645 in agent 10.0.0.27
2024-09-12 01:57:59,729 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b75b06fa-593f-44c7-beb2-2748f492f89f
2024-09-12 01:57:59,734 - INFO - Pod ctest-pod-71369645 with uuid b75b06fa-593f-44c7-beb2-2748f492f89f found in kube manager
2024-09-12 01:57:59,734 - INFO - Pod ctest-pod-71369645 verification passed
2024-09-12 01:57:59,743 - DEBUG - Pod ctest-pod-56628959 not in running state.Currently in Pending
2024-09-12 01:58:04,750 - INFO - Pod ctest-pod-56628959 is in running state.Got IP 10.47.255.249
2024-09-12 01:58:04,806 - DEBUG - Pod ctest-pod-56628959 has vmi 69393f62-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:04,806 - INFO - Verified pod ctest-pod-56628959 in contrail-api
2024-09-12 01:58:04,823 - DEBUG - VMI 69393f62-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:04,823 - INFO - Verified Pod ctest-pod-56628959 in agent 10.0.0.27
2024-09-12 01:58:04,823 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=f772e2cb-c186-4b60-8d00-5489e5f2c316
2024-09-12 01:58:04,830 - INFO - Pod ctest-pod-56628959 with uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 found in kube manager
2024-09-12 01:58:04,830 - INFO - Pod ctest-pod-56628959 verification passed
2024-09-12 01:58:04,838 - INFO - Pod ctest-pod-53405532 is in running state.Got IP 10.47.255.248
2024-09-12 01:58:04,952 - DEBUG - Pod ctest-pod-53405532 has vmi 6a7330fe-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:04,952 - INFO - Verified pod ctest-pod-53405532 in contrail-api
2024-09-12 01:58:04,974 - DEBUG - VMI 6a7330fe-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:04,974 - INFO - Verified Pod ctest-pod-53405532 in agent 10.0.0.27
2024-09-12 01:58:04,974 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45
2024-09-12 01:58:04,981 - INFO - Pod ctest-pod-53405532 with uuid 2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45 found in kube manager
2024-09-12 01:58:04,981 - INFO - Pod ctest-pod-53405532 verification passed
2024-09-12 01:58:04,993 - INFO - Pod ctest-pod-62284179 is in running state.Got IP 10.47.255.247
2024-09-12 01:58:05,072 - DEBUG - Pod ctest-pod-62284179 has vmi 6b3c84a4-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:05,072 - INFO - Verified pod ctest-pod-62284179 in contrail-api
2024-09-12 01:58:05,101 - DEBUG - VMI 6b3c84a4-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:05,102 - INFO - Verified Pod ctest-pod-62284179 in agent 10.0.0.27
2024-09-12 01:58:05,102 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=a468c416-c6ee-4958-b9ac-6d4e319dd031
2024-09-12 01:58:05,117 - INFO - Pod ctest-pod-62284179 with uuid a468c416-c6ee-4958-b9ac-6d4e319dd031 found in kube manager
2024-09-12 01:58:05,117 - INFO - Pod ctest-pod-62284179 verification passed
2024-09-12 01:58:05,135 - INFO - Pod ctest-pod-44443422 is in running state.Got IP 10.47.255.246
2024-09-12 01:58:05,213 - DEBUG - Pod ctest-pod-44443422 has vmi 6c2b4198-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:05,214 - INFO - Verified pod ctest-pod-44443422 in contrail-api
2024-09-12 01:58:05,259 - DEBUG - VMI 6c2b4198-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:05,260 - INFO - Verified Pod ctest-pod-44443422 in agent 10.0.0.27
2024-09-12 01:58:05,260 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=8aace0d7-df8c-407b-91d8-a2b00071db67
2024-09-12 01:58:05,273 - INFO - Pod ctest-pod-44443422 with uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 found in kube manager
2024-09-12 01:58:05,274 - INFO - Pod ctest-pod-44443422 verification passed
2024-09-12 01:58:05,295 - DEBUG - Pod ctest-pod-89105801 not in running state.Currently in Pending
2024-09-12 01:58:10,316 - INFO - Pod ctest-pod-89105801 is in running state.Got IP 10.47.255.244
2024-09-12 01:58:10,415 - DEBUG - Pod ctest-pod-89105801 has vmi 6e153efa-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:10,416 - INFO - Verified pod ctest-pod-89105801 in contrail-api
2024-09-12 01:58:10,464 - DEBUG - VMI 6e153efa-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:10,465 - INFO - Verified Pod ctest-pod-89105801 in agent 10.0.0.27
2024-09-12 01:58:10,465 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=28704b95-a4aa-495d-98e1-115892caf892
2024-09-12 01:58:10,480 - INFO - Pod ctest-pod-89105801 with uuid 28704b95-a4aa-495d-98e1-115892caf892 found in kube manager
2024-09-12 01:58:10,481 - INFO - Pod ctest-pod-89105801 verification passed
2024-09-12 01:58:10,497 - INFO - Pod ctest-pod-69533668 is in running state.Got IP 10.47.255.245
2024-09-12 01:58:10,592 - DEBUG - Pod ctest-pod-69533668 has vmi 6d1a632c-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:10,592 - INFO - Verified pod ctest-pod-69533668 in contrail-api
2024-09-12 01:58:10,624 - DEBUG - VMI 6d1a632c-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:10,625 - INFO - Verified Pod ctest-pod-69533668 in agent 10.0.0.27
2024-09-12 01:58:10,625 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=a5c8533d-2ae9-4052-a699-c143570da37e
2024-09-12 01:58:10,636 - INFO - Pod ctest-pod-69533668 with uuid a5c8533d-2ae9-4052-a699-c143570da37e found in kube manager
2024-09-12 01:58:10,637 - INFO - Pod ctest-pod-69533668 verification passed
2024-09-12 01:58:10,655 - INFO - Pod ctest-pod-39120651 is in running state.Got IP 10.47.255.243
2024-09-12 01:58:10,736 - DEBUG - Pod ctest-pod-39120651 has vmi 6f098c4e-70aa-11ef-ada5-0242ec0c41c5
2024-09-12 01:58:10,736 - INFO - Verified pod ctest-pod-39120651 in contrail-api
2024-09-12 01:58:10,778 - DEBUG - VMI 6f098c4e-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27
2024-09-12 01:58:10,779 - INFO - Verified Pod ctest-pod-39120651 in agent 10.0.0.27
2024-09-12 01:58:10,780 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=42cdf242-3bfa-415e-bd6f-1e91338e91c9
2024-09-12 01:58:10,797 - INFO - Pod ctest-pod-39120651 with uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 found in kube manager
2024-09-12 01:58:10,798 - INFO - Pod ctest-pod-39120651 verification passed
2024-09-12 01:58:10,798 - INFO - ================================================================================
2024-09-12 01:58:10,799 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-12 01:58:10,799 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-12 01:58:11,321 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.27': '1'}} with
2024-09-12 01:58:11,321 - INFO - Initial checks done. Running the testcase now
2024-09-12 01:58:11,321 - INFO -
2024-09-12 01:58:11,489 - DEBUG - [Pod ctest-pod-71369645] Cmd: echo ctest-pod-71369645 > /usr/share/nginx/html/index.html, Output:
2024-09-12 01:58:11,622 - DEBUG - [Pod ctest-pod-56628959] Cmd: echo ctest-pod-56628959 > /usr/share/nginx/html/index.html, Output:
2024-09-12 01:58:11,729 - DEBUG - [Pod ctest-pod-53405532] Cmd: echo ctest-pod-53405532 > /usr/share/nginx/html/index.html, Output:
2024-09-12 01:58:11,819 - DEBUG - [Pod ctest-pod-62284179] Cmd: echo ctest-pod-62284179 > /usr/share/nginx/html/index.html, Output:
2024-09-12 01:58:11,823 - DEBUG - Service ctest-nginx-svc-12671226 not present
2024-09-12 01:58:11,824 - INFO - Creating service ctest-nginx-svc-12671226
2024-09-12 01:58:11,849 - INFO - Created Service ctest-nginx-svc-12671226
2024-09-12 01:58:11,858 - WARNING - Service UUID 260222eb-c053-4ae4-8ceb-a8425739b39a not yet found in contrail-api
2024-09-12 01:58:12,895 - INFO - Validated that Service ctest-nginx-svc-12671226 is seen in contrail-api
2024-09-12 01:58:12,895 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=260222eb-c053-4ae4-8ceb-a8425739b39a
2024-09-12 01:58:12,902 - INFO - Service ctest-nginx-svc-12671226 with uuid 260222eb-c053-4ae4-8ceb-a8425739b39a found in kube manager
2024-09-12 01:58:12,902 - INFO - Service ctest-nginx-svc-12671226 verification passed
2024-09-12 01:58:16,068 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% ctest-pod-71369645
|********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,068 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:58:16,068 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% ctest-pod-71369645
|********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,173 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
ctest-pod-56628959
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,173 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:58:16,173 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
ctest-pod-56628959
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,174 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71369645': 1, 'ctest-pod-56628959': 1}
2024-09-12 01:58:16,252 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-56628959
2024-09-12 01:58:16,253 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:58:16,253 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-56628959
2024-09-12 01:58:16,335 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,335 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:58:16,335 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,418 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
ctest-pod-56628959
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,418 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:58:16,418 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
ctest-pod-56628959
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,498 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: ctest-pod-71369645
Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,498 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:58:16,498 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: ctest-pod-71369645
Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:58:16,498 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71369645': 1, 'ctest-pod-56628959': 3}
2024-09-12 01:58:16,503 - DEBUG - Network policy ingress-on-service not present
2024-09-12 01:58:16,503 - INFO - Creating Network Policy ingress-on-service
2024-09-12 01:58:16,515 - INFO - Network policy found in k8s
2024-09-12 01:58:16,515 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f3b008fe-d4ff-43de-b0e5-19e98988c65a
2024-09-12 01:58:16,522 - INFO - Network Policy ingress-on-service with uuid f3b008fe-d4ff-43de-b0e5-19e98988c65a found in kube manager
2024-09-12 01:58:16,556 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-12 01:58:16,556 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-12 01:58:16,557 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f3b008fe-d4ff-43de-b0e5-19e98988c65a
2024-09-12 01:58:16,599 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-12 01:58:18,600 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f3b008fe-d4ff-43de-b0e5-19e98988c65a
2024-09-12 01:58:18,641 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-12 01:58:20,646 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f3b008fe-d4ff-43de-b0e5-19e98988c65a
2024-09-12 01:58:20,730 - INFO - Network policy with name ingress-on-service found in agent
2024-09-12 01:58:20,731 - INFO - Network Policy ingress-on-service verification passed
2024-09-12 01:58:25,900 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:25,900 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:25,900 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:31,094 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:31,094 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:31,094 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:36,207 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:36,208 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:36,208 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:41,388 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:41,388 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:41,388 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:46,539 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:46,540 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:46,540 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:51,645 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:51,645 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:51,645 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:56,743 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:56,743 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:58:56,744 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:01,931 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:01,931 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:01,931 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:07,071 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:07,071 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:07,071 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:12,170 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:12,170 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:12,170 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:12,170 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71369645': 0, 'ctest-pod-56628959': 0}
2024-09-12 01:59:12,320 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: ctest-pod-56628959
Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:59:12,320 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:59:12,320 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: ctest-pod-56628959
Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:59:12,411 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-71369645
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:59:12,411 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 01:59:12,412 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-71369645
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 01:59:12,412 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71369645': 1, 'ctest-pod-56628959': 1}
2024-09-12 01:59:17,508 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:17,508 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:17,508 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:22,640 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:22,640 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:22,640 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:27,809 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:27,809 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:27,809 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:32,977 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:32,977 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:32,977 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:38,138 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:38,139 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:38,139 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:43,310 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:43,310 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:43,310 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:48,507 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:48,507 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:48,508 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:53,680 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:53,681 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:53,681 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:58,806 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:58,807 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 01:59:58,807 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:04,023 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:04,023 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:04,023 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:04,024 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71369645': 0, 'ctest-pod-56628959': 0}
2024-09-12 02:00:06,204 - DEBUG - [Pod ctest-pod-69533668] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.946 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.153 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.216 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.153/0.438/0.946 ms
2024-09-12 02:00:06,204 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69533668 with expectation True passed
2024-09-12 02:00:08,413 - DEBUG - [Pod ctest-pod-44443422] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.229 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.640 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.185 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.185/0.684/1.229 ms
2024-09-12 02:00:08,413 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-44443422 with expectation True passed
2024-09-12 02:00:10,605 - DEBUG - [Pod ctest-pod-89105801] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.020 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.401/1.020 ms
2024-09-12 02:00:10,605 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-89105801 with expectation True passed
2024-09-12 02:00:10,729 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:00:10,729 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-12 02:00:10,729 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:00:10,729 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69533668 passed
2024-09-12 02:00:10,820 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:00:10,820 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2024-09-12 02:00:10,820 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:00:10,820 - INFO - wget check of of http://10.47.255.249 from ctest-pod-69533668 passed
2024-09-12 02:00:15,929 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-09-12 02:00:15,929 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-09-12 02:00:15,929 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-09-12 02:00:15,929 - INFO - wget check of of http://10.47.255.249 from ctest-pod-44443422 passed
2024-09-12 02:00:21,065 - DEBUG - [Pod ctest-pod-39120651] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-12 02:00:21,065 - DEBUG - [Pod Pod ctest-pod-39120651] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-12 02:00:21,066 - DEBUG - [Pod Pod ctest-pod-39120651] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-12 02:00:21,066 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39120651 passed
2024-09-12 02:00:21,101 - INFO - Updating Network Policy ingress-on-service
2024-09-12 02:00:26,306 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:26,306 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:26,306 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:31,531 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:31,531 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:31,531 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:36,635 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:36,635 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:36,635 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:41,765 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:41,766 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:41,766 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:46,968 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:46,968 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:46,968 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:52,143 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:52,143 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:52,144 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:57,246 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:57,246 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:00:57,246 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:02,383 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:02,383 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:02,383 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:07,542 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:07,542 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:07,542 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:12,731 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:12,732 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:12,732 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
wget: download timed out
2024-09-12 02:01:12,732 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71369645': 0, 'ctest-pod-56628959': 0}
2024-09-12 02:01:12,876 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-71369645
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:12,877 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 02:01:12,877 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-71369645
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,014 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,014 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 02:01:13,014 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,014 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71369645': 1, 'ctest-pod-56628959': 1}
2024-09-12 02:01:13,121 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,121 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 02:01:13,121 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,225 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,225 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 02:01:13,225 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
ctest-pod-56628959
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,314 - DEBUG - [Pod ctest-pod-89105801] Cmd: wget http://10.111.64.95:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
ctest-pod-71369645
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,315 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd wget http://10.111.64.95:80/ -O - -T 5 -t 1 passed
2024-09-12 02:01:13,315 - DEBUG - [Pod Pod ctest-pod-89105801] Cmd output: Connecting to 10.111.64.95:80 (10.111.64.95:80)
writing to stdout
ctest-pod-71369645
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-12 02:01:13,315 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71369645': 1, 'ctest-pod-56628959': 2}
2024-09-12 02:01:15,398 - DEBUG - [Pod ctest-pod-69533668] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.375 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.058/0.838/2.375 ms
2024-09-12 02:01:15,398 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69533668 with expectation True passed
2024-09-12 02:01:17,511 - DEBUG - [Pod ctest-pod-44443422] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.282 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.056 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.184 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.056/0.840/2.282 ms
2024-09-12 02:01:17,511 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-44443422 with expectation True passed
2024-09-12 02:01:19,607 - DEBUG - [Pod ctest-pod-89105801] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.050 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.133 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.206 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.133/0.463/1.050 ms
2024-09-12 02:01:19,608 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-89105801 with expectation True passed
2024-09-12 02:01:19,809 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:01:19,809 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-12 02:01:19,809 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:01:19,809 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69533668 passed
2024-09-12 02:01:19,920 - DEBUG - [Pod ctest-pod-69533668] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:01:19,920 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2024-09-12 02:01:19,920 - DEBUG - [Pod Pod ctest-pod-69533668] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:01:19,920 - INFO - wget check of of http://10.47.255.249 from ctest-pod-69533668 passed
2024-09-12 02:01:25,046 - DEBUG - [Pod ctest-pod-44443422] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-09-12 02:01:25,046 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-09-12 02:01:25,046 - DEBUG - [Pod Pod ctest-pod-44443422] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2024-09-12 02:01:25,047 - INFO - wget check of of http://10.47.255.249 from ctest-pod-44443422 passed
2024-09-12 02:01:25,253 - DEBUG - [Pod ctest-pod-39120651] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:01:25,253 - DEBUG - [Pod Pod ctest-pod-39120651] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-12 02:01:25,253 - DEBUG - [Pod Pod ctest-pod-39120651] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-12 02:01:25,253 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39120651 passed
2024-09-12 02:01:25,253 - INFO - Deleting Network Policy : ingress-on-service
2024-09-12 02:01:25,254 - INFO - Deleting service : ctest-nginx-svc-12671226
2024-09-12 02:01:26,049 - DEBUG - No XMPP flaps were noticed during the test
2024-09-12 02:01:26,050 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:16]
2024-09-12 02:01:26,050 - INFO - --------------------------------------------------------------------------------
2024-09-12 02:01:26,065 - INFO - Deleting pod ctest-new-default-50530652:ctest-pod-71369645
2024-09-12 02:01:26,066 - INFO - Deleting pod ctest-new-default-50530652:ctest-pod-56628959
2024-09-12 02:01:26,068 - INFO - Deleting pod ctest-non-default-91512143:ctest-pod-53405532
2024-09-12 02:01:26,069 - INFO - Deleting pod ctest-non-default-91512143:ctest-pod-62284179
2024-09-12 02:01:26,070 - INFO - Deleting pod ctest-new-default-50530652:ctest-pod-44443422
2024-09-12 02:01:26,071 - INFO - Deleting pod ctest-new-default-50530652:ctest-pod-69533668
2024-09-12 02:01:26,072 - INFO - Deleting pod ctest-non-default-91512143:ctest-pod-89105801
2024-09-12 02:01:26,073 - INFO - Deleting pod ctest-non-default-91512143:ctest-pod-39120651
2024-09-12 02:01:26,244 - WARNING - Pod uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,245 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,245 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,246 - WARNING - Pod uuid a468c416-c6ee-4958-b9ac-6d4e319dd031 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,247 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,248 - WARNING - Pod uuid b75b06fa-593f-44c7-beb2-2748f492f89f is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,261 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:26,262 - WARNING - Pod uuid 2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:31,276 - DEBUG - Pod a468c416-c6ee-4958-b9ac-6d4e319dd031 is not in agent 10.0.0.27 VM list
2024-09-12 02:01:31,278 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:31,279 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:31,280 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:31,282 - WARNING - Pod uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:31,282 - DEBUG - Pod b75b06fa-593f-44c7-beb2-2748f492f89f is not in agent 10.0.0.27 VM list
2024-09-12 02:01:31,292 - DEBUG - VMI 6b3c84a4-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:01:31,292 - INFO - Verified that pod ctest-pod-62284179 is removed in agent
2024-09-12 02:01:31,292 - DEBUG - Pod 2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45 is not in agent 10.0.0.27 VM list
2024-09-12 02:01:31,294 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:31,295 - DEBUG - VMI 68711294-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:01:31,295 - INFO - Verified that pod ctest-pod-71369645 is removed in agent
2024-09-12 02:01:31,300 - DEBUG - VMI 6a7330fe-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:01:31,300 - INFO - Verified that pod ctest-pod-53405532 is removed in agent
2024-09-12 02:01:36,361 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:36,362 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:36,364 - WARNING - Pod uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:36,365 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:36,368 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:41,444 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:41,446 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:41,447 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:41,453 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:41,454 - WARNING - Pod uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:46,520 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:46,522 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:46,526 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:46,527 - WARNING - Pod uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:46,528 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:51,537 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:51,538 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:51,545 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:51,546 - WARNING - Pod uuid f772e2cb-c186-4b60-8d00-5489e5f2c316 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:51,546 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:56,565 - WARNING - Pod uuid 8aace0d7-df8c-407b-91d8-a2b00071db67 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:56,566 - WARNING - Pod uuid 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:56,574 - WARNING - Pod uuid a5c8533d-2ae9-4052-a699-c143570da37e is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:56,575 - DEBUG - Pod f772e2cb-c186-4b60-8d00-5489e5f2c316 is not in agent 10.0.0.27 VM list
2024-09-12 02:01:56,578 - WARNING - Pod uuid 28704b95-a4aa-495d-98e1-115892caf892 is still seen in agent 10.0.0.27 VM list
2024-09-12 02:01:56,582 - DEBUG - VMI 69393f62-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:01:56,582 - INFO - Verified that pod ctest-pod-56628959 is removed in agent
2024-09-12 02:02:01,602 - DEBUG - Pod a5c8533d-2ae9-4052-a699-c143570da37e is not in agent 10.0.0.27 VM list
2024-09-12 02:02:01,604 - DEBUG - Pod 42cdf242-3bfa-415e-bd6f-1e91338e91c9 is not in agent 10.0.0.27 VM list
2024-09-12 02:02:01,608 - DEBUG - Pod 28704b95-a4aa-495d-98e1-115892caf892 is not in agent 10.0.0.27 VM list
2024-09-12 02:02:01,611 - DEBUG - Pod 8aace0d7-df8c-407b-91d8-a2b00071db67 is not in agent 10.0.0.27 VM list
2024-09-12 02:02:01,635 - DEBUG - VMI 6d1a632c-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:02:01,635 - INFO - Verified that pod ctest-pod-69533668 is removed in agent
2024-09-12 02:02:01,640 - DEBUG - VMI 6c2b4198-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:02:01,640 - INFO - Verified that pod ctest-pod-44443422 is removed in agent
2024-09-12 02:02:01,641 - DEBUG - VMI 6e153efa-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:02:01,641 - INFO - Verified that pod ctest-pod-89105801 is removed in agent
2024-09-12 02:02:01,642 - DEBUG - VMI 6f098c4e-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27
2024-09-12 02:02:01,642 - INFO - Verified that pod ctest-pod-39120651 is removed in agent
2024-09-12 02:02:01,642 - INFO - Deleting namespace ctest-non-default-91512143
2024-09-12 02:02:01,660 - DEBUG - Namespace ctest-non-default-91512143 still in k8s
2024-09-12 02:02:03,668 - DEBUG - Namespace ctest-non-default-91512143 still in k8s
2024-09-12 02:02:05,684 - DEBUG - Namespace ctest-non-default-91512143 still in k8s
2024-09-12 02:02:07,690 - DEBUG - Namespace ctest-non-default-91512143 is not in k8s
2024-09-12 02:02:07,690 - DEBUG - No need to check project deletion in contrail-api
2024-09-12 02:02:07,691 - INFO - Deleting namespace ctest-new-default-50530652
2024-09-12 02:02:07,703 - DEBUG - Namespace ctest-new-default-50530652 still in k8s
2024-09-12 02:02:09,708 - DEBUG - Namespace ctest-new-default-50530652 still in k8s
2024-09-12 02:02:11,722 - DEBUG - Namespace ctest-new-default-50530652 still in k8s
2024-09-12 02:02:13,727 - DEBUG - Namespace ctest-new-default-50530652 is not in k8s
2024-09-12 02:02:13,728 - DEBUG - No need to check project deletion in contrail-api