2024-09-10 23:39:00,005 - INFO - Using existing project ['default-domain', 'k8s-default'](7a84d294-d4dd-40e3-bb13-8b597b585257)
2024-09-10 23:39:00,029 - DEBUG - Namespace ctest-new-default-94791557 not present
2024-09-10 23:39:00,035 - INFO - Created namespace ctest-new-default-94791557
2024-09-10 23:39:03,039 - DEBUG - Namespace ctest-non-default-94477358 not present
2024-09-10 23:39:03,045 - INFO - Created namespace ctest-non-default-94477358
2024-09-10 23:39:06,062 - DEBUG - Pod ctest-pod-97486521 not present
2024-09-10 23:39:06,062 - INFO - Creating Pod ctest-pod-97486521
2024-09-10 23:39:06,096 - DEBUG - Pod : ctest-pod-97486521 UUID is 67fff971-5290-4abc-96b5-ba2b6770deae
2024-09-10 23:39:06,100 - DEBUG - Pod ctest-pod-10611841 not present
2024-09-10 23:39:06,101 - INFO - Creating Pod ctest-pod-10611841
2024-09-10 23:39:06,130 - DEBUG - Pod : ctest-pod-10611841 UUID is 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3
2024-09-10 23:39:06,132 - DEBUG - Pod ctest-pod-84867136 not present
2024-09-10 23:39:06,133 - INFO - Creating Pod ctest-pod-84867136
2024-09-10 23:39:06,153 - DEBUG - Pod : ctest-pod-84867136 UUID is 8e6ff7b9-7e32-408f-bb68-0c16bbe5b8f2
2024-09-10 23:39:06,157 - DEBUG - Pod ctest-pod-00118740 not present
2024-09-10 23:39:06,157 - INFO - Creating Pod ctest-pod-00118740
2024-09-10 23:39:06,208 - DEBUG - Pod : ctest-pod-00118740 UUID is ec25e550-9e77-4759-9c8d-d61b1d86065c
2024-09-10 23:39:06,210 - DEBUG - Pod ctest-pod-69626371 not present
2024-09-10 23:39:06,211 - INFO - Creating Pod ctest-pod-69626371
2024-09-10 23:39:06,230 - DEBUG - Pod : ctest-pod-69626371 UUID is a8f1c3bd-ab3a-465d-850f-4bb052d638f0
2024-09-10 23:39:06,233 - DEBUG - Pod ctest-pod-83815983 not present
2024-09-10 23:39:06,234 - INFO - Creating Pod ctest-pod-83815983
2024-09-10 23:39:06,251 - DEBUG - Pod : ctest-pod-83815983 UUID is 0e76e965-3899-4b7d-b3b0-635770c143cb
2024-09-10 23:39:06,254 - DEBUG - Pod ctest-pod-95284491 not present
2024-09-10 23:39:06,254 - INFO - Creating Pod ctest-pod-95284491
2024-09-10 23:39:06,269 - DEBUG - Pod : ctest-pod-95284491 UUID is a384fccf-ac84-4006-a910-824cc53f939c
2024-09-10 23:39:06,271 - DEBUG - Pod ctest-pod-14402440 not present
2024-09-10 23:39:06,271 - INFO - Creating Pod ctest-pod-14402440
2024-09-10 23:39:06,291 - DEBUG - Pod : ctest-pod-14402440 UUID is 0961801c-ee4e-4197-b9ed-12962203c2a9
2024-09-10 23:39:06,438 - INFO - Project default-domain:k8s-ctest-new-default-94791557 for Namespace ctest-new-default-94791557 is seen in contrail-api
2024-09-10 23:39:06,439 - DEBUG - Project uuid in Contrail is c9e6bb15-b221-454c-8147-da6c6ad176d2
2024-09-10 23:39:06,549 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=034a85f2-1f4e-4d33-9ebb-fed83569d328
2024-09-10 23:39:06,554 - INFO - Namespace ctest-new-default-94791557 with uuid 034a85f2-1f4e-4d33-9ebb-fed83569d328 found in kube manager
2024-09-10 23:39:06,554 - INFO - Namespace ctest-new-default-94791557 verification passed
2024-09-10 23:39:06,788 - INFO - Project default-domain:k8s-ctest-non-default-94477358 for Namespace ctest-non-default-94477358 is seen in contrail-api
2024-09-10 23:39:06,788 - DEBUG - Project uuid in Contrail is ff6e3b46-bfdd-4898-99ed-2aec395a214b
2024-09-10 23:39:06,788 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=b1337af2-dae1-4408-9cc6-3cd1b3e944b0
2024-09-10 23:39:06,794 - INFO - Namespace ctest-non-default-94477358 with uuid b1337af2-dae1-4408-9cc6-3cd1b3e944b0 found in kube manager
2024-09-10 23:39:06,794 - INFO - Namespace ctest-non-default-94477358 verification passed
2024-09-10 23:39:06,799 - DEBUG - Pod ctest-pod-97486521 not in running state.Currently in Pending
2024-09-10 23:39:11,814 - DEBUG - Pod ctest-pod-97486521 not in running state.Currently in Pending
2024-09-10 23:39:16,821 - INFO - Pod ctest-pod-97486521 is in running state.Got IP 10.47.255.251
2024-09-10 23:39:16,832 - DEBUG - Pod ctest-pod-97486521 has vmi df3f0ae4-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:16,832 - INFO - Verified pod ctest-pod-97486521 in contrail-api
2024-09-10 23:39:16,855 - DEBUG - VMI df3f0ae4-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:16,855 - INFO - Verified Pod ctest-pod-97486521 in agent 10.0.0.27
2024-09-10 23:39:16,855 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=67fff971-5290-4abc-96b5-ba2b6770deae
2024-09-10 23:39:16,860 - INFO - Pod ctest-pod-97486521 with uuid 67fff971-5290-4abc-96b5-ba2b6770deae found in kube manager
2024-09-10 23:39:16,860 - INFO - Pod ctest-pod-97486521 verification passed
2024-09-10 23:39:16,865 - INFO - Pod ctest-pod-10611841 is in running state.Got IP 10.47.255.250
2024-09-10 23:39:16,875 - DEBUG - Pod ctest-pod-10611841 has vmi dfb0447a-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:16,875 - INFO - Verified pod ctest-pod-10611841 in contrail-api
2024-09-10 23:39:16,901 - DEBUG - VMI dfb0447a-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:16,901 - INFO - Verified Pod ctest-pod-10611841 in agent 10.0.0.27
2024-09-10 23:39:16,901 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=6eb0c3a7-383a-441c-8ee1-84a5aa3876a3
2024-09-10 23:39:16,906 - INFO - Pod ctest-pod-10611841 with uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 found in kube manager
2024-09-10 23:39:16,906 - INFO - Pod ctest-pod-10611841 verification passed
2024-09-10 23:39:16,911 - INFO - Pod ctest-pod-84867136 is in running state.Got IP 10.47.255.249
2024-09-10 23:39:16,968 - DEBUG - Pod ctest-pod-84867136 has vmi e02d1cfc-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:16,968 - INFO - Verified pod ctest-pod-84867136 in contrail-api
2024-09-10 23:39:16,993 - DEBUG - VMI e02d1cfc-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:16,994 - INFO - Verified Pod ctest-pod-84867136 in agent 10.0.0.27
2024-09-10 23:39:16,994 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=8e6ff7b9-7e32-408f-bb68-0c16bbe5b8f2
2024-09-10 23:39:17,000 - INFO - Pod ctest-pod-84867136 with uuid 8e6ff7b9-7e32-408f-bb68-0c16bbe5b8f2 found in kube manager
2024-09-10 23:39:17,000 - INFO - Pod ctest-pod-84867136 verification passed
2024-09-10 23:39:17,008 - DEBUG - Pod ctest-pod-00118740 not in running state.Currently in Pending
2024-09-10 23:39:22,015 - INFO - Pod ctest-pod-00118740 is in running state.Got IP 10.47.255.248
2024-09-10 23:39:22,028 - DEBUG - Pod ctest-pod-00118740 has vmi e09838f2-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:22,028 - INFO - Verified pod ctest-pod-00118740 in contrail-api
2024-09-10 23:39:22,056 - DEBUG - VMI e09838f2-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:22,057 - INFO - Verified Pod ctest-pod-00118740 in agent 10.0.0.27
2024-09-10 23:39:22,057 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ec25e550-9e77-4759-9c8d-d61b1d86065c
2024-09-10 23:39:22,066 - INFO - Pod ctest-pod-00118740 with uuid ec25e550-9e77-4759-9c8d-d61b1d86065c found in kube manager
2024-09-10 23:39:22,067 - INFO - Pod ctest-pod-00118740 verification passed
2024-09-10 23:39:22,071 - INFO - Pod ctest-pod-69626371 is in running state.Got IP 10.47.255.247
2024-09-10 23:39:22,084 - DEBUG - Pod ctest-pod-69626371 has vmi e10db2d0-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:22,084 - INFO - Verified pod ctest-pod-69626371 in contrail-api
2024-09-10 23:39:22,104 - DEBUG - VMI e10db2d0-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:22,104 - INFO - Verified Pod ctest-pod-69626371 in agent 10.0.0.27
2024-09-10 23:39:22,104 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=a8f1c3bd-ab3a-465d-850f-4bb052d638f0
2024-09-10 23:39:22,109 - INFO - Pod ctest-pod-69626371 with uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 found in kube manager
2024-09-10 23:39:22,109 - INFO - Pod ctest-pod-69626371 verification passed
2024-09-10 23:39:22,115 - INFO - Pod ctest-pod-95284491 is in running state.Got IP 10.47.255.245
2024-09-10 23:39:22,172 - DEBUG - Pod ctest-pod-95284491 has vmi e1d8738a-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:22,172 - INFO - Verified pod ctest-pod-95284491 in contrail-api
2024-09-10 23:39:22,192 - DEBUG - VMI e1d8738a-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:22,192 - INFO - Verified Pod ctest-pod-95284491 in agent 10.0.0.27
2024-09-10 23:39:22,192 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=a384fccf-ac84-4006-a910-824cc53f939c
2024-09-10 23:39:22,199 - INFO - Pod ctest-pod-95284491 with uuid a384fccf-ac84-4006-a910-824cc53f939c found in kube manager
2024-09-10 23:39:22,199 - INFO - Pod ctest-pod-95284491 verification passed
2024-09-10 23:39:22,205 - INFO - Pod ctest-pod-83815983 is in running state.Got IP 10.47.255.246
2024-09-10 23:39:22,216 - DEBUG - Pod ctest-pod-83815983 has vmi e1731166-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:22,216 - INFO - Verified pod ctest-pod-83815983 in contrail-api
2024-09-10 23:39:22,238 - DEBUG - VMI e1731166-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:22,239 - INFO - Verified Pod ctest-pod-83815983 in agent 10.0.0.27
2024-09-10 23:39:22,239 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=0e76e965-3899-4b7d-b3b0-635770c143cb
2024-09-10 23:39:22,247 - INFO - Pod ctest-pod-83815983 with uuid 0e76e965-3899-4b7d-b3b0-635770c143cb found in kube manager
2024-09-10 23:39:22,247 - INFO - Pod ctest-pod-83815983 verification passed
2024-09-10 23:39:22,253 - INFO - Pod ctest-pod-14402440 is in running state.Got IP 10.47.255.244
2024-09-10 23:39:22,320 - DEBUG - Pod ctest-pod-14402440 has vmi e241d5f0-6fcd-11ef-a3b5-fa163e3bcfa0
2024-09-10 23:39:22,320 - INFO - Verified pod ctest-pod-14402440 in contrail-api
2024-09-10 23:39:22,350 - DEBUG - VMI e241d5f0-6fcd-11ef-a3b5-fa163e3bcfa0 is active in agent 10.0.0.27
2024-09-10 23:39:22,350 - INFO - Verified Pod ctest-pod-14402440 in agent 10.0.0.27
2024-09-10 23:39:22,350 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=0961801c-ee4e-4197-b9ed-12962203c2a9
2024-09-10 23:39:22,355 - INFO - Pod ctest-pod-14402440 with uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 found in kube manager
2024-09-10 23:39:22,356 - INFO - Pod ctest-pod-14402440 verification passed
2024-09-10 23:39:22,356 - INFO - ================================================================================
2024-09-10 23:39:22,356 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-10 23:39:22,356 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-10 23:39:22,666 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.33': '0'}} with
2024-09-10 23:39:22,667 - INFO - Initial checks done. Running the testcase now
2024-09-10 23:39:22,667 - INFO -
2024-09-10 23:39:22,768 - DEBUG - [Pod ctest-pod-97486521] Cmd: echo ctest-pod-97486521 > /usr/share/nginx/html/index.html, Output:
2024-09-10 23:39:22,848 - DEBUG - [Pod ctest-pod-10611841] Cmd: echo ctest-pod-10611841 > /usr/share/nginx/html/index.html, Output:
2024-09-10 23:39:22,937 - DEBUG - [Pod ctest-pod-84867136] Cmd: echo ctest-pod-84867136 > /usr/share/nginx/html/index.html, Output:
2024-09-10 23:39:23,011 - DEBUG - [Pod ctest-pod-00118740] Cmd: echo ctest-pod-00118740 > /usr/share/nginx/html/index.html, Output:
2024-09-10 23:39:23,015 - DEBUG - Service ctest-nginx-svc-16039826 not present
2024-09-10 23:39:23,015 - INFO - Creating service ctest-nginx-svc-16039826
2024-09-10 23:39:23,027 - INFO - Created Service ctest-nginx-svc-16039826
2024-09-10 23:39:23,036 - WARNING - Service UUID 8975cc9f-3159-4589-918c-5f1a27b070a5 not yet found in contrail-api
2024-09-10 23:39:24,042 - INFO - Validated that Service ctest-nginx-svc-16039826 is seen in contrail-api
2024-09-10 23:39:24,043 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=8975cc9f-3159-4589-918c-5f1a27b070a5
2024-09-10 23:39:24,048 - INFO - Service ctest-nginx-svc-16039826 with uuid 8975cc9f-3159-4589-918c-5f1a27b070a5 found in kube manager
2024-09-10 23:39:24,048 - INFO - Service ctest-nginx-svc-16039826 verification passed
2024-09-10 23:39:25,160 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
ctest-pod-97486521
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,161 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:39:25,161 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
ctest-pod-97486521
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,265 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,265 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:39:25,265 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,346 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-10611841
2024-09-10 23:39:25,346 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:39:25,346 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-10611841
2024-09-10 23:39:25,347 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97486521': 2, 'ctest-pod-10611841': 1}
2024-09-10 23:39:25,413 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
ctest-pod-10611841
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,413 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:39:25,413 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
ctest-pod-10611841
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,467 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,467 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:39:25,467 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:39:25,467 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97486521': 1, 'ctest-pod-10611841': 1}
2024-09-10 23:39:25,475 - DEBUG - Network policy ingress-on-service not present
2024-09-10 23:39:25,476 - INFO - Creating Network Policy ingress-on-service
2024-09-10 23:39:25,492 - INFO - Network policy found in k8s
2024-09-10 23:39:25,492 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e2f7480c-1144-49c4-a160-ee53e8996150
2024-09-10 23:39:25,499 - INFO - Network Policy ingress-on-service with uuid e2f7480c-1144-49c4-a160-ee53e8996150 found in kube manager
2024-09-10 23:39:25,543 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-10 23:39:25,543 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-10 23:39:25,548 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e2f7480c-1144-49c4-a160-ee53e8996150
2024-09-10 23:39:25,586 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-10 23:39:27,586 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e2f7480c-1144-49c4-a160-ee53e8996150
2024-09-10 23:39:27,624 - INFO - Network policy with name ingress-on-service found in agent
2024-09-10 23:39:27,624 - INFO - Network Policy ingress-on-service verification passed
2024-09-10 23:39:32,735 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:32,736 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:32,736 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:37,826 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:37,826 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:37,826 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:42,938 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:42,938 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:42,938 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:48,036 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:48,036 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:48,036 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:53,133 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:53,133 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:53,133 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:58,232 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:58,232 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:39:58,232 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:03,332 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:03,333 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:03,333 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:08,442 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:08,442 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:08,442 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:13,549 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:13,549 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:13,549 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:18,679 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:18,679 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:18,679 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:18,679 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-97486521': 0, 'ctest-pod-10611841': 0}
2024-09-10 23:40:18,775 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:18,775 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:18,775 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:18,870 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:18,870 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:18,870 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:18,962 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:18,963 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:18,963 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,031 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,031 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:19,032 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,101 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,101 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:19,101 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,168 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,168 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:19,168 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,252 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97486521
2024-09-10 23:40:19,252 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:19,252 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97486521
2024-09-10 23:40:19,324 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-10611841
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,324 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:40:19,324 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-10611841
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:40:19,324 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97486521': 7, 'ctest-pod-10611841': 1}
2024-09-10 23:40:24,399 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:24,399 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:24,399 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:29,525 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:29,525 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:29,525 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:34,647 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:34,647 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:34,647 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:39,741 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:39,742 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:39,742 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:44,857 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:44,857 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:44,857 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:49,951 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:49,951 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:49,951 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:55,049 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:55,049 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:40:55,049 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:00,171 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:00,171 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:00,172 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:05,284 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:05,285 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:05,285 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:10,424 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:10,424 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:10,424 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:10,425 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-97486521': 0, 'ctest-pod-10611841': 0}
2024-09-10 23:41:12,531 - DEBUG - [Pod ctest-pod-83815983] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.594 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.102 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.144 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.102/0.280/0.594 ms
2024-09-10 23:41:12,532 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-83815983 with expectation True passed
2024-09-10 23:41:14,636 - DEBUG - [Pod ctest-pod-69626371] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.450 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.098 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.168 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.098/0.238/0.450 ms
2024-09-10 23:41:14,636 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69626371 with expectation True passed
2024-09-10 23:41:16,751 - DEBUG - [Pod ctest-pod-95284491] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.756 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.165 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.116 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.116/0.345/0.756 ms
2024-09-10 23:41:16,752 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-95284491 with expectation True passed
2024-09-10 23:41:16,870 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:41:16,870 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-10 23:41:16,870 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:41:16,870 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83815983 passed
2024-09-10 23:41:16,944 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:41:16,944 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-10 23:41:16,944 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:41:16,944 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83815983 passed
2024-09-10 23:41:22,018 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-10 23:41:22,019 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-10 23:41:22,019 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-10 23:41:22,019 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69626371 passed
2024-09-10 23:41:27,097 - DEBUG - [Pod ctest-pod-14402440] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-10 23:41:27,097 - DEBUG - [Pod Pod ctest-pod-14402440] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-10 23:41:27,097 - DEBUG - [Pod Pod ctest-pod-14402440] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-10 23:41:27,097 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14402440 passed
2024-09-10 23:41:27,107 - INFO - Updating Network Policy ingress-on-service
2024-09-10 23:41:32,222 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:32,222 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:32,222 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:37,341 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:37,341 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:37,341 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:42,460 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:42,461 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:42,461 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:47,568 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:47,568 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:47,568 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:52,644 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:52,644 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:52,644 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:57,769 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:57,769 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:41:57,769 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:02,887 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:02,887 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:02,887 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:07,992 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:07,992 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:07,992 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:13,125 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:13,126 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:13,126 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:18,249 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:18,249 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:18,249 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.101.221.37:80 (10.101.221.37:80)
wget: download timed out
2024-09-10 23:42:18,249 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-97486521': 0, 'ctest-pod-10611841': 0}
2024-09-10 23:42:18,372 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-10611841
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,372 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:42:18,372 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-10611841
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,456 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,456 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:42:18,456 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,456 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97486521': 1, 'ctest-pod-10611841': 1}
2024-09-10 23:42:18,516 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,516 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:42:18,516 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: ctest-pod-97486521
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,589 - DEBUG - [Pod ctest-pod-95284491] Cmd: wget http://10.101.221.37:80/ -O - -T 5 -t 1 , Output: ctest-pod-10611841
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,589 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd wget http://10.101.221.37:80/ -O - -T 5 -t 1 passed
2024-09-10 23:42:18,589 - DEBUG - [Pod Pod ctest-pod-95284491] Cmd output: ctest-pod-10611841
Connecting to 10.101.221.37:80 (10.101.221.37:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-10 23:42:18,589 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97486521': 1, 'ctest-pod-10611841': 1}
2024-09-10 23:42:20,664 - DEBUG - [Pod ctest-pod-83815983] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.062 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.154 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.062/0.105/0.154 ms
2024-09-10 23:42:20,664 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-83815983 with expectation True passed
2024-09-10 23:42:22,781 - DEBUG - [Pod ctest-pod-69626371] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.604 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.264/0.604 ms
2024-09-10 23:42:22,782 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69626371 with expectation True passed
2024-09-10 23:42:24,889 - DEBUG - [Pod ctest-pod-95284491] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.282 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.196 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.520/1.282 ms
2024-09-10 23:42:24,890 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-95284491 with expectation True passed
2024-09-10 23:42:25,030 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:42:25,030 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-10 23:42:25,030 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:42:25,030 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83815983 passed
2024-09-10 23:42:25,130 - DEBUG - [Pod ctest-pod-83815983] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:42:25,130 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-10 23:42:25,130 - DEBUG - [Pod Pod ctest-pod-83815983] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:42:25,130 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83815983 passed
2024-09-10 23:42:30,244 - DEBUG - [Pod ctest-pod-69626371] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-10 23:42:30,245 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-10 23:42:30,245 - DEBUG - [Pod Pod ctest-pod-69626371] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-10 23:42:30,245 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69626371 passed
2024-09-10 23:42:30,359 - DEBUG - [Pod ctest-pod-14402440] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:42:30,359 - DEBUG - [Pod Pod ctest-pod-14402440] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-10 23:42:30,359 - DEBUG - [Pod Pod ctest-pod-14402440] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-10 23:42:30,359 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14402440 passed
2024-09-10 23:42:30,359 - INFO - Deleting Network Policy : ingress-on-service
2024-09-10 23:42:30,360 - INFO - Deleting service : ctest-nginx-svc-16039826
2024-09-10 23:42:30,671 - DEBUG - No XMPP flaps were noticed during the test
2024-09-10 23:42:30,671 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:08]
2024-09-10 23:42:30,671 - INFO - --------------------------------------------------------------------------------
2024-09-10 23:42:30,678 - INFO - Deleting pod ctest-new-default-94791557:ctest-pod-97486521
2024-09-10 23:42:30,678 - INFO - Deleting pod ctest-new-default-94791557:ctest-pod-10611841
2024-09-10 23:42:30,679 - INFO - Deleting pod ctest-non-default-94477358:ctest-pod-84867136
2024-09-10 23:42:30,679 - INFO - Deleting pod ctest-non-default-94477358:ctest-pod-00118740
2024-09-10 23:42:30,679 - INFO - Deleting pod ctest-new-default-94791557:ctest-pod-69626371
2024-09-10 23:42:30,679 - INFO - Deleting pod ctest-new-default-94791557:ctest-pod-83815983
2024-09-10 23:42:30,680 - INFO - Deleting pod ctest-non-default-94477358:ctest-pod-95284491
2024-09-10 23:42:30,680 - INFO - Deleting pod ctest-non-default-94477358:ctest-pod-14402440
2024-09-10 23:42:30,773 - WARNING - Pod uuid 67fff971-5290-4abc-96b5-ba2b6770deae is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,848 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,850 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,850 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,850 - WARNING - Pod uuid 8e6ff7b9-7e32-408f-bb68-0c16bbe5b8f2 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,851 - WARNING - Pod uuid ec25e550-9e77-4759-9c8d-d61b1d86065c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,851 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:30,851 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:35,788 - DEBUG - Pod 67fff971-5290-4abc-96b5-ba2b6770deae is not in agent 10.0.0.27 VM list
2024-09-10 23:42:35,803 - DEBUG - VMI df3f0ae4-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:42:35,803 - INFO - Verified that pod ctest-pod-97486521 is removed in agent
2024-09-10 23:42:35,884 - DEBUG - Pod ec25e550-9e77-4759-9c8d-d61b1d86065c is not in agent 10.0.0.27 VM list
2024-09-10 23:42:35,886 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:35,886 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:35,887 - DEBUG - Pod 8e6ff7b9-7e32-408f-bb68-0c16bbe5b8f2 is not in agent 10.0.0.27 VM list
2024-09-10 23:42:35,889 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:35,889 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:35,889 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:35,899 - DEBUG - VMI e02d1cfc-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:42:35,899 - INFO - Verified that pod ctest-pod-84867136 is removed in agent
2024-09-10 23:42:35,900 - DEBUG - VMI e09838f2-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:42:35,900 - INFO - Verified that pod ctest-pod-00118740 is removed in agent
2024-09-10 23:42:40,937 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:40,937 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:40,938 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:40,939 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:40,939 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:45,967 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:45,968 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:45,969 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:45,970 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:45,970 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:51,022 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:51,023 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:51,024 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:51,025 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:51,025 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:56,076 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:56,077 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:56,078 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:56,079 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:42:56,079 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:43:01,127 - WARNING - Pod uuid a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:43:01,129 - WARNING - Pod uuid 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:43:01,129 - WARNING - Pod uuid 0e76e965-3899-4b7d-b3b0-635770c143cb is still seen in agent 10.0.0.27 VM list
2024-09-10 23:43:01,130 - WARNING - Pod uuid 0961801c-ee4e-4197-b9ed-12962203c2a9 is still seen in agent 10.0.0.27 VM list
2024-09-10 23:43:01,130 - WARNING - Pod uuid a384fccf-ac84-4006-a910-824cc53f939c is still seen in agent 10.0.0.27 VM list
2024-09-10 23:43:06,179 - DEBUG - Pod a8f1c3bd-ab3a-465d-850f-4bb052d638f0 is not in agent 10.0.0.27 VM list
2024-09-10 23:43:06,182 - DEBUG - Pod 6eb0c3a7-383a-441c-8ee1-84a5aa3876a3 is not in agent 10.0.0.27 VM list
2024-09-10 23:43:06,183 - DEBUG - Pod a384fccf-ac84-4006-a910-824cc53f939c is not in agent 10.0.0.27 VM list
2024-09-10 23:43:06,188 - DEBUG - Pod 0e76e965-3899-4b7d-b3b0-635770c143cb is not in agent 10.0.0.27 VM list
2024-09-10 23:43:06,190 - DEBUG - Pod 0961801c-ee4e-4197-b9ed-12962203c2a9 is not in agent 10.0.0.27 VM list
2024-09-10 23:43:06,218 - DEBUG - VMI e1d8738a-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:43:06,218 - INFO - Verified that pod ctest-pod-95284491 is removed in agent
2024-09-10 23:43:06,218 - DEBUG - VMI dfb0447a-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:43:06,218 - INFO - Verified that pod ctest-pod-10611841 is removed in agent
2024-09-10 23:43:06,220 - DEBUG - VMI e1731166-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:43:06,220 - INFO - Verified that pod ctest-pod-83815983 is removed in agent
2024-09-10 23:43:06,220 - DEBUG - VMI e241d5f0-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:43:06,220 - INFO - Verified that pod ctest-pod-14402440 is removed in agent
2024-09-10 23:43:06,220 - DEBUG - VMI e10db2d0-6fcd-11ef-a3b5-fa163e3bcfa0 is removed from agent 10.0.0.27
2024-09-10 23:43:06,220 - INFO - Verified that pod ctest-pod-69626371 is removed in agent
2024-09-10 23:43:06,221 - INFO - Deleting namespace ctest-non-default-94477358
2024-09-10 23:43:06,236 - DEBUG - Namespace ctest-non-default-94477358 still in k8s
2024-09-10 23:43:08,243 - DEBUG - Namespace ctest-non-default-94477358 still in k8s
2024-09-10 23:43:10,248 - DEBUG - Namespace ctest-non-default-94477358 still in k8s
2024-09-10 23:43:12,253 - DEBUG - Namespace ctest-non-default-94477358 is not in k8s
2024-09-10 23:43:12,253 - DEBUG - No need to check project deletion in contrail-api
2024-09-10 23:43:12,253 - INFO - Deleting namespace ctest-new-default-94791557
2024-09-10 23:43:12,267 - DEBUG - Namespace ctest-new-default-94791557 still in k8s
2024-09-10 23:43:14,273 - DEBUG - Namespace ctest-new-default-94791557 still in k8s
2024-09-10 23:43:16,279 - DEBUG - Namespace ctest-new-default-94791557 still in k8s
2024-09-10 23:43:18,283 - DEBUG - Namespace ctest-new-default-94791557 is not in k8s
2024-09-10 23:43:18,283 - DEBUG - No need to check project deletion in contrail-api