2025-01-10 21:33:10,901 - INFO - Using existing project ['default-domain', 'k8s-default'](8457cf8c-703e-4d8c-86fe-ba88fbef6d7c)
2025-01-10 21:33:10,927 - DEBUG - Namespace ctest-new-default-91825309 not present
2025-01-10 21:33:10,939 - INFO - Created namespace ctest-new-default-91825309
2025-01-10 21:33:13,945 - DEBUG - Namespace ctest-non-default-93868004 not present
2025-01-10 21:33:13,952 - INFO - Created namespace ctest-non-default-93868004
2025-01-10 21:33:16,973 - DEBUG - Pod ctest-pod-17027531 not present
2025-01-10 21:33:16,974 - INFO - Creating Pod ctest-pod-17027531
2025-01-10 21:33:17,002 - DEBUG - Pod : ctest-pod-17027531 UUID is f3149f1d-b0a9-4c1c-9fae-ec42e30334ec
2025-01-10 21:33:17,008 - DEBUG - Pod ctest-pod-44635051 not present
2025-01-10 21:33:17,009 - INFO - Creating Pod ctest-pod-44635051
2025-01-10 21:33:17,036 - DEBUG - Pod : ctest-pod-44635051 UUID is e8072118-4002-420e-9cfe-49e74f8d0bd0
2025-01-10 21:33:17,040 - DEBUG - Pod ctest-pod-64576843 not present
2025-01-10 21:33:17,040 - INFO - Creating Pod ctest-pod-64576843
2025-01-10 21:33:17,067 - DEBUG - Pod : ctest-pod-64576843 UUID is 0361dfcb-d0d8-4076-a257-0190504e04df
2025-01-10 21:33:17,070 - DEBUG - Pod ctest-pod-80103067 not present
2025-01-10 21:33:17,070 - INFO - Creating Pod ctest-pod-80103067
2025-01-10 21:33:17,091 - DEBUG - Pod : ctest-pod-80103067 UUID is bae43691-acc5-4f06-9868-0597d3d142a8
2025-01-10 21:33:17,099 - DEBUG - Pod ctest-pod-97988983 not present
2025-01-10 21:33:17,099 - INFO - Creating Pod ctest-pod-97988983
2025-01-10 21:33:17,120 - DEBUG - Pod : ctest-pod-97988983 UUID is db668401-da06-4cc0-b2dd-e8b9cd08b7e1
2025-01-10 21:33:17,124 - DEBUG - Pod ctest-pod-25929693 not present
2025-01-10 21:33:17,125 - INFO - Creating Pod ctest-pod-25929693
2025-01-10 21:33:17,148 - DEBUG - Pod : ctest-pod-25929693 UUID is 2d49c8fd-b027-490d-b297-1f75efe802b6
2025-01-10 21:33:17,152 - DEBUG - Pod ctest-pod-17567295 not present
2025-01-10 21:33:17,152 - INFO - Creating Pod ctest-pod-17567295
2025-01-10 21:33:17,177 - DEBUG - Pod : ctest-pod-17567295 UUID is 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864
2025-01-10 21:33:17,180 - DEBUG - Pod ctest-pod-50395348 not present
2025-01-10 21:33:17,180 - INFO - Creating Pod ctest-pod-50395348
2025-01-10 21:33:17,205 - DEBUG - Pod : ctest-pod-50395348 UUID is a7886401-c793-4bfe-99c2-044105e6f56b
2025-01-10 21:33:17,472 - INFO - Project default-domain:k8s-ctest-new-default-91825309 for Namespace ctest-new-default-91825309 is seen in contrail-api
2025-01-10 21:33:17,472 - DEBUG - Project uuid in Contrail is 3762ba72-feac-4e79-9c81-c9569c603529
2025-01-10 21:33:17,692 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=eb449fe5-374e-48d8-97c5-20f5b8f63382
2025-01-10 21:33:17,696 - INFO - Namespace ctest-new-default-91825309 with uuid eb449fe5-374e-48d8-97c5-20f5b8f63382 found in kube manager
2025-01-10 21:33:17,696 - INFO - Namespace ctest-new-default-91825309 verification passed
2025-01-10 21:33:17,977 - INFO - Project default-domain:k8s-ctest-non-default-93868004 for Namespace ctest-non-default-93868004 is seen in contrail-api
2025-01-10 21:33:17,977 - DEBUG - Project uuid in Contrail is 90c65a92-f3d3-4baa-8558-00cafdbf864b
2025-01-10 21:33:17,977 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=afac5b2a-3d27-4006-ba70-91b7ea7c3e84
2025-01-10 21:33:17,983 - INFO - Namespace ctest-non-default-93868004 with uuid afac5b2a-3d27-4006-ba70-91b7ea7c3e84 found in kube manager
2025-01-10 21:33:17,983 - INFO - Namespace ctest-non-default-93868004 verification passed
2025-01-10 21:33:17,990 - DEBUG - Pod ctest-pod-17027531 not in running state.Currently in Pending
2025-01-10 21:33:22,997 - DEBUG - Pod ctest-pod-17027531 not in running state.Currently in Pending
2025-01-10 21:33:28,004 - DEBUG - Pod ctest-pod-17027531 not in running state.Currently in Pending
2025-01-10 21:33:33,014 - DEBUG - Pod ctest-pod-17027531 not in running state.Currently in Pending
2025-01-10 21:33:38,022 - DEBUG - Pod ctest-pod-17027531 not in running state.Currently in Pending
2025-01-10 21:33:43,031 - DEBUG - Pod ctest-pod-17027531 not in running state.Currently in Pending
2025-01-10 21:33:48,039 - INFO - Pod ctest-pod-17027531 is in running state.Got IP 10.47.255.248
2025-01-10 21:33:48,055 - DEBUG - Pod ctest-pod-17027531 has vmi 88a885c0-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:33:48,055 - INFO - Verified pod ctest-pod-17027531 in contrail-api
2025-01-10 21:33:48,068 - DEBUG - VMI 88a885c0-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:33:48,068 - INFO - Verified Pod ctest-pod-17027531 in agent 10.0.0.12
2025-01-10 21:33:48,068 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=f3149f1d-b0a9-4c1c-9fae-ec42e30334ec
2025-01-10 21:33:48,073 - INFO - Pod ctest-pod-17027531 with uuid f3149f1d-b0a9-4c1c-9fae-ec42e30334ec found in kube manager
2025-01-10 21:33:48,073 - INFO - Pod ctest-pod-17027531 verification passed
2025-01-10 21:33:48,078 - DEBUG - Pod ctest-pod-44635051 not in running state.Currently in Pending
2025-01-10 21:33:53,085 - INFO - Pod ctest-pod-44635051 is in running state.Got IP 10.47.255.247
2025-01-10 21:33:53,105 - DEBUG - Pod ctest-pod-44635051 has vmi 8b6fe2c6-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:33:53,105 - INFO - Verified pod ctest-pod-44635051 in contrail-api
2025-01-10 21:33:53,119 - DEBUG - VMI 8b6fe2c6-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:33:53,120 - INFO - Verified Pod ctest-pod-44635051 in agent 10.0.0.12
2025-01-10 21:33:53,120 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=e8072118-4002-420e-9cfe-49e74f8d0bd0
2025-01-10 21:33:53,128 - INFO - Pod ctest-pod-44635051 with uuid e8072118-4002-420e-9cfe-49e74f8d0bd0 found in kube manager
2025-01-10 21:33:53,128 - INFO - Pod ctest-pod-44635051 verification passed
2025-01-10 21:33:53,134 - INFO - Pod ctest-pod-64576843 is in running state.Got IP 10.47.255.246
2025-01-10 21:33:53,151 - DEBUG - Pod ctest-pod-64576843 has vmi 8edfed20-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:33:53,151 - INFO - Verified pod ctest-pod-64576843 in contrail-api
2025-01-10 21:33:53,166 - DEBUG - VMI 8edfed20-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:33:53,167 - INFO - Verified Pod ctest-pod-64576843 in agent 10.0.0.12
2025-01-10 21:33:53,167 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=0361dfcb-d0d8-4076-a257-0190504e04df
2025-01-10 21:33:53,171 - INFO - Pod ctest-pod-64576843 with uuid 0361dfcb-d0d8-4076-a257-0190504e04df found in kube manager
2025-01-10 21:33:53,171 - INFO - Pod ctest-pod-64576843 verification passed
2025-01-10 21:33:53,179 - DEBUG - Pod ctest-pod-80103067 not in running state.Currently in Pending
2025-01-10 21:33:58,186 - INFO - Pod ctest-pod-80103067 is in running state.Got IP 10.47.255.245
2025-01-10 21:33:58,200 - DEBUG - Pod ctest-pod-80103067 has vmi 91094092-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:33:58,200 - INFO - Verified pod ctest-pod-80103067 in contrail-api
2025-01-10 21:33:58,212 - DEBUG - VMI 91094092-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:33:58,212 - INFO - Verified Pod ctest-pod-80103067 in agent 10.0.0.12
2025-01-10 21:33:58,212 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=bae43691-acc5-4f06-9868-0597d3d142a8
2025-01-10 21:33:58,217 - INFO - Pod ctest-pod-80103067 with uuid bae43691-acc5-4f06-9868-0597d3d142a8 found in kube manager
2025-01-10 21:33:58,217 - INFO - Pod ctest-pod-80103067 verification passed
2025-01-10 21:33:58,223 - DEBUG - Pod ctest-pod-97988983 not in running state.Currently in Pending
2025-01-10 21:34:03,234 - DEBUG - Pod ctest-pod-97988983 not in running state.Currently in Pending
2025-01-10 21:34:08,242 - INFO - Pod ctest-pod-97988983 is in running state.Got IP 10.47.255.244
2025-01-10 21:34:08,255 - DEBUG - Pod ctest-pod-97988983 has vmi 933fac0c-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:34:08,256 - INFO - Verified pod ctest-pod-97988983 in contrail-api
2025-01-10 21:34:08,268 - DEBUG - VMI 933fac0c-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:34:08,268 - INFO - Verified Pod ctest-pod-97988983 in agent 10.0.0.12
2025-01-10 21:34:08,268 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=db668401-da06-4cc0-b2dd-e8b9cd08b7e1
2025-01-10 21:34:08,273 - INFO - Pod ctest-pod-97988983 with uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 found in kube manager
2025-01-10 21:34:08,273 - INFO - Pod ctest-pod-97988983 verification passed
2025-01-10 21:34:08,278 - DEBUG - Pod ctest-pod-17567295 not in running state.Currently in Pending
2025-01-10 21:34:13,285 - INFO - Pod ctest-pod-17567295 is in running state.Got IP 10.47.255.242
2025-01-10 21:34:13,299 - DEBUG - Pod ctest-pod-17567295 has vmi 964c3514-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:34:13,299 - INFO - Verified pod ctest-pod-17567295 in contrail-api
2025-01-10 21:34:13,311 - DEBUG - VMI 964c3514-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:34:13,312 - INFO - Verified Pod ctest-pod-17567295 in agent 10.0.0.12
2025-01-10 21:34:13,312 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=3f11a0ba-bce6-46ef-834e-d0a3d1bdf864
2025-01-10 21:34:13,317 - INFO - Pod ctest-pod-17567295 with uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 found in kube manager
2025-01-10 21:34:13,317 - INFO - Pod ctest-pod-17567295 verification passed
2025-01-10 21:34:13,323 - INFO - Pod ctest-pod-25929693 is in running state.Got IP 10.47.255.243
2025-01-10 21:34:13,337 - DEBUG - Pod ctest-pod-25929693 has vmi 955b5e46-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:34:13,338 - INFO - Verified pod ctest-pod-25929693 in contrail-api
2025-01-10 21:34:13,350 - DEBUG - VMI 955b5e46-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:34:13,350 - INFO - Verified Pod ctest-pod-25929693 in agent 10.0.0.12
2025-01-10 21:34:13,350 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=2d49c8fd-b027-490d-b297-1f75efe802b6
2025-01-10 21:34:13,354 - INFO - Pod ctest-pod-25929693 with uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 found in kube manager
2025-01-10 21:34:13,355 - INFO - Pod ctest-pod-25929693 verification passed
2025-01-10 21:34:13,361 - INFO - Pod ctest-pod-50395348 is in running state.Got IP 10.47.255.241
2025-01-10 21:34:13,375 - DEBUG - Pod ctest-pod-50395348 has vmi 97e399a8-cf9a-11ef-90e5-fa163e497c56
2025-01-10 21:34:13,375 - INFO - Verified pod ctest-pod-50395348 in contrail-api
2025-01-10 21:34:13,389 - DEBUG - VMI 97e399a8-cf9a-11ef-90e5-fa163e497c56 is active in agent 10.0.0.12
2025-01-10 21:34:13,390 - INFO - Verified Pod ctest-pod-50395348 in agent 10.0.0.12
2025-01-10 21:34:13,390 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=a7886401-c793-4bfe-99c2-044105e6f56b
2025-01-10 21:34:13,395 - INFO - Pod ctest-pod-50395348 with uuid a7886401-c793-4bfe-99c2-044105e6f56b found in kube manager
2025-01-10 21:34:13,395 - INFO - Pod ctest-pod-50395348 verification passed
2025-01-10 21:34:13,395 - INFO - ================================================================================
2025-01-10 21:34:13,396 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-10 21:34:13,396 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-10 21:34:13,899 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.12': '0'}} with
2025-01-10 21:34:13,899 - INFO - Initial checks done. Running the testcase now
2025-01-10 21:34:13,899 - INFO -
2025-01-10 21:34:13,952 - DEBUG - [Pod ctest-pod-17027531] Cmd: echo ctest-pod-17027531 > /usr/share/nginx/html/index.html, Output:
2025-01-10 21:34:14,000 - DEBUG - [Pod ctest-pod-44635051] Cmd: echo ctest-pod-44635051 > /usr/share/nginx/html/index.html, Output:
2025-01-10 21:34:14,053 - DEBUG - [Pod ctest-pod-64576843] Cmd: echo ctest-pod-64576843 > /usr/share/nginx/html/index.html, Output:
2025-01-10 21:34:14,104 - DEBUG - [Pod ctest-pod-80103067] Cmd: echo ctest-pod-80103067 > /usr/share/nginx/html/index.html, Output:
2025-01-10 21:34:14,107 - DEBUG - Service ctest-nginx-svc-48369095 not present
2025-01-10 21:34:14,107 - INFO - Creating service ctest-nginx-svc-48369095
2025-01-10 21:34:14,123 - INFO - Created Service ctest-nginx-svc-48369095
2025-01-10 21:34:14,131 - WARNING - Service UUID 638b702b-1524-4ac6-8d07-3683c0952563 not yet found in contrail-api
2025-01-10 21:34:15,139 - WARNING - Service UUID 638b702b-1524-4ac6-8d07-3683c0952563 not yet found in contrail-api
2025-01-10 21:34:16,147 - INFO - Validated that Service ctest-nginx-svc-48369095 is seen in contrail-api
2025-01-10 21:34:16,147 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=638b702b-1524-4ac6-8d07-3683c0952563
2025-01-10 21:34:16,152 - INFO - Service ctest-nginx-svc-48369095 with uuid 638b702b-1524-4ac6-8d07-3683c0952563 found in kube manager
2025-01-10 21:34:16,152 - INFO - Service ctest-nginx-svc-48369095 verification passed
2025-01-10 21:34:19,254 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-44635051
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:34:19,254 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:34:19,254 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-44635051
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:34:19,314 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:34:19,314 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:34:19,314 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:34:19,360 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-17027531
2025-01-10 21:34:19,360 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:34:19,360 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-17027531
2025-01-10 21:34:19,360 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-17027531': 1, 'ctest-pod-44635051': 2}
2025-01-10 21:34:19,418 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-44635051
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:34:19,418 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:34:19,418 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-44635051
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:34:19,472 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-17027531
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:34:19,472 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:34:19,472 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-17027531
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:34:19,472 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-17027531': 1, 'ctest-pod-44635051': 1}
2025-01-10 21:34:19,475 - DEBUG - Network policy ingress-on-service not present
2025-01-10 21:34:19,475 - INFO - Creating Network Policy ingress-on-service
2025-01-10 21:34:19,553 - INFO - Network policy found in k8s
2025-01-10 21:34:19,553 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1dd2a31-8ab8-44be-bace-01bbb83fc336
2025-01-10 21:34:19,558 - INFO - Network Policy ingress-on-service with uuid c1dd2a31-8ab8-44be-bace-01bbb83fc336 found in kube manager
2025-01-10 21:34:19,601 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-10 21:34:19,602 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-10 21:34:19,602 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1dd2a31-8ab8-44be-bace-01bbb83fc336
2025-01-10 21:34:19,638 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-10 21:34:21,639 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1dd2a31-8ab8-44be-bace-01bbb83fc336
2025-01-10 21:34:21,666 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-10 21:34:23,667 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c1dd2a31-8ab8-44be-bace-01bbb83fc336
2025-01-10 21:34:23,702 - INFO - Network policy with name ingress-on-service found in agent
2025-01-10 21:34:23,702 - INFO - Network Policy ingress-on-service verification passed
2025-01-10 21:34:28,752 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:28,753 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:28,753 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:33,801 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:33,801 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:33,801 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:38,846 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:38,846 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:38,846 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:43,892 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:43,892 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:43,892 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:48,941 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:48,941 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:48,941 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:53,982 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:53,982 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:53,982 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:59,028 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:59,028 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:34:59,028 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:04,073 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:04,073 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:04,074 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:09,118 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:09,118 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:09,118 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:14,159 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:14,159 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:14,160 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:14,160 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-17027531': 0, 'ctest-pod-44635051': 0}
2025-01-10 21:35:14,213 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-17027531
2025-01-10 21:35:14,214 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:35:14,214 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-17027531
2025-01-10 21:35:14,261 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-44635051
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:35:14,261 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:35:14,261 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
ctest-pod-44635051
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:35:14,261 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-17027531': 1, 'ctest-pod-44635051': 1}
2025-01-10 21:35:19,306 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:19,306 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:19,306 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:24,354 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:24,354 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:24,354 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:29,398 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:29,398 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:29,398 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:34,444 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:34,444 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:34,444 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:39,493 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:39,494 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:39,494 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:44,544 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:44,544 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:44,544 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:49,588 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:49,588 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:49,588 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:54,629 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:54,629 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:54,629 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:59,670 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:59,671 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:35:59,671 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:04,715 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:04,715 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:04,715 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:04,715 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-17027531': 0, 'ctest-pod-44635051': 0}
2025-01-10 21:36:06,772 - DEBUG - [Pod ctest-pod-25929693] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes
64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.508 ms
64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.244 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.227/0.508 ms
2025-01-10 21:36:06,772 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-25929693 with expectation True passed
2025-01-10 21:36:08,818 - DEBUG - [Pod ctest-pod-97988983] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes
64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.728 ms
64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.243 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.631/1.728 ms
2025-01-10 21:36:08,818 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-97988983 with expectation True passed
2025-01-10 21:36:10,867 - DEBUG - [Pod ctest-pod-17567295] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes
64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.453 ms
64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.243 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.201/0.453 ms
2025-01-10 21:36:10,867 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-17567295 with expectation True passed
2025-01-10 21:36:10,907 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:36:10,907 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed
2025-01-10 21:36:10,907 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:36:10,907 - INFO - wget check of of http://10.47.255.248 from ctest-pod-25929693 passed
2025-01-10 21:36:10,955 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:36:10,956 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed
2025-01-10 21:36:10,956 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:36:10,956 - INFO - wget check of of http://10.47.255.247 from ctest-pod-25929693 passed
2025-01-10 21:36:16,000 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80)
wget: download timed out
2025-01-10 21:36:16,000 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80)
wget: download timed out
2025-01-10 21:36:16,000 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80)
wget: download timed out
2025-01-10 21:36:16,000 - INFO - wget check of of http://10.47.255.247 from ctest-pod-97988983 passed
2025-01-10 21:36:21,058 - DEBUG - [Pod ctest-pod-50395348] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80)
wget: download timed out
2025-01-10 21:36:21,058 - DEBUG - [Pod Pod ctest-pod-50395348] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.248 (10.47.255.248:80)
wget: download timed out
2025-01-10 21:36:21,058 - DEBUG - [Pod Pod ctest-pod-50395348] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80)
wget: download timed out
2025-01-10 21:36:21,058 - INFO - wget check of of http://10.47.255.248 from ctest-pod-50395348 passed
2025-01-10 21:36:21,069 - INFO - Updating Network Policy ingress-on-service
2025-01-10 21:36:26,122 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:26,122 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:26,122 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:31,167 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:31,168 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:31,168 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:36,211 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:36,212 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:36,212 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:41,276 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:41,276 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:41,276 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:46,328 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:46,328 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:46,328 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:51,369 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:51,369 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:51,369 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:56,415 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:56,415 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:36:56,415 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:01,464 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:01,464 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:01,464 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:06,511 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:06,511 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:06,511 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:11,566 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:11,566 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:11,566 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
wget: download timed out
2025-01-10 21:37:11,566 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-17027531': 0, 'ctest-pod-44635051': 0}
2025-01-10 21:37:11,617 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,617 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:37:11,617 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,663 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,663 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:37:11,663 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,706 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
ctest-pod-17027531
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:37:11,706 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:37:11,706 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
ctest-pod-17027531
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:37:11,707 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-17027531': 1, 'ctest-pod-44635051': 2}
2025-01-10 21:37:11,750 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,750 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:37:11,751 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,789 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,789 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:37:11,789 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-44635051
2025-01-10 21:37:11,831 - DEBUG - [Pod ctest-pod-17567295] Cmd: wget http://10.101.67.21:80/ -O - -T 5 -t 1 , Output: ctest-pod-17027531
Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:37:11,831 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd wget http://10.101.67.21:80/ -O - -T 5 -t 1 passed
2025-01-10 21:37:11,831 - DEBUG - [Pod Pod ctest-pod-17567295] Cmd output: ctest-pod-17027531
Connecting to 10.101.67.21:80 (10.101.67.21:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-10 21:37:11,831 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-17027531': 1, 'ctest-pod-44635051': 2}
2025-01-10 21:37:13,875 - DEBUG - [Pod ctest-pod-25929693] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes
64 bytes from 10.47.255.244: seq=0 ttl=63 time=1.138 ms
64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.244 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.429/1.138 ms
2025-01-10 21:37:13,876 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-25929693 with expectation True passed
2025-01-10 21:37:15,933 - DEBUG - [Pod ctest-pod-97988983] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes
64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.485 ms
64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.064 ms
64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.243 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.064/0.207/0.485 ms
2025-01-10 21:37:15,933 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-97988983 with expectation True passed
2025-01-10 21:37:17,975 - DEBUG - [Pod ctest-pod-17567295] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes
64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.051 ms
64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.243 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.401/1.051 ms
2025-01-10 21:37:17,975 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-17567295 with expectation True passed
2025-01-10 21:37:18,028 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:37:18,028 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed
2025-01-10 21:37:18,029 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:37:18,029 - INFO - wget check of of http://10.47.255.248 from ctest-pod-25929693 passed
2025-01-10 21:37:18,086 - DEBUG - [Pod ctest-pod-25929693] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:37:18,086 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed
2025-01-10 21:37:18,086 - DEBUG - [Pod Pod ctest-pod-25929693] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:37:18,086 - INFO - wget check of of http://10.47.255.247 from ctest-pod-25929693 passed
2025-01-10 21:37:23,138 - DEBUG - [Pod ctest-pod-97988983] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80)
wget: download timed out
2025-01-10 21:37:23,138 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80)
wget: download timed out
2025-01-10 21:37:23,138 - DEBUG - [Pod Pod ctest-pod-97988983] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80)
wget: download timed out
2025-01-10 21:37:23,138 - INFO - wget check of of http://10.47.255.247 from ctest-pod-97988983 passed
2025-01-10 21:37:23,180 - DEBUG - [Pod ctest-pod-50395348] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:37:23,180 - DEBUG - [Pod Pod ctest-pod-50395348] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed
2025-01-10 21:37:23,180 - DEBUG - [Pod Pod ctest-pod-50395348] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-10 21:37:23,180 - INFO - wget check of of http://10.47.255.248 from ctest-pod-50395348 passed
2025-01-10 21:37:23,180 - INFO - Deleting Network Policy : ingress-on-service
2025-01-10 21:37:23,181 - INFO - Deleting service : ctest-nginx-svc-48369095
2025-01-10 21:37:23,671 - DEBUG - No XMPP flaps were noticed during the test
2025-01-10 21:37:23,671 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-01-10 21:37:23,671 - INFO - --------------------------------------------------------------------------------
2025-01-10 21:37:23,677 - INFO - Deleting pod ctest-new-default-91825309:ctest-pod-17027531
2025-01-10 21:37:23,678 - INFO - Deleting pod ctest-new-default-91825309:ctest-pod-44635051
2025-01-10 21:37:23,678 - INFO - Deleting pod ctest-non-default-93868004:ctest-pod-64576843
2025-01-10 21:37:23,678 - INFO - Deleting pod ctest-non-default-93868004:ctest-pod-80103067
2025-01-10 21:37:23,679 - INFO - Deleting pod ctest-new-default-91825309:ctest-pod-97988983
2025-01-10 21:37:23,679 - INFO - Deleting pod ctest-new-default-91825309:ctest-pod-25929693
2025-01-10 21:37:23,679 - INFO - Deleting pod ctest-non-default-93868004:ctest-pod-17567295
2025-01-10 21:37:23,680 - INFO - Deleting pod ctest-non-default-93868004:ctest-pod-50395348
2025-01-10 21:37:23,880 - WARNING - Pod uuid f3149f1d-b0a9-4c1c-9fae-ec42e30334ec is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,881 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,882 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,886 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,887 - WARNING - Pod uuid bae43691-acc5-4f06-9868-0597d3d142a8 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,889 - WARNING - Pod uuid e8072118-4002-420e-9cfe-49e74f8d0bd0 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,889 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:23,890 - WARNING - Pod uuid 0361dfcb-d0d8-4076-a257-0190504e04df is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,933 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,934 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,934 - WARNING - Pod uuid f3149f1d-b0a9-4c1c-9fae-ec42e30334ec is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,939 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,969 - WARNING - Pod uuid 0361dfcb-d0d8-4076-a257-0190504e04df is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,969 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:28,970 - DEBUG - Pod bae43691-acc5-4f06-9868-0597d3d142a8 is not in agent 10.0.0.12 VM list
2025-01-10 21:37:28,971 - DEBUG - Pod e8072118-4002-420e-9cfe-49e74f8d0bd0 is not in agent 10.0.0.12 VM list
2025-01-10 21:37:28,989 - DEBUG - VMI 91094092-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:37:28,989 - INFO - Verified that pod ctest-pod-80103067 is removed in agent
2025-01-10 21:37:28,990 - DEBUG - VMI 8b6fe2c6-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:37:28,990 - INFO - Verified that pod ctest-pod-44635051 is removed in agent
2025-01-10 21:37:33,949 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:33,951 - DEBUG - Pod f3149f1d-b0a9-4c1c-9fae-ec42e30334ec is not in agent 10.0.0.12 VM list
2025-01-10 21:37:33,952 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:33,952 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:33,957 - DEBUG - VMI 88a885c0-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:37:33,957 - INFO - Verified that pod ctest-pod-17027531 is removed in agent
2025-01-10 21:37:33,980 - DEBUG - Pod 0361dfcb-d0d8-4076-a257-0190504e04df is not in agent 10.0.0.12 VM list
2025-01-10 21:37:33,983 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:33,988 - DEBUG - VMI 8edfed20-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:37:33,988 - INFO - Verified that pod ctest-pod-64576843 is removed in agent
2025-01-10 21:37:38,963 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:38,964 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:38,965 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:38,990 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:43,977 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:43,979 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:43,979 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:43,997 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:48,995 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:48,997 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:48,998 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:49,005 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:54,020 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:54,020 - WARNING - Pod uuid 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:54,021 - WARNING - Pod uuid 2d49c8fd-b027-490d-b297-1f75efe802b6 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:54,022 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:59,039 - DEBUG - Pod 3f11a0ba-bce6-46ef-834e-d0a3d1bdf864 is not in agent 10.0.0.12 VM list
2025-01-10 21:37:59,041 - WARNING - Pod uuid db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:59,043 - DEBUG - Pod 2d49c8fd-b027-490d-b297-1f75efe802b6 is not in agent 10.0.0.12 VM list
2025-01-10 21:37:59,045 - WARNING - Pod uuid a7886401-c793-4bfe-99c2-044105e6f56b is still seen in agent 10.0.0.12 VM list
2025-01-10 21:37:59,051 - DEBUG - VMI 955b5e46-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:37:59,051 - INFO - Verified that pod ctest-pod-25929693 is removed in agent
2025-01-10 21:37:59,052 - DEBUG - VMI 964c3514-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:37:59,052 - INFO - Verified that pod ctest-pod-17567295 is removed in agent
2025-01-10 21:38:04,049 - DEBUG - Pod db668401-da06-4cc0-b2dd-e8b9cd08b7e1 is not in agent 10.0.0.12 VM list
2025-01-10 21:38:04,057 - DEBUG - Pod a7886401-c793-4bfe-99c2-044105e6f56b is not in agent 10.0.0.12 VM list
2025-01-10 21:38:04,061 - DEBUG - VMI 933fac0c-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:38:04,061 - INFO - Verified that pod ctest-pod-97988983 is removed in agent
2025-01-10 21:38:04,065 - DEBUG - VMI 97e399a8-cf9a-11ef-90e5-fa163e497c56 is removed from agent 10.0.0.12
2025-01-10 21:38:04,065 - INFO - Verified that pod ctest-pod-50395348 is removed in agent
2025-01-10 21:38:04,066 - INFO - Deleting namespace ctest-non-default-93868004
2025-01-10 21:38:04,076 - DEBUG - Namespace ctest-non-default-93868004 still in k8s
2025-01-10 21:38:06,081 - DEBUG - Namespace ctest-non-default-93868004 still in k8s
2025-01-10 21:38:08,086 - DEBUG - Namespace ctest-non-default-93868004 still in k8s
2025-01-10 21:38:10,090 - DEBUG - Namespace ctest-non-default-93868004 is not in k8s
2025-01-10 21:38:10,090 - DEBUG - No need to check project deletion in contrail-api
2025-01-10 21:38:10,091 - INFO - Deleting namespace ctest-new-default-91825309
2025-01-10 21:38:10,101 - DEBUG - Namespace ctest-new-default-91825309 still in k8s
2025-01-10 21:38:12,106 - DEBUG - Namespace ctest-new-default-91825309 still in k8s
2025-01-10 21:38:14,113 - DEBUG - Namespace ctest-new-default-91825309 still in k8s
2025-01-10 21:38:16,118 - DEBUG - Namespace ctest-new-default-91825309 is not in k8s
2025-01-10 21:38:16,118 - DEBUG - No need to check project deletion in contrail-api