2024-09-18 01:57:42,301 - INFO - Using existing project ['default-domain', 'k8s-default'](504888da-aba9-49ed-afe3-c5090754b81c)
2024-09-18 01:57:42,320 - DEBUG - Namespace ctest-new-default-58629640 not present
2024-09-18 01:57:42,341 - INFO - Created namespace ctest-new-default-58629640
2024-09-18 01:57:45,351 - DEBUG - Namespace ctest-non-default-35413762 not present
2024-09-18 01:57:45,359 - INFO - Created namespace ctest-non-default-35413762
2024-09-18 01:57:48,377 - DEBUG - Pod ctest-pod-16867919 not present
2024-09-18 01:57:48,377 - INFO - Creating Pod ctest-pod-16867919
2024-09-18 01:57:48,404 - DEBUG - Pod : ctest-pod-16867919 UUID is e5ca1c89-d50a-4a06-97a2-f3d51be522f2
2024-09-18 01:57:48,407 - DEBUG - Pod ctest-pod-72616070 not present
2024-09-18 01:57:48,407 - INFO - Creating Pod ctest-pod-72616070
2024-09-18 01:57:48,473 - DEBUG - Pod : ctest-pod-72616070 UUID is 2599e14b-e47f-46ae-b1f5-99b42822ff80
2024-09-18 01:57:48,481 - DEBUG - Pod ctest-pod-23076827 not present
2024-09-18 01:57:48,481 - INFO - Creating Pod ctest-pod-23076827
2024-09-18 01:57:48,528 - DEBUG - Pod : ctest-pod-23076827 UUID is 190af8af-6a49-4dc3-89d7-fd82da259d8e
2024-09-18 01:57:48,530 - DEBUG - Pod ctest-pod-18527552 not present
2024-09-18 01:57:48,531 - INFO - Creating Pod ctest-pod-18527552
2024-09-18 01:57:48,556 - DEBUG - Pod : ctest-pod-18527552 UUID is ef964680-9d1b-40ba-9dbf-e18807634c06
2024-09-18 01:57:48,558 - DEBUG - Pod ctest-pod-54913181 not present
2024-09-18 01:57:48,558 - INFO - Creating Pod ctest-pod-54913181
2024-09-18 01:57:48,575 - DEBUG - Pod : ctest-pod-54913181 UUID is f2d93bcb-4cda-4130-b0e1-c07dbd4aad00
2024-09-18 01:57:48,577 - DEBUG - Pod ctest-pod-12635822 not present
2024-09-18 01:57:48,577 - INFO - Creating Pod ctest-pod-12635822
2024-09-18 01:57:48,591 - DEBUG - Pod : ctest-pod-12635822 UUID is 5a2045a0-f350-48a3-89b5-00348956c9da
2024-09-18 01:57:48,601 - DEBUG - Pod ctest-pod-45659550 not present
2024-09-18 01:57:48,602 - INFO - Creating Pod ctest-pod-45659550
2024-09-18 01:57:48,624 - DEBUG - Pod : ctest-pod-45659550 UUID is aa969640-6036-4e67-aeed-84fef6b7f14f
2024-09-18 01:57:48,631 - DEBUG - Pod ctest-pod-99989249 not present
2024-09-18 01:57:48,632 - INFO - Creating Pod ctest-pod-99989249
2024-09-18 01:57:48,655 - DEBUG - Pod : ctest-pod-99989249 UUID is fa2a45aa-f4ad-4b7d-8caa-48dffc136805
2024-09-18 01:57:48,835 - INFO - Project default-domain:k8s-ctest-new-default-58629640 for Namespace ctest-new-default-58629640 is seen in contrail-api
2024-09-18 01:57:48,835 - DEBUG - Project uuid in Contrail is 2109a24b-b4c0-4c15-a4ca-8b24242379ef
2024-09-18 01:57:48,982 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_NamespaceDatabaseList?namespace_uuid=3b4ea18a-c824-4c02-b305-96d104932a6a
2024-09-18 01:57:49,000 - INFO - Namespace ctest-new-default-58629640 with uuid 3b4ea18a-c824-4c02-b305-96d104932a6a found in kube manager
2024-09-18 01:57:49,000 - INFO - Namespace ctest-new-default-58629640 verification passed
2024-09-18 01:57:49,205 - INFO - Project default-domain:k8s-ctest-non-default-35413762 for Namespace ctest-non-default-35413762 is seen in contrail-api
2024-09-18 01:57:49,205 - DEBUG - Project uuid in Contrail is 028b6f4d-d32b-47e4-8995-28f244f25bea
2024-09-18 01:57:49,205 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_NamespaceDatabaseList?namespace_uuid=473819a2-c106-40e0-8ac6-35d18d189881
2024-09-18 01:57:49,211 - INFO - Namespace ctest-non-default-35413762 with uuid 473819a2-c106-40e0-8ac6-35d18d189881 found in kube manager
2024-09-18 01:57:49,211 - INFO - Namespace ctest-non-default-35413762 verification passed
2024-09-18 01:57:49,217 - DEBUG - Pod ctest-pod-16867919 not in running state.Currently in Pending
2024-09-18 01:57:54,224 - DEBUG - Pod ctest-pod-16867919 not in running state.Currently in Pending
2024-09-18 01:57:59,231 - DEBUG - Pod ctest-pod-16867919 not in running state.Currently in Pending
2024-09-18 01:58:04,244 - INFO - Pod ctest-pod-16867919 is in running state.Got IP 10.47.255.251
2024-09-18 01:58:04,305 - DEBUG - Pod ctest-pod-16867919 has vmi 68edc9c2-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:04,305 - INFO - Verified pod ctest-pod-16867919 in contrail-api
2024-09-18 01:58:04,320 - DEBUG - VMI 68edc9c2-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:04,320 - INFO - Verified Pod ctest-pod-16867919 in agent 10.0.0.40
2024-09-18 01:58:04,320 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=e5ca1c89-d50a-4a06-97a2-f3d51be522f2
2024-09-18 01:58:04,325 - INFO - Pod ctest-pod-16867919 with uuid e5ca1c89-d50a-4a06-97a2-f3d51be522f2 found in kube manager
2024-09-18 01:58:04,325 - INFO - Pod ctest-pod-16867919 verification passed
2024-09-18 01:58:04,329 - INFO - Pod ctest-pod-72616070 is in running state.Got IP 10.47.255.250
2024-09-18 01:58:04,347 - DEBUG - Pod ctest-pod-72616070 has vmi 69696f28-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:04,347 - INFO - Verified pod ctest-pod-72616070 in contrail-api
2024-09-18 01:58:04,360 - DEBUG - VMI 69696f28-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:04,361 - INFO - Verified Pod ctest-pod-72616070 in agent 10.0.0.40
2024-09-18 01:58:04,361 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=2599e14b-e47f-46ae-b1f5-99b42822ff80
2024-09-18 01:58:04,365 - INFO - Pod ctest-pod-72616070 with uuid 2599e14b-e47f-46ae-b1f5-99b42822ff80 found in kube manager
2024-09-18 01:58:04,365 - INFO - Pod ctest-pod-72616070 verification passed
2024-09-18 01:58:04,370 - INFO - Pod ctest-pod-23076827 is in running state.Got IP 10.47.255.249
2024-09-18 01:58:04,436 - DEBUG - Pod ctest-pod-23076827 has vmi 6a2c795a-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:04,436 - INFO - Verified pod ctest-pod-23076827 in contrail-api
2024-09-18 01:58:04,449 - DEBUG - VMI 6a2c795a-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:04,449 - INFO - Verified Pod ctest-pod-23076827 in agent 10.0.0.40
2024-09-18 01:58:04,450 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=190af8af-6a49-4dc3-89d7-fd82da259d8e
2024-09-18 01:58:04,454 - INFO - Pod ctest-pod-23076827 with uuid 190af8af-6a49-4dc3-89d7-fd82da259d8e found in kube manager
2024-09-18 01:58:04,455 - INFO - Pod ctest-pod-23076827 verification passed
2024-09-18 01:58:04,460 - INFO - Pod ctest-pod-18527552 is in running state.Got IP 10.47.255.248
2024-09-18 01:58:04,521 - DEBUG - Pod ctest-pod-18527552 has vmi 6ab25336-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:04,521 - INFO - Verified pod ctest-pod-18527552 in contrail-api
2024-09-18 01:58:04,534 - DEBUG - VMI 6ab25336-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:04,535 - INFO - Verified Pod ctest-pod-18527552 in agent 10.0.0.40
2024-09-18 01:58:04,535 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=ef964680-9d1b-40ba-9dbf-e18807634c06
2024-09-18 01:58:04,539 - INFO - Pod ctest-pod-18527552 with uuid ef964680-9d1b-40ba-9dbf-e18807634c06 found in kube manager
2024-09-18 01:58:04,539 - INFO - Pod ctest-pod-18527552 verification passed
2024-09-18 01:58:04,544 - DEBUG - Pod ctest-pod-54913181 not in running state.Currently in Pending
2024-09-18 01:58:09,551 - INFO - Pod ctest-pod-54913181 is in running state.Got IP 10.47.255.247
2024-09-18 01:58:09,569 - DEBUG - Pod ctest-pod-54913181 has vmi 6b395570-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:09,569 - INFO - Verified pod ctest-pod-54913181 in contrail-api
2024-09-18 01:58:09,582 - DEBUG - VMI 6b395570-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:09,582 - INFO - Verified Pod ctest-pod-54913181 in agent 10.0.0.40
2024-09-18 01:58:09,582 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=f2d93bcb-4cda-4130-b0e1-c07dbd4aad00
2024-09-18 01:58:09,587 - INFO - Pod ctest-pod-54913181 with uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 found in kube manager
2024-09-18 01:58:09,587 - INFO - Pod ctest-pod-54913181 verification passed
2024-09-18 01:58:09,592 - INFO - Pod ctest-pod-45659550 is in running state.Got IP 10.47.255.245
2024-09-18 01:58:09,653 - DEBUG - Pod ctest-pod-45659550 has vmi 6c46bad4-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:09,653 - INFO - Verified pod ctest-pod-45659550 in contrail-api
2024-09-18 01:58:09,667 - DEBUG - VMI 6c46bad4-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:09,667 - INFO - Verified Pod ctest-pod-45659550 in agent 10.0.0.40
2024-09-18 01:58:09,667 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=aa969640-6036-4e67-aeed-84fef6b7f14f
2024-09-18 01:58:09,672 - INFO - Pod ctest-pod-45659550 with uuid aa969640-6036-4e67-aeed-84fef6b7f14f found in kube manager
2024-09-18 01:58:09,672 - INFO - Pod ctest-pod-45659550 verification passed
2024-09-18 01:58:09,677 - INFO - Pod ctest-pod-12635822 is in running state.Got IP 10.47.255.246
2024-09-18 01:58:09,694 - DEBUG - Pod ctest-pod-12635822 has vmi 6bb852da-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:09,694 - INFO - Verified pod ctest-pod-12635822 in contrail-api
2024-09-18 01:58:09,708 - DEBUG - VMI 6bb852da-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:09,708 - INFO - Verified Pod ctest-pod-12635822 in agent 10.0.0.40
2024-09-18 01:58:09,708 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=5a2045a0-f350-48a3-89b5-00348956c9da
2024-09-18 01:58:09,713 - INFO - Pod ctest-pod-12635822 with uuid 5a2045a0-f350-48a3-89b5-00348956c9da found in kube manager
2024-09-18 01:58:09,713 - INFO - Pod ctest-pod-12635822 verification passed
2024-09-18 01:58:09,718 - INFO - Pod ctest-pod-99989249 is in running state.Got IP 10.47.255.244
2024-09-18 01:58:09,780 - DEBUG - Pod ctest-pod-99989249 has vmi 6cc6a276-7561-11ef-ace6-fa163eda9c33
2024-09-18 01:58:09,781 - INFO - Verified pod ctest-pod-99989249 in contrail-api
2024-09-18 01:58:09,797 - DEBUG - VMI 6cc6a276-7561-11ef-ace6-fa163eda9c33 is active in agent 10.0.0.40
2024-09-18 01:58:09,797 - INFO - Verified Pod ctest-pod-99989249 in agent 10.0.0.40
2024-09-18 01:58:09,797 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_VirtualMachineDatabaseList?x=fa2a45aa-f4ad-4b7d-8caa-48dffc136805
2024-09-18 01:58:09,801 - INFO - Pod ctest-pod-99989249 with uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 found in kube manager
2024-09-18 01:58:09,801 - INFO - Pod ctest-pod-99989249 verification passed
2024-09-18 01:58:09,802 - INFO - ================================================================================
2024-09-18 01:58:09,802 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-18 01:58:09,802 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-18 01:58:10,031 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.0.0.82': '0'}} with
2024-09-18 01:58:10,031 - INFO - Initial checks done. Running the testcase now
2024-09-18 01:58:10,031 - INFO -
2024-09-18 01:58:10,104 - DEBUG - [Pod ctest-pod-16867919] Cmd: echo ctest-pod-16867919 > /usr/share/nginx/html/index.html, Output:
2024-09-18 01:58:10,180 - DEBUG - [Pod ctest-pod-72616070] Cmd: echo ctest-pod-72616070 > /usr/share/nginx/html/index.html, Output:
2024-09-18 01:58:10,235 - DEBUG - [Pod ctest-pod-23076827] Cmd: echo ctest-pod-23076827 > /usr/share/nginx/html/index.html, Output:
2024-09-18 01:58:10,307 - DEBUG - [Pod ctest-pod-18527552] Cmd: echo ctest-pod-18527552 > /usr/share/nginx/html/index.html, Output:
2024-09-18 01:58:10,310 - DEBUG - Service ctest-nginx-svc-42797082 not present
2024-09-18 01:58:10,310 - INFO - Creating service ctest-nginx-svc-42797082
2024-09-18 01:58:10,321 - INFO - Created Service ctest-nginx-svc-42797082
2024-09-18 01:58:10,334 - WARNING - Service UUID e1d19311-dbb4-4cab-a633-696e495c35bf not yet found in contrail-api
2024-09-18 01:58:11,342 - INFO - Validated that Service ctest-nginx-svc-42797082 is seen in contrail-api
2024-09-18 01:58:11,342 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_LoadbalancerDatabaseList?x=e1d19311-dbb4-4cab-a633-696e495c35bf
2024-09-18 01:58:11,347 - INFO - Service ctest-nginx-svc-42797082 with uuid e1d19311-dbb4-4cab-a633-696e495c35bf found in kube manager
2024-09-18 01:58:11,347 - INFO - Service ctest-nginx-svc-42797082 verification passed
2024-09-18 01:58:12,424 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72616070
2024-09-18 01:58:12,424 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:58:12,425 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72616070
2024-09-18 01:58:12,492 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,492 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:58:12,492 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,553 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,553 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:58:12,553 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,553 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16867919': 1, 'ctest-pod-72616070': 2}
2024-09-18 01:58:12,611 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,611 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:58:12,611 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,671 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,671 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:58:12,671 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:58:12,723 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16867919
2024-09-18 01:58:12,723 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:58:12,723 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16867919
2024-09-18 01:58:12,723 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16867919': 1, 'ctest-pod-72616070': 2}
2024-09-18 01:58:12,727 - DEBUG - Network policy ingress-on-service not present
2024-09-18 01:58:12,727 - INFO - Creating Network Policy ingress-on-service
2024-09-18 01:58:12,743 - INFO - Network policy found in k8s
2024-09-18 01:58:12,743 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=338eea83-5437-48c7-b8eb-99408c0564bf
2024-09-18 01:58:12,749 - INFO - Network Policy ingress-on-service with uuid 338eea83-5437-48c7-b8eb-99408c0564bf found in kube manager
2024-09-18 01:58:12,795 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-18 01:58:12,795 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-18 01:58:12,796 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=338eea83-5437-48c7-b8eb-99408c0564bf
2024-09-18 01:58:12,826 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-18 01:58:14,826 - DEBUG - Requesting: http://10.0.0.82:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=338eea83-5437-48c7-b8eb-99408c0564bf
2024-09-18 01:58:14,856 - INFO - Network policy with name ingress-on-service found in agent
2024-09-18 01:58:14,856 - INFO - Network Policy ingress-on-service verification passed
2024-09-18 01:58:19,906 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:19,906 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:19,906 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:24,973 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:24,973 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:24,973 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:30,018 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:30,018 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:30,018 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:35,085 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:35,085 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:35,085 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:40,138 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:40,138 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:40,138 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:45,213 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:45,213 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:45,213 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:50,269 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:50,269 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:50,269 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:55,321 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:55,321 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:58:55,321 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:00,387 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:00,387 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:00,387 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:05,457 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:05,458 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:05,458 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:05,458 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16867919': 0, 'ctest-pod-72616070': 0}
2024-09-18 01:59:05,520 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,520 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:59:05,520 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,575 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,576 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:59:05,576 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,640 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,640 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:59:05,640 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,703 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,703 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:59:05,703 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,775 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,776 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 01:59:05,776 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 01:59:05,776 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16867919': 1, 'ctest-pod-72616070': 4}
2024-09-18 01:59:10,839 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:10,840 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:10,840 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:15,905 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:15,905 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:15,905 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:20,982 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:20,982 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:20,982 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:26,041 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:26,042 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:26,042 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:31,102 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:31,102 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:31,102 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:36,161 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:36,161 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:36,161 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:41,233 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:41,233 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:41,233 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:46,302 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:46,302 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:46,302 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:51,362 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:51,362 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:51,362 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:56,425 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:56,425 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:56,425 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 01:59:56,425 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16867919': 0, 'ctest-pod-72616070': 0}
2024-09-18 01:59:58,477 - DEBUG - [Pod ctest-pod-12635822] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.833 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.106 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.094/0.344/0.833 ms
2024-09-18 01:59:58,477 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12635822 with expectation True passed
2024-09-18 02:00:00,551 - DEBUG - [Pod ctest-pod-54913181] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.812 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/0.336/0.812 ms
2024-09-18 02:00:00,551 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-54913181 with expectation True passed
2024-09-18 02:00:02,637 - DEBUG - [Pod ctest-pod-45659550] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.773 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.315/0.773 ms
2024-09-18 02:00:02,637 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-45659550 with expectation True passed
2024-09-18 02:00:02,717 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:00:02,717 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:00:02,717 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:00:02,717 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12635822 passed
2024-09-18 02:00:02,800 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:00:02,800 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:00:02,800 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:00:02,800 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12635822 passed
2024-09-18 02:00:07,869 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:00:07,870 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:00:07,870 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:00:07,870 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54913181 passed
2024-09-18 02:00:12,931 - DEBUG - [Pod ctest-pod-99989249] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-18 02:00:12,931 - DEBUG - [Pod Pod ctest-pod-99989249] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-18 02:00:12,931 - DEBUG - [Pod Pod ctest-pod-99989249] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-18 02:00:12,931 - INFO - wget check of of http://10.47.255.251 from ctest-pod-99989249 passed
2024-09-18 02:00:12,939 - INFO - Updating Network Policy ingress-on-service
2024-09-18 02:00:18,011 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:18,011 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:18,011 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:23,080 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:23,081 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:23,081 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:28,145 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:28,146 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:28,146 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:33,218 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:33,218 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:33,218 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:38,374 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:38,374 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:38,374 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:43,430 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:43,430 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:43,430 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:48,483 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:48,483 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:48,483 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:53,553 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:53,553 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:53,553 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:58,607 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:58,607 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:00:58,607 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:01:03,675 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:01:03,675 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:01:03,675 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
wget: download timed out
2024-09-18 02:01:03,675 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16867919': 0, 'ctest-pod-72616070': 0}
2024-09-18 02:01:03,740 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,740 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:03,740 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,808 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,808 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:03,808 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-16867919
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,863 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,863 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:03,863 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,863 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16867919': 2, 'ctest-pod-72616070': 1}
2024-09-18 02:01:03,939 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,939 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:03,939 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,981 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:03,981 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:03,981 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:04,075 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:04,076 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:04,076 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:04,152 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:04,153 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:04,153 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: ctest-pod-72616070
Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:01:04,214 - DEBUG - [Pod ctest-pod-45659550] Cmd: wget http://10.96.201.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16867919
2024-09-18 02:01:04,214 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd wget http://10.96.201.252:80/ -O - -T 5 -t 1 passed
2024-09-18 02:01:04,214 - DEBUG - [Pod Pod ctest-pod-45659550] Cmd output: Connecting to 10.96.201.252:80 (10.96.201.252:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16867919
2024-09-18 02:01:04,214 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16867919': 1, 'ctest-pod-72616070': 4}
2024-09-18 02:01:06,282 - DEBUG - [Pod ctest-pod-12635822] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.835 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.328/0.835 ms
2024-09-18 02:01:06,282 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12635822 with expectation True passed
2024-09-18 02:01:08,340 - DEBUG - [Pod ctest-pod-54913181] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.592 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.249/0.592 ms
2024-09-18 02:01:08,340 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-54913181 with expectation True passed
2024-09-18 02:01:10,401 - DEBUG - [Pod ctest-pod-45659550] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.459 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.205/0.459 ms
2024-09-18 02:01:10,402 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-45659550 with expectation True passed
2024-09-18 02:01:10,463 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:01:10,463 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:01:10,463 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:01:10,463 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12635822 passed
2024-09-18 02:01:10,534 - DEBUG - [Pod ctest-pod-12635822] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:01:10,535 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:01:10,535 - DEBUG - [Pod Pod ctest-pod-12635822] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:01:10,535 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12635822 passed
2024-09-18 02:01:15,593 - DEBUG - [Pod ctest-pod-54913181] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:01:15,593 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:01:15,593 - DEBUG - [Pod Pod ctest-pod-54913181] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:01:15,593 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54913181 passed
2024-09-18 02:01:15,648 - DEBUG - [Pod ctest-pod-99989249] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:01:15,649 - DEBUG - [Pod Pod ctest-pod-99989249] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:01:15,649 - DEBUG - [Pod Pod ctest-pod-99989249] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:01:15,649 - INFO - wget check of of http://10.47.255.251 from ctest-pod-99989249 passed
2024-09-18 02:01:15,649 - INFO - Deleting Network Policy : ingress-on-service
2024-09-18 02:01:15,650 - INFO - Deleting service : ctest-nginx-svc-42797082
2024-09-18 02:01:15,888 - DEBUG - No XMPP flaps were noticed during the test
2024-09-18 02:01:15,888 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-09-18 02:01:15,888 - INFO - --------------------------------------------------------------------------------
2024-09-18 02:01:15,894 - INFO - Deleting pod ctest-new-default-58629640:ctest-pod-16867919
2024-09-18 02:01:15,895 - INFO - Deleting pod ctest-new-default-58629640:ctest-pod-72616070
2024-09-18 02:01:15,896 - INFO - Deleting pod ctest-non-default-35413762:ctest-pod-23076827
2024-09-18 02:01:15,896 - INFO - Deleting pod ctest-non-default-35413762:ctest-pod-18527552
2024-09-18 02:01:15,897 - INFO - Deleting pod ctest-new-default-58629640:ctest-pod-54913181
2024-09-18 02:01:15,897 - INFO - Deleting pod ctest-new-default-58629640:ctest-pod-12635822
2024-09-18 02:01:15,898 - INFO - Deleting pod ctest-non-default-35413762:ctest-pod-45659550
2024-09-18 02:01:15,898 - INFO - Deleting pod ctest-non-default-35413762:ctest-pod-99989249
2024-09-18 02:01:15,994 - WARNING - Pod uuid ef964680-9d1b-40ba-9dbf-e18807634c06 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,057 - WARNING - Pod uuid 190af8af-6a49-4dc3-89d7-fd82da259d8e is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,060 - WARNING - Pod uuid e5ca1c89-d50a-4a06-97a2-f3d51be522f2 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,173 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,177 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,178 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,179 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:16,180 - WARNING - Pod uuid 2599e14b-e47f-46ae-b1f5-99b42822ff80 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:21,010 - DEBUG - Pod ef964680-9d1b-40ba-9dbf-e18807634c06 is not in agent 10.0.0.40 VM list
2024-09-18 02:01:21,018 - DEBUG - VMI 6ab25336-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:21,018 - INFO - Verified that pod ctest-pod-18527552 is removed in agent
2024-09-18 02:01:21,072 - DEBUG - Pod e5ca1c89-d50a-4a06-97a2-f3d51be522f2 is not in agent 10.0.0.40 VM list
2024-09-18 02:01:21,075 - DEBUG - Pod 190af8af-6a49-4dc3-89d7-fd82da259d8e is not in agent 10.0.0.40 VM list
2024-09-18 02:01:21,085 - DEBUG - VMI 68edc9c2-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:21,086 - INFO - Verified that pod ctest-pod-16867919 is removed in agent
2024-09-18 02:01:21,086 - DEBUG - VMI 6a2c795a-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:21,086 - INFO - Verified that pod ctest-pod-23076827 is removed in agent
2024-09-18 02:01:21,186 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:21,203 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:21,205 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:21,206 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:21,206 - DEBUG - Pod 2599e14b-e47f-46ae-b1f5-99b42822ff80 is not in agent 10.0.0.40 VM list
2024-09-18 02:01:21,213 - DEBUG - VMI 69696f28-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:21,213 - INFO - Verified that pod ctest-pod-72616070 is removed in agent
2024-09-18 02:01:26,195 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:26,219 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:26,221 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:26,221 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:31,204 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:31,238 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:31,239 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:31,240 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:36,212 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:36,253 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:36,254 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:36,255 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:41,219 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:41,270 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:41,272 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:41,273 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:46,228 - WARNING - Pod uuid f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:46,289 - WARNING - Pod uuid 5a2045a0-f350-48a3-89b5-00348956c9da is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:46,291 - WARNING - Pod uuid fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:46,292 - WARNING - Pod uuid aa969640-6036-4e67-aeed-84fef6b7f14f is still seen in agent 10.0.0.40 VM list
2024-09-18 02:01:51,236 - DEBUG - Pod f2d93bcb-4cda-4130-b0e1-c07dbd4aad00 is not in agent 10.0.0.40 VM list
2024-09-18 02:01:51,242 - DEBUG - VMI 6b395570-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:51,242 - INFO - Verified that pod ctest-pod-54913181 is removed in agent
2024-09-18 02:01:51,304 - DEBUG - Pod 5a2045a0-f350-48a3-89b5-00348956c9da is not in agent 10.0.0.40 VM list
2024-09-18 02:01:51,307 - DEBUG - Pod fa2a45aa-f4ad-4b7d-8caa-48dffc136805 is not in agent 10.0.0.40 VM list
2024-09-18 02:01:51,308 - DEBUG - Pod aa969640-6036-4e67-aeed-84fef6b7f14f is not in agent 10.0.0.40 VM list
2024-09-18 02:01:51,322 - DEBUG - VMI 6bb852da-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:51,322 - INFO - Verified that pod ctest-pod-12635822 is removed in agent
2024-09-18 02:01:51,324 - DEBUG - VMI 6cc6a276-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:51,324 - INFO - Verified that pod ctest-pod-99989249 is removed in agent
2024-09-18 02:01:51,324 - DEBUG - VMI 6c46bad4-7561-11ef-ace6-fa163eda9c33 is removed from agent 10.0.0.40
2024-09-18 02:01:51,324 - INFO - Verified that pod ctest-pod-45659550 is removed in agent
2024-09-18 02:01:51,324 - INFO - Deleting namespace ctest-non-default-35413762
2024-09-18 02:01:51,335 - DEBUG - Namespace ctest-non-default-35413762 still in k8s
2024-09-18 02:01:53,344 - DEBUG - Namespace ctest-non-default-35413762 still in k8s
2024-09-18 02:01:55,349 - DEBUG - Namespace ctest-non-default-35413762 still in k8s
2024-09-18 02:01:57,354 - DEBUG - Namespace ctest-non-default-35413762 is not in k8s
2024-09-18 02:01:57,354 - DEBUG - No need to check project deletion in contrail-api
2024-09-18 02:01:57,355 - INFO - Deleting namespace ctest-new-default-58629640
2024-09-18 02:01:57,376 - DEBUG - Namespace ctest-new-default-58629640 still in k8s
2024-09-18 02:01:59,380 - DEBUG - Namespace ctest-new-default-58629640 still in k8s
2024-09-18 02:02:01,386 - DEBUG - Namespace ctest-new-default-58629640 still in k8s
2024-09-18 02:02:03,389 - DEBUG - Namespace ctest-new-default-58629640 is not in k8s
2024-09-18 02:02:03,390 - DEBUG - No need to check project deletion in contrail-api