2024-08-20 22:20:10,517 - INFO - Using existing project ['default-domain', 'k8s-default'](8d14d093-8d45-4ded-8228-d5c7f4b7dd1d)
2024-08-20 22:20:10,544 - DEBUG - Namespace ctest-new-default-74371008 not present
2024-08-20 22:20:10,558 - INFO - Created namespace ctest-new-default-74371008
2024-08-20 22:20:13,563 - DEBUG - Namespace ctest-non-default-47839323 not present
2024-08-20 22:20:13,571 - INFO - Created namespace ctest-non-default-47839323
2024-08-20 22:20:16,592 - DEBUG - Pod ctest-pod-24260323 not present
2024-08-20 22:20:16,593 - INFO - Creating Pod ctest-pod-24260323
2024-08-20 22:20:16,640 - DEBUG - Pod : ctest-pod-24260323 UUID is 220ad7cd-0f47-40ea-bae9-c2ab50abefe9
2024-08-20 22:20:16,660 - DEBUG - Pod ctest-pod-46068815 not present
2024-08-20 22:20:16,661 - INFO - Creating Pod ctest-pod-46068815
2024-08-20 22:20:16,685 - DEBUG - Pod : ctest-pod-46068815 UUID is 529030b7-e659-4786-940f-9965c059476c
2024-08-20 22:20:16,702 - DEBUG - Pod ctest-pod-71771933 not present
2024-08-20 22:20:16,703 - INFO - Creating Pod ctest-pod-71771933
2024-08-20 22:20:16,745 - DEBUG - Pod : ctest-pod-71771933 UUID is 2878063b-0533-4d5c-9524-79f1c5f9d2f6
2024-08-20 22:20:16,748 - DEBUG - Pod ctest-pod-36715579 not present
2024-08-20 22:20:16,748 - INFO - Creating Pod ctest-pod-36715579
2024-08-20 22:20:16,776 - DEBUG - Pod : ctest-pod-36715579 UUID is fcd4a917-3258-40e3-b0a6-837688463133
2024-08-20 22:20:16,778 - DEBUG - Pod ctest-pod-69186009 not present
2024-08-20 22:20:16,778 - INFO - Creating Pod ctest-pod-69186009
2024-08-20 22:20:16,802 - DEBUG - Pod : ctest-pod-69186009 UUID is 42a17c4e-d28b-4d14-8469-91083b03ad54
2024-08-20 22:20:16,805 - DEBUG - Pod ctest-pod-32506708 not present
2024-08-20 22:20:16,805 - INFO - Creating Pod ctest-pod-32506708
2024-08-20 22:20:16,841 - DEBUG - Pod : ctest-pod-32506708 UUID is 66f766b3-21db-41a2-b3f1-4e45745e3a93
2024-08-20 22:20:16,844 - DEBUG - Pod ctest-pod-67897355 not present
2024-08-20 22:20:16,845 - INFO - Creating Pod ctest-pod-67897355
2024-08-20 22:20:16,867 - DEBUG - Pod : ctest-pod-67897355 UUID is fd42a089-a3f3-4b98-94cc-4f6a8fe638d8
2024-08-20 22:20:16,869 - DEBUG - Pod ctest-pod-69198566 not present
2024-08-20 22:20:16,869 - INFO - Creating Pod ctest-pod-69198566
2024-08-20 22:20:16,891 - DEBUG - Pod : ctest-pod-69198566 UUID is 9479f3d2-b7da-4fa3-9922-3167699a6d3d
2024-08-20 22:20:17,095 - INFO - Project default-domain:k8s-ctest-new-default-74371008 for Namespace ctest-new-default-74371008 is seen in contrail-api
2024-08-20 22:20:17,095 - DEBUG - Project uuid in Contrail is b1110037-64ca-41de-ab12-6b433661418e
2024-08-20 22:20:17,256 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=f7c97421-7497-41de-b7b9-e2fc5bc0e48c
2024-08-20 22:20:17,283 - INFO - Namespace ctest-new-default-74371008 with uuid f7c97421-7497-41de-b7b9-e2fc5bc0e48c found in kube manager
2024-08-20 22:20:17,284 - INFO - Namespace ctest-new-default-74371008 verification passed
2024-08-20 22:20:17,487 - INFO - Project default-domain:k8s-ctest-non-default-47839323 for Namespace ctest-non-default-47839323 is seen in contrail-api
2024-08-20 22:20:17,487 - DEBUG - Project uuid in Contrail is 48eed2f7-60a3-48e2-b1ea-028ad7211de2
2024-08-20 22:20:17,487 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=36b033a6-7c85-413f-a72f-07784389a9d7
2024-08-20 22:20:17,494 - INFO - Namespace ctest-non-default-47839323 with uuid 36b033a6-7c85-413f-a72f-07784389a9d7 found in kube manager
2024-08-20 22:20:17,494 - INFO - Namespace ctest-non-default-47839323 verification passed
2024-08-20 22:20:17,502 - DEBUG - Pod ctest-pod-24260323 not in running state.Currently in Pending
2024-08-20 22:20:22,509 - DEBUG - Pod ctest-pod-24260323 not in running state.Currently in Pending
2024-08-20 22:20:27,516 - DEBUG - Pod ctest-pod-24260323 not in running state.Currently in Pending
2024-08-20 22:20:32,523 - INFO - Pod ctest-pod-24260323 is in running state.Got IP 10.47.255.251
2024-08-20 22:20:32,579 - DEBUG - Pod ctest-pod-24260323 has vmi 61b2bdb4-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:32,580 - INFO - Verified pod ctest-pod-24260323 in contrail-api
2024-08-20 22:20:32,597 - DEBUG - VMI 61b2bdb4-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:32,597 - INFO - Verified Pod ctest-pod-24260323 in agent 10.0.0.23
2024-08-20 22:20:32,597 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=220ad7cd-0f47-40ea-bae9-c2ab50abefe9
2024-08-20 22:20:32,604 - INFO - Pod ctest-pod-24260323 with uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 found in kube manager
2024-08-20 22:20:32,604 - INFO - Pod ctest-pod-24260323 verification passed
2024-08-20 22:20:32,610 - INFO - Pod ctest-pod-46068815 is in running state.Got IP 10.47.255.250
2024-08-20 22:20:32,622 - DEBUG - Pod ctest-pod-46068815 has vmi 62428a52-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:32,622 - INFO - Verified pod ctest-pod-46068815 in contrail-api
2024-08-20 22:20:33,004 - DEBUG - VMI 62428a52-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:33,004 - INFO - Verified Pod ctest-pod-46068815 in agent 10.0.0.23
2024-08-20 22:20:33,004 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=529030b7-e659-4786-940f-9965c059476c
2024-08-20 22:20:33,010 - INFO - Pod ctest-pod-46068815 with uuid 529030b7-e659-4786-940f-9965c059476c found in kube manager
2024-08-20 22:20:33,010 - INFO - Pod ctest-pod-46068815 verification passed
2024-08-20 22:20:33,019 - INFO - Pod ctest-pod-71771933 is in running state.Got IP 10.47.255.249
2024-08-20 22:20:33,071 - DEBUG - Pod ctest-pod-71771933 has vmi 62e977f4-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:33,072 - INFO - Verified pod ctest-pod-71771933 in contrail-api
2024-08-20 22:20:33,087 - DEBUG - VMI 62e977f4-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:33,087 - INFO - Verified Pod ctest-pod-71771933 in agent 10.0.0.23
2024-08-20 22:20:33,087 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2878063b-0533-4d5c-9524-79f1c5f9d2f6
2024-08-20 22:20:33,094 - INFO - Pod ctest-pod-71771933 with uuid 2878063b-0533-4d5c-9524-79f1c5f9d2f6 found in kube manager
2024-08-20 22:20:33,095 - INFO - Pod ctest-pod-71771933 verification passed
2024-08-20 22:20:33,100 - INFO - Pod ctest-pod-36715579 is in running state.Got IP 10.47.255.248
2024-08-20 22:20:33,113 - DEBUG - Pod ctest-pod-36715579 has vmi 636d38c8-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:33,113 - INFO - Verified pod ctest-pod-36715579 in contrail-api
2024-08-20 22:20:33,129 - DEBUG - VMI 636d38c8-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:33,130 - INFO - Verified Pod ctest-pod-36715579 in agent 10.0.0.23
2024-08-20 22:20:33,130 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=fcd4a917-3258-40e3-b0a6-837688463133
2024-08-20 22:20:33,135 - INFO - Pod ctest-pod-36715579 with uuid fcd4a917-3258-40e3-b0a6-837688463133 found in kube manager
2024-08-20 22:20:33,135 - INFO - Pod ctest-pod-36715579 verification passed
2024-08-20 22:20:33,141 - INFO - Pod ctest-pod-69186009 is in running state.Got IP 10.47.255.247
2024-08-20 22:20:33,203 - DEBUG - Pod ctest-pod-69186009 has vmi 63fdf9b2-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:33,203 - INFO - Verified pod ctest-pod-69186009 in contrail-api
2024-08-20 22:20:33,219 - DEBUG - VMI 63fdf9b2-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:33,219 - INFO - Verified Pod ctest-pod-69186009 in agent 10.0.0.23
2024-08-20 22:20:33,219 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=42a17c4e-d28b-4d14-8469-91083b03ad54
2024-08-20 22:20:33,224 - INFO - Pod ctest-pod-69186009 with uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 found in kube manager
2024-08-20 22:20:33,224 - INFO - Pod ctest-pod-69186009 verification passed
2024-08-20 22:20:33,229 - DEBUG - Pod ctest-pod-67897355 not in running state.Currently in Pending
2024-08-20 22:20:38,238 - INFO - Pod ctest-pod-67897355 is in running state.Got IP 10.47.255.245
2024-08-20 22:20:38,251 - DEBUG - Pod ctest-pod-67897355 has vmi 64e87cbc-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:38,252 - INFO - Verified pod ctest-pod-67897355 in contrail-api
2024-08-20 22:20:38,265 - DEBUG - VMI 64e87cbc-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:38,266 - INFO - Verified Pod ctest-pod-67897355 in agent 10.0.0.23
2024-08-20 22:20:38,266 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=fd42a089-a3f3-4b98-94cc-4f6a8fe638d8
2024-08-20 22:20:38,271 - INFO - Pod ctest-pod-67897355 with uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 found in kube manager
2024-08-20 22:20:38,271 - INFO - Pod ctest-pod-67897355 verification passed
2024-08-20 22:20:38,277 - INFO - Pod ctest-pod-32506708 is in running state.Got IP 10.47.255.246
2024-08-20 22:20:38,335 - DEBUG - Pod ctest-pod-32506708 has vmi 6472bc2a-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:38,335 - INFO - Verified pod ctest-pod-32506708 in contrail-api
2024-08-20 22:20:38,350 - DEBUG - VMI 6472bc2a-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:38,350 - INFO - Verified Pod ctest-pod-32506708 in agent 10.0.0.23
2024-08-20 22:20:38,350 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=66f766b3-21db-41a2-b3f1-4e45745e3a93
2024-08-20 22:20:38,362 - INFO - Pod ctest-pod-32506708 with uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 found in kube manager
2024-08-20 22:20:38,362 - INFO - Pod ctest-pod-32506708 verification passed
2024-08-20 22:20:38,368 - INFO - Pod ctest-pod-69198566 is in running state.Got IP 10.47.255.244
2024-08-20 22:20:38,381 - DEBUG - Pod ctest-pod-69198566 has vmi 655e0982-5f42-11ef-b4a7-fa163e9eee0a
2024-08-20 22:20:38,381 - INFO - Verified pod ctest-pod-69198566 in contrail-api
2024-08-20 22:20:38,397 - DEBUG - VMI 655e0982-5f42-11ef-b4a7-fa163e9eee0a is active in agent 10.0.0.23
2024-08-20 22:20:38,397 - INFO - Verified Pod ctest-pod-69198566 in agent 10.0.0.23
2024-08-20 22:20:38,397 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9479f3d2-b7da-4fa3-9922-3167699a6d3d
2024-08-20 22:20:38,403 - INFO - Pod ctest-pod-69198566 with uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d found in kube manager
2024-08-20 22:20:38,403 - INFO - Pod ctest-pod-69198566 verification passed
2024-08-20 22:20:38,404 - INFO - ================================================================================
2024-08-20 22:20:38,404 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-08-20 22:20:38,404 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-08-20 22:20:38,656 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.22': '0'}} with
2024-08-20 22:20:38,656 - INFO - Initial checks done. Running the testcase now
2024-08-20 22:20:38,656 - INFO -
2024-08-20 22:20:38,715 - DEBUG - [Pod ctest-pod-24260323] Cmd: echo ctest-pod-24260323 > /usr/share/nginx/html/index.html, Output:
2024-08-20 22:20:38,776 - DEBUG - [Pod ctest-pod-46068815] Cmd: echo ctest-pod-46068815 > /usr/share/nginx/html/index.html, Output:
2024-08-20 22:20:38,833 - DEBUG - [Pod ctest-pod-71771933] Cmd: echo ctest-pod-71771933 > /usr/share/nginx/html/index.html, Output:
2024-08-20 22:20:38,892 - DEBUG - [Pod ctest-pod-36715579] Cmd: echo ctest-pod-36715579 > /usr/share/nginx/html/index.html, Output:
2024-08-20 22:20:38,895 - DEBUG - Service ctest-nginx-svc-25432716 not present
2024-08-20 22:20:38,896 - INFO - Creating service ctest-nginx-svc-25432716
2024-08-20 22:20:38,932 - INFO - Created Service ctest-nginx-svc-25432716
2024-08-20 22:20:38,943 - WARNING - Service UUID fcc82996-2c84-43f0-93fe-e73e9240cb1c not yet found in contrail-api
2024-08-20 22:20:39,949 - INFO - Validated that Service ctest-nginx-svc-25432716 is seen in contrail-api
2024-08-20 22:20:39,949 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=fcc82996-2c84-43f0-93fe-e73e9240cb1c
2024-08-20 22:20:39,955 - INFO - Service ctest-nginx-svc-25432716 with uuid fcc82996-2c84-43f0-93fe-e73e9240cb1c found in kube manager
2024-08-20 22:20:39,955 - INFO - Service ctest-nginx-svc-25432716 verification passed
2024-08-20 22:20:41,032 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24260323
2024-08-20 22:20:41,032 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:20:41,032 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24260323
2024-08-20 22:20:41,109 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46068815
2024-08-20 22:20:41,109 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:20:41,109 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46068815
2024-08-20 22:20:41,109 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24260323': 1, 'ctest-pod-46068815': 1}
2024-08-20 22:20:41,182 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46068815
2024-08-20 22:20:41,182 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:20:41,182 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46068815
2024-08-20 22:20:41,259 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:20:41,259 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:20:41,259 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:20:41,259 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24260323': 1, 'ctest-pod-46068815': 1}
2024-08-20 22:20:41,265 - DEBUG - Network policy ingress-on-service not present
2024-08-20 22:20:41,265 - INFO - Creating Network Policy ingress-on-service
2024-08-20 22:20:41,282 - INFO - Network policy found in k8s
2024-08-20 22:20:41,282 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f1af4917-bdcd-4b5e-8d21-2efafec277a3
2024-08-20 22:20:41,290 - INFO - Network Policy ingress-on-service with uuid f1af4917-bdcd-4b5e-8d21-2efafec277a3 found in kube manager
2024-08-20 22:20:41,610 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-08-20 22:20:41,611 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-08-20 22:20:41,611 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f1af4917-bdcd-4b5e-8d21-2efafec277a3
2024-08-20 22:20:41,643 - WARNING - Network policy with name ingress-on-service not found in agent
2024-08-20 22:20:43,644 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f1af4917-bdcd-4b5e-8d21-2efafec277a3
2024-08-20 22:20:43,685 - INFO - Network policy with name ingress-on-service found in agent
2024-08-20 22:20:43,685 - INFO - Network Policy ingress-on-service verification passed
2024-08-20 22:20:48,762 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:48,762 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:48,762 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:53,830 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:53,830 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:53,830 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:58,918 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:58,918 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:20:58,918 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:04,009 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:04,009 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:04,009 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:06,761 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-08-20 22:21:16,839 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:16,839 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:16,839 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:21,897 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:21,897 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:21,897 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:26,981 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:26,981 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:26,981 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:32,048 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:32,049 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:32,049 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:37,147 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:37,147 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:37,147 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:42,226 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:42,226 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:42,226 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:42,226 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24260323': 0, 'ctest-pod-46068815': 0}
2024-08-20 22:21:42,298 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:21:42,299 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:21:42,299 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:21:42,363 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-46068815
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:21:42,364 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:21:42,364 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: ctest-pod-46068815
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:21:42,364 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24260323': 1, 'ctest-pod-46068815': 1}
2024-08-20 22:21:47,435 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:47,436 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:47,436 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:52,507 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:52,508 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:52,508 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:57,605 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:57,605 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:21:57,605 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:02,681 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:02,682 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:02,682 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:07,738 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:07,738 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:07,738 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:12,801 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:12,801 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:12,801 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:18,062 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:18,062 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:18,062 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:23,133 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:23,133 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:23,133 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:28,193 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:28,193 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:28,194 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:33,260 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:33,260 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:33,261 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:33,261 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24260323': 0, 'ctest-pod-46068815': 0}
2024-08-20 22:22:35,324 - DEBUG - [Pod ctest-pod-32506708] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.475 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.100/0.228/0.475 ms
2024-08-20 22:22:35,324 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-32506708 with expectation True passed
2024-08-20 22:22:37,376 - DEBUG - [Pod ctest-pod-69186009] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.828 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.333/0.828 ms
2024-08-20 22:22:37,376 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69186009 with expectation True passed
2024-08-20 22:22:39,462 - DEBUG - [Pod ctest-pod-67897355] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.907 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.366/0.907 ms
2024-08-20 22:22:39,462 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67897355 with expectation True passed
2024-08-20 22:22:39,536 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:22:39,536 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-20 22:22:39,536 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:22:39,536 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32506708 passed
2024-08-20 22:22:39,609 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:22:39,609 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-20 22:22:39,609 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:22:39,609 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32506708 passed
2024-08-20 22:22:44,681 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 22:22:44,681 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 22:22:44,681 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 22:22:44,681 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69186009 passed
2024-08-20 22:22:49,747 - DEBUG - [Pod ctest-pod-69198566] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-20 22:22:49,747 - DEBUG - [Pod Pod ctest-pod-69198566] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-20 22:22:49,747 - DEBUG - [Pod Pod ctest-pod-69198566] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-20 22:22:49,747 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69198566 passed
2024-08-20 22:22:49,766 - INFO - Updating Network Policy ingress-on-service
2024-08-20 22:22:54,856 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:54,856 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:22:54,856 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:00,535 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:00,535 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:00,535 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:05,621 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:05,622 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:05,622 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:10,672 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:10,672 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:10,672 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:15,728 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:15,728 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:15,729 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:20,801 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:20,801 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:20,801 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:25,859 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:25,859 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:25,859 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:30,918 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:30,918 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:30,918 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:35,979 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:35,979 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:35,979 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:41,052 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:41,053 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:41,053 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.111.226.177:80 (10.111.226.177:80)
wget: download timed out
2024-08-20 22:23:41,053 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24260323': 0, 'ctest-pod-46068815': 0}
2024-08-20 22:23:41,112 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,112 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:23:41,112 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,183 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-46068815
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,183 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:23:41,183 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: ctest-pod-46068815
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,183 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24260323': 1, 'ctest-pod-46068815': 1}
2024-08-20 22:23:41,264 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,264 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:23:41,264 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: ctest-pod-24260323
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,343 - DEBUG - [Pod ctest-pod-67897355] Cmd: wget http://10.111.226.177:80/ -O - -T 5 -t 1 , Output: ctest-pod-46068815
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,343 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd wget http://10.111.226.177:80/ -O - -T 5 -t 1 passed
2024-08-20 22:23:41,343 - DEBUG - [Pod Pod ctest-pod-67897355] Cmd output: ctest-pod-46068815
Connecting to 10.111.226.177:80 (10.111.226.177:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 22:23:41,343 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24260323': 1, 'ctest-pod-46068815': 1}
2024-08-20 22:23:43,412 - DEBUG - [Pod ctest-pod-32506708] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.687 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.284/0.687 ms
2024-08-20 22:23:43,412 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-32506708 with expectation True passed
2024-08-20 22:23:45,497 - DEBUG - [Pod ctest-pod-69186009] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.914 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.253 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.415/0.914 ms
2024-08-20 22:23:45,497 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69186009 with expectation True passed
2024-08-20 22:23:47,569 - DEBUG - [Pod ctest-pod-67897355] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.916 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.358/0.916 ms
2024-08-20 22:23:47,570 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67897355 with expectation True passed
2024-08-20 22:23:47,638 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:23:47,638 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-20 22:23:47,638 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:23:47,638 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32506708 passed
2024-08-20 22:23:47,722 - DEBUG - [Pod ctest-pod-32506708] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:23:47,722 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-20 22:23:47,722 - DEBUG - [Pod Pod ctest-pod-32506708] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:23:47,722 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32506708 passed
2024-08-20 22:23:52,790 - DEBUG - [Pod ctest-pod-69186009] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 22:23:52,791 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 22:23:52,791 - DEBUG - [Pod Pod ctest-pod-69186009] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 22:23:52,791 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69186009 passed
2024-08-20 22:23:52,863 - DEBUG - [Pod ctest-pod-69198566] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:23:52,863 - DEBUG - [Pod Pod ctest-pod-69198566] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-20 22:23:52,863 - DEBUG - [Pod Pod ctest-pod-69198566] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 22:23:52,863 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69198566 passed
2024-08-20 22:23:52,864 - INFO - Deleting Network Policy : ingress-on-service
2024-08-20 22:23:52,864 - INFO - Deleting service : ctest-nginx-svc-25432716
2024-08-20 22:23:53,147 - DEBUG - No XMPP flaps were noticed during the test
2024-08-20 22:23:53,148 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2024-08-20 22:23:53,148 - INFO - --------------------------------------------------------------------------------
2024-08-20 22:23:53,154 - INFO - Deleting pod ctest-new-default-74371008:ctest-pod-24260323
2024-08-20 22:23:53,155 - INFO - Deleting pod ctest-new-default-74371008:ctest-pod-46068815
2024-08-20 22:23:53,155 - INFO - Deleting pod ctest-non-default-47839323:ctest-pod-71771933
2024-08-20 22:23:53,156 - INFO - Deleting pod ctest-non-default-47839323:ctest-pod-36715579
2024-08-20 22:23:53,156 - INFO - Deleting pod ctest-new-default-74371008:ctest-pod-69186009
2024-08-20 22:23:53,157 - INFO - Deleting pod ctest-new-default-74371008:ctest-pod-32506708
2024-08-20 22:23:53,157 - INFO - Deleting pod ctest-non-default-47839323:ctest-pod-67897355
2024-08-20 22:23:53,157 - INFO - Deleting pod ctest-non-default-47839323:ctest-pod-69198566
2024-08-20 22:23:53,323 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,325 - WARNING - Pod uuid 2878063b-0533-4d5c-9524-79f1c5f9d2f6 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,326 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,326 - WARNING - Pod uuid fcd4a917-3258-40e3-b0a6-837688463133 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,326 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,327 - WARNING - Pod uuid 529030b7-e659-4786-940f-9965c059476c is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,327 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:53,327 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:58,365 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:58,366 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:58,366 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:58,367 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:58,368 - DEBUG - Pod fcd4a917-3258-40e3-b0a6-837688463133 is not in agent 10.0.0.23 VM list
2024-08-20 22:23:58,369 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:23:58,370 - DEBUG - Pod 2878063b-0533-4d5c-9524-79f1c5f9d2f6 is not in agent 10.0.0.23 VM list
2024-08-20 22:23:58,373 - DEBUG - Pod 529030b7-e659-4786-940f-9965c059476c is not in agent 10.0.0.23 VM list
2024-08-20 22:23:58,385 - DEBUG - VMI 636d38c8-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:23:58,385 - INFO - Verified that pod ctest-pod-36715579 is removed in agent
2024-08-20 22:23:58,387 - DEBUG - VMI 62e977f4-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:23:58,387 - INFO - Verified that pod ctest-pod-71771933 is removed in agent
2024-08-20 22:23:58,387 - DEBUG - VMI 62428a52-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:23:58,387 - INFO - Verified that pod ctest-pod-46068815 is removed in agent
2024-08-20 22:24:03,391 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:03,391 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:03,394 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:03,394 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:03,395 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:08,416 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:08,417 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:08,418 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:08,419 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:08,420 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:13,441 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:13,442 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:13,444 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:13,444 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:13,445 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:18,469 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:18,472 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:18,472 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:18,473 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:18,473 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:23,499 - WARNING - Pod uuid 9479f3d2-b7da-4fa3-9922-3167699a6d3d is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:23,499 - WARNING - Pod uuid 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:23,505 - WARNING - Pod uuid 66f766b3-21db-41a2-b3f1-4e45745e3a93 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:23,507 - WARNING - Pod uuid fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:24,557 - WARNING - Pod uuid 42a17c4e-d28b-4d14-8469-91083b03ad54 is still seen in agent 10.0.0.23 VM list
2024-08-20 22:24:28,517 - DEBUG - Pod 220ad7cd-0f47-40ea-bae9-c2ab50abefe9 is not in agent 10.0.0.23 VM list
2024-08-20 22:24:28,519 - DEBUG - Pod 9479f3d2-b7da-4fa3-9922-3167699a6d3d is not in agent 10.0.0.23 VM list
2024-08-20 22:24:28,523 - DEBUG - Pod 66f766b3-21db-41a2-b3f1-4e45745e3a93 is not in agent 10.0.0.23 VM list
2024-08-20 22:24:28,524 - DEBUG - Pod fd42a089-a3f3-4b98-94cc-4f6a8fe638d8 is not in agent 10.0.0.23 VM list
2024-08-20 22:24:28,542 - DEBUG - VMI 655e0982-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:24:28,542 - INFO - Verified that pod ctest-pod-69198566 is removed in agent
2024-08-20 22:24:28,543 - DEBUG - VMI 6472bc2a-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:24:28,543 - INFO - Verified that pod ctest-pod-32506708 is removed in agent
2024-08-20 22:24:28,543 - DEBUG - VMI 64e87cbc-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:24:28,543 - INFO - Verified that pod ctest-pod-67897355 is removed in agent
2024-08-20 22:24:28,544 - DEBUG - VMI 61b2bdb4-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:24:28,544 - INFO - Verified that pod ctest-pod-24260323 is removed in agent
2024-08-20 22:24:29,567 - DEBUG - Pod 42a17c4e-d28b-4d14-8469-91083b03ad54 is not in agent 10.0.0.23 VM list
2024-08-20 22:24:29,576 - DEBUG - VMI 63fdf9b2-5f42-11ef-b4a7-fa163e9eee0a is removed from agent 10.0.0.23
2024-08-20 22:24:29,576 - INFO - Verified that pod ctest-pod-69186009 is removed in agent
2024-08-20 22:24:29,576 - INFO - Deleting namespace ctest-non-default-47839323
2024-08-20 22:24:29,597 - DEBUG - Namespace ctest-non-default-47839323 still in k8s
2024-08-20 22:24:31,603 - DEBUG - Namespace ctest-non-default-47839323 still in k8s
2024-08-20 22:24:33,608 - DEBUG - Namespace ctest-non-default-47839323 still in k8s
2024-08-20 22:24:35,612 - DEBUG - Namespace ctest-non-default-47839323 is not in k8s
2024-08-20 22:24:35,612 - DEBUG - No need to check project deletion in contrail-api
2024-08-20 22:24:35,612 - INFO - Deleting namespace ctest-new-default-74371008
2024-08-20 22:24:35,621 - DEBUG - Namespace ctest-new-default-74371008 still in k8s
2024-08-20 22:24:37,627 - DEBUG - Namespace ctest-new-default-74371008 still in k8s
2024-08-20 22:24:39,634 - DEBUG - Namespace ctest-new-default-74371008 still in k8s
2024-08-20 22:24:41,639 - DEBUG - Namespace ctest-new-default-74371008 is not in k8s
2024-08-20 22:24:41,639 - DEBUG - No need to check project deletion in contrail-api