2024-08-22 02:07:13,957 - INFO - Using existing project ['default-domain', 'k8s-default'](ff7ac0b5-76fc-45e6-8299-b4181681ac19)
2024-08-22 02:07:13,976 - DEBUG - Namespace ctest-new-default-98860571 not present
2024-08-22 02:07:13,993 - INFO - Created namespace ctest-new-default-98860571
2024-08-22 02:07:16,998 - DEBUG - Namespace ctest-non-default-43849692 not present
2024-08-22 02:07:17,022 - INFO - Created namespace ctest-non-default-43849692
2024-08-22 02:07:20,039 - DEBUG - Pod ctest-pod-00485845 not present
2024-08-22 02:07:20,039 - INFO - Creating Pod ctest-pod-00485845
2024-08-22 02:07:20,071 - DEBUG - Pod : ctest-pod-00485845 UUID is 150c714c-3f99-43a9-9812-369a18124e6a
2024-08-22 02:07:20,076 - DEBUG - Pod ctest-pod-52789544 not present
2024-08-22 02:07:20,076 - INFO - Creating Pod ctest-pod-52789544
2024-08-22 02:07:20,112 - DEBUG - Pod : ctest-pod-52789544 UUID is c99616cf-bdd8-43f9-8bdb-a6cbf37140a2
2024-08-22 02:07:20,121 - DEBUG - Pod ctest-pod-88301549 not present
2024-08-22 02:07:20,121 - INFO - Creating Pod ctest-pod-88301549
2024-08-22 02:07:20,154 - DEBUG - Pod : ctest-pod-88301549 UUID is 7e0c63d4-60a4-4b7c-bc6d-c14afba2a4dd
2024-08-22 02:07:20,156 - DEBUG - Pod ctest-pod-30772929 not present
2024-08-22 02:07:20,156 - INFO - Creating Pod ctest-pod-30772929
2024-08-22 02:07:20,173 - DEBUG - Pod : ctest-pod-30772929 UUID is b4a58a4a-2984-4db0-9994-5339897620d6
2024-08-22 02:07:20,181 - DEBUG - Pod ctest-pod-51278070 not present
2024-08-22 02:07:20,181 - INFO - Creating Pod ctest-pod-51278070
2024-08-22 02:07:20,201 - DEBUG - Pod : ctest-pod-51278070 UUID is 73d09275-54ee-4640-a847-34b45f401ef8
2024-08-22 02:07:20,203 - DEBUG - Pod ctest-pod-57133389 not present
2024-08-22 02:07:20,203 - INFO - Creating Pod ctest-pod-57133389
2024-08-22 02:07:20,222 - DEBUG - Pod : ctest-pod-57133389 UUID is 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a
2024-08-22 02:07:20,225 - DEBUG - Pod ctest-pod-00824358 not present
2024-08-22 02:07:20,225 - INFO - Creating Pod ctest-pod-00824358
2024-08-22 02:07:20,248 - DEBUG - Pod : ctest-pod-00824358 UUID is af19a0e6-8cd1-438e-be67-b695ff1c66a9
2024-08-22 02:07:20,250 - DEBUG - Pod ctest-pod-37545465 not present
2024-08-22 02:07:20,251 - INFO - Creating Pod ctest-pod-37545465
2024-08-22 02:07:20,270 - DEBUG - Pod : ctest-pod-37545465 UUID is 45bec838-6bc2-4d17-8f25-37e7932d3aae
2024-08-22 02:07:20,434 - INFO - Project default-domain:k8s-ctest-new-default-98860571 for Namespace ctest-new-default-98860571 is seen in contrail-api
2024-08-22 02:07:20,434 - DEBUG - Project uuid in Contrail is 33676e6f-fa84-43a8-9723-f526e3737db8
2024-08-22 02:07:20,593 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=5a7fb9f3-4434-4cfd-9518-5c0a7d86337d
2024-08-22 02:07:20,597 - INFO - Namespace ctest-new-default-98860571 with uuid 5a7fb9f3-4434-4cfd-9518-5c0a7d86337d found in kube manager
2024-08-22 02:07:20,597 - INFO - Namespace ctest-new-default-98860571 verification passed
2024-08-22 02:07:20,805 - INFO - Project default-domain:k8s-ctest-non-default-43849692 for Namespace ctest-non-default-43849692 is seen in contrail-api
2024-08-22 02:07:20,805 - DEBUG - Project uuid in Contrail is dae9bc8b-5767-4796-859b-e0f10c7e234f
2024-08-22 02:07:20,805 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=3e659f52-3f4d-4e7b-83c5-c2685bd781fd
2024-08-22 02:07:20,817 - INFO - Namespace ctest-non-default-43849692 with uuid 3e659f52-3f4d-4e7b-83c5-c2685bd781fd found in kube manager
2024-08-22 02:07:20,817 - INFO - Namespace ctest-non-default-43849692 verification passed
2024-08-22 02:07:20,822 - DEBUG - Pod ctest-pod-00485845 not in running state.Currently in Pending
2024-08-22 02:07:25,828 - DEBUG - Pod ctest-pod-00485845 not in running state.Currently in Pending
2024-08-22 02:07:30,834 - DEBUG - Pod ctest-pod-00485845 not in running state.Currently in Pending
2024-08-22 02:07:35,842 - INFO - Pod ctest-pod-00485845 is in running state.Got IP 10.47.255.251
2024-08-22 02:07:35,859 - DEBUG - Pod ctest-pod-00485845 has vmi 443de0b2-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:35,859 - INFO - Verified pod ctest-pod-00485845 in contrail-api
2024-08-22 02:07:36,207 - DEBUG - VMI 443de0b2-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:36,207 - INFO - Verified Pod ctest-pod-00485845 in agent 10.0.0.38
2024-08-22 02:07:36,208 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=150c714c-3f99-43a9-9812-369a18124e6a
2024-08-22 02:07:36,219 - INFO - Pod ctest-pod-00485845 with uuid 150c714c-3f99-43a9-9812-369a18124e6a found in kube manager
2024-08-22 02:07:36,220 - INFO - Pod ctest-pod-00485845 verification passed
2024-08-22 02:07:36,228 - INFO - Pod ctest-pod-52789544 is in running state.Got IP 10.47.255.250
2024-08-22 02:07:36,241 - DEBUG - Pod ctest-pod-52789544 has vmi 44b83272-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:36,241 - INFO - Verified pod ctest-pod-52789544 in contrail-api
2024-08-22 02:07:36,255 - DEBUG - VMI 44b83272-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:36,256 - INFO - Verified Pod ctest-pod-52789544 in agent 10.0.0.38
2024-08-22 02:07:36,256 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=c99616cf-bdd8-43f9-8bdb-a6cbf37140a2
2024-08-22 02:07:36,261 - INFO - Pod ctest-pod-52789544 with uuid c99616cf-bdd8-43f9-8bdb-a6cbf37140a2 found in kube manager
2024-08-22 02:07:36,261 - INFO - Pod ctest-pod-52789544 verification passed
2024-08-22 02:07:36,268 - INFO - Pod ctest-pod-88301549 is in running state.Got IP 10.47.255.249
2024-08-22 02:07:36,325 - DEBUG - Pod ctest-pod-88301549 has vmi 4619a8a8-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:36,325 - INFO - Verified pod ctest-pod-88301549 in contrail-api
2024-08-22 02:07:36,339 - DEBUG - VMI 4619a8a8-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:36,339 - INFO - Verified Pod ctest-pod-88301549 in agent 10.0.0.38
2024-08-22 02:07:36,339 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=7e0c63d4-60a4-4b7c-bc6d-c14afba2a4dd
2024-08-22 02:07:36,344 - INFO - Pod ctest-pod-88301549 with uuid 7e0c63d4-60a4-4b7c-bc6d-c14afba2a4dd found in kube manager
2024-08-22 02:07:36,344 - INFO - Pod ctest-pod-88301549 verification passed
2024-08-22 02:07:36,350 - INFO - Pod ctest-pod-30772929 is in running state.Got IP 10.47.255.248
2024-08-22 02:07:36,361 - DEBUG - Pod ctest-pod-30772929 has vmi 468d8a20-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:36,361 - INFO - Verified pod ctest-pod-30772929 in contrail-api
2024-08-22 02:07:36,375 - DEBUG - VMI 468d8a20-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:36,376 - INFO - Verified Pod ctest-pod-30772929 in agent 10.0.0.38
2024-08-22 02:07:36,376 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=b4a58a4a-2984-4db0-9994-5339897620d6
2024-08-22 02:07:36,380 - INFO - Pod ctest-pod-30772929 with uuid b4a58a4a-2984-4db0-9994-5339897620d6 found in kube manager
2024-08-22 02:07:36,380 - INFO - Pod ctest-pod-30772929 verification passed
2024-08-22 02:07:36,386 - DEBUG - Pod ctest-pod-51278070 not in running state.Currently in Pending
2024-08-22 02:07:41,392 - INFO - Pod ctest-pod-51278070 is in running state.Got IP 10.47.255.247
2024-08-22 02:07:41,445 - DEBUG - Pod ctest-pod-51278070 has vmi 470ee278-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:41,445 - INFO - Verified pod ctest-pod-51278070 in contrail-api
2024-08-22 02:07:41,458 - DEBUG - VMI 470ee278-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:41,459 - INFO - Verified Pod ctest-pod-51278070 in agent 10.0.0.38
2024-08-22 02:07:41,459 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=73d09275-54ee-4640-a847-34b45f401ef8
2024-08-22 02:07:41,463 - INFO - Pod ctest-pod-51278070 with uuid 73d09275-54ee-4640-a847-34b45f401ef8 found in kube manager
2024-08-22 02:07:41,463 - INFO - Pod ctest-pod-51278070 verification passed
2024-08-22 02:07:41,468 - INFO - Pod ctest-pod-00824358 is in running state.Got IP 10.47.255.245
2024-08-22 02:07:41,478 - DEBUG - Pod ctest-pod-00824358 has vmi 485ef7a8-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:41,478 - INFO - Verified pod ctest-pod-00824358 in contrail-api
2024-08-22 02:07:41,491 - DEBUG - VMI 485ef7a8-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:41,491 - INFO - Verified Pod ctest-pod-00824358 in agent 10.0.0.38
2024-08-22 02:07:41,491 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=af19a0e6-8cd1-438e-be67-b695ff1c66a9
2024-08-22 02:07:41,495 - INFO - Pod ctest-pod-00824358 with uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 found in kube manager
2024-08-22 02:07:41,495 - INFO - Pod ctest-pod-00824358 verification passed
2024-08-22 02:07:41,500 - INFO - Pod ctest-pod-57133389 is in running state.Got IP 10.47.255.246
2024-08-22 02:07:41,555 - DEBUG - Pod ctest-pod-57133389 has vmi 4781ab00-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:41,555 - INFO - Verified pod ctest-pod-57133389 in contrail-api
2024-08-22 02:07:41,568 - DEBUG - VMI 4781ab00-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:41,568 - INFO - Verified Pod ctest-pod-57133389 in agent 10.0.0.38
2024-08-22 02:07:41,568 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a
2024-08-22 02:07:41,573 - INFO - Pod ctest-pod-57133389 with uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a found in kube manager
2024-08-22 02:07:41,573 - INFO - Pod ctest-pod-57133389 verification passed
2024-08-22 02:07:41,579 - INFO - Pod ctest-pod-37545465 is in running state.Got IP 10.47.255.244
2024-08-22 02:07:41,633 - DEBUG - Pod ctest-pod-37545465 has vmi 48d5aa42-602b-11ef-9d7c-fa163e53105c
2024-08-22 02:07:41,633 - INFO - Verified pod ctest-pod-37545465 in contrail-api
2024-08-22 02:07:41,646 - DEBUG - VMI 48d5aa42-602b-11ef-9d7c-fa163e53105c is active in agent 10.0.0.38
2024-08-22 02:07:41,647 - INFO - Verified Pod ctest-pod-37545465 in agent 10.0.0.38
2024-08-22 02:07:41,647 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=45bec838-6bc2-4d17-8f25-37e7932d3aae
2024-08-22 02:07:41,651 - INFO - Pod ctest-pod-37545465 with uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae found in kube manager
2024-08-22 02:07:41,651 - INFO - Pod ctest-pod-37545465 verification passed
2024-08-22 02:07:41,651 - INFO - ================================================================================
2024-08-22 02:07:41,651 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-08-22 02:07:41,651 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-08-22 02:07:41,843 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.31': '0'}} with
2024-08-22 02:07:41,843 - INFO - Initial checks done. Running the testcase now
2024-08-22 02:07:41,843 - INFO -
2024-08-22 02:07:41,897 - DEBUG - [Pod ctest-pod-00485845] Cmd: echo ctest-pod-00485845 > /usr/share/nginx/html/index.html, Output:
2024-08-22 02:07:41,975 - DEBUG - [Pod ctest-pod-52789544] Cmd: echo ctest-pod-52789544 > /usr/share/nginx/html/index.html, Output:
2024-08-22 02:07:42,032 - DEBUG - [Pod ctest-pod-88301549] Cmd: echo ctest-pod-88301549 > /usr/share/nginx/html/index.html, Output:
2024-08-22 02:07:42,093 - DEBUG - [Pod ctest-pod-30772929] Cmd: echo ctest-pod-30772929 > /usr/share/nginx/html/index.html, Output:
2024-08-22 02:07:42,096 - DEBUG - Service ctest-nginx-svc-13183907 not present
2024-08-22 02:07:42,096 - INFO - Creating service ctest-nginx-svc-13183907
2024-08-22 02:07:42,109 - INFO - Created Service ctest-nginx-svc-13183907
2024-08-22 02:07:42,122 - WARNING - Service UUID c61ecde0-4981-4d77-86cd-0a35ed59f443 not yet found in contrail-api
2024-08-22 02:07:43,130 - INFO - Validated that Service ctest-nginx-svc-13183907 is seen in contrail-api
2024-08-22 02:07:43,130 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_LoadbalancerDatabaseList?x=c61ecde0-4981-4d77-86cd-0a35ed59f443
2024-08-22 02:07:43,137 - INFO - Service ctest-nginx-svc-13183907 with uuid c61ecde0-4981-4d77-86cd-0a35ed59f443 found in kube manager
2024-08-22 02:07:43,137 - INFO - Service ctest-nginx-svc-13183907 verification passed
2024-08-22 02:07:43,206 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,206 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,206 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,258 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,258 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,258 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,316 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:07:43,317 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,317 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:07:43,369 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:07:43,370 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,370 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:07:43,429 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,429 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,429 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,482 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,482 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,482 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,547 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00485845
2024-08-22 02:07:43,548 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,548 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00485845
2024-08-22 02:07:43,548 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00485845': 1, 'ctest-pod-52789544': 6}
2024-08-22 02:07:43,610 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-00485845
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,611 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,611 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: ctest-pod-00485845
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:07:43,690 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:07:43,690 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:07:43,690 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:07:43,690 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00485845': 1, 'ctest-pod-52789544': 1}
2024-08-22 02:07:43,694 - DEBUG - Network policy ingress-on-service not present
2024-08-22 02:07:43,695 - INFO - Creating Network Policy ingress-on-service
2024-08-22 02:07:43,706 - INFO - Network policy found in k8s
2024-08-22 02:07:43,706 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f55d9cce-2d81-4020-ab80-d08c0e4c9c14
2024-08-22 02:07:43,713 - INFO - Network Policy ingress-on-service with uuid f55d9cce-2d81-4020-ab80-d08c0e4c9c14 found in kube manager
2024-08-22 02:07:43,745 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-08-22 02:07:43,745 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-08-22 02:07:43,746 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f55d9cce-2d81-4020-ab80-d08c0e4c9c14
2024-08-22 02:07:43,774 - WARNING - Network policy with name ingress-on-service not found in agent
2024-08-22 02:07:45,775 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f55d9cce-2d81-4020-ab80-d08c0e4c9c14
2024-08-22 02:07:45,806 - INFO - Network policy with name ingress-on-service found in agent
2024-08-22 02:07:45,806 - INFO - Network Policy ingress-on-service verification passed
2024-08-22 02:07:50,864 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:07:50,864 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:07:50,864 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:07:55,924 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:07:55,924 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:07:55,924 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:00,996 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:00,996 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:00,996 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:06,061 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:06,061 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:06,061 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:11,128 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:11,128 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:11,128 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:16,173 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:16,173 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:16,173 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:21,229 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:21,229 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:21,229 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:26,289 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:26,289 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:26,289 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:31,340 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:31,340 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:31,340 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:36,395 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:36,395 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:36,395 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:36,395 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00485845': 0, 'ctest-pod-52789544': 0}
2024-08-22 02:08:36,455 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:08:36,455 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:08:36,455 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52789544
2024-08-22 02:08:36,510 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:08:36,510 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:08:36,510 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:08:36,565 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-00485845
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:08:36,565 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:08:36,566 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: ctest-pod-00485845
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:08:36,566 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00485845': 1, 'ctest-pod-52789544': 2}
2024-08-22 02:08:41,616 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:41,616 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:41,616 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:46,676 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:46,676 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:46,676 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:51,729 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:51,729 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:51,729 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:56,791 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:56,791 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:08:56,791 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:01,865 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:01,865 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:01,865 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:06,912 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:06,923 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:06,924 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:11,989 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:11,989 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:11,989 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:17,072 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:17,074 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:17,074 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:20,990 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-08-22 02:09:31,828 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:31,828 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:31,828 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:37,938 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:37,938 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:37,938 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:09:37,938 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00485845': 0, 'ctest-pod-52789544': 0}
2024-08-22 02:09:39,995 - DEBUG - [Pod ctest-pod-57133389] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.665 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.274/0.665 ms
2024-08-22 02:09:39,995 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-57133389 with expectation True passed
2024-08-22 02:09:42,966 - DEBUG - [Pod ctest-pod-51278070] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.445 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.192/0.445 ms
2024-08-22 02:09:42,966 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51278070 with expectation True passed
2024-08-22 02:09:45,019 - DEBUG - [Pod ctest-pod-00824358] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.196 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.449/1.196 ms
2024-08-22 02:09:45,019 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00824358 with expectation True passed
2024-08-22 02:09:45,085 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:09:45,085 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-22 02:09:45,086 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:09:45,086 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57133389 passed
2024-08-22 02:09:45,149 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:09:45,149 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-22 02:09:45,149 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:09:45,149 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57133389 passed
2024-08-22 02:09:50,208 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-22 02:09:50,208 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-22 02:09:50,208 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-22 02:09:50,208 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51278070 passed
2024-08-22 02:09:55,628 - DEBUG - [Pod ctest-pod-37545465] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-22 02:09:55,628 - DEBUG - [Pod Pod ctest-pod-37545465] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-22 02:09:55,628 - DEBUG - [Pod Pod ctest-pod-37545465] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-22 02:09:55,628 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37545465 passed
2024-08-22 02:09:55,636 - INFO - Updating Network Policy ingress-on-service
2024-08-22 02:10:00,704 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:00,704 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:00,704 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:05,764 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:05,764 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:05,764 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:10,833 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:10,833 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:10,833 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:15,903 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:15,903 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:15,903 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:21,107 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:21,108 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:21,108 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:26,167 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:26,167 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:26,168 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:31,219 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:31,219 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:31,219 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:37,588 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:37,588 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:37,589 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:42,639 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:42,639 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:42,639 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:47,940 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:47,940 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:47,940 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
wget: download timed out
2024-08-22 02:10:47,940 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00485845': 0, 'ctest-pod-52789544': 0}
2024-08-22 02:10:48,000 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00485845
2024-08-22 02:10:48,000 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:10:48,000 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-00485845
2024-08-22 02:10:48,049 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:10:48,049 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:10:48,049 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:10:48,049 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00485845': 1, 'ctest-pod-52789544': 1}
2024-08-22 02:10:48,109 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-00485845
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:10:48,109 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:10:48,109 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: ctest-pod-00485845
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:10:48,177 - DEBUG - [Pod ctest-pod-00824358] Cmd: wget http://10.97.96.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:10:48,178 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd wget http://10.97.96.233:80/ -O - -T 5 -t 1 passed
2024-08-22 02:10:48,178 - DEBUG - [Pod Pod ctest-pod-00824358] Cmd output: ctest-pod-52789544
Connecting to 10.97.96.233:80 (10.97.96.233:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-22 02:10:48,178 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00485845': 1, 'ctest-pod-52789544': 1}
2024-08-22 02:10:50,224 - DEBUG - [Pod ctest-pod-57133389] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.884 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.096 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.352/0.884 ms
2024-08-22 02:10:50,224 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-57133389 with expectation True passed
2024-08-22 02:10:52,301 - DEBUG - [Pod ctest-pod-51278070] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.396 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.178/0.396 ms
2024-08-22 02:10:52,301 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51278070 with expectation True passed
2024-08-22 02:10:54,887 - DEBUG - [Pod ctest-pod-00824358] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.613 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.256/0.613 ms
2024-08-22 02:10:54,888 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00824358 with expectation True passed
2024-08-22 02:10:54,942 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:10:54,942 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-22 02:10:54,942 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:10:54,942 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57133389 passed
2024-08-22 02:10:55,007 - DEBUG - [Pod ctest-pod-57133389] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:10:55,007 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-22 02:10:55,007 - DEBUG - [Pod Pod ctest-pod-57133389] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:10:55,007 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57133389 passed
2024-08-22 02:11:00,061 - DEBUG - [Pod ctest-pod-51278070] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-22 02:11:00,061 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-22 02:11:00,061 - DEBUG - [Pod Pod ctest-pod-51278070] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-22 02:11:00,061 - INFO - wget check of of http://10.47.255.250 from ctest-pod-51278070 passed
2024-08-22 02:11:01,009 - DEBUG - [Pod ctest-pod-37545465] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:11:01,009 - DEBUG - [Pod Pod ctest-pod-37545465] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-22 02:11:01,009 - DEBUG - [Pod Pod ctest-pod-37545465] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-22 02:11:01,009 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37545465 passed
2024-08-22 02:11:01,009 - INFO - Deleting Network Policy : ingress-on-service
2024-08-22 02:11:01,009 - INFO - Deleting service : ctest-nginx-svc-13183907
2024-08-22 02:11:01,249 - DEBUG - No XMPP flaps were noticed during the test
2024-08-22 02:11:01,249 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:20]
2024-08-22 02:11:01,249 - INFO - --------------------------------------------------------------------------------
2024-08-22 02:11:01,254 - INFO - Deleting pod ctest-new-default-98860571:ctest-pod-00485845
2024-08-22 02:11:01,255 - INFO - Deleting pod ctest-new-default-98860571:ctest-pod-52789544
2024-08-22 02:11:01,255 - INFO - Deleting pod ctest-non-default-43849692:ctest-pod-88301549
2024-08-22 02:11:01,256 - INFO - Deleting pod ctest-non-default-43849692:ctest-pod-30772929
2024-08-22 02:11:01,256 - INFO - Deleting pod ctest-new-default-98860571:ctest-pod-51278070
2024-08-22 02:11:01,256 - INFO - Deleting pod ctest-new-default-98860571:ctest-pod-57133389
2024-08-22 02:11:01,256 - INFO - Deleting pod ctest-non-default-43849692:ctest-pod-00824358
2024-08-22 02:11:01,257 - INFO - Deleting pod ctest-non-default-43849692:ctest-pod-37545465
2024-08-22 02:11:02,808 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,809 - WARNING - Pod uuid 150c714c-3f99-43a9-9812-369a18124e6a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,811 - WARNING - Pod uuid 7e0c63d4-60a4-4b7c-bc6d-c14afba2a4dd is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,812 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,814 - WARNING - Pod uuid b4a58a4a-2984-4db0-9994-5339897620d6 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,814 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,815 - WARNING - Pod uuid c99616cf-bdd8-43f9-8bdb-a6cbf37140a2 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:02,815 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:07,840 - WARNING - Pod uuid b4a58a4a-2984-4db0-9994-5339897620d6 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:07,842 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:07,842 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:07,843 - WARNING - Pod uuid c99616cf-bdd8-43f9-8bdb-a6cbf37140a2 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:07,843 - WARNING - Pod uuid 7e0c63d4-60a4-4b7c-bc6d-c14afba2a4dd is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:07,843 - WARNING - Pod uuid 150c714c-3f99-43a9-9812-369a18124e6a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:08,959 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:08,967 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:12,865 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:12,866 - DEBUG - Pod b4a58a4a-2984-4db0-9994-5339897620d6 is not in agent 10.0.0.38 VM list
2024-08-22 02:11:12,870 - DEBUG - Pod c99616cf-bdd8-43f9-8bdb-a6cbf37140a2 is not in agent 10.0.0.38 VM list
2024-08-22 02:11:12,871 - DEBUG - Pod 7e0c63d4-60a4-4b7c-bc6d-c14afba2a4dd is not in agent 10.0.0.38 VM list
2024-08-22 02:11:12,872 - DEBUG - Pod 150c714c-3f99-43a9-9812-369a18124e6a is not in agent 10.0.0.38 VM list
2024-08-22 02:11:12,882 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:12,895 - DEBUG - VMI 468d8a20-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:12,895 - INFO - Verified that pod ctest-pod-30772929 is removed in agent
2024-08-22 02:11:12,899 - DEBUG - VMI 4619a8a8-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:12,899 - INFO - Verified that pod ctest-pod-88301549 is removed in agent
2024-08-22 02:11:12,901 - DEBUG - VMI 443de0b2-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:12,901 - INFO - Verified that pod ctest-pod-00485845 is removed in agent
2024-08-22 02:11:12,902 - DEBUG - VMI 44b83272-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:12,902 - INFO - Verified that pod ctest-pod-52789544 is removed in agent
2024-08-22 02:11:13,968 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:13,974 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:17,874 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:17,891 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:18,975 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:18,982 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:22,881 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:22,899 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:23,986 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:23,991 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:27,890 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:27,907 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:28,996 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:28,998 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:32,900 - WARNING - Pod uuid af19a0e6-8cd1-438e-be67-b695ff1c66a9 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:32,914 - WARNING - Pod uuid 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:34,009 - WARNING - Pod uuid 73d09275-54ee-4640-a847-34b45f401ef8 is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:34,010 - WARNING - Pod uuid 45bec838-6bc2-4d17-8f25-37e7932d3aae is still seen in agent 10.0.0.38 VM list
2024-08-22 02:11:37,925 - DEBUG - Pod 6f6e8a0f-37bf-4e2e-b350-1fabdd3d0f5a is not in agent 10.0.0.38 VM list
2024-08-22 02:11:37,935 - DEBUG - VMI 4781ab00-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:37,935 - INFO - Verified that pod ctest-pod-57133389 is removed in agent
2024-08-22 02:11:39,022 - DEBUG - Pod 45bec838-6bc2-4d17-8f25-37e7932d3aae is not in agent 10.0.0.38 VM list
2024-08-22 02:11:39,023 - DEBUG - Pod 73d09275-54ee-4640-a847-34b45f401ef8 is not in agent 10.0.0.38 VM list
2024-08-22 02:11:39,032 - DEBUG - VMI 470ee278-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:39,032 - INFO - Verified that pod ctest-pod-51278070 is removed in agent
2024-08-22 02:11:39,033 - DEBUG - VMI 48d5aa42-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:39,033 - INFO - Verified that pod ctest-pod-37545465 is removed in agent
2024-08-22 02:11:39,325 - DEBUG - Pod af19a0e6-8cd1-438e-be67-b695ff1c66a9 is not in agent 10.0.0.38 VM list
2024-08-22 02:11:39,336 - DEBUG - VMI 485ef7a8-602b-11ef-9d7c-fa163e53105c is removed from agent 10.0.0.38
2024-08-22 02:11:39,336 - INFO - Verified that pod ctest-pod-00824358 is removed in agent
2024-08-22 02:11:39,336 - INFO - Deleting namespace ctest-non-default-43849692
2024-08-22 02:11:39,356 - DEBUG - Namespace ctest-non-default-43849692 still in k8s
2024-08-22 02:11:41,361 - DEBUG - Namespace ctest-non-default-43849692 still in k8s
2024-08-22 02:11:43,366 - DEBUG - Namespace ctest-non-default-43849692 still in k8s
2024-08-22 02:11:45,370 - DEBUG - Namespace ctest-non-default-43849692 is not in k8s
2024-08-22 02:11:45,370 - DEBUG - No need to check project deletion in contrail-api
2024-08-22 02:11:45,370 - INFO - Deleting namespace ctest-new-default-98860571
2024-08-22 02:11:45,383 - DEBUG - Namespace ctest-new-default-98860571 still in k8s
2024-08-22 02:11:47,388 - DEBUG - Namespace ctest-new-default-98860571 still in k8s
2024-08-22 02:11:49,408 - DEBUG - Namespace ctest-new-default-98860571 still in k8s
2024-08-22 02:11:51,413 - DEBUG - Namespace ctest-new-default-98860571 is not in k8s
2024-08-22 02:11:51,413 - DEBUG - No need to check project deletion in contrail-api