2025-03-31 02:22:30,282 - INFO - Using existing project ['default-domain', 'k8s-default'](e4876756-ad68-45f0-ada1-ffceaf2f3bb2)
2025-03-31 02:22:30,302 - DEBUG - Namespace ctest-new-default-50103650 not present
2025-03-31 02:22:30,314 - INFO - Created namespace ctest-new-default-50103650
2025-03-31 02:22:33,319 - DEBUG - Namespace ctest-non-default-76121202 not present
2025-03-31 02:22:33,327 - INFO - Created namespace ctest-non-default-76121202
2025-03-31 02:22:36,354 - DEBUG - Pod ctest-pod-10408406 not present
2025-03-31 02:22:36,354 - INFO - Creating Pod ctest-pod-10408406
2025-03-31 02:22:36,395 - DEBUG - Pod : ctest-pod-10408406 UUID is b22fa05e-ce04-46a5-b811-0453f271720d
2025-03-31 02:22:36,398 - DEBUG - Pod ctest-pod-12440975 not present
2025-03-31 02:22:36,398 - INFO - Creating Pod ctest-pod-12440975
2025-03-31 02:22:36,471 - DEBUG - Pod : ctest-pod-12440975 UUID is 25c66d81-db8c-4514-a508-351bc9c9bef8
2025-03-31 02:22:36,473 - DEBUG - Pod ctest-pod-36437393 not present
2025-03-31 02:22:36,473 - INFO - Creating Pod ctest-pod-36437393
2025-03-31 02:22:36,509 - DEBUG - Pod : ctest-pod-36437393 UUID is 56a1034c-e31c-41ce-890f-e0c518552617
2025-03-31 02:22:36,515 - DEBUG - Pod ctest-pod-53591749 not present
2025-03-31 02:22:36,515 - INFO - Creating Pod ctest-pod-53591749
2025-03-31 02:22:36,554 - DEBUG - Pod : ctest-pod-53591749 UUID is e5fadc02-1399-4c21-bb53-210d6d2db9b3
2025-03-31 02:22:36,568 - DEBUG - Pod ctest-pod-42648347 not present
2025-03-31 02:22:36,569 - INFO - Creating Pod ctest-pod-42648347
2025-03-31 02:22:36,611 - DEBUG - Pod : ctest-pod-42648347 UUID is 0d9f6e58-4502-473a-917e-54f501027ecd
2025-03-31 02:22:36,617 - DEBUG - Pod ctest-pod-42837864 not present
2025-03-31 02:22:36,618 - INFO - Creating Pod ctest-pod-42837864
2025-03-31 02:22:36,651 - DEBUG - Pod : ctest-pod-42837864 UUID is 1989cf6e-8495-4136-be06-d214be619bf1
2025-03-31 02:22:36,656 - DEBUG - Pod ctest-pod-67138728 not present
2025-03-31 02:22:36,661 - INFO - Creating Pod ctest-pod-67138728
2025-03-31 02:22:36,685 - DEBUG - Pod : ctest-pod-67138728 UUID is b0906d1e-691b-4821-8e1c-b11ccb3cf112
2025-03-31 02:22:36,690 - DEBUG - Pod ctest-pod-92869608 not present
2025-03-31 02:22:36,691 - INFO - Creating Pod ctest-pod-92869608
2025-03-31 02:22:36,730 - DEBUG - Pod : ctest-pod-92869608 UUID is aa582a7e-e4d5-45a7-9aa7-3e658400e3d9
2025-03-31 02:22:36,969 - INFO - Project default-domain:k8s-ctest-new-default-50103650 for Namespace ctest-new-default-50103650 is seen in contrail-api
2025-03-31 02:22:36,970 - DEBUG - Project uuid in Contrail is ce65a89f-3fb6-4e8e-bc61-4b11c656bcac
2025-03-31 02:22:37,162 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=17785cdc-f2a0-40b5-9f90-7105a5abe312
2025-03-31 02:22:37,169 - INFO - Namespace ctest-new-default-50103650 with uuid 17785cdc-f2a0-40b5-9f90-7105a5abe312 found in kube manager
2025-03-31 02:22:37,169 - INFO - Namespace ctest-new-default-50103650 verification passed
2025-03-31 02:22:37,367 - INFO - Project default-domain:k8s-ctest-non-default-76121202 for Namespace ctest-non-default-76121202 is seen in contrail-api
2025-03-31 02:22:37,367 - DEBUG - Project uuid in Contrail is 00b1ebad-05f7-4029-a3a4-3b6365511e7f
2025-03-31 02:22:37,368 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=9748c2b2-f464-4cda-a04f-89d3f548c5d4
2025-03-31 02:22:37,373 - INFO - Namespace ctest-non-default-76121202 with uuid 9748c2b2-f464-4cda-a04f-89d3f548c5d4 found in kube manager
2025-03-31 02:22:37,373 - INFO - Namespace ctest-non-default-76121202 verification passed
2025-03-31 02:22:37,378 - DEBUG - Pod ctest-pod-10408406 not in running state.Currently in Pending
2025-03-31 02:22:42,393 - DEBUG - Pod ctest-pod-10408406 not in running state.Currently in Pending
2025-03-31 02:22:47,400 - DEBUG - Pod ctest-pod-10408406 not in running state.Currently in Pending
2025-03-31 02:22:52,409 - INFO - Pod ctest-pod-10408406 is in running state.Got IP 10.47.255.251
2025-03-31 02:22:52,470 - DEBUG - Pod ctest-pod-10408406 has vmi 03fdeede-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:52,470 - INFO - Verified pod ctest-pod-10408406 in contrail-api
2025-03-31 02:22:52,487 - DEBUG - VMI 03fdeede-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:52,488 - INFO - Verified Pod ctest-pod-10408406 in agent 10.0.0.49
2025-03-31 02:22:52,488 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b22fa05e-ce04-46a5-b811-0453f271720d
2025-03-31 02:22:52,493 - INFO - Pod ctest-pod-10408406 with uuid b22fa05e-ce04-46a5-b811-0453f271720d found in kube manager
2025-03-31 02:22:52,494 - INFO - Pod ctest-pod-10408406 verification passed
2025-03-31 02:22:52,499 - INFO - Pod ctest-pod-12440975 is in running state.Got IP 10.47.255.250
2025-03-31 02:22:52,515 - DEBUG - Pod ctest-pod-12440975 has vmi 046b320a-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:52,515 - INFO - Verified pod ctest-pod-12440975 in contrail-api
2025-03-31 02:22:52,530 - DEBUG - VMI 046b320a-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:52,530 - INFO - Verified Pod ctest-pod-12440975 in agent 10.0.0.49
2025-03-31 02:22:52,531 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=25c66d81-db8c-4514-a508-351bc9c9bef8
2025-03-31 02:22:52,536 - INFO - Pod ctest-pod-12440975 with uuid 25c66d81-db8c-4514-a508-351bc9c9bef8 found in kube manager
2025-03-31 02:22:52,536 - INFO - Pod ctest-pod-12440975 verification passed
2025-03-31 02:22:52,543 - INFO - Pod ctest-pod-36437393 is in running state.Got IP 10.47.255.249
2025-03-31 02:22:52,598 - DEBUG - Pod ctest-pod-36437393 has vmi 052df27c-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:52,598 - INFO - Verified pod ctest-pod-36437393 in contrail-api
2025-03-31 02:22:52,620 - DEBUG - VMI 052df27c-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:52,621 - INFO - Verified Pod ctest-pod-36437393 in agent 10.0.0.49
2025-03-31 02:22:52,621 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=56a1034c-e31c-41ce-890f-e0c518552617
2025-03-31 02:22:52,626 - INFO - Pod ctest-pod-36437393 with uuid 56a1034c-e31c-41ce-890f-e0c518552617 found in kube manager
2025-03-31 02:22:52,626 - INFO - Pod ctest-pod-36437393 verification passed
2025-03-31 02:22:52,631 - INFO - Pod ctest-pod-53591749 is in running state.Got IP 10.47.255.248
2025-03-31 02:22:52,686 - DEBUG - Pod ctest-pod-53591749 has vmi 05bb6e0e-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:52,686 - INFO - Verified pod ctest-pod-53591749 in contrail-api
2025-03-31 02:22:52,701 - DEBUG - VMI 05bb6e0e-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:52,701 - INFO - Verified Pod ctest-pod-53591749 in agent 10.0.0.49
2025-03-31 02:22:52,701 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=e5fadc02-1399-4c21-bb53-210d6d2db9b3
2025-03-31 02:22:52,706 - INFO - Pod ctest-pod-53591749 with uuid e5fadc02-1399-4c21-bb53-210d6d2db9b3 found in kube manager
2025-03-31 02:22:52,706 - INFO - Pod ctest-pod-53591749 verification passed
2025-03-31 02:22:52,712 - DEBUG - Pod ctest-pod-42648347 not in running state.Currently in Pending
2025-03-31 02:22:57,721 - INFO - Pod ctest-pod-42648347 is in running state.Got IP 10.47.255.247
2025-03-31 02:22:57,739 - DEBUG - Pod ctest-pod-42648347 has vmi 065da282-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:57,739 - INFO - Verified pod ctest-pod-42648347 in contrail-api
2025-03-31 02:22:57,756 - DEBUG - VMI 065da282-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:57,757 - INFO - Verified Pod ctest-pod-42648347 in agent 10.0.0.49
2025-03-31 02:22:57,757 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=0d9f6e58-4502-473a-917e-54f501027ecd
2025-03-31 02:22:57,763 - INFO - Pod ctest-pod-42648347 with uuid 0d9f6e58-4502-473a-917e-54f501027ecd found in kube manager
2025-03-31 02:22:57,763 - INFO - Pod ctest-pod-42648347 verification passed
2025-03-31 02:22:57,840 - INFO - Pod ctest-pod-67138728 is in running state.Got IP 10.47.255.245
2025-03-31 02:22:57,862 - DEBUG - Pod ctest-pod-67138728 has vmi 07644780-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:57,862 - INFO - Verified pod ctest-pod-67138728 in contrail-api
2025-03-31 02:22:57,877 - DEBUG - VMI 07644780-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:57,878 - INFO - Verified Pod ctest-pod-67138728 in agent 10.0.0.49
2025-03-31 02:22:57,878 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b0906d1e-691b-4821-8e1c-b11ccb3cf112
2025-03-31 02:22:57,883 - INFO - Pod ctest-pod-67138728 with uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 found in kube manager
2025-03-31 02:22:57,883 - INFO - Pod ctest-pod-67138728 verification passed
2025-03-31 02:22:57,888 - INFO - Pod ctest-pod-42837864 is in running state.Got IP 10.47.255.246
2025-03-31 02:22:57,951 - DEBUG - Pod ctest-pod-42837864 has vmi 06dfd84c-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:57,951 - INFO - Verified pod ctest-pod-42837864 in contrail-api
2025-03-31 02:22:57,966 - DEBUG - VMI 06dfd84c-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:57,966 - INFO - Verified Pod ctest-pod-42837864 in agent 10.0.0.49
2025-03-31 02:22:57,966 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=1989cf6e-8495-4136-be06-d214be619bf1
2025-03-31 02:22:57,971 - INFO - Pod ctest-pod-42837864 with uuid 1989cf6e-8495-4136-be06-d214be619bf1 found in kube manager
2025-03-31 02:22:57,972 - INFO - Pod ctest-pod-42837864 verification passed
2025-03-31 02:22:57,979 - INFO - Pod ctest-pod-92869608 is in running state.Got IP 10.47.255.244
2025-03-31 02:22:58,038 - DEBUG - Pod ctest-pod-92869608 has vmi 07e08566-0dd7-11f0-8fe2-fa163e14dac2
2025-03-31 02:22:58,038 - INFO - Verified pod ctest-pod-92869608 in contrail-api
2025-03-31 02:22:58,055 - DEBUG - VMI 07e08566-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49
2025-03-31 02:22:58,055 - INFO - Verified Pod ctest-pod-92869608 in agent 10.0.0.49
2025-03-31 02:22:58,055 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=aa582a7e-e4d5-45a7-9aa7-3e658400e3d9
2025-03-31 02:22:58,060 - INFO - Pod ctest-pod-92869608 with uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 found in kube manager
2025-03-31 02:22:58,060 - INFO - Pod ctest-pod-92869608 verification passed
2025-03-31 02:22:58,060 - INFO - ================================================================================
2025-03-31 02:22:58,060 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-31 02:22:58,061 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-31 02:22:58,270 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.38': '0'}} with
2025-03-31 02:22:58,270 - INFO - Initial checks done. Running the testcase now
2025-03-31 02:22:58,270 - INFO -
2025-03-31 02:22:58,351 - DEBUG - [Pod ctest-pod-10408406] Cmd: echo ctest-pod-10408406 > /usr/share/nginx/html/index.html, Output:
2025-03-31 02:22:58,426 - DEBUG - [Pod ctest-pod-12440975] Cmd: echo ctest-pod-12440975 > /usr/share/nginx/html/index.html, Output:
2025-03-31 02:22:58,498 - DEBUG - [Pod ctest-pod-36437393] Cmd: echo ctest-pod-36437393 > /usr/share/nginx/html/index.html, Output:
2025-03-31 02:22:58,591 - DEBUG - [Pod ctest-pod-53591749] Cmd: echo ctest-pod-53591749 > /usr/share/nginx/html/index.html, Output:
2025-03-31 02:22:58,595 - DEBUG - Service ctest-nginx-svc-06794045 not present
2025-03-31 02:22:58,595 - INFO - Creating service ctest-nginx-svc-06794045
2025-03-31 02:22:58,609 - INFO - Created Service ctest-nginx-svc-06794045
2025-03-31 02:22:58,620 - WARNING - Service UUID 6f408cdf-8524-4025-8a03-6b08c64d88e9 not yet found in contrail-api
2025-03-31 02:22:59,627 - INFO - Validated that Service ctest-nginx-svc-06794045 is seen in contrail-api
2025-03-31 02:22:59,627 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=6f408cdf-8524-4025-8a03-6b08c64d88e9
2025-03-31 02:22:59,632 - INFO - Service ctest-nginx-svc-06794045 with uuid 6f408cdf-8524-4025-8a03-6b08c64d88e9 found in kube manager
2025-03-31 02:22:59,632 - INFO - Service ctest-nginx-svc-06794045 verification passed
2025-03-31 02:23:00,703 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12440975
2025-03-31 02:23:00,703 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:00,703 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12440975
2025-03-31 02:23:00,780 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:00,780 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:00,780 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:00,862 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:00,863 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:00,863 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:00,863 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 2}
2025-03-31 02:23:00,943 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12440975
2025-03-31 02:23:00,943 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:00,943 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12440975
2025-03-31 02:23:01,013 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:01,013 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:01,013 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:01,080 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:01,080 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:01,080 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:01,080 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 2}
2025-03-31 02:23:01,083 - DEBUG - Network policy ingress-on-service not present
2025-03-31 02:23:01,083 - INFO - Creating Network Policy ingress-on-service
2025-03-31 02:23:01,103 - INFO - Network policy found in k8s
2025-03-31 02:23:01,103 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fb8c29-3afe-4d92-b7b4-aa946256a882
2025-03-31 02:23:01,111 - INFO - Network Policy ingress-on-service with uuid f4fb8c29-3afe-4d92-b7b4-aa946256a882 found in kube manager
2025-03-31 02:23:01,149 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-31 02:23:01,150 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-31 02:23:01,150 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fb8c29-3afe-4d92-b7b4-aa946256a882
2025-03-31 02:23:01,184 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-31 02:23:03,185 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fb8c29-3afe-4d92-b7b4-aa946256a882
2025-03-31 02:23:03,222 - INFO - Network policy with name ingress-on-service found in agent
2025-03-31 02:23:03,223 - INFO - Network Policy ingress-on-service verification passed
2025-03-31 02:23:08,297 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:08,297 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:08,297 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:13,347 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:13,347 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:13,347 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:18,425 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:18,425 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:18,425 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:23,493 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:23,494 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:23,494 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:28,569 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:28,569 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:28,570 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:33,640 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:33,640 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:33,640 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:38,716 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:38,716 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:38,716 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:43,789 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:43,789 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:43,789 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:48,864 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:48,865 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:48,865 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:53,921 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:53,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:53,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:53,921 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10408406': 0, 'ctest-pod-12440975': 0}
2025-03-31 02:23:53,992 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:53,992 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:53,992 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,066 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,066 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:54,066 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,139 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,139 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:54,139 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,196 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,196 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:54,196 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,274 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
ctest-pod-12440975
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,275 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:54,275 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
ctest-pod-12440975
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,362 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,362 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:23:54,362 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:23:54,362 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 5}
2025-03-31 02:23:59,419 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:59,419 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:23:59,419 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:04,483 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:04,483 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:04,483 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:09,552 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:09,552 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:09,552 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:14,609 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:14,610 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:14,610 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:19,683 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:19,683 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:19,684 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:24,746 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:24,746 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:24,746 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:29,813 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:29,814 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:29,814 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:34,877 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:34,877 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:34,877 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:39,957 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:39,957 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:39,957 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:45,021 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:45,022 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:45,022 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:24:45,022 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10408406': 0, 'ctest-pod-12440975': 0}
2025-03-31 02:24:47,094 - DEBUG - [Pod ctest-pod-42837864] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.809 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.104 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.330/0.809 ms
2025-03-31 02:24:47,094 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42837864 with expectation True passed
2025-03-31 02:24:49,154 - DEBUG - [Pod ctest-pod-42648347] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.503 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.229/0.503 ms
2025-03-31 02:24:49,154 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42648347 with expectation True passed
2025-03-31 02:24:51,225 - DEBUG - [Pod ctest-pod-67138728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.504 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.226/0.504 ms
2025-03-31 02:24:51,225 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67138728 with expectation True passed
2025-03-31 02:24:51,299 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:24:51,299 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-31 02:24:51,299 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:24:51,299 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42837864 passed
2025-03-31 02:24:51,367 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:24:51,367 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-31 02:24:51,367 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:24:51,367 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42837864 passed
2025-03-31 02:24:56,437 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-31 02:24:56,438 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-31 02:24:56,438 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-31 02:24:56,438 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42648347 passed
2025-03-31 02:25:01,519 - DEBUG - [Pod ctest-pod-92869608] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-31 02:25:01,519 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-31 02:25:01,519 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-31 02:25:01,519 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92869608 passed
2025-03-31 02:25:01,531 - INFO - Updating Network Policy ingress-on-service
2025-03-31 02:25:06,606 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:06,606 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:06,606 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:11,675 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:11,676 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:11,676 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:16,740 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:16,740 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:16,740 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:21,804 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:21,805 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:21,805 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:26,885 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:26,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:26,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:31,987 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:31,987 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:31,987 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:37,050 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:37,050 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:37,050 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:42,136 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:42,136 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:42,136 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:47,210 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:47,210 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:47,210 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:52,285 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:52,285 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:52,285 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
wget: download timed out
2025-03-31 02:25:52,285 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10408406': 0, 'ctest-pod-12440975': 0}
2025-03-31 02:25:52,339 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
ctest-pod-12440975
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,340 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:25:52,340 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
ctest-pod-12440975
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,403 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,403 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:25:52,403 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,483 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
ctest-pod-10408406
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,483 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:25:52,484 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80)
ctest-pod-10408406
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,484 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 2}
2025-03-31 02:25:52,563 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,563 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:25:52,563 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-12440975
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,627 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,628 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed
2025-03-31 02:25:52,628 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-10408406
Connecting to 10.100.15.138:80 (10.100.15.138:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-31 02:25:52,628 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 1}
2025-03-31 02:25:54,689 - DEBUG - [Pod ctest-pod-42837864] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.677 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.619/1.677 ms
2025-03-31 02:25:54,689 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42837864 with expectation True passed
2025-03-31 02:25:56,761 - DEBUG - [Pod ctest-pod-42648347] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.435 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.112 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.202/0.435 ms
2025-03-31 02:25:56,761 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42648347 with expectation True passed
2025-03-31 02:25:58,816 - DEBUG - [Pod ctest-pod-67138728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.470 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.208/0.470 ms
2025-03-31 02:25:58,817 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67138728 with expectation True passed
2025-03-31 02:25:58,886 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:25:58,887 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-31 02:25:58,887 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:25:58,887 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42837864 passed
2025-03-31 02:25:58,949 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:25:58,950 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-31 02:25:58,950 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:25:58,950 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42837864 passed
2025-03-31 02:26:04,006 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-31 02:26:04,006 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-31 02:26:04,006 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-31 02:26:04,006 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42648347 passed
2025-03-31 02:26:04,067 - DEBUG - [Pod ctest-pod-92869608] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:26:04,067 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-31 02:26:04,067 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-31 02:26:04,067 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92869608 passed
2025-03-31 02:26:04,067 - INFO - Deleting Network Policy : ingress-on-service
2025-03-31 02:26:04,068 - INFO - Deleting service : ctest-nginx-svc-06794045
2025-03-31 02:26:04,266 - DEBUG - No XMPP flaps were noticed during the test
2025-03-31 02:26:04,266 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-31 02:26:04,267 - INFO - --------------------------------------------------------------------------------
2025-03-31 02:26:04,273 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-10408406
2025-03-31 02:26:04,274 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-12440975
2025-03-31 02:26:04,274 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-36437393
2025-03-31 02:26:04,275 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-53591749
2025-03-31 02:26:04,275 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-42648347
2025-03-31 02:26:04,275 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-42837864
2025-03-31 02:26:04,276 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-67138728
2025-03-31 02:26:04,276 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-92869608
2025-03-31 02:26:04,319 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,409 - WARNING - Pod uuid 25c66d81-db8c-4514-a508-351bc9c9bef8 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,411 - WARNING - Pod uuid 56a1034c-e31c-41ce-890f-e0c518552617 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,411 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,412 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,412 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,412 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:04,413 - WARNING - Pod uuid e5fadc02-1399-4c21-bb53-210d6d2db9b3 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:09,329 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:09,444 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:09,446 - DEBUG - Pod 56a1034c-e31c-41ce-890f-e0c518552617 is not in agent 10.0.0.49 VM list
2025-03-31 02:26:09,448 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:09,448 - DEBUG - Pod 25c66d81-db8c-4514-a508-351bc9c9bef8 is not in agent 10.0.0.49 VM list
2025-03-31 02:26:09,449 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:09,450 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:09,450 - DEBUG - Pod e5fadc02-1399-4c21-bb53-210d6d2db9b3 is not in agent 10.0.0.49 VM list
2025-03-31 02:26:09,463 - DEBUG - VMI 052df27c-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:09,463 - INFO - Verified that pod ctest-pod-36437393 is removed in agent
2025-03-31 02:26:09,465 - DEBUG - VMI 046b320a-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:09,465 - INFO - Verified that pod ctest-pod-12440975 is removed in agent
2025-03-31 02:26:09,466 - DEBUG - VMI 05bb6e0e-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:09,466 - INFO - Verified that pod ctest-pod-53591749 is removed in agent
2025-03-31 02:26:14,338 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:14,468 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:14,470 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:14,471 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:14,471 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:19,349 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:19,489 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:19,489 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:19,491 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:19,491 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:24,359 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:24,511 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:24,513 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:24,513 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:24,514 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:29,370 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:29,531 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:29,534 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:29,534 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:29,534 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:34,381 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:34,541 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:34,552 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:34,553 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:34,553 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list
2025-03-31 02:26:39,390 - DEBUG - Pod b22fa05e-ce04-46a5-b811-0453f271720d is not in agent 10.0.0.49 VM list
2025-03-31 02:26:39,397 - DEBUG - VMI 03fdeede-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:39,397 - INFO - Verified that pod ctest-pod-10408406 is removed in agent
2025-03-31 02:26:39,548 - DEBUG - Pod 1989cf6e-8495-4136-be06-d214be619bf1 is not in agent 10.0.0.49 VM list
2025-03-31 02:26:39,558 - DEBUG - VMI 06dfd84c-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:39,558 - INFO - Verified that pod ctest-pod-42837864 is removed in agent
2025-03-31 02:26:39,564 - DEBUG - Pod b0906d1e-691b-4821-8e1c-b11ccb3cf112 is not in agent 10.0.0.49 VM list
2025-03-31 02:26:39,574 - DEBUG - VMI 07644780-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:39,574 - INFO - Verified that pod ctest-pod-67138728 is removed in agent
2025-03-31 02:26:39,577 - DEBUG - Pod 0d9f6e58-4502-473a-917e-54f501027ecd is not in agent 10.0.0.49 VM list
2025-03-31 02:26:39,578 - DEBUG - Pod aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is not in agent 10.0.0.49 VM list
2025-03-31 02:26:39,587 - DEBUG - VMI 065da282-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:39,587 - INFO - Verified that pod ctest-pod-42648347 is removed in agent
2025-03-31 02:26:39,590 - DEBUG - VMI 07e08566-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49
2025-03-31 02:26:39,590 - INFO - Verified that pod ctest-pod-92869608 is removed in agent
2025-03-31 02:26:39,591 - INFO - Deleting namespace ctest-non-default-76121202
2025-03-31 02:26:39,616 - DEBUG - Namespace ctest-non-default-76121202 still in k8s
2025-03-31 02:26:41,621 - DEBUG - Namespace ctest-non-default-76121202 still in k8s
2025-03-31 02:26:43,625 - DEBUG - Namespace ctest-non-default-76121202 still in k8s
2025-03-31 02:26:45,631 - DEBUG - Namespace ctest-non-default-76121202 is not in k8s
2025-03-31 02:26:45,631 - DEBUG - No need to check project deletion in contrail-api
2025-03-31 02:26:45,631 - INFO - Deleting namespace ctest-new-default-50103650
2025-03-31 02:26:45,643 - DEBUG - Namespace ctest-new-default-50103650 still in k8s
2025-03-31 02:26:47,656 - DEBUG - Namespace ctest-new-default-50103650 still in k8s
2025-03-31 02:26:49,661 - DEBUG - Namespace ctest-new-default-50103650 still in k8s
2025-03-31 02:26:51,666 - DEBUG - Namespace ctest-new-default-50103650 is not in k8s
2025-03-31 02:26:51,666 - DEBUG - No need to check project deletion in contrail-api