2025-03-31 02:22:30,282 - INFO - Using existing project ['default-domain', 'k8s-default'](e4876756-ad68-45f0-ada1-ffceaf2f3bb2) 2025-03-31 02:22:30,302 - DEBUG - Namespace ctest-new-default-50103650 not present 2025-03-31 02:22:30,314 - INFO - Created namespace ctest-new-default-50103650 2025-03-31 02:22:33,319 - DEBUG - Namespace ctest-non-default-76121202 not present 2025-03-31 02:22:33,327 - INFO - Created namespace ctest-non-default-76121202 2025-03-31 02:22:36,354 - DEBUG - Pod ctest-pod-10408406 not present 2025-03-31 02:22:36,354 - INFO - Creating Pod ctest-pod-10408406 2025-03-31 02:22:36,395 - DEBUG - Pod : ctest-pod-10408406 UUID is b22fa05e-ce04-46a5-b811-0453f271720d 2025-03-31 02:22:36,398 - DEBUG - Pod ctest-pod-12440975 not present 2025-03-31 02:22:36,398 - INFO - Creating Pod ctest-pod-12440975 2025-03-31 02:22:36,471 - DEBUG - Pod : ctest-pod-12440975 UUID is 25c66d81-db8c-4514-a508-351bc9c9bef8 2025-03-31 02:22:36,473 - DEBUG - Pod ctest-pod-36437393 not present 2025-03-31 02:22:36,473 - INFO - Creating Pod ctest-pod-36437393 2025-03-31 02:22:36,509 - DEBUG - Pod : ctest-pod-36437393 UUID is 56a1034c-e31c-41ce-890f-e0c518552617 2025-03-31 02:22:36,515 - DEBUG - Pod ctest-pod-53591749 not present 2025-03-31 02:22:36,515 - INFO - Creating Pod ctest-pod-53591749 2025-03-31 02:22:36,554 - DEBUG - Pod : ctest-pod-53591749 UUID is e5fadc02-1399-4c21-bb53-210d6d2db9b3 2025-03-31 02:22:36,568 - DEBUG - Pod ctest-pod-42648347 not present 2025-03-31 02:22:36,569 - INFO - Creating Pod ctest-pod-42648347 2025-03-31 02:22:36,611 - DEBUG - Pod : ctest-pod-42648347 UUID is 0d9f6e58-4502-473a-917e-54f501027ecd 2025-03-31 02:22:36,617 - DEBUG - Pod ctest-pod-42837864 not present 2025-03-31 02:22:36,618 - INFO - Creating Pod ctest-pod-42837864 2025-03-31 02:22:36,651 - DEBUG - Pod : ctest-pod-42837864 UUID is 1989cf6e-8495-4136-be06-d214be619bf1 2025-03-31 02:22:36,656 - DEBUG - Pod ctest-pod-67138728 not present 2025-03-31 02:22:36,661 - INFO - Creating Pod ctest-pod-67138728 2025-03-31 02:22:36,685 - DEBUG - Pod : ctest-pod-67138728 UUID is b0906d1e-691b-4821-8e1c-b11ccb3cf112 2025-03-31 02:22:36,690 - DEBUG - Pod ctest-pod-92869608 not present 2025-03-31 02:22:36,691 - INFO - Creating Pod ctest-pod-92869608 2025-03-31 02:22:36,730 - DEBUG - Pod : ctest-pod-92869608 UUID is aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 2025-03-31 02:22:36,969 - INFO - Project default-domain:k8s-ctest-new-default-50103650 for Namespace ctest-new-default-50103650 is seen in contrail-api 2025-03-31 02:22:36,970 - DEBUG - Project uuid in Contrail is ce65a89f-3fb6-4e8e-bc61-4b11c656bcac 2025-03-31 02:22:37,162 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=17785cdc-f2a0-40b5-9f90-7105a5abe312 2025-03-31 02:22:37,169 - INFO - Namespace ctest-new-default-50103650 with uuid 17785cdc-f2a0-40b5-9f90-7105a5abe312 found in kube manager 2025-03-31 02:22:37,169 - INFO - Namespace ctest-new-default-50103650 verification passed 2025-03-31 02:22:37,367 - INFO - Project default-domain:k8s-ctest-non-default-76121202 for Namespace ctest-non-default-76121202 is seen in contrail-api 2025-03-31 02:22:37,367 - DEBUG - Project uuid in Contrail is 00b1ebad-05f7-4029-a3a4-3b6365511e7f 2025-03-31 02:22:37,368 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=9748c2b2-f464-4cda-a04f-89d3f548c5d4 2025-03-31 02:22:37,373 - INFO - Namespace ctest-non-default-76121202 with uuid 9748c2b2-f464-4cda-a04f-89d3f548c5d4 found in kube manager 2025-03-31 02:22:37,373 - INFO - Namespace ctest-non-default-76121202 verification passed 2025-03-31 02:22:37,378 - DEBUG - Pod ctest-pod-10408406 not in running state.Currently in Pending 2025-03-31 02:22:42,393 - DEBUG - Pod ctest-pod-10408406 not in running state.Currently in Pending 2025-03-31 02:22:47,400 - DEBUG - Pod ctest-pod-10408406 not in running state.Currently in Pending 2025-03-31 02:22:52,409 - INFO - Pod ctest-pod-10408406 is in running state.Got IP 10.47.255.251 2025-03-31 02:22:52,470 - DEBUG - Pod ctest-pod-10408406 has vmi 03fdeede-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:52,470 - INFO - Verified pod ctest-pod-10408406 in contrail-api 2025-03-31 02:22:52,487 - DEBUG - VMI 03fdeede-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:52,488 - INFO - Verified Pod ctest-pod-10408406 in agent 10.0.0.49 2025-03-31 02:22:52,488 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b22fa05e-ce04-46a5-b811-0453f271720d 2025-03-31 02:22:52,493 - INFO - Pod ctest-pod-10408406 with uuid b22fa05e-ce04-46a5-b811-0453f271720d found in kube manager 2025-03-31 02:22:52,494 - INFO - Pod ctest-pod-10408406 verification passed 2025-03-31 02:22:52,499 - INFO - Pod ctest-pod-12440975 is in running state.Got IP 10.47.255.250 2025-03-31 02:22:52,515 - DEBUG - Pod ctest-pod-12440975 has vmi 046b320a-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:52,515 - INFO - Verified pod ctest-pod-12440975 in contrail-api 2025-03-31 02:22:52,530 - DEBUG - VMI 046b320a-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:52,530 - INFO - Verified Pod ctest-pod-12440975 in agent 10.0.0.49 2025-03-31 02:22:52,531 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=25c66d81-db8c-4514-a508-351bc9c9bef8 2025-03-31 02:22:52,536 - INFO - Pod ctest-pod-12440975 with uuid 25c66d81-db8c-4514-a508-351bc9c9bef8 found in kube manager 2025-03-31 02:22:52,536 - INFO - Pod ctest-pod-12440975 verification passed 2025-03-31 02:22:52,543 - INFO - Pod ctest-pod-36437393 is in running state.Got IP 10.47.255.249 2025-03-31 02:22:52,598 - DEBUG - Pod ctest-pod-36437393 has vmi 052df27c-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:52,598 - INFO - Verified pod ctest-pod-36437393 in contrail-api 2025-03-31 02:22:52,620 - DEBUG - VMI 052df27c-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:52,621 - INFO - Verified Pod ctest-pod-36437393 in agent 10.0.0.49 2025-03-31 02:22:52,621 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=56a1034c-e31c-41ce-890f-e0c518552617 2025-03-31 02:22:52,626 - INFO - Pod ctest-pod-36437393 with uuid 56a1034c-e31c-41ce-890f-e0c518552617 found in kube manager 2025-03-31 02:22:52,626 - INFO - Pod ctest-pod-36437393 verification passed 2025-03-31 02:22:52,631 - INFO - Pod ctest-pod-53591749 is in running state.Got IP 10.47.255.248 2025-03-31 02:22:52,686 - DEBUG - Pod ctest-pod-53591749 has vmi 05bb6e0e-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:52,686 - INFO - Verified pod ctest-pod-53591749 in contrail-api 2025-03-31 02:22:52,701 - DEBUG - VMI 05bb6e0e-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:52,701 - INFO - Verified Pod ctest-pod-53591749 in agent 10.0.0.49 2025-03-31 02:22:52,701 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=e5fadc02-1399-4c21-bb53-210d6d2db9b3 2025-03-31 02:22:52,706 - INFO - Pod ctest-pod-53591749 with uuid e5fadc02-1399-4c21-bb53-210d6d2db9b3 found in kube manager 2025-03-31 02:22:52,706 - INFO - Pod ctest-pod-53591749 verification passed 2025-03-31 02:22:52,712 - DEBUG - Pod ctest-pod-42648347 not in running state.Currently in Pending 2025-03-31 02:22:57,721 - INFO - Pod ctest-pod-42648347 is in running state.Got IP 10.47.255.247 2025-03-31 02:22:57,739 - DEBUG - Pod ctest-pod-42648347 has vmi 065da282-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:57,739 - INFO - Verified pod ctest-pod-42648347 in contrail-api 2025-03-31 02:22:57,756 - DEBUG - VMI 065da282-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:57,757 - INFO - Verified Pod ctest-pod-42648347 in agent 10.0.0.49 2025-03-31 02:22:57,757 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=0d9f6e58-4502-473a-917e-54f501027ecd 2025-03-31 02:22:57,763 - INFO - Pod ctest-pod-42648347 with uuid 0d9f6e58-4502-473a-917e-54f501027ecd found in kube manager 2025-03-31 02:22:57,763 - INFO - Pod ctest-pod-42648347 verification passed 2025-03-31 02:22:57,840 - INFO - Pod ctest-pod-67138728 is in running state.Got IP 10.47.255.245 2025-03-31 02:22:57,862 - DEBUG - Pod ctest-pod-67138728 has vmi 07644780-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:57,862 - INFO - Verified pod ctest-pod-67138728 in contrail-api 2025-03-31 02:22:57,877 - DEBUG - VMI 07644780-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:57,878 - INFO - Verified Pod ctest-pod-67138728 in agent 10.0.0.49 2025-03-31 02:22:57,878 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=b0906d1e-691b-4821-8e1c-b11ccb3cf112 2025-03-31 02:22:57,883 - INFO - Pod ctest-pod-67138728 with uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 found in kube manager 2025-03-31 02:22:57,883 - INFO - Pod ctest-pod-67138728 verification passed 2025-03-31 02:22:57,888 - INFO - Pod ctest-pod-42837864 is in running state.Got IP 10.47.255.246 2025-03-31 02:22:57,951 - DEBUG - Pod ctest-pod-42837864 has vmi 06dfd84c-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:57,951 - INFO - Verified pod ctest-pod-42837864 in contrail-api 2025-03-31 02:22:57,966 - DEBUG - VMI 06dfd84c-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:57,966 - INFO - Verified Pod ctest-pod-42837864 in agent 10.0.0.49 2025-03-31 02:22:57,966 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=1989cf6e-8495-4136-be06-d214be619bf1 2025-03-31 02:22:57,971 - INFO - Pod ctest-pod-42837864 with uuid 1989cf6e-8495-4136-be06-d214be619bf1 found in kube manager 2025-03-31 02:22:57,972 - INFO - Pod ctest-pod-42837864 verification passed 2025-03-31 02:22:57,979 - INFO - Pod ctest-pod-92869608 is in running state.Got IP 10.47.255.244 2025-03-31 02:22:58,038 - DEBUG - Pod ctest-pod-92869608 has vmi 07e08566-0dd7-11f0-8fe2-fa163e14dac2 2025-03-31 02:22:58,038 - INFO - Verified pod ctest-pod-92869608 in contrail-api 2025-03-31 02:22:58,055 - DEBUG - VMI 07e08566-0dd7-11f0-8fe2-fa163e14dac2 is active in agent 10.0.0.49 2025-03-31 02:22:58,055 - INFO - Verified Pod ctest-pod-92869608 in agent 10.0.0.49 2025-03-31 02:22:58,055 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 2025-03-31 02:22:58,060 - INFO - Pod ctest-pod-92869608 with uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 found in kube manager 2025-03-31 02:22:58,060 - INFO - Pod ctest-pod-92869608 verification passed 2025-03-31 02:22:58,060 - INFO - ================================================================================ 2025-03-31 02:22:58,060 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-31 02:22:58,061 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-31 02:22:58,270 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.38': '0'}} with 2025-03-31 02:22:58,270 - INFO - Initial checks done. Running the testcase now 2025-03-31 02:22:58,270 - INFO - 2025-03-31 02:22:58,351 - DEBUG - [Pod ctest-pod-10408406] Cmd: echo ctest-pod-10408406 > /usr/share/nginx/html/index.html, Output: 2025-03-31 02:22:58,426 - DEBUG - [Pod ctest-pod-12440975] Cmd: echo ctest-pod-12440975 > /usr/share/nginx/html/index.html, Output: 2025-03-31 02:22:58,498 - DEBUG - [Pod ctest-pod-36437393] Cmd: echo ctest-pod-36437393 > /usr/share/nginx/html/index.html, Output: 2025-03-31 02:22:58,591 - DEBUG - [Pod ctest-pod-53591749] Cmd: echo ctest-pod-53591749 > /usr/share/nginx/html/index.html, Output: 2025-03-31 02:22:58,595 - DEBUG - Service ctest-nginx-svc-06794045 not present 2025-03-31 02:22:58,595 - INFO - Creating service ctest-nginx-svc-06794045 2025-03-31 02:22:58,609 - INFO - Created Service ctest-nginx-svc-06794045 2025-03-31 02:22:58,620 - WARNING - Service UUID 6f408cdf-8524-4025-8a03-6b08c64d88e9 not yet found in contrail-api 2025-03-31 02:22:59,627 - INFO - Validated that Service ctest-nginx-svc-06794045 is seen in contrail-api 2025-03-31 02:22:59,627 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=6f408cdf-8524-4025-8a03-6b08c64d88e9 2025-03-31 02:22:59,632 - INFO - Service ctest-nginx-svc-06794045 with uuid 6f408cdf-8524-4025-8a03-6b08c64d88e9 found in kube manager 2025-03-31 02:22:59,632 - INFO - Service ctest-nginx-svc-06794045 verification passed 2025-03-31 02:23:00,703 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12440975 2025-03-31 02:23:00,703 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:00,703 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12440975 2025-03-31 02:23:00,780 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:00,780 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:00,780 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:00,862 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:00,863 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:00,863 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:00,863 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 2} 2025-03-31 02:23:00,943 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12440975 2025-03-31 02:23:00,943 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:00,943 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12440975 2025-03-31 02:23:01,013 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:01,013 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:01,013 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:01,080 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:01,080 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:01,080 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:01,080 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 2} 2025-03-31 02:23:01,083 - DEBUG - Network policy ingress-on-service not present 2025-03-31 02:23:01,083 - INFO - Creating Network Policy ingress-on-service 2025-03-31 02:23:01,103 - INFO - Network policy found in k8s 2025-03-31 02:23:01,103 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fb8c29-3afe-4d92-b7b4-aa946256a882 2025-03-31 02:23:01,111 - INFO - Network Policy ingress-on-service with uuid f4fb8c29-3afe-4d92-b7b4-aa946256a882 found in kube manager 2025-03-31 02:23:01,149 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-31 02:23:01,150 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-31 02:23:01,150 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fb8c29-3afe-4d92-b7b4-aa946256a882 2025-03-31 02:23:01,184 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-31 02:23:03,185 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f4fb8c29-3afe-4d92-b7b4-aa946256a882 2025-03-31 02:23:03,222 - INFO - Network policy with name ingress-on-service found in agent 2025-03-31 02:23:03,223 - INFO - Network Policy ingress-on-service verification passed 2025-03-31 02:23:08,297 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:08,297 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:08,297 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:13,347 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:13,347 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:13,347 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:18,425 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:18,425 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:18,425 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:23,493 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:23,494 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:23,494 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:28,569 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:28,569 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:28,570 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:33,640 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:33,640 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:33,640 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:38,716 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:38,716 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:38,716 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:43,789 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:43,789 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:43,789 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:48,864 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:48,865 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:48,865 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:53,921 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:53,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:53,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:53,921 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10408406': 0, 'ctest-pod-12440975': 0} 2025-03-31 02:23:53,992 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:53,992 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:53,992 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,066 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,066 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:54,066 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,139 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,139 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:54,139 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,196 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,196 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:54,196 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,274 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) ctest-pod-12440975 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,275 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:54,275 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) ctest-pod-12440975 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,362 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,362 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:23:54,362 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:23:54,362 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 5} 2025-03-31 02:23:59,419 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:59,419 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:23:59,419 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:04,483 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:04,483 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:04,483 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:09,552 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:09,552 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:09,552 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:14,609 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:14,610 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:14,610 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:19,683 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:19,683 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:19,684 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:24,746 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:24,746 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:24,746 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:29,813 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:29,814 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:29,814 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:34,877 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:34,877 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:34,877 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:39,957 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:39,957 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:39,957 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:45,021 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:45,022 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:45,022 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:24:45,022 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10408406': 0, 'ctest-pod-12440975': 0} 2025-03-31 02:24:47,094 - DEBUG - [Pod ctest-pod-42837864] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.809 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.104 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.330/0.809 ms 2025-03-31 02:24:47,094 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42837864 with expectation True passed 2025-03-31 02:24:49,154 - DEBUG - [Pod ctest-pod-42648347] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.503 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.229/0.503 ms 2025-03-31 02:24:49,154 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42648347 with expectation True passed 2025-03-31 02:24:51,225 - DEBUG - [Pod ctest-pod-67138728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.504 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.226/0.504 ms 2025-03-31 02:24:51,225 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67138728 with expectation True passed 2025-03-31 02:24:51,299 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:24:51,299 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-31 02:24:51,299 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:24:51,299 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42837864 passed 2025-03-31 02:24:51,367 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:24:51,367 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-31 02:24:51,367 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:24:51,367 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42837864 passed 2025-03-31 02:24:56,437 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-31 02:24:56,438 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-31 02:24:56,438 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-31 02:24:56,438 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42648347 passed 2025-03-31 02:25:01,519 - DEBUG - [Pod ctest-pod-92869608] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-31 02:25:01,519 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-31 02:25:01,519 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-31 02:25:01,519 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92869608 passed 2025-03-31 02:25:01,531 - INFO - Updating Network Policy ingress-on-service 2025-03-31 02:25:06,606 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:06,606 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:06,606 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:11,675 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:11,676 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:11,676 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:16,740 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:16,740 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:16,740 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:21,804 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:21,805 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:21,805 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:26,885 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:26,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:26,921 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:31,987 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:31,987 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:31,987 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:37,050 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:37,050 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:37,050 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:42,136 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:42,136 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:42,136 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:47,210 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:47,210 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:47,210 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:52,285 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:52,285 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:52,285 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) wget: download timed out 2025-03-31 02:25:52,285 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10408406': 0, 'ctest-pod-12440975': 0} 2025-03-31 02:25:52,339 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) ctest-pod-12440975 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,340 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:25:52,340 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) ctest-pod-12440975 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,403 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,403 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:25:52,403 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,483 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.15.138:80 (10.100.15.138:80) ctest-pod-10408406 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,483 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:25:52,484 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.100.15.138:80 (10.100.15.138:80) ctest-pod-10408406 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,484 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 2} 2025-03-31 02:25:52,563 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,563 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:25:52,563 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-12440975 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,627 - DEBUG - [Pod ctest-pod-67138728] Cmd: wget http://10.100.15.138:80/ -O - -T 5 -t 1 , Output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,628 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd wget http://10.100.15.138:80/ -O - -T 5 -t 1 passed 2025-03-31 02:25:52,628 - DEBUG - [Pod Pod ctest-pod-67138728] Cmd output: ctest-pod-10408406 Connecting to 10.100.15.138:80 (10.100.15.138:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-31 02:25:52,628 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10408406': 1, 'ctest-pod-12440975': 1} 2025-03-31 02:25:54,689 - DEBUG - [Pod ctest-pod-42837864] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.677 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.619/1.677 ms 2025-03-31 02:25:54,689 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42837864 with expectation True passed 2025-03-31 02:25:56,761 - DEBUG - [Pod ctest-pod-42648347] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.435 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.112 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.202/0.435 ms 2025-03-31 02:25:56,761 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42648347 with expectation True passed 2025-03-31 02:25:58,816 - DEBUG - [Pod ctest-pod-67138728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.470 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.208/0.470 ms 2025-03-31 02:25:58,817 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67138728 with expectation True passed 2025-03-31 02:25:58,886 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:25:58,887 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-31 02:25:58,887 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:25:58,887 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42837864 passed 2025-03-31 02:25:58,949 - DEBUG - [Pod ctest-pod-42837864] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:25:58,950 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-31 02:25:58,950 - DEBUG - [Pod Pod ctest-pod-42837864] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:25:58,950 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42837864 passed 2025-03-31 02:26:04,006 - DEBUG - [Pod ctest-pod-42648347] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-31 02:26:04,006 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-31 02:26:04,006 - DEBUG - [Pod Pod ctest-pod-42648347] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-31 02:26:04,006 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42648347 passed 2025-03-31 02:26:04,067 - DEBUG - [Pod ctest-pod-92869608] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:26:04,067 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-31 02:26:04,067 - DEBUG - [Pod Pod ctest-pod-92869608] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-31 02:26:04,067 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92869608 passed 2025-03-31 02:26:04,067 - INFO - Deleting Network Policy : ingress-on-service 2025-03-31 02:26:04,068 - INFO - Deleting service : ctest-nginx-svc-06794045 2025-03-31 02:26:04,266 - DEBUG - No XMPP flaps were noticed during the test 2025-03-31 02:26:04,266 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-03-31 02:26:04,267 - INFO - -------------------------------------------------------------------------------- 2025-03-31 02:26:04,273 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-10408406 2025-03-31 02:26:04,274 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-12440975 2025-03-31 02:26:04,274 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-36437393 2025-03-31 02:26:04,275 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-53591749 2025-03-31 02:26:04,275 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-42648347 2025-03-31 02:26:04,275 - INFO - Deleting pod ctest-new-default-50103650:ctest-pod-42837864 2025-03-31 02:26:04,276 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-67138728 2025-03-31 02:26:04,276 - INFO - Deleting pod ctest-non-default-76121202:ctest-pod-92869608 2025-03-31 02:26:04,319 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,409 - WARNING - Pod uuid 25c66d81-db8c-4514-a508-351bc9c9bef8 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,411 - WARNING - Pod uuid 56a1034c-e31c-41ce-890f-e0c518552617 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,411 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,412 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,412 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,412 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:04,413 - WARNING - Pod uuid e5fadc02-1399-4c21-bb53-210d6d2db9b3 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:09,329 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:09,444 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:09,446 - DEBUG - Pod 56a1034c-e31c-41ce-890f-e0c518552617 is not in agent 10.0.0.49 VM list 2025-03-31 02:26:09,448 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:09,448 - DEBUG - Pod 25c66d81-db8c-4514-a508-351bc9c9bef8 is not in agent 10.0.0.49 VM list 2025-03-31 02:26:09,449 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:09,450 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:09,450 - DEBUG - Pod e5fadc02-1399-4c21-bb53-210d6d2db9b3 is not in agent 10.0.0.49 VM list 2025-03-31 02:26:09,463 - DEBUG - VMI 052df27c-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:09,463 - INFO - Verified that pod ctest-pod-36437393 is removed in agent 2025-03-31 02:26:09,465 - DEBUG - VMI 046b320a-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:09,465 - INFO - Verified that pod ctest-pod-12440975 is removed in agent 2025-03-31 02:26:09,466 - DEBUG - VMI 05bb6e0e-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:09,466 - INFO - Verified that pod ctest-pod-53591749 is removed in agent 2025-03-31 02:26:14,338 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:14,468 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:14,470 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:14,471 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:14,471 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:19,349 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:19,489 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:19,489 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:19,491 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:19,491 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:24,359 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:24,511 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:24,513 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:24,513 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:24,514 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:29,370 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:29,531 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:29,534 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:29,534 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:29,534 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:34,381 - WARNING - Pod uuid b22fa05e-ce04-46a5-b811-0453f271720d is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:34,541 - WARNING - Pod uuid 1989cf6e-8495-4136-be06-d214be619bf1 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:34,552 - WARNING - Pod uuid b0906d1e-691b-4821-8e1c-b11ccb3cf112 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:34,553 - WARNING - Pod uuid 0d9f6e58-4502-473a-917e-54f501027ecd is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:34,553 - WARNING - Pod uuid aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is still seen in agent 10.0.0.49 VM list 2025-03-31 02:26:39,390 - DEBUG - Pod b22fa05e-ce04-46a5-b811-0453f271720d is not in agent 10.0.0.49 VM list 2025-03-31 02:26:39,397 - DEBUG - VMI 03fdeede-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:39,397 - INFO - Verified that pod ctest-pod-10408406 is removed in agent 2025-03-31 02:26:39,548 - DEBUG - Pod 1989cf6e-8495-4136-be06-d214be619bf1 is not in agent 10.0.0.49 VM list 2025-03-31 02:26:39,558 - DEBUG - VMI 06dfd84c-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:39,558 - INFO - Verified that pod ctest-pod-42837864 is removed in agent 2025-03-31 02:26:39,564 - DEBUG - Pod b0906d1e-691b-4821-8e1c-b11ccb3cf112 is not in agent 10.0.0.49 VM list 2025-03-31 02:26:39,574 - DEBUG - VMI 07644780-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:39,574 - INFO - Verified that pod ctest-pod-67138728 is removed in agent 2025-03-31 02:26:39,577 - DEBUG - Pod 0d9f6e58-4502-473a-917e-54f501027ecd is not in agent 10.0.0.49 VM list 2025-03-31 02:26:39,578 - DEBUG - Pod aa582a7e-e4d5-45a7-9aa7-3e658400e3d9 is not in agent 10.0.0.49 VM list 2025-03-31 02:26:39,587 - DEBUG - VMI 065da282-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:39,587 - INFO - Verified that pod ctest-pod-42648347 is removed in agent 2025-03-31 02:26:39,590 - DEBUG - VMI 07e08566-0dd7-11f0-8fe2-fa163e14dac2 is removed from agent 10.0.0.49 2025-03-31 02:26:39,590 - INFO - Verified that pod ctest-pod-92869608 is removed in agent 2025-03-31 02:26:39,591 - INFO - Deleting namespace ctest-non-default-76121202 2025-03-31 02:26:39,616 - DEBUG - Namespace ctest-non-default-76121202 still in k8s 2025-03-31 02:26:41,621 - DEBUG - Namespace ctest-non-default-76121202 still in k8s 2025-03-31 02:26:43,625 - DEBUG - Namespace ctest-non-default-76121202 still in k8s 2025-03-31 02:26:45,631 - DEBUG - Namespace ctest-non-default-76121202 is not in k8s 2025-03-31 02:26:45,631 - DEBUG - No need to check project deletion in contrail-api 2025-03-31 02:26:45,631 - INFO - Deleting namespace ctest-new-default-50103650 2025-03-31 02:26:45,643 - DEBUG - Namespace ctest-new-default-50103650 still in k8s 2025-03-31 02:26:47,656 - DEBUG - Namespace ctest-new-default-50103650 still in k8s 2025-03-31 02:26:49,661 - DEBUG - Namespace ctest-new-default-50103650 still in k8s 2025-03-31 02:26:51,666 - DEBUG - Namespace ctest-new-default-50103650 is not in k8s 2025-03-31 02:26:51,666 - DEBUG - No need to check project deletion in contrail-api