2025-04-23 09:56:11,280 - INFO - Using existing project ['default-domain', 'k8s-default'](758fc46b-3d3c-4aed-a7dd-d15fda486d96)
2025-04-23 09:56:11,298 - DEBUG - Namespace ctest-new-default-19324300 not present
2025-04-23 09:56:11,312 - INFO - Created namespace ctest-new-default-19324300
2025-04-23 09:56:14,317 - DEBUG - Namespace ctest-non-default-12844858 not present
2025-04-23 09:56:14,329 - INFO - Created namespace ctest-non-default-12844858
2025-04-23 09:56:17,370 - DEBUG - Pod ctest-pod-30341661 not present
2025-04-23 09:56:17,371 - INFO - Creating Pod ctest-pod-30341661
2025-04-23 09:56:17,402 - DEBUG - Pod : ctest-pod-30341661 UUID is 3659d0b6-87d8-44bf-ad98-9421d955570c
2025-04-23 09:56:17,406 - DEBUG - Pod ctest-pod-41963951 not present
2025-04-23 09:56:17,407 - INFO - Creating Pod ctest-pod-41963951
2025-04-23 09:56:17,449 - DEBUG - Pod : ctest-pod-41963951 UUID is 7cc4bca5-a230-40fc-8f11-8cd890a76b18
2025-04-23 09:56:17,452 - DEBUG - Pod ctest-pod-98545652 not present
2025-04-23 09:56:17,453 - INFO - Creating Pod ctest-pod-98545652
2025-04-23 09:56:17,477 - DEBUG - Pod : ctest-pod-98545652 UUID is 5ca1c227-9cb7-4d0e-8cbd-5a3e8f07a1c8
2025-04-23 09:56:17,485 - DEBUG - Pod ctest-pod-80265772 not present
2025-04-23 09:56:17,486 - INFO - Creating Pod ctest-pod-80265772
2025-04-23 09:56:17,517 - DEBUG - Pod : ctest-pod-80265772 UUID is f0fef83d-91b5-40eb-8974-6b35f63e5ab5
2025-04-23 09:56:17,521 - DEBUG - Pod ctest-pod-65058564 not present
2025-04-23 09:56:17,522 - INFO - Creating Pod ctest-pod-65058564
2025-04-23 09:56:17,543 - DEBUG - Pod : ctest-pod-65058564 UUID is cd9bb433-6250-49b2-b298-fa01822e1f7a
2025-04-23 09:56:17,545 - DEBUG - Pod ctest-pod-71635739 not present
2025-04-23 09:56:17,545 - INFO - Creating Pod ctest-pod-71635739
2025-04-23 09:56:17,569 - DEBUG - Pod : ctest-pod-71635739 UUID is 17c22429-262c-413a-8baf-3cacf0b7954e
2025-04-23 09:56:17,571 - DEBUG - Pod ctest-pod-26134967 not present
2025-04-23 09:56:17,571 - INFO - Creating Pod ctest-pod-26134967
2025-04-23 09:56:17,607 - DEBUG - Pod : ctest-pod-26134967 UUID is 128bab6f-c152-4104-8582-f322153bf035
2025-04-23 09:56:17,611 - DEBUG - Pod ctest-pod-12232457 not present
2025-04-23 09:56:17,611 - INFO - Creating Pod ctest-pod-12232457
2025-04-23 09:56:17,645 - DEBUG - Pod : ctest-pod-12232457 UUID is 62f38136-53d5-4a96-8096-6e40b5e684f3
2025-04-23 09:56:17,845 - INFO - Project default-domain:k8s-ctest-new-default-19324300 for Namespace ctest-new-default-19324300 is seen in contrail-api
2025-04-23 09:56:17,845 - DEBUG - Project uuid in Contrail is 196d4ab4-414f-4ce2-bff9-ea307ed0ceb3
2025-04-23 09:56:18,102 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=cc2decab-91cc-46ed-bfae-33c1ce97316c
2025-04-23 09:56:18,107 - INFO - Namespace ctest-new-default-19324300 with uuid cc2decab-91cc-46ed-bfae-33c1ce97316c found in kube manager
2025-04-23 09:56:18,108 - INFO - Namespace ctest-new-default-19324300 verification passed
2025-04-23 09:56:18,329 - INFO - Project default-domain:k8s-ctest-non-default-12844858 for Namespace ctest-non-default-12844858 is seen in contrail-api
2025-04-23 09:56:18,329 - DEBUG - Project uuid in Contrail is 281c5109-9a49-46a6-9b6a-4b2e3e5cb131
2025-04-23 09:56:18,330 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=94f6d5d8-dbf1-4ac3-bdc1-017dd2519eed
2025-04-23 09:56:18,344 - INFO - Namespace ctest-non-default-12844858 with uuid 94f6d5d8-dbf1-4ac3-bdc1-017dd2519eed found in kube manager
2025-04-23 09:56:18,345 - INFO - Namespace ctest-non-default-12844858 verification passed
2025-04-23 09:56:18,351 - DEBUG - Pod ctest-pod-30341661 not in running state.Currently in Pending
2025-04-23 09:56:23,359 - DEBUG - Pod ctest-pod-30341661 not in running state.Currently in Pending
2025-04-23 09:56:28,367 - DEBUG - Pod ctest-pod-30341661 not in running state.Currently in Pending
2025-04-23 09:56:33,375 - INFO - Pod ctest-pod-30341661 is in running state.Got IP 10.47.255.251
2025-04-23 09:56:33,432 - DEBUG - Pod ctest-pod-30341661 has vmi 3465bc78-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:33,432 - INFO - Verified pod ctest-pod-30341661 in contrail-api
2025-04-23 09:56:33,449 - DEBUG - VMI 3465bc78-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:33,449 - INFO - Verified Pod ctest-pod-30341661 in agent 10.0.0.56
2025-04-23 09:56:33,449 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=3659d0b6-87d8-44bf-ad98-9421d955570c
2025-04-23 09:56:33,454 - INFO - Pod ctest-pod-30341661 with uuid 3659d0b6-87d8-44bf-ad98-9421d955570c found in kube manager
2025-04-23 09:56:33,454 - INFO - Pod ctest-pod-30341661 verification passed
2025-04-23 09:56:33,462 - INFO - Pod ctest-pod-41963951 is in running state.Got IP 10.47.255.250
2025-04-23 09:56:33,480 - DEBUG - Pod ctest-pod-41963951 has vmi 34ecbf5c-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:33,480 - INFO - Verified pod ctest-pod-41963951 in contrail-api
2025-04-23 09:56:33,496 - DEBUG - VMI 34ecbf5c-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:33,496 - INFO - Verified Pod ctest-pod-41963951 in agent 10.0.0.56
2025-04-23 09:56:33,496 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=7cc4bca5-a230-40fc-8f11-8cd890a76b18
2025-04-23 09:56:33,501 - INFO - Pod ctest-pod-41963951 with uuid 7cc4bca5-a230-40fc-8f11-8cd890a76b18 found in kube manager
2025-04-23 09:56:33,502 - INFO - Pod ctest-pod-41963951 verification passed
2025-04-23 09:56:33,507 - INFO - Pod ctest-pod-98545652 is in running state.Got IP 10.47.255.249
2025-04-23 09:56:33,566 - DEBUG - Pod ctest-pod-98545652 has vmi 359928be-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:33,566 - INFO - Verified pod ctest-pod-98545652 in contrail-api
2025-04-23 09:56:33,580 - DEBUG - VMI 359928be-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:33,581 - INFO - Verified Pod ctest-pod-98545652 in agent 10.0.0.56
2025-04-23 09:56:33,581 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5ca1c227-9cb7-4d0e-8cbd-5a3e8f07a1c8
2025-04-23 09:56:33,586 - INFO - Pod ctest-pod-98545652 with uuid 5ca1c227-9cb7-4d0e-8cbd-5a3e8f07a1c8 found in kube manager
2025-04-23 09:56:33,586 - INFO - Pod ctest-pod-98545652 verification passed
2025-04-23 09:56:33,593 - INFO - Pod ctest-pod-80265772 is in running state.Got IP 10.47.255.248
2025-04-23 09:56:33,653 - DEBUG - Pod ctest-pod-80265772 has vmi 3612ee88-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:33,653 - INFO - Verified pod ctest-pod-80265772 in contrail-api
2025-04-23 09:56:33,670 - DEBUG - VMI 3612ee88-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:33,670 - INFO - Verified Pod ctest-pod-80265772 in agent 10.0.0.56
2025-04-23 09:56:33,670 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=f0fef83d-91b5-40eb-8974-6b35f63e5ab5
2025-04-23 09:56:33,678 - INFO - Pod ctest-pod-80265772 with uuid f0fef83d-91b5-40eb-8974-6b35f63e5ab5 found in kube manager
2025-04-23 09:56:33,678 - INFO - Pod ctest-pod-80265772 verification passed
2025-04-23 09:56:33,684 - INFO - Pod ctest-pod-65058564 is in running state.Got IP 10.47.255.247
2025-04-23 09:56:33,702 - DEBUG - Pod ctest-pod-65058564 has vmi 36a2f122-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:33,702 - INFO - Verified pod ctest-pod-65058564 in contrail-api
2025-04-23 09:56:33,717 - DEBUG - VMI 36a2f122-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:33,717 - INFO - Verified Pod ctest-pod-65058564 in agent 10.0.0.56
2025-04-23 09:56:33,717 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=cd9bb433-6250-49b2-b298-fa01822e1f7a
2025-04-23 09:56:33,722 - INFO - Pod ctest-pod-65058564 with uuid cd9bb433-6250-49b2-b298-fa01822e1f7a found in kube manager
2025-04-23 09:56:33,722 - INFO - Pod ctest-pod-65058564 verification passed
2025-04-23 09:56:33,727 - DEBUG - Pod ctest-pod-26134967 not in running state.Currently in Pending
2025-04-23 09:56:38,735 - INFO - Pod ctest-pod-26134967 is in running state.Got IP 10.47.255.245
2025-04-23 09:56:38,800 - DEBUG - Pod ctest-pod-26134967 has vmi 379e7ccc-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:38,800 - INFO - Verified pod ctest-pod-26134967 in contrail-api
2025-04-23 09:56:38,814 - DEBUG - VMI 379e7ccc-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:38,814 - INFO - Verified Pod ctest-pod-26134967 in agent 10.0.0.56
2025-04-23 09:56:38,815 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=128bab6f-c152-4104-8582-f322153bf035
2025-04-23 09:56:38,820 - INFO - Pod ctest-pod-26134967 with uuid 128bab6f-c152-4104-8582-f322153bf035 found in kube manager
2025-04-23 09:56:38,821 - INFO - Pod ctest-pod-26134967 verification passed
2025-04-23 09:56:38,903 - INFO - Pod ctest-pod-71635739 is in running state.Got IP 10.47.255.246
2025-04-23 09:56:38,919 - DEBUG - Pod ctest-pod-71635739 has vmi 371a4c04-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:38,919 - INFO - Verified pod ctest-pod-71635739 in contrail-api
2025-04-23 09:56:38,932 - DEBUG - VMI 371a4c04-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:38,932 - INFO - Verified Pod ctest-pod-71635739 in agent 10.0.0.56
2025-04-23 09:56:38,933 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=17c22429-262c-413a-8baf-3cacf0b7954e
2025-04-23 09:56:38,937 - INFO - Pod ctest-pod-71635739 with uuid 17c22429-262c-413a-8baf-3cacf0b7954e found in kube manager
2025-04-23 09:56:38,938 - INFO - Pod ctest-pod-71635739 verification passed
2025-04-23 09:56:38,943 - INFO - Pod ctest-pod-12232457 is in running state.Got IP 10.47.255.244
2025-04-23 09:56:39,000 - DEBUG - Pod ctest-pod-12232457 has vmi 381c6150-2029-11f0-910f-fa163e5eef2a
2025-04-23 09:56:39,000 - INFO - Verified pod ctest-pod-12232457 in contrail-api
2025-04-23 09:56:39,016 - DEBUG - VMI 381c6150-2029-11f0-910f-fa163e5eef2a is active in agent 10.0.0.56
2025-04-23 09:56:39,016 - INFO - Verified Pod ctest-pod-12232457 in agent 10.0.0.56
2025-04-23 09:56:39,017 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=62f38136-53d5-4a96-8096-6e40b5e684f3
2025-04-23 09:56:39,022 - INFO - Pod ctest-pod-12232457 with uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 found in kube manager
2025-04-23 09:56:39,022 - INFO - Pod ctest-pod-12232457 verification passed
2025-04-23 09:56:39,023 - INFO - ================================================================================
2025-04-23 09:56:39,023 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-23 09:56:39,023 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-23 09:56:39,297 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.33': '0'}} with
2025-04-23 09:56:39,297 - INFO - Initial checks done. Running the testcase now
2025-04-23 09:56:39,297 - INFO -
2025-04-23 09:56:39,366 - DEBUG - [Pod ctest-pod-30341661] Cmd: echo ctest-pod-30341661 > /usr/share/nginx/html/index.html, Output:
2025-04-23 09:56:39,428 - DEBUG - [Pod ctest-pod-41963951] Cmd: echo ctest-pod-41963951 > /usr/share/nginx/html/index.html, Output:
2025-04-23 09:56:39,483 - DEBUG - [Pod ctest-pod-98545652] Cmd: echo ctest-pod-98545652 > /usr/share/nginx/html/index.html, Output:
2025-04-23 09:56:39,530 - DEBUG - [Pod ctest-pod-80265772] Cmd: echo ctest-pod-80265772 > /usr/share/nginx/html/index.html, Output:
2025-04-23 09:56:39,534 - DEBUG - Service ctest-nginx-svc-79734559 not present
2025-04-23 09:56:39,534 - INFO - Creating service ctest-nginx-svc-79734559
2025-04-23 09:56:39,557 - INFO - Created Service ctest-nginx-svc-79734559
2025-04-23 09:56:39,572 - WARNING - Service UUID b4cda366-bdfc-48e6-a423-5ad8e3c76aba not yet found in contrail-api
2025-04-23 09:56:40,590 - INFO - Validated that Service ctest-nginx-svc-79734559 is seen in contrail-api
2025-04-23 09:56:40,590 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=b4cda366-bdfc-48e6-a423-5ad8e3c76aba
2025-04-23 09:56:40,596 - INFO - Service ctest-nginx-svc-79734559 with uuid b4cda366-bdfc-48e6-a423-5ad8e3c76aba found in kube manager
2025-04-23 09:56:40,596 - INFO - Service ctest-nginx-svc-79734559 verification passed
2025-04-23 09:56:41,649 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41963951
2025-04-23 09:56:41,649 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:56:41,649 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41963951
2025-04-23 09:56:41,703 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:56:41,703 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:56:41,703 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:56:41,703 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30341661': 1, 'ctest-pod-41963951': 1}
2025-04-23 09:56:41,758 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:56:41,759 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:56:41,759 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:56:41,793 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:56:41,793 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:56:41,793 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:56:41,851 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30341661
2025-04-23 09:56:41,852 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:56:41,852 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30341661
2025-04-23 09:56:41,852 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30341661': 1, 'ctest-pod-41963951': 2}
2025-04-23 09:56:41,855 - DEBUG - Network policy ingress-on-service not present
2025-04-23 09:56:41,856 - INFO - Creating Network Policy ingress-on-service
2025-04-23 09:56:41,873 - INFO - Network policy found in k8s
2025-04-23 09:56:41,874 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fa1b1d50-2806-4eca-a8cf-abde9aca1aa1
2025-04-23 09:56:41,879 - INFO - Network Policy ingress-on-service with uuid fa1b1d50-2806-4eca-a8cf-abde9aca1aa1 found in kube manager
2025-04-23 09:56:41,910 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-23 09:56:41,911 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-23 09:56:41,911 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fa1b1d50-2806-4eca-a8cf-abde9aca1aa1
2025-04-23 09:56:41,940 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-23 09:56:43,942 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fa1b1d50-2806-4eca-a8cf-abde9aca1aa1
2025-04-23 09:56:43,977 - INFO - Network policy with name ingress-on-service found in agent
2025-04-23 09:56:43,977 - INFO - Network Policy ingress-on-service verification passed
2025-04-23 09:56:49,028 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:49,029 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:49,029 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:54,081 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:54,081 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:54,081 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:59,141 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:59,141 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:56:59,141 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:04,192 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:04,193 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:04,193 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:09,245 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:09,245 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:09,245 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:14,299 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:14,299 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:14,299 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:19,344 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:19,344 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:19,344 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:24,392 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:24,393 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:24,393 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:29,444 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:29,444 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:29,444 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:34,496 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:34,496 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:34,496 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:34,496 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30341661': 0, 'ctest-pod-41963951': 0}
2025-04-23 09:57:34,545 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,546 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:57:34,546 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,592 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,592 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:57:34,592 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,650 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,651 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:57:34,651 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,700 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,700 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:57:34,700 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,755 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,755 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:57:34,755 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:57:34,755 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30341661': 1, 'ctest-pod-41963951': 4}
2025-04-23 09:57:39,802 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:39,802 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:39,802 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:44,865 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:44,865 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:44,865 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:49,912 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:49,912 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:49,912 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:54,960 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:54,961 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:57:54,961 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:00,013 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:00,013 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:00,013 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:05,060 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:05,060 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:05,060 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:10,112 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:10,112 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:10,112 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:15,164 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:15,164 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:15,164 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:20,212 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:20,213 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:20,213 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:25,257 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:25,257 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:25,257 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:25,257 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30341661': 0, 'ctest-pod-41963951': 0}
2025-04-23 09:58:27,301 - DEBUG - [Pod ctest-pod-71635739] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.039 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.407/1.039 ms
2025-04-23 09:58:27,301 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-71635739 with expectation True passed
2025-04-23 09:58:29,345 - DEBUG - [Pod ctest-pod-65058564] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.330 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.156/0.330 ms
2025-04-23 09:58:29,345 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65058564 with expectation True passed
2025-04-23 09:58:31,392 - DEBUG - [Pod ctest-pod-26134967] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.584 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.091/0.256/0.584 ms
2025-04-23 09:58:31,393 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26134967 with expectation True passed
2025-04-23 09:58:31,441 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:58:31,441 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 09:58:31,441 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:58:31,441 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71635739 passed
2025-04-23 09:58:31,486 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:58:31,486 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-23 09:58:31,486 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:58:31,486 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71635739 passed
2025-04-23 09:58:36,532 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 09:58:36,533 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 09:58:36,533 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 09:58:36,533 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65058564 passed
2025-04-23 09:58:41,585 - DEBUG - [Pod ctest-pod-12232457] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 09:58:41,586 - DEBUG - [Pod Pod ctest-pod-12232457] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 09:58:41,586 - DEBUG - [Pod Pod ctest-pod-12232457] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 09:58:41,586 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12232457 passed
2025-04-23 09:58:41,595 - INFO - Updating Network Policy ingress-on-service
2025-04-23 09:58:44,575 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-23 09:58:54,636 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:54,637 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:54,637 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:59,688 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:59,688 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:58:59,688 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:04,774 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:04,774 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:04,774 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:09,825 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:09,825 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:09,825 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:14,877 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:14,877 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:14,877 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:19,924 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:19,925 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:19,925 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:24,976 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:24,976 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:24,976 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:30,020 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:30,020 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:30,020 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:35,068 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:35,069 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:35,069 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:40,117 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:40,117 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:40,117 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
wget: download timed out
2025-04-23 09:59:40,117 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30341661': 0, 'ctest-pod-41963951': 0}
2025-04-23 09:59:40,166 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41963951
2025-04-23 09:59:40,166 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,166 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41963951
2025-04-23 09:59:40,219 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,220 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,220 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,253 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,253 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,253 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,302 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,302 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,302 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,302 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30341661': 1, 'ctest-pod-41963951': 3}
2025-04-23 09:59:40,355 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,355 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,355 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,407 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,408 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,408 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,458 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,458 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,458 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: ctest-pod-41963951
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,496 - DEBUG - [Pod ctest-pod-26134967] Cmd: wget http://10.101.178.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,497 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd wget http://10.101.178.198:80/ -O - -T 5 -t 1 passed
2025-04-23 09:59:40,497 - DEBUG - [Pod Pod ctest-pod-26134967] Cmd output: ctest-pod-30341661
Connecting to 10.101.178.198:80 (10.101.178.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 09:59:40,497 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30341661': 1, 'ctest-pod-41963951': 3}
2025-04-23 09:59:42,549 - DEBUG - [Pod ctest-pod-71635739] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.418 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.530/1.418 ms
2025-04-23 09:59:42,549 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-71635739 with expectation True passed
2025-04-23 09:59:44,596 - DEBUG - [Pod ctest-pod-65058564] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.113 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.058/0.415/1.113 ms
2025-04-23 09:59:44,597 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65058564 with expectation True passed
2025-04-23 09:59:46,649 - DEBUG - [Pod ctest-pod-26134967] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.392 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.518/1.392 ms
2025-04-23 09:59:46,649 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26134967 with expectation True passed
2025-04-23 09:59:46,702 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:59:46,702 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 09:59:46,702 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:59:46,702 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71635739 passed
2025-04-23 09:59:46,750 - DEBUG - [Pod ctest-pod-71635739] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:59:46,750 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-23 09:59:46,750 - DEBUG - [Pod Pod ctest-pod-71635739] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:59:46,750 - INFO - wget check of of http://10.47.255.250 from ctest-pod-71635739 passed
2025-04-23 09:59:51,780 - DEBUG - [Pod ctest-pod-65058564] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 09:59:51,780 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 09:59:51,780 - DEBUG - [Pod Pod ctest-pod-65058564] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 09:59:51,780 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65058564 passed
2025-04-23 09:59:51,834 - DEBUG - [Pod ctest-pod-12232457] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:59:51,834 - DEBUG - [Pod Pod ctest-pod-12232457] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 09:59:51,834 - DEBUG - [Pod Pod ctest-pod-12232457] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 09:59:51,834 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12232457 passed
2025-04-23 09:59:51,834 - INFO - Deleting Network Policy : ingress-on-service
2025-04-23 09:59:51,834 - INFO - Deleting service : ctest-nginx-svc-79734559
2025-04-23 09:59:52,089 - DEBUG - No XMPP flaps were noticed during the test
2025-04-23 09:59:52,089 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-04-23 09:59:52,089 - INFO - --------------------------------------------------------------------------------
2025-04-23 09:59:52,094 - INFO - Deleting pod ctest-new-default-19324300:ctest-pod-30341661
2025-04-23 09:59:52,094 - INFO - Deleting pod ctest-new-default-19324300:ctest-pod-41963951
2025-04-23 09:59:52,095 - INFO - Deleting pod ctest-non-default-12844858:ctest-pod-98545652
2025-04-23 09:59:52,095 - INFO - Deleting pod ctest-non-default-12844858:ctest-pod-80265772
2025-04-23 09:59:52,095 - INFO - Deleting pod ctest-new-default-19324300:ctest-pod-65058564
2025-04-23 09:59:52,096 - INFO - Deleting pod ctest-new-default-19324300:ctest-pod-71635739
2025-04-23 09:59:52,096 - INFO - Deleting pod ctest-non-default-12844858:ctest-pod-26134967
2025-04-23 09:59:52,096 - INFO - Deleting pod ctest-non-default-12844858:ctest-pod-12232457
2025-04-23 09:59:52,193 - WARNING - Pod uuid 3659d0b6-87d8-44bf-ad98-9421d955570c is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,196 - WARNING - Pod uuid 7cc4bca5-a230-40fc-8f11-8cd890a76b18 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,196 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,232 - WARNING - Pod uuid f0fef83d-91b5-40eb-8974-6b35f63e5ab5 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,232 - WARNING - Pod uuid 5ca1c227-9cb7-4d0e-8cbd-5a3e8f07a1c8 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,232 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,233 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:52,234 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:57,205 - DEBUG - Pod 3659d0b6-87d8-44bf-ad98-9421d955570c is not in agent 10.0.0.56 VM list
2025-04-23 09:59:57,208 - DEBUG - Pod 7cc4bca5-a230-40fc-8f11-8cd890a76b18 is not in agent 10.0.0.56 VM list
2025-04-23 09:59:57,209 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:57,214 - DEBUG - VMI 34ecbf5c-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 09:59:57,215 - INFO - Verified that pod ctest-pod-41963951 is removed in agent
2025-04-23 09:59:57,254 - DEBUG - Pod 5ca1c227-9cb7-4d0e-8cbd-5a3e8f07a1c8 is not in agent 10.0.0.56 VM list
2025-04-23 09:59:57,256 - DEBUG - Pod f0fef83d-91b5-40eb-8974-6b35f63e5ab5 is not in agent 10.0.0.56 VM list
2025-04-23 09:59:57,259 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:57,260 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:57,260 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 09:59:57,261 - DEBUG - VMI 3465bc78-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 09:59:57,261 - INFO - Verified that pod ctest-pod-30341661 is removed in agent
2025-04-23 09:59:57,270 - DEBUG - VMI 359928be-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 09:59:57,270 - INFO - Verified that pod ctest-pod-98545652 is removed in agent
2025-04-23 09:59:57,270 - DEBUG - VMI 3612ee88-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 09:59:57,270 - INFO - Verified that pod ctest-pod-80265772 is removed in agent
2025-04-23 10:00:02,217 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:02,274 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:02,276 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:02,276 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:07,225 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:07,289 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:07,290 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:07,291 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:12,233 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:12,304 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:12,305 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:12,305 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:17,243 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:17,322 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:17,323 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:17,324 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:22,262 - WARNING - Pod uuid 17c22429-262c-413a-8baf-3cacf0b7954e is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:22,336 - WARNING - Pod uuid 62f38136-53d5-4a96-8096-6e40b5e684f3 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:22,337 - WARNING - Pod uuid cd9bb433-6250-49b2-b298-fa01822e1f7a is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:22,356 - WARNING - Pod uuid 128bab6f-c152-4104-8582-f322153bf035 is still seen in agent 10.0.0.56 VM list
2025-04-23 10:00:27,270 - DEBUG - Pod 17c22429-262c-413a-8baf-3cacf0b7954e is not in agent 10.0.0.56 VM list
2025-04-23 10:00:27,276 - DEBUG - VMI 371a4c04-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 10:00:27,276 - INFO - Verified that pod ctest-pod-71635739 is removed in agent
2025-04-23 10:00:27,347 - DEBUG - Pod 62f38136-53d5-4a96-8096-6e40b5e684f3 is not in agent 10.0.0.56 VM list
2025-04-23 10:00:27,349 - DEBUG - Pod cd9bb433-6250-49b2-b298-fa01822e1f7a is not in agent 10.0.0.56 VM list
2025-04-23 10:00:27,358 - DEBUG - VMI 36a2f122-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 10:00:27,358 - INFO - Verified that pod ctest-pod-65058564 is removed in agent
2025-04-23 10:00:27,358 - DEBUG - VMI 381c6150-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 10:00:27,358 - INFO - Verified that pod ctest-pod-12232457 is removed in agent
2025-04-23 10:00:27,364 - DEBUG - Pod 128bab6f-c152-4104-8582-f322153bf035 is not in agent 10.0.0.56 VM list
2025-04-23 10:00:27,416 - DEBUG - VMI 379e7ccc-2029-11f0-910f-fa163e5eef2a is removed from agent 10.0.0.56
2025-04-23 10:00:27,417 - INFO - Verified that pod ctest-pod-26134967 is removed in agent
2025-04-23 10:00:27,417 - INFO - Deleting namespace ctest-non-default-12844858
2025-04-23 10:00:27,434 - DEBUG - Namespace ctest-non-default-12844858 still in k8s
2025-04-23 10:00:29,445 - DEBUG - Namespace ctest-non-default-12844858 still in k8s
2025-04-23 10:00:31,450 - DEBUG - Namespace ctest-non-default-12844858 still in k8s
2025-04-23 10:00:33,454 - DEBUG - Namespace ctest-non-default-12844858 is not in k8s
2025-04-23 10:00:33,454 - DEBUG - No need to check project deletion in contrail-api
2025-04-23 10:00:33,454 - INFO - Deleting namespace ctest-new-default-19324300
2025-04-23 10:00:33,463 - DEBUG - Namespace ctest-new-default-19324300 still in k8s
2025-04-23 10:00:35,468 - DEBUG - Namespace ctest-new-default-19324300 still in k8s
2025-04-23 10:00:37,473 - DEBUG - Namespace ctest-new-default-19324300 still in k8s
2025-04-23 10:00:39,483 - DEBUG - Namespace ctest-new-default-19324300 is not in k8s
2025-04-23 10:00:39,483 - DEBUG - No need to check project deletion in contrail-api