2025-03-28 12:29:04,828 - INFO - Using existing project ['default-domain', 'k8s-default'](c78db44e-bee9-4ed4-9a3e-4a7d9b8e3fb1)
2025-03-28 12:29:04,848 - DEBUG - Namespace ctest-new-default-56466789 not present
2025-03-28 12:29:04,860 - INFO - Created namespace ctest-new-default-56466789
2025-03-28 12:29:07,865 - DEBUG - Namespace ctest-non-default-86465134 not present
2025-03-28 12:29:07,878 - INFO - Created namespace ctest-non-default-86465134
2025-03-28 12:29:10,908 - DEBUG - Pod ctest-pod-07181502 not present
2025-03-28 12:29:10,908 - INFO - Creating Pod ctest-pod-07181502
2025-03-28 12:29:10,941 - DEBUG - Pod : ctest-pod-07181502 UUID is ef6b7198-b388-424a-ab8d-394074c29bfa
2025-03-28 12:29:10,943 - DEBUG - Pod ctest-pod-14304285 not present
2025-03-28 12:29:10,943 - INFO - Creating Pod ctest-pod-14304285
2025-03-28 12:29:10,981 - DEBUG - Pod : ctest-pod-14304285 UUID is 88a2c487-e02f-4f7a-9659-a7895e6dc843
2025-03-28 12:29:10,985 - DEBUG - Pod ctest-pod-44509844 not present
2025-03-28 12:29:10,985 - INFO - Creating Pod ctest-pod-44509844
2025-03-28 12:29:11,023 - DEBUG - Pod : ctest-pod-44509844 UUID is 92d1ac84-e079-40c3-a035-8e884162a471
2025-03-28 12:29:11,029 - DEBUG - Pod ctest-pod-91685989 not present
2025-03-28 12:29:11,030 - INFO - Creating Pod ctest-pod-91685989
2025-03-28 12:29:11,055 - DEBUG - Pod : ctest-pod-91685989 UUID is 0b921b81-db70-4463-a2fe-c78d19c821c6
2025-03-28 12:29:11,060 - DEBUG - Pod ctest-pod-01488684 not present
2025-03-28 12:29:11,061 - INFO - Creating Pod ctest-pod-01488684
2025-03-28 12:29:11,080 - DEBUG - Pod : ctest-pod-01488684 UUID is 24b08d51-c541-4a3f-9e22-2b9f89e3c521
2025-03-28 12:29:11,082 - DEBUG - Pod ctest-pod-09719172 not present
2025-03-28 12:29:11,083 - INFO - Creating Pod ctest-pod-09719172
2025-03-28 12:29:11,102 - DEBUG - Pod : ctest-pod-09719172 UUID is a694177b-617d-4d54-9749-57e96d086248
2025-03-28 12:29:11,104 - DEBUG - Pod ctest-pod-20714270 not present
2025-03-28 12:29:11,104 - INFO - Creating Pod ctest-pod-20714270
2025-03-28 12:29:11,126 - DEBUG - Pod : ctest-pod-20714270 UUID is f3ecedba-4972-492e-a290-226d409a726a
2025-03-28 12:29:11,129 - DEBUG - Pod ctest-pod-82133344 not present
2025-03-28 12:29:11,129 - INFO - Creating Pod ctest-pod-82133344
2025-03-28 12:29:11,157 - DEBUG - Pod : ctest-pod-82133344 UUID is 1c2dd2d5-141b-463d-8b79-6e3d28fccaee
2025-03-28 12:29:11,365 - INFO - Project default-domain:k8s-ctest-new-default-56466789 for Namespace ctest-new-default-56466789 is seen in contrail-api
2025-03-28 12:29:11,365 - DEBUG - Project uuid in Contrail is 6102d0b0-4baa-4442-8033-1982d0b933ad
2025-03-28 12:29:11,551 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=1b2e30ac-9ac1-4b58-9173-9dd5a3abf06e
2025-03-28 12:29:11,557 - INFO - Namespace ctest-new-default-56466789 with uuid 1b2e30ac-9ac1-4b58-9173-9dd5a3abf06e found in kube manager
2025-03-28 12:29:11,557 - INFO - Namespace ctest-new-default-56466789 verification passed
2025-03-28 12:29:11,816 - INFO - Project default-domain:k8s-ctest-non-default-86465134 for Namespace ctest-non-default-86465134 is seen in contrail-api
2025-03-28 12:29:11,817 - DEBUG - Project uuid in Contrail is b38c0f41-3742-4ef1-91da-7d7f980d2609
2025-03-28 12:29:11,817 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=b34d77da-f016-40da-861b-f47f7af912a3
2025-03-28 12:29:11,830 - INFO - Namespace ctest-non-default-86465134 with uuid b34d77da-f016-40da-861b-f47f7af912a3 found in kube manager
2025-03-28 12:29:11,830 - INFO - Namespace ctest-non-default-86465134 verification passed
2025-03-28 12:29:11,839 - DEBUG - Pod ctest-pod-07181502 not in running state.Currently in Pending
2025-03-28 12:29:16,847 - DEBUG - Pod ctest-pod-07181502 not in running state.Currently in Pending
2025-03-28 12:29:21,854 - INFO - Pod ctest-pod-07181502 is in running state.Got IP 10.47.255.251
2025-03-28 12:29:21,911 - DEBUG - Pod ctest-pod-07181502 has vmi 419840e0-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:21,911 - INFO - Verified pod ctest-pod-07181502 in contrail-api
2025-03-28 12:29:21,925 - DEBUG - VMI 419840e0-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:21,925 - INFO - Verified Pod ctest-pod-07181502 in agent 10.0.0.42
2025-03-28 12:29:21,925 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=ef6b7198-b388-424a-ab8d-394074c29bfa
2025-03-28 12:29:21,930 - INFO - Pod ctest-pod-07181502 with uuid ef6b7198-b388-424a-ab8d-394074c29bfa found in kube manager
2025-03-28 12:29:21,930 - INFO - Pod ctest-pod-07181502 verification passed
2025-03-28 12:29:21,935 - INFO - Pod ctest-pod-14304285 is in running state.Got IP 10.47.255.250
2025-03-28 12:29:21,954 - DEBUG - Pod ctest-pod-14304285 has vmi 4232b71a-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:21,954 - INFO - Verified pod ctest-pod-14304285 in contrail-api
2025-03-28 12:29:21,966 - DEBUG - VMI 4232b71a-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:21,967 - INFO - Verified Pod ctest-pod-14304285 in agent 10.0.0.42
2025-03-28 12:29:21,967 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=88a2c487-e02f-4f7a-9659-a7895e6dc843
2025-03-28 12:29:21,972 - INFO - Pod ctest-pod-14304285 with uuid 88a2c487-e02f-4f7a-9659-a7895e6dc843 found in kube manager
2025-03-28 12:29:21,972 - INFO - Pod ctest-pod-14304285 verification passed
2025-03-28 12:29:21,977 - INFO - Pod ctest-pod-44509844 is in running state.Got IP 10.47.255.249
2025-03-28 12:29:22,036 - DEBUG - Pod ctest-pod-44509844 has vmi 42e5bc48-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:22,037 - INFO - Verified pod ctest-pod-44509844 in contrail-api
2025-03-28 12:29:22,058 - DEBUG - VMI 42e5bc48-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:22,058 - INFO - Verified Pod ctest-pod-44509844 in agent 10.0.0.42
2025-03-28 12:29:22,059 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=92d1ac84-e079-40c3-a035-8e884162a471
2025-03-28 12:29:22,064 - INFO - Pod ctest-pod-44509844 with uuid 92d1ac84-e079-40c3-a035-8e884162a471 found in kube manager
2025-03-28 12:29:22,064 - INFO - Pod ctest-pod-44509844 verification passed
2025-03-28 12:29:22,071 - DEBUG - Pod ctest-pod-91685989 not in running state.Currently in Pending
2025-03-28 12:29:27,078 - INFO - Pod ctest-pod-91685989 is in running state.Got IP 10.47.255.248
2025-03-28 12:29:27,093 - DEBUG - Pod ctest-pod-91685989 has vmi 437401a6-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:27,093 - INFO - Verified pod ctest-pod-91685989 in contrail-api
2025-03-28 12:29:27,107 - DEBUG - VMI 437401a6-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:27,107 - INFO - Verified Pod ctest-pod-91685989 in agent 10.0.0.42
2025-03-28 12:29:27,108 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=0b921b81-db70-4463-a2fe-c78d19c821c6
2025-03-28 12:29:27,112 - INFO - Pod ctest-pod-91685989 with uuid 0b921b81-db70-4463-a2fe-c78d19c821c6 found in kube manager
2025-03-28 12:29:27,112 - INFO - Pod ctest-pod-91685989 verification passed
2025-03-28 12:29:27,117 - DEBUG - Pod ctest-pod-01488684 not in running state.Currently in Pending
2025-03-28 12:29:32,130 - INFO - Pod ctest-pod-01488684 is in running state.Got IP 10.47.255.247
2025-03-28 12:29:32,191 - DEBUG - Pod ctest-pod-01488684 has vmi 441007ea-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:32,191 - INFO - Verified pod ctest-pod-01488684 in contrail-api
2025-03-28 12:29:32,210 - DEBUG - VMI 441007ea-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:32,211 - INFO - Verified Pod ctest-pod-01488684 in agent 10.0.0.42
2025-03-28 12:29:32,211 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=24b08d51-c541-4a3f-9e22-2b9f89e3c521
2025-03-28 12:29:32,216 - INFO - Pod ctest-pod-01488684 with uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 found in kube manager
2025-03-28 12:29:32,217 - INFO - Pod ctest-pod-01488684 verification passed
2025-03-28 12:29:32,224 - INFO - Pod ctest-pod-20714270 is in running state.Got IP 10.47.255.245
2025-03-28 12:29:32,241 - DEBUG - Pod ctest-pod-20714270 has vmi 45121034-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:32,241 - INFO - Verified pod ctest-pod-20714270 in contrail-api
2025-03-28 12:29:32,256 - DEBUG - VMI 45121034-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:32,256 - INFO - Verified Pod ctest-pod-20714270 in agent 10.0.0.42
2025-03-28 12:29:32,256 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=f3ecedba-4972-492e-a290-226d409a726a
2025-03-28 12:29:32,262 - INFO - Pod ctest-pod-20714270 with uuid f3ecedba-4972-492e-a290-226d409a726a found in kube manager
2025-03-28 12:29:32,262 - INFO - Pod ctest-pod-20714270 verification passed
2025-03-28 12:29:32,348 - INFO - Pod ctest-pod-09719172 is in running state.Got IP 10.47.255.246
2025-03-28 12:29:32,407 - DEBUG - Pod ctest-pod-09719172 has vmi 44995856-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:32,407 - INFO - Verified pod ctest-pod-09719172 in contrail-api
2025-03-28 12:29:32,423 - DEBUG - VMI 44995856-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:32,423 - INFO - Verified Pod ctest-pod-09719172 in agent 10.0.0.42
2025-03-28 12:29:32,423 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=a694177b-617d-4d54-9749-57e96d086248
2025-03-28 12:29:32,429 - INFO - Pod ctest-pod-09719172 with uuid a694177b-617d-4d54-9749-57e96d086248 found in kube manager
2025-03-28 12:29:32,429 - INFO - Pod ctest-pod-09719172 verification passed
2025-03-28 12:29:32,434 - INFO - Pod ctest-pod-82133344 is in running state.Got IP 10.47.255.244
2025-03-28 12:29:32,452 - DEBUG - Pod ctest-pod-82133344 has vmi 458aedba-0bd0-11f0-b239-fa163e0cf0c2
2025-03-28 12:29:32,452 - INFO - Verified pod ctest-pod-82133344 in contrail-api
2025-03-28 12:29:32,469 - DEBUG - VMI 458aedba-0bd0-11f0-b239-fa163e0cf0c2 is active in agent 10.0.0.42
2025-03-28 12:29:32,469 - INFO - Verified Pod ctest-pod-82133344 in agent 10.0.0.42
2025-03-28 12:29:32,469 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=1c2dd2d5-141b-463d-8b79-6e3d28fccaee
2025-03-28 12:29:32,475 - INFO - Pod ctest-pod-82133344 with uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee found in kube manager
2025-03-28 12:29:32,475 - INFO - Pod ctest-pod-82133344 verification passed
2025-03-28 12:29:32,475 - INFO - ================================================================================
2025-03-28 12:29:32,475 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-28 12:29:32,475 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-28 12:29:32,732 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.0.0.40': '0'}} with
2025-03-28 12:29:32,732 - INFO - Initial checks done. Running the testcase now
2025-03-28 12:29:32,732 - INFO -
2025-03-28 12:29:32,794 - DEBUG - [Pod ctest-pod-07181502] Cmd: echo ctest-pod-07181502 > /usr/share/nginx/html/index.html, Output:
2025-03-28 12:29:32,877 - DEBUG - [Pod ctest-pod-14304285] Cmd: echo ctest-pod-14304285 > /usr/share/nginx/html/index.html, Output:
2025-03-28 12:29:32,943 - DEBUG - [Pod ctest-pod-44509844] Cmd: echo ctest-pod-44509844 > /usr/share/nginx/html/index.html, Output:
2025-03-28 12:29:33,009 - DEBUG - [Pod ctest-pod-91685989] Cmd: echo ctest-pod-91685989 > /usr/share/nginx/html/index.html, Output:
2025-03-28 12:29:33,013 - DEBUG - Service ctest-nginx-svc-88823915 not present
2025-03-28 12:29:33,013 - INFO - Creating service ctest-nginx-svc-88823915
2025-03-28 12:29:33,054 - INFO - Created Service ctest-nginx-svc-88823915
2025-03-28 12:29:33,065 - WARNING - Service UUID ac7d5cd1-ab0c-4df0-b2b7-1f08c01725ec not yet found in contrail-api
2025-03-28 12:29:34,073 - INFO - Validated that Service ctest-nginx-svc-88823915 is seen in contrail-api
2025-03-28 12:29:34,073 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_LoadbalancerDatabaseList?x=ac7d5cd1-ab0c-4df0-b2b7-1f08c01725ec
2025-03-28 12:29:34,082 - INFO - Service ctest-nginx-svc-88823915 with uuid ac7d5cd1-ab0c-4df0-b2b7-1f08c01725ec found in kube manager
2025-03-28 12:29:34,082 - INFO - Service ctest-nginx-svc-88823915 verification passed
2025-03-28 12:29:35,163 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:29:35,163 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:29:35,163 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:29:35,220 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07181502
2025-03-28 12:29:35,221 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:29:35,221 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07181502
2025-03-28 12:29:35,221 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07181502': 1, 'ctest-pod-14304285': 1}
2025-03-28 12:29:35,289 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:29:35,289 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:29:35,289 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:29:35,354 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-07181502
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:29:35,354 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:29:35,354 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: ctest-pod-07181502
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:29:35,354 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07181502': 1, 'ctest-pod-14304285': 1}
2025-03-28 12:29:35,360 - DEBUG - Network policy ingress-on-service not present
2025-03-28 12:29:35,361 - INFO - Creating Network Policy ingress-on-service
2025-03-28 12:29:35,373 - INFO - Network policy found in k8s
2025-03-28 12:29:35,374 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7b9a22b3-8758-4cb9-be11-c43620a698e6
2025-03-28 12:29:35,385 - INFO - Network Policy ingress-on-service with uuid 7b9a22b3-8758-4cb9-be11-c43620a698e6 found in kube manager
2025-03-28 12:29:35,434 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-28 12:29:35,434 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-28 12:29:35,435 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7b9a22b3-8758-4cb9-be11-c43620a698e6
2025-03-28 12:29:35,488 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-28 12:29:37,489 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7b9a22b3-8758-4cb9-be11-c43620a698e6
2025-03-28 12:29:37,539 - INFO - Network policy with name ingress-on-service found in agent
2025-03-28 12:29:37,541 - INFO - Network Policy ingress-on-service verification passed
2025-03-28 12:29:42,604 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:42,604 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:42,604 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:47,668 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:47,668 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:47,668 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:52,736 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:52,737 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:52,737 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:57,793 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:57,793 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:29:57,793 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:02,849 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:02,849 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:02,849 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:07,914 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:07,914 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:07,914 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:12,999 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:12,999 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:12,999 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:18,053 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:18,053 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:18,053 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:23,128 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:23,128 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:23,128 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:28,196 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:28,196 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:28,196 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:28,197 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07181502': 0, 'ctest-pod-14304285': 0}
2025-03-28 12:30:28,262 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-07181502
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:30:28,262 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:30:28,262 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: ctest-pod-07181502
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:30:28,327 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:30:28,328 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:30:28,328 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:30:28,328 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07181502': 1, 'ctest-pod-14304285': 1}
2025-03-28 12:30:33,391 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:33,391 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:33,391 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:38,470 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:38,470 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:38,470 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:43,543 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:43,543 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:43,543 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:48,624 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:48,625 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:48,625 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:53,710 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:53,711 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:53,711 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:58,771 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:58,771 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:30:58,771 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:03,841 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:03,841 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:03,841 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:08,911 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:08,912 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:08,912 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:13,972 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:13,972 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:13,972 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:19,050 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:19,050 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:19,050 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:19,050 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07181502': 0, 'ctest-pod-14304285': 0}
2025-03-28 12:31:21,126 - DEBUG - [Pod ctest-pod-09719172] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.204 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.459/1.204 ms
2025-03-28 12:31:21,126 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09719172 with expectation True passed
2025-03-28 12:31:23,180 - DEBUG - [Pod ctest-pod-01488684] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.002 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.389/1.002 ms
2025-03-28 12:31:23,180 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01488684 with expectation True passed
2025-03-28 12:31:25,248 - DEBUG - [Pod ctest-pod-20714270] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.552 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.576/1.552 ms
2025-03-28 12:31:25,248 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20714270 with expectation True passed
2025-03-28 12:31:25,310 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:31:25,310 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-28 12:31:25,310 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:31:25,310 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09719172 passed
2025-03-28 12:31:25,370 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:31:25,370 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-28 12:31:25,370 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:31:25,370 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09719172 passed
2025-03-28 12:31:30,435 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 12:31:30,436 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 12:31:30,436 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 12:31:30,436 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01488684 passed
2025-03-28 12:31:35,517 - DEBUG - [Pod ctest-pod-82133344] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-28 12:31:35,518 - DEBUG - [Pod Pod ctest-pod-82133344] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-28 12:31:35,518 - DEBUG - [Pod Pod ctest-pod-82133344] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-28 12:31:35,518 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82133344 passed
2025-03-28 12:31:35,526 - INFO - Updating Network Policy ingress-on-service
2025-03-28 12:31:40,612 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:40,612 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:40,612 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:45,681 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:45,681 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:45,681 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:47,036 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-03-28 12:31:57,102 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:57,102 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:31:57,103 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:02,168 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:02,168 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:02,168 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:07,220 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:07,220 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:07,220 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:12,283 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:12,284 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:12,284 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:17,355 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:17,356 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:17,356 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:22,431 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:22,431 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:22,431 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:27,495 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:27,495 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:27,495 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:32,556 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:32,556 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:32,556 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
wget: download timed out
2025-03-28 12:32:32,556 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-07181502': 0, 'ctest-pod-14304285': 0}
2025-03-28 12:32:32,633 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-07181502
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:32,634 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:32,634 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: ctest-pod-07181502
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:32,697 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:32:32,697 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:32,697 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:32:32,697 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07181502': 1, 'ctest-pod-14304285': 1}
2025-03-28 12:32:32,764 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:32:32,764 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:32,764 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:32:32,842 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:32,842 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:32,842 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:32,921 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:32:32,921 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:32,921 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-14304285
2025-03-28 12:32:32,985 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:32,985 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:32,985 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:33,049 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:33,049 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:33,049 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: ctest-pod-14304285
Connecting to 10.107.165.6:80 (10.107.165.6:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:33,106 - DEBUG - [Pod ctest-pod-20714270] Cmd: wget http://10.107.165.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
ctest-pod-07181502
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:33,107 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd wget http://10.107.165.6:80/ -O - -T 5 -t 1 passed
2025-03-28 12:32:33,107 - DEBUG - [Pod Pod ctest-pod-20714270] Cmd output: Connecting to 10.107.165.6:80 (10.107.165.6:80)
ctest-pod-07181502
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 12:32:33,107 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-07181502': 1, 'ctest-pod-14304285': 5}
2025-03-28 12:32:35,159 - DEBUG - [Pod ctest-pod-09719172] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.352 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.099 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.099/0.184/0.352 ms
2025-03-28 12:32:35,160 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09719172 with expectation True passed
2025-03-28 12:32:37,229 - DEBUG - [Pod ctest-pod-01488684] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.515 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.229/0.515 ms
2025-03-28 12:32:37,229 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01488684 with expectation True passed
2025-03-28 12:32:39,303 - DEBUG - [Pod ctest-pod-20714270] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.233 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.116 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.477/1.233 ms
2025-03-28 12:32:39,303 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20714270 with expectation True passed
2025-03-28 12:32:39,387 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:32:39,387 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-28 12:32:39,387 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:32:39,387 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09719172 passed
2025-03-28 12:32:39,460 - DEBUG - [Pod ctest-pod-09719172] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:32:39,461 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-28 12:32:39,461 - DEBUG - [Pod Pod ctest-pod-09719172] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:32:39,461 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09719172 passed
2025-03-28 12:32:44,530 - DEBUG - [Pod ctest-pod-01488684] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 12:32:44,531 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 12:32:44,531 - DEBUG - [Pod Pod ctest-pod-01488684] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 12:32:44,531 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01488684 passed
2025-03-28 12:32:44,594 - DEBUG - [Pod ctest-pod-82133344] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:32:44,594 - DEBUG - [Pod Pod ctest-pod-82133344] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-28 12:32:44,594 - DEBUG - [Pod Pod ctest-pod-82133344] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 12:32:44,595 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82133344 passed
2025-03-28 12:32:44,595 - INFO - Deleting Network Policy : ingress-on-service
2025-03-28 12:32:44,595 - INFO - Deleting service : ctest-nginx-svc-88823915
2025-03-28 12:32:44,859 - DEBUG - No XMPP flaps were noticed during the test
2025-03-28 12:32:44,859 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-03-28 12:32:44,859 - INFO - --------------------------------------------------------------------------------
2025-03-28 12:32:44,865 - INFO - Deleting pod ctest-new-default-56466789:ctest-pod-07181502
2025-03-28 12:32:44,866 - INFO - Deleting pod ctest-new-default-56466789:ctest-pod-14304285
2025-03-28 12:32:44,867 - INFO - Deleting pod ctest-non-default-86465134:ctest-pod-44509844
2025-03-28 12:32:44,867 - INFO - Deleting pod ctest-non-default-86465134:ctest-pod-91685989
2025-03-28 12:32:44,867 - INFO - Deleting pod ctest-new-default-56466789:ctest-pod-01488684
2025-03-28 12:32:44,868 - INFO - Deleting pod ctest-new-default-56466789:ctest-pod-09719172
2025-03-28 12:32:44,868 - INFO - Deleting pod ctest-non-default-86465134:ctest-pod-20714270
2025-03-28 12:32:44,869 - INFO - Deleting pod ctest-non-default-86465134:ctest-pod-82133344
2025-03-28 12:32:45,017 - WARNING - Pod uuid ef6b7198-b388-424a-ab8d-394074c29bfa is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,020 - WARNING - Pod uuid 92d1ac84-e079-40c3-a035-8e884162a471 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,070 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,072 - WARNING - Pod uuid 88a2c487-e02f-4f7a-9659-a7895e6dc843 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,073 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,073 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,073 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:45,074 - WARNING - Pod uuid 0b921b81-db70-4463-a2fe-c78d19c821c6 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:50,030 - DEBUG - Pod 92d1ac84-e079-40c3-a035-8e884162a471 is not in agent 10.0.0.42 VM list
2025-03-28 12:32:50,033 - DEBUG - Pod ef6b7198-b388-424a-ab8d-394074c29bfa is not in agent 10.0.0.42 VM list
2025-03-28 12:32:50,042 - DEBUG - VMI 42e5bc48-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:32:50,042 - INFO - Verified that pod ctest-pod-44509844 is removed in agent
2025-03-28 12:32:50,044 - DEBUG - VMI 419840e0-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:32:50,044 - INFO - Verified that pod ctest-pod-07181502 is removed in agent
2025-03-28 12:32:50,101 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:50,102 - DEBUG - Pod 88a2c487-e02f-4f7a-9659-a7895e6dc843 is not in agent 10.0.0.42 VM list
2025-03-28 12:32:50,104 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:50,104 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:50,105 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:50,105 - DEBUG - Pod 0b921b81-db70-4463-a2fe-c78d19c821c6 is not in agent 10.0.0.42 VM list
2025-03-28 12:32:50,117 - DEBUG - VMI 437401a6-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:32:50,117 - INFO - Verified that pod ctest-pod-91685989 is removed in agent
2025-03-28 12:32:50,117 - DEBUG - VMI 4232b71a-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:32:50,118 - INFO - Verified that pod ctest-pod-14304285 is removed in agent
2025-03-28 12:32:55,121 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:55,123 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:55,123 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:32:55,123 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:00,145 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:00,146 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:00,148 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:00,148 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:05,165 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:05,167 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:05,167 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:05,168 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:10,189 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:10,190 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:10,190 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:10,191 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:15,232 - WARNING - Pod uuid a694177b-617d-4d54-9749-57e96d086248 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:15,233 - WARNING - Pod uuid 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:15,233 - WARNING - Pod uuid f3ecedba-4972-492e-a290-226d409a726a is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:15,233 - WARNING - Pod uuid 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is still seen in agent 10.0.0.42 VM list
2025-03-28 12:33:20,253 - DEBUG - Pod 1c2dd2d5-141b-463d-8b79-6e3d28fccaee is not in agent 10.0.0.42 VM list
2025-03-28 12:33:20,258 - DEBUG - Pod f3ecedba-4972-492e-a290-226d409a726a is not in agent 10.0.0.42 VM list
2025-03-28 12:33:20,260 - DEBUG - Pod 24b08d51-c541-4a3f-9e22-2b9f89e3c521 is not in agent 10.0.0.42 VM list
2025-03-28 12:33:20,262 - DEBUG - Pod a694177b-617d-4d54-9749-57e96d086248 is not in agent 10.0.0.42 VM list
2025-03-28 12:33:20,280 - DEBUG - VMI 441007ea-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:33:20,280 - INFO - Verified that pod ctest-pod-01488684 is removed in agent
2025-03-28 12:33:20,281 - DEBUG - VMI 45121034-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:33:20,282 - INFO - Verified that pod ctest-pod-20714270 is removed in agent
2025-03-28 12:33:20,282 - DEBUG - VMI 44995856-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:33:20,282 - INFO - Verified that pod ctest-pod-09719172 is removed in agent
2025-03-28 12:33:20,283 - DEBUG - VMI 458aedba-0bd0-11f0-b239-fa163e0cf0c2 is removed from agent 10.0.0.42
2025-03-28 12:33:20,283 - INFO - Verified that pod ctest-pod-82133344 is removed in agent
2025-03-28 12:33:20,283 - INFO - Deleting namespace ctest-non-default-86465134
2025-03-28 12:33:20,313 - DEBUG - Namespace ctest-non-default-86465134 still in k8s
2025-03-28 12:33:22,319 - DEBUG - Namespace ctest-non-default-86465134 still in k8s
2025-03-28 12:33:24,324 - DEBUG - Namespace ctest-non-default-86465134 still in k8s
2025-03-28 12:33:26,328 - DEBUG - Namespace ctest-non-default-86465134 is not in k8s
2025-03-28 12:33:26,328 - DEBUG - No need to check project deletion in contrail-api
2025-03-28 12:33:26,329 - INFO - Deleting namespace ctest-new-default-56466789
2025-03-28 12:33:26,340 - DEBUG - Namespace ctest-new-default-56466789 still in k8s
2025-03-28 12:33:28,344 - DEBUG - Namespace ctest-new-default-56466789 still in k8s
2025-03-28 12:33:30,349 - DEBUG - Namespace ctest-new-default-56466789 still in k8s
2025-03-28 12:33:32,353 - DEBUG - Namespace ctest-new-default-56466789 is not in k8s
2025-03-28 12:33:32,353 - DEBUG - No need to check project deletion in contrail-api