2025-04-25 00:14:06,849 - INFO - Using existing project ['default-domain', 'k8s-default'](a27b4921-6fb0-4dca-b7f0-e9f1eb0fcf22)
2025-04-25 00:14:06,868 - DEBUG - Namespace ctest-new-default-85485204 not present
2025-04-25 00:14:06,878 - INFO - Created namespace ctest-new-default-85485204
2025-04-25 00:14:09,882 - DEBUG - Namespace ctest-non-default-31679619 not present
2025-04-25 00:14:09,889 - INFO - Created namespace ctest-non-default-31679619
2025-04-25 00:14:12,907 - DEBUG - Pod ctest-pod-52759632 not present
2025-04-25 00:14:12,907 - INFO - Creating Pod ctest-pod-52759632
2025-04-25 00:14:12,922 - DEBUG - Node for Pod ctest-pod-52759632 not yet populated
2025-04-25 00:14:15,930 - DEBUG - Pod : ctest-pod-52759632 UUID is db327a82-529e-4536-88bd-92eec0883774
2025-04-25 00:14:15,933 - DEBUG - Pod ctest-pod-21280725 not present
2025-04-25 00:14:15,933 - INFO - Creating Pod ctest-pod-21280725
2025-04-25 00:14:15,946 - DEBUG - Node for Pod ctest-pod-21280725 not yet populated
2025-04-25 00:14:18,964 - DEBUG - Pod : ctest-pod-21280725 UUID is 24d07a36-8af1-4389-bc0a-106fe4a6caab
2025-04-25 00:14:18,966 - DEBUG - Pod ctest-pod-33188293 not present
2025-04-25 00:14:18,966 - INFO - Creating Pod ctest-pod-33188293
2025-04-25 00:14:18,994 - DEBUG - Pod : ctest-pod-33188293 UUID is 3e549b7e-05bf-49ed-94ff-505d075296cb
2025-04-25 00:14:19,000 - DEBUG - Pod ctest-pod-35238451 not present
2025-04-25 00:14:19,000 - INFO - Creating Pod ctest-pod-35238451
2025-04-25 00:14:19,030 - DEBUG - Pod : ctest-pod-35238451 UUID is 76b9138c-d2b3-41bc-adc2-b28c4882d905
2025-04-25 00:14:19,032 - DEBUG - Pod ctest-pod-01355526 not present
2025-04-25 00:14:19,033 - INFO - Creating Pod ctest-pod-01355526
2025-04-25 00:14:19,087 - DEBUG - Pod : ctest-pod-01355526 UUID is 01860288-0400-442f-b42e-1bb4c47993db
2025-04-25 00:14:19,097 - DEBUG - Pod ctest-pod-42266627 not present
2025-04-25 00:14:19,097 - INFO - Creating Pod ctest-pod-42266627
2025-04-25 00:14:19,139 - DEBUG - Pod : ctest-pod-42266627 UUID is db88d62f-ed7f-47db-8809-d4a4f82e402e
2025-04-25 00:14:19,160 - DEBUG - Pod ctest-pod-14491178 not present
2025-04-25 00:14:19,160 - INFO - Creating Pod ctest-pod-14491178
2025-04-25 00:14:19,190 - DEBUG - Pod : ctest-pod-14491178 UUID is 3ddc6c76-fec0-419b-859a-259d054dce14
2025-04-25 00:14:19,198 - DEBUG - Pod ctest-pod-74351631 not present
2025-04-25 00:14:19,198 - INFO - Creating Pod ctest-pod-74351631
2025-04-25 00:14:19,227 - DEBUG - Pod : ctest-pod-74351631 UUID is 4d4a34db-203e-444a-83c0-5a93fe6c51fa
2025-04-25 00:14:19,381 - INFO - Project default-domain:k8s-ctest-new-default-85485204 for Namespace ctest-new-default-85485204 is seen in contrail-api
2025-04-25 00:14:19,381 - DEBUG - Project uuid in Contrail is e5fa86a4-aaac-4cf2-8db0-42e5945dbc00
2025-04-25 00:14:19,529 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=98ebf049-bc47-4bed-886c-cf457b29e5cc
2025-04-25 00:14:19,544 - INFO - Namespace ctest-new-default-85485204 with uuid 98ebf049-bc47-4bed-886c-cf457b29e5cc found in kube manager
2025-04-25 00:14:19,545 - INFO - Namespace ctest-new-default-85485204 verification passed
2025-04-25 00:14:19,764 - INFO - Project default-domain:k8s-ctest-non-default-31679619 for Namespace ctest-non-default-31679619 is seen in contrail-api
2025-04-25 00:14:19,764 - DEBUG - Project uuid in Contrail is 992c42aa-c654-4896-bd50-c95f89422e20
2025-04-25 00:14:19,765 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=0d295d6e-6f05-4682-8b41-2492bd0cca35
2025-04-25 00:14:19,769 - INFO - Namespace ctest-non-default-31679619 with uuid 0d295d6e-6f05-4682-8b41-2492bd0cca35 found in kube manager
2025-04-25 00:14:19,769 - INFO - Namespace ctest-non-default-31679619 verification passed
2025-04-25 00:14:19,776 - DEBUG - Pod ctest-pod-52759632 not in running state.Currently in Pending
2025-04-25 00:14:24,783 - DEBUG - Pod ctest-pod-52759632 not in running state.Currently in Pending
2025-04-25 00:14:29,790 - INFO - Pod ctest-pod-52759632 is in running state.Got IP 10.47.255.251
2025-04-25 00:14:29,803 - DEBUG - Pod ctest-pod-52759632 has vmi 386288a0-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:29,803 - INFO - Verified pod ctest-pod-52759632 in contrail-api
2025-04-25 00:14:29,815 - DEBUG - VMI 386288a0-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:29,816 - INFO - Verified Pod ctest-pod-52759632 in agent 10.0.0.22
2025-04-25 00:14:29,816 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=db327a82-529e-4536-88bd-92eec0883774
2025-04-25 00:14:29,820 - INFO - Pod ctest-pod-52759632 with uuid db327a82-529e-4536-88bd-92eec0883774 found in kube manager
2025-04-25 00:14:29,820 - INFO - Pod ctest-pod-52759632 verification passed
2025-04-25 00:14:29,825 - INFO - Pod ctest-pod-21280725 is in running state.Got IP 10.47.255.250
2025-04-25 00:14:29,881 - DEBUG - Pod ctest-pod-21280725 has vmi 395d7b0c-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:29,881 - INFO - Verified pod ctest-pod-21280725 in contrail-api
2025-04-25 00:14:29,899 - DEBUG - VMI 395d7b0c-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:29,899 - INFO - Verified Pod ctest-pod-21280725 in agent 10.0.0.22
2025-04-25 00:14:29,899 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=24d07a36-8af1-4389-bc0a-106fe4a6caab
2025-04-25 00:14:29,904 - INFO - Pod ctest-pod-21280725 with uuid 24d07a36-8af1-4389-bc0a-106fe4a6caab found in kube manager
2025-04-25 00:14:29,905 - INFO - Pod ctest-pod-21280725 verification passed
2025-04-25 00:14:29,914 - INFO - Pod ctest-pod-33188293 is in running state.Got IP 10.47.255.249
2025-04-25 00:14:29,969 - DEBUG - Pod ctest-pod-33188293 has vmi 3b6eea0c-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:29,969 - INFO - Verified pod ctest-pod-33188293 in contrail-api
2025-04-25 00:14:29,981 - DEBUG - VMI 3b6eea0c-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:29,982 - INFO - Verified Pod ctest-pod-33188293 in agent 10.0.0.22
2025-04-25 00:14:29,982 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3e549b7e-05bf-49ed-94ff-505d075296cb
2025-04-25 00:14:29,986 - INFO - Pod ctest-pod-33188293 with uuid 3e549b7e-05bf-49ed-94ff-505d075296cb found in kube manager
2025-04-25 00:14:29,986 - INFO - Pod ctest-pod-33188293 verification passed
2025-04-25 00:14:29,991 - DEBUG - Pod ctest-pod-35238451 not in running state.Currently in Pending
2025-04-25 00:14:34,997 - INFO - Pod ctest-pod-35238451 is in running state.Got IP 10.47.255.248
2025-04-25 00:14:35,014 - DEBUG - Pod ctest-pod-35238451 has vmi 3bee862c-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:35,014 - INFO - Verified pod ctest-pod-35238451 in contrail-api
2025-04-25 00:14:35,026 - DEBUG - VMI 3bee862c-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:35,026 - INFO - Verified Pod ctest-pod-35238451 in agent 10.0.0.22
2025-04-25 00:14:35,026 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=76b9138c-d2b3-41bc-adc2-b28c4882d905
2025-04-25 00:14:35,030 - INFO - Pod ctest-pod-35238451 with uuid 76b9138c-d2b3-41bc-adc2-b28c4882d905 found in kube manager
2025-04-25 00:14:35,030 - INFO - Pod ctest-pod-35238451 verification passed
2025-04-25 00:14:35,036 - INFO - Pod ctest-pod-01355526 is in running state.Got IP 10.47.255.247
2025-04-25 00:14:35,047 - DEBUG - Pod ctest-pod-01355526 has vmi 3c7a6322-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:35,047 - INFO - Verified pod ctest-pod-01355526 in contrail-api
2025-04-25 00:14:35,059 - DEBUG - VMI 3c7a6322-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:35,060 - INFO - Verified Pod ctest-pod-01355526 in agent 10.0.0.22
2025-04-25 00:14:35,060 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=01860288-0400-442f-b42e-1bb4c47993db
2025-04-25 00:14:35,064 - INFO - Pod ctest-pod-01355526 with uuid 01860288-0400-442f-b42e-1bb4c47993db found in kube manager
2025-04-25 00:14:35,064 - INFO - Pod ctest-pod-01355526 verification passed
2025-04-25 00:14:35,130 - INFO - Pod ctest-pod-14491178 is in running state.Got IP 10.47.255.245
2025-04-25 00:14:35,185 - DEBUG - Pod ctest-pod-14491178 has vmi 3d7f7438-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:35,185 - INFO - Verified pod ctest-pod-14491178 in contrail-api
2025-04-25 00:14:35,205 - DEBUG - VMI 3d7f7438-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:35,206 - INFO - Verified Pod ctest-pod-14491178 in agent 10.0.0.22
2025-04-25 00:14:35,206 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3ddc6c76-fec0-419b-859a-259d054dce14
2025-04-25 00:14:35,212 - INFO - Pod ctest-pod-14491178 with uuid 3ddc6c76-fec0-419b-859a-259d054dce14 found in kube manager
2025-04-25 00:14:35,212 - INFO - Pod ctest-pod-14491178 verification passed
2025-04-25 00:14:35,217 - INFO - Pod ctest-pod-42266627 is in running state.Got IP 10.47.255.246
2025-04-25 00:14:35,230 - DEBUG - Pod ctest-pod-42266627 has vmi 3cfebdc0-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:35,230 - INFO - Verified pod ctest-pod-42266627 in contrail-api
2025-04-25 00:14:35,243 - DEBUG - VMI 3cfebdc0-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:35,243 - INFO - Verified Pod ctest-pod-42266627 in agent 10.0.0.22
2025-04-25 00:14:35,243 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=db88d62f-ed7f-47db-8809-d4a4f82e402e
2025-04-25 00:14:35,247 - INFO - Pod ctest-pod-42266627 with uuid db88d62f-ed7f-47db-8809-d4a4f82e402e found in kube manager
2025-04-25 00:14:35,248 - INFO - Pod ctest-pod-42266627 verification passed
2025-04-25 00:14:35,252 - INFO - Pod ctest-pod-74351631 is in running state.Got IP 10.47.255.244
2025-04-25 00:14:35,312 - DEBUG - Pod ctest-pod-74351631 has vmi 3df2007a-216a-11f0-8ba6-fa163eed3076
2025-04-25 00:14:35,312 - INFO - Verified pod ctest-pod-74351631 in contrail-api
2025-04-25 00:14:35,324 - DEBUG - VMI 3df2007a-216a-11f0-8ba6-fa163eed3076 is active in agent 10.0.0.22
2025-04-25 00:14:35,324 - INFO - Verified Pod ctest-pod-74351631 in agent 10.0.0.22
2025-04-25 00:14:35,325 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4d4a34db-203e-444a-83c0-5a93fe6c51fa
2025-04-25 00:14:35,329 - INFO - Pod ctest-pod-74351631 with uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa found in kube manager
2025-04-25 00:14:35,329 - INFO - Pod ctest-pod-74351631 verification passed
2025-04-25 00:14:35,329 - INFO - ================================================================================
2025-04-25 00:14:35,329 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-25 00:14:35,329 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-25 00:14:35,537 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with
2025-04-25 00:14:35,537 - INFO - Initial checks done. Running the testcase now
2025-04-25 00:14:35,537 - INFO -
2025-04-25 00:14:35,581 - DEBUG - [Pod ctest-pod-52759632] Cmd: echo ctest-pod-52759632 > /usr/share/nginx/html/index.html, Output:
2025-04-25 00:14:35,625 - DEBUG - [Pod ctest-pod-21280725] Cmd: echo ctest-pod-21280725 > /usr/share/nginx/html/index.html, Output:
2025-04-25 00:14:35,669 - DEBUG - [Pod ctest-pod-33188293] Cmd: echo ctest-pod-33188293 > /usr/share/nginx/html/index.html, Output:
2025-04-25 00:14:35,713 - DEBUG - [Pod ctest-pod-35238451] Cmd: echo ctest-pod-35238451 > /usr/share/nginx/html/index.html, Output:
2025-04-25 00:14:35,717 - DEBUG - Service ctest-nginx-svc-22804309 not present
2025-04-25 00:14:35,717 - INFO - Creating service ctest-nginx-svc-22804309
2025-04-25 00:14:35,731 - INFO - Created Service ctest-nginx-svc-22804309
2025-04-25 00:14:35,752 - WARNING - Service UUID 3909952b-5dd9-4fc5-b86e-b71f6ccfe082 not yet found in contrail-api
2025-04-25 00:14:36,759 - INFO - Validated that Service ctest-nginx-svc-22804309 is seen in contrail-api
2025-04-25 00:14:36,759 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=3909952b-5dd9-4fc5-b86e-b71f6ccfe082
2025-04-25 00:14:36,766 - INFO - Service ctest-nginx-svc-22804309 with uuid 3909952b-5dd9-4fc5-b86e-b71f6ccfe082 found in kube manager
2025-04-25 00:14:36,766 - INFO - Service ctest-nginx-svc-22804309 verification passed
2025-04-25 00:14:37,829 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21280725
2025-04-25 00:14:37,829 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:14:37,829 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21280725
2025-04-25 00:14:37,882 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:14:37,882 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:14:37,882 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:14:37,882 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52759632': 1, 'ctest-pod-21280725': 1}
2025-04-25 00:14:37,928 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:14:37,928 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:14:37,928 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:14:37,972 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21280725
2025-04-25 00:14:37,972 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:14:37,972 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21280725
2025-04-25 00:14:37,972 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52759632': 1, 'ctest-pod-21280725': 1}
2025-04-25 00:14:37,975 - DEBUG - Network policy ingress-on-service not present
2025-04-25 00:14:37,975 - INFO - Creating Network Policy ingress-on-service
2025-04-25 00:14:37,986 - INFO - Network policy found in k8s
2025-04-25 00:14:37,986 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4ace2c36-78fb-4dbc-8a9d-b309719da9ce
2025-04-25 00:14:37,992 - INFO - Network Policy ingress-on-service with uuid 4ace2c36-78fb-4dbc-8a9d-b309719da9ce found in kube manager
2025-04-25 00:14:38,026 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-25 00:14:38,026 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-25 00:14:38,026 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4ace2c36-78fb-4dbc-8a9d-b309719da9ce
2025-04-25 00:14:38,053 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-25 00:14:40,054 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4ace2c36-78fb-4dbc-8a9d-b309719da9ce
2025-04-25 00:14:40,085 - INFO - Network policy with name ingress-on-service found in agent
2025-04-25 00:14:40,085 - INFO - Network Policy ingress-on-service verification passed
2025-04-25 00:14:45,135 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:45,136 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:45,136 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:50,180 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:50,180 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:50,180 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:55,230 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:55,230 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:14:55,230 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:00,279 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:00,279 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:00,279 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:05,328 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:05,328 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:05,328 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:10,380 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:10,380 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:10,380 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:15,423 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:15,423 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:15,423 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:20,469 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:20,469 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:20,469 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:25,511 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:25,511 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:25,512 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:30,560 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:30,560 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:30,560 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:30,560 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-52759632': 0, 'ctest-pod-21280725': 0}
2025-04-25 00:15:30,606 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-21280725
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:15:30,607 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:15:30,607 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: ctest-pod-21280725
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:15:30,656 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-21280725
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:15:30,656 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:15:30,656 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: ctest-pod-21280725
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:15:30,705 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:15:30,705 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:15:30,705 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:15:30,705 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52759632': 1, 'ctest-pod-21280725': 2}
2025-04-25 00:15:35,748 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:35,748 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:35,748 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:40,805 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:40,806 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:40,806 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:45,857 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:45,857 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:45,857 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:50,901 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:50,902 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:50,902 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:55,948 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:55,948 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:15:55,948 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:00,991 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:00,991 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:00,992 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:06,045 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:06,045 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:06,045 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:11,093 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:11,093 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:11,093 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:16,145 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:16,145 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:16,145 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:21,188 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:21,188 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:21,188 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:21,188 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-52759632': 0, 'ctest-pod-21280725': 0}
2025-04-25 00:16:23,235 - DEBUG - [Pod ctest-pod-42266627] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.829 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.323/0.829 ms
2025-04-25 00:16:23,236 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42266627 with expectation True passed
2025-04-25 00:16:25,276 - DEBUG - [Pod ctest-pod-01355526] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.313 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.166/0.313 ms
2025-04-25 00:16:25,276 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01355526 with expectation True passed
2025-04-25 00:16:27,327 - DEBUG - [Pod ctest-pod-14491178] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.934 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.361/0.934 ms
2025-04-25 00:16:27,327 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14491178 with expectation True passed
2025-04-25 00:16:27,372 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:16:27,372 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-25 00:16:27,372 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:16:27,372 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42266627 passed
2025-04-25 00:16:27,433 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:16:27,433 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-25 00:16:27,433 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:16:27,433 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42266627 passed
2025-04-25 00:16:32,481 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-25 00:16:32,481 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-25 00:16:32,481 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-25 00:16:32,481 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01355526 passed
2025-04-25 00:16:37,529 - DEBUG - [Pod ctest-pod-74351631] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-25 00:16:37,529 - DEBUG - [Pod Pod ctest-pod-74351631] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-25 00:16:37,529 - DEBUG - [Pod Pod ctest-pod-74351631] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-25 00:16:37,529 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74351631 passed
2025-04-25 00:16:37,537 - INFO - Updating Network Policy ingress-on-service
2025-04-25 00:16:42,591 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:42,591 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:42,591 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:47,640 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:47,640 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:47,641 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:52,693 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:52,693 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:52,693 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:57,740 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:57,740 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:16:57,740 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:02,788 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:02,788 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:02,789 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:07,845 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:07,845 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:07,845 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:12,888 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:12,888 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:12,888 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:17,936 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:17,936 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:17,936 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:22,988 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:22,988 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:22,988 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:28,032 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:28,032 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:28,032 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
wget: download timed out
2025-04-25 00:17:28,032 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-52759632': 0, 'ctest-pod-21280725': 0}
2025-04-25 00:17:28,087 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,087 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,087 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,143 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,143 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,143 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,194 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52759632
2025-04-25 00:17:28,194 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,195 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52759632
2025-04-25 00:17:28,247 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-21280725
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,247 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,247 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: ctest-pod-21280725
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,247 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52759632': 3, 'ctest-pod-21280725': 1}
2025-04-25 00:17:28,293 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,293 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,293 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,339 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52759632
2025-04-25 00:17:28,339 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,340 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52759632
2025-04-25 00:17:28,391 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,391 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,391 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,445 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,445 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,445 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: ctest-pod-52759632
Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-25 00:17:28,476 - DEBUG - [Pod ctest-pod-14491178] Cmd: wget http://10.97.67.190:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21280725
2025-04-25 00:17:28,476 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd wget http://10.97.67.190:80/ -O - -T 5 -t 1 passed
2025-04-25 00:17:28,476 - DEBUG - [Pod Pod ctest-pod-14491178] Cmd output: Connecting to 10.97.67.190:80 (10.97.67.190:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21280725
2025-04-25 00:17:28,476 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52759632': 4, 'ctest-pod-21280725': 1}
2025-04-25 00:17:30,523 - DEBUG - [Pod ctest-pod-42266627] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.702 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.283/0.702 ms
2025-04-25 00:17:30,524 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42266627 with expectation True passed
2025-04-25 00:17:32,569 - DEBUG - [Pod ctest-pod-01355526] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.528 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.112 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.237/0.528 ms
2025-04-25 00:17:32,570 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01355526 with expectation True passed
2025-04-25 00:17:34,631 - DEBUG - [Pod ctest-pod-14491178] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.201 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.451/1.201 ms
2025-04-25 00:17:34,631 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14491178 with expectation True passed
2025-04-25 00:17:34,677 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:17:34,677 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-25 00:17:34,677 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:17:34,677 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42266627 passed
2025-04-25 00:17:34,724 - DEBUG - [Pod ctest-pod-42266627] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:17:34,724 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-25 00:17:34,725 - DEBUG - [Pod Pod ctest-pod-42266627] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:17:34,725 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42266627 passed
2025-04-25 00:17:39,754 - DEBUG - [Pod ctest-pod-01355526] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-25 00:17:39,754 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-25 00:17:39,755 - DEBUG - [Pod Pod ctest-pod-01355526] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-25 00:17:39,755 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01355526 passed
2025-04-25 00:17:39,801 - DEBUG - [Pod ctest-pod-74351631] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:17:39,801 - DEBUG - [Pod Pod ctest-pod-74351631] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-25 00:17:39,801 - DEBUG - [Pod Pod ctest-pod-74351631] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-25 00:17:39,801 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74351631 passed
2025-04-25 00:17:39,801 - INFO - Deleting Network Policy : ingress-on-service
2025-04-25 00:17:39,802 - INFO - Deleting service : ctest-nginx-svc-22804309
2025-04-25 00:17:39,952 - DEBUG - No XMPP flaps were noticed during the test
2025-04-25 00:17:39,953 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:04]
2025-04-25 00:17:39,953 - INFO - --------------------------------------------------------------------------------
2025-04-25 00:17:39,958 - INFO - Deleting pod ctest-new-default-85485204:ctest-pod-52759632
2025-04-25 00:17:39,959 - INFO - Deleting pod ctest-new-default-85485204:ctest-pod-21280725
2025-04-25 00:17:39,959 - INFO - Deleting pod ctest-non-default-31679619:ctest-pod-33188293
2025-04-25 00:17:39,960 - INFO - Deleting pod ctest-non-default-31679619:ctest-pod-35238451
2025-04-25 00:17:39,960 - INFO - Deleting pod ctest-new-default-85485204:ctest-pod-01355526
2025-04-25 00:17:39,961 - INFO - Deleting pod ctest-new-default-85485204:ctest-pod-42266627
2025-04-25 00:17:39,961 - INFO - Deleting pod ctest-non-default-31679619:ctest-pod-14491178
2025-04-25 00:17:39,961 - INFO - Deleting pod ctest-non-default-31679619:ctest-pod-74351631
2025-04-25 00:17:39,992 - WARNING - Pod uuid db327a82-529e-4536-88bd-92eec0883774 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,026 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,026 - WARNING - Pod uuid 24d07a36-8af1-4389-bc0a-106fe4a6caab is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,059 - WARNING - Pod uuid 3e549b7e-05bf-49ed-94ff-505d075296cb is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,136 - WARNING - Pod uuid 76b9138c-d2b3-41bc-adc2-b28c4882d905 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,138 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,139 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:40,139 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:45,001 - DEBUG - Pod db327a82-529e-4536-88bd-92eec0883774 is not in agent 10.0.0.22 VM list
2025-04-25 00:17:45,008 - DEBUG - VMI 386288a0-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:17:45,008 - INFO - Verified that pod ctest-pod-52759632 is removed in agent
2025-04-25 00:17:45,037 - DEBUG - Pod 24d07a36-8af1-4389-bc0a-106fe4a6caab is not in agent 10.0.0.22 VM list
2025-04-25 00:17:45,039 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:45,044 - DEBUG - VMI 395d7b0c-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:17:45,044 - INFO - Verified that pod ctest-pod-21280725 is removed in agent
2025-04-25 00:17:45,067 - DEBUG - Pod 3e549b7e-05bf-49ed-94ff-505d075296cb is not in agent 10.0.0.22 VM list
2025-04-25 00:17:45,073 - DEBUG - VMI 3b6eea0c-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:17:45,073 - INFO - Verified that pod ctest-pod-33188293 is removed in agent
2025-04-25 00:17:45,154 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:45,154 - DEBUG - Pod 76b9138c-d2b3-41bc-adc2-b28c4882d905 is not in agent 10.0.0.22 VM list
2025-04-25 00:17:45,157 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:45,158 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:45,162 - DEBUG - VMI 3bee862c-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:17:45,162 - INFO - Verified that pod ctest-pod-35238451 is removed in agent
2025-04-25 00:17:50,047 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:50,162 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:50,168 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:50,169 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:55,055 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:55,172 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:55,180 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:17:55,182 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:00,064 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:00,180 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:00,190 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:00,191 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:05,074 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:05,187 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:05,200 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:05,202 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:10,081 - WARNING - Pod uuid 4d4a34db-203e-444a-83c0-5a93fe6c51fa is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:10,194 - WARNING - Pod uuid db88d62f-ed7f-47db-8809-d4a4f82e402e is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:10,213 - WARNING - Pod uuid 3ddc6c76-fec0-419b-859a-259d054dce14 is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:10,213 - WARNING - Pod uuid 01860288-0400-442f-b42e-1bb4c47993db is still seen in agent 10.0.0.22 VM list
2025-04-25 00:18:15,089 - DEBUG - Pod 4d4a34db-203e-444a-83c0-5a93fe6c51fa is not in agent 10.0.0.22 VM list
2025-04-25 00:18:15,095 - DEBUG - VMI 3df2007a-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:18:15,095 - INFO - Verified that pod ctest-pod-74351631 is removed in agent
2025-04-25 00:18:15,202 - DEBUG - Pod db88d62f-ed7f-47db-8809-d4a4f82e402e is not in agent 10.0.0.22 VM list
2025-04-25 00:18:15,208 - DEBUG - VMI 3cfebdc0-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:18:15,208 - INFO - Verified that pod ctest-pod-42266627 is removed in agent
2025-04-25 00:18:15,223 - DEBUG - Pod 01860288-0400-442f-b42e-1bb4c47993db is not in agent 10.0.0.22 VM list
2025-04-25 00:18:15,226 - DEBUG - Pod 3ddc6c76-fec0-419b-859a-259d054dce14 is not in agent 10.0.0.22 VM list
2025-04-25 00:18:15,233 - DEBUG - VMI 3c7a6322-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:18:15,233 - INFO - Verified that pod ctest-pod-01355526 is removed in agent
2025-04-25 00:18:15,234 - DEBUG - VMI 3d7f7438-216a-11f0-8ba6-fa163eed3076 is removed from agent 10.0.0.22
2025-04-25 00:18:15,234 - INFO - Verified that pod ctest-pod-14491178 is removed in agent
2025-04-25 00:18:15,234 - INFO - Deleting namespace ctest-non-default-31679619
2025-04-25 00:18:15,258 - DEBUG - Namespace ctest-non-default-31679619 still in k8s
2025-04-25 00:18:17,263 - DEBUG - Namespace ctest-non-default-31679619 still in k8s
2025-04-25 00:18:19,269 - DEBUG - Namespace ctest-non-default-31679619 still in k8s
2025-04-25 00:18:21,272 - DEBUG - Namespace ctest-non-default-31679619 is not in k8s
2025-04-25 00:18:21,273 - DEBUG - No need to check project deletion in contrail-api
2025-04-25 00:18:21,273 - INFO - Deleting namespace ctest-new-default-85485204
2025-04-25 00:18:21,282 - DEBUG - Namespace ctest-new-default-85485204 still in k8s
2025-04-25 00:18:23,287 - DEBUG - Namespace ctest-new-default-85485204 still in k8s
2025-04-25 00:18:25,291 - DEBUG - Namespace ctest-new-default-85485204 still in k8s
2025-04-25 00:18:27,295 - DEBUG - Namespace ctest-new-default-85485204 is not in k8s
2025-04-25 00:18:27,295 - DEBUG - No need to check project deletion in contrail-api