2024-09-04 19:29:32,998 - INFO - Using existing project ['default-domain', 'k8s-default'](9dc9ffed-a8b2-49b7-8224-587cfc982707)
2024-09-04 19:29:33,021 - DEBUG - Namespace ctest-new-default-90002989 not present
2024-09-04 19:29:33,031 - INFO - Created namespace ctest-new-default-90002989
2024-09-04 19:29:36,040 - DEBUG - Namespace ctest-non-default-79038127 not present
2024-09-04 19:29:36,051 - INFO - Created namespace ctest-non-default-79038127
2024-09-04 19:29:39,068 - DEBUG - Pod ctest-pod-05505726 not present
2024-09-04 19:29:39,068 - INFO - Creating Pod ctest-pod-05505726
2024-09-04 19:29:39,089 - DEBUG - Node for Pod ctest-pod-05505726 not yet populated
2024-09-04 19:29:42,096 - DEBUG - Pod : ctest-pod-05505726 UUID is 2d789185-9fb0-4360-b76f-fa95b829a5a0
2024-09-04 19:29:42,098 - DEBUG - Pod ctest-pod-43033158 not present
2024-09-04 19:29:42,098 - INFO - Creating Pod ctest-pod-43033158
2024-09-04 19:29:42,127 - DEBUG - Pod : ctest-pod-43033158 UUID is 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e
2024-09-04 19:29:42,134 - DEBUG - Pod ctest-pod-52767481 not present
2024-09-04 19:29:42,134 - INFO - Creating Pod ctest-pod-52767481
2024-09-04 19:29:42,151 - DEBUG - Node for Pod ctest-pod-52767481 not yet populated
2024-09-04 19:29:45,157 - DEBUG - Pod : ctest-pod-52767481 UUID is a38b0a63-7543-4c1a-ba90-3e43cc4ef3c7
2024-09-04 19:29:45,160 - DEBUG - Pod ctest-pod-18747403 not present
2024-09-04 19:29:45,160 - INFO - Creating Pod ctest-pod-18747403
2024-09-04 19:29:45,187 - DEBUG - Pod : ctest-pod-18747403 UUID is 15a598d2-6a26-46c2-aa4c-f82b99ac0cd9
2024-09-04 19:29:45,190 - DEBUG - Pod ctest-pod-42520785 not present
2024-09-04 19:29:45,190 - INFO - Creating Pod ctest-pod-42520785
2024-09-04 19:29:45,231 - DEBUG - Pod : ctest-pod-42520785 UUID is 2eace709-ba57-40d5-8d07-87f0dae11c52
2024-09-04 19:29:45,236 - DEBUG - Pod ctest-pod-55296689 not present
2024-09-04 19:29:45,236 - INFO - Creating Pod ctest-pod-55296689
2024-09-04 19:29:45,257 - DEBUG - Pod : ctest-pod-55296689 UUID is effa753b-f5d0-40ef-b612-cd36288fabe7
2024-09-04 19:29:45,259 - DEBUG - Pod ctest-pod-76647706 not present
2024-09-04 19:29:45,260 - INFO - Creating Pod ctest-pod-76647706
2024-09-04 19:29:45,276 - DEBUG - Pod : ctest-pod-76647706 UUID is d0c44653-9cf0-4029-9c21-6819f63b94e1
2024-09-04 19:29:45,279 - DEBUG - Pod ctest-pod-24881196 not present
2024-09-04 19:29:45,279 - INFO - Creating Pod ctest-pod-24881196
2024-09-04 19:29:45,295 - DEBUG - Pod : ctest-pod-24881196 UUID is 7c161418-6926-48ee-a050-240e019b9c79
2024-09-04 19:29:45,519 - INFO - Project default-domain:k8s-ctest-new-default-90002989 for Namespace ctest-new-default-90002989 is seen in contrail-api
2024-09-04 19:29:45,519 - DEBUG - Project uuid in Contrail is fe6d84e2-e76d-4f06-8961-edd4815ff297
2024-09-04 19:29:45,662 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=fffa0794-47e8-4ed5-b0ca-a0aa1b06fb0a
2024-09-04 19:29:45,678 - INFO - Namespace ctest-new-default-90002989 with uuid fffa0794-47e8-4ed5-b0ca-a0aa1b06fb0a found in kube manager
2024-09-04 19:29:45,678 - INFO - Namespace ctest-new-default-90002989 verification passed
2024-09-04 19:29:45,857 - INFO - Project default-domain:k8s-ctest-non-default-79038127 for Namespace ctest-non-default-79038127 is seen in contrail-api
2024-09-04 19:29:45,857 - DEBUG - Project uuid in Contrail is 0179b959-8152-4121-ad9c-a04122df5a14
2024-09-04 19:29:45,858 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=735d1405-f962-4a47-960b-1f97e1d62b48
2024-09-04 19:29:45,871 - INFO - Namespace ctest-non-default-79038127 with uuid 735d1405-f962-4a47-960b-1f97e1d62b48 found in kube manager
2024-09-04 19:29:45,871 - INFO - Namespace ctest-non-default-79038127 verification passed
2024-09-04 19:29:45,876 - DEBUG - Pod ctest-pod-05505726 not in running state.Currently in Pending
2024-09-04 19:29:50,882 - INFO - Pod ctest-pod-05505726 is in running state.Got IP 10.47.255.251
2024-09-04 19:29:50,938 - DEBUG - Pod ctest-pod-05505726 has vmi 07bd269c-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:29:50,938 - INFO - Verified pod ctest-pod-05505726 in contrail-api
2024-09-04 19:29:50,954 - DEBUG - VMI 07bd269c-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:29:50,954 - INFO - Verified Pod ctest-pod-05505726 in agent 10.0.0.46
2024-09-04 19:29:50,954 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2d789185-9fb0-4360-b76f-fa95b829a5a0
2024-09-04 19:29:50,961 - INFO - Pod ctest-pod-05505726 with uuid 2d789185-9fb0-4360-b76f-fa95b829a5a0 found in kube manager
2024-09-04 19:29:50,961 - INFO - Pod ctest-pod-05505726 verification passed
2024-09-04 19:29:50,966 - DEBUG - Pod ctest-pod-43033158 not in running state.Currently in Pending
2024-09-04 19:29:55,973 - INFO - Pod ctest-pod-43033158 is in running state.Got IP 10.47.255.250
2024-09-04 19:29:55,987 - DEBUG - Pod ctest-pod-43033158 has vmi 08bdd438-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:29:55,987 - INFO - Verified pod ctest-pod-43033158 in contrail-api
2024-09-04 19:29:56,003 - DEBUG - VMI 08bdd438-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:29:56,003 - INFO - Verified Pod ctest-pod-43033158 in agent 10.0.0.46
2024-09-04 19:29:56,003 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e
2024-09-04 19:29:56,008 - INFO - Pod ctest-pod-43033158 with uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e found in kube manager
2024-09-04 19:29:56,008 - INFO - Pod ctest-pod-43033158 verification passed
2024-09-04 19:29:56,018 - INFO - Pod ctest-pod-52767481 is in running state.Got IP 10.47.255.249
2024-09-04 19:29:56,070 - DEBUG - Pod ctest-pod-52767481 has vmi 096b613e-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:29:56,070 - INFO - Verified pod ctest-pod-52767481 in contrail-api
2024-09-04 19:29:56,099 - DEBUG - VMI 096b613e-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:29:56,099 - INFO - Verified Pod ctest-pod-52767481 in agent 10.0.0.46
2024-09-04 19:29:56,100 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a38b0a63-7543-4c1a-ba90-3e43cc4ef3c7
2024-09-04 19:29:56,105 - INFO - Pod ctest-pod-52767481 with uuid a38b0a63-7543-4c1a-ba90-3e43cc4ef3c7 found in kube manager
2024-09-04 19:29:56,105 - INFO - Pod ctest-pod-52767481 verification passed
2024-09-04 19:29:56,110 - INFO - Pod ctest-pod-18747403 is in running state.Got IP 10.47.255.248
2024-09-04 19:29:56,122 - DEBUG - Pod ctest-pod-18747403 has vmi 0a8fedd2-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:29:56,122 - INFO - Verified pod ctest-pod-18747403 in contrail-api
2024-09-04 19:29:56,137 - DEBUG - VMI 0a8fedd2-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:29:56,138 - INFO - Verified Pod ctest-pod-18747403 in agent 10.0.0.46
2024-09-04 19:29:56,138 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=15a598d2-6a26-46c2-aa4c-f82b99ac0cd9
2024-09-04 19:29:56,143 - INFO - Pod ctest-pod-18747403 with uuid 15a598d2-6a26-46c2-aa4c-f82b99ac0cd9 found in kube manager
2024-09-04 19:29:56,143 - INFO - Pod ctest-pod-18747403 verification passed
2024-09-04 19:29:56,148 - DEBUG - Pod ctest-pod-42520785 not in running state.Currently in Pending
2024-09-04 19:30:01,154 - INFO - Pod ctest-pod-42520785 is in running state.Got IP 10.47.255.247
2024-09-04 19:30:01,164 - DEBUG - Pod ctest-pod-42520785 has vmi 0b1afc2e-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:30:01,165 - INFO - Verified pod ctest-pod-42520785 in contrail-api
2024-09-04 19:30:01,177 - DEBUG - VMI 0b1afc2e-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:30:01,178 - INFO - Verified Pod ctest-pod-42520785 in agent 10.0.0.46
2024-09-04 19:30:01,178 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2eace709-ba57-40d5-8d07-87f0dae11c52
2024-09-04 19:30:01,182 - INFO - Pod ctest-pod-42520785 with uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 found in kube manager
2024-09-04 19:30:01,182 - INFO - Pod ctest-pod-42520785 verification passed
2024-09-04 19:30:01,187 - INFO - Pod ctest-pod-76647706 is in running state.Got IP 10.47.255.245
2024-09-04 19:30:01,239 - DEBUG - Pod ctest-pod-76647706 has vmi 0bfd1398-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:30:01,240 - INFO - Verified pod ctest-pod-76647706 in contrail-api
2024-09-04 19:30:01,266 - DEBUG - VMI 0bfd1398-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:30:01,266 - INFO - Verified Pod ctest-pod-76647706 in agent 10.0.0.46
2024-09-04 19:30:01,266 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d0c44653-9cf0-4029-9c21-6819f63b94e1
2024-09-04 19:30:01,271 - INFO - Pod ctest-pod-76647706 with uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 found in kube manager
2024-09-04 19:30:01,271 - INFO - Pod ctest-pod-76647706 verification passed
2024-09-04 19:30:01,276 - INFO - Pod ctest-pod-55296689 is in running state.Got IP 10.47.255.246
2024-09-04 19:30:01,287 - DEBUG - Pod ctest-pod-55296689 has vmi 0b830b16-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:30:01,287 - INFO - Verified pod ctest-pod-55296689 in contrail-api
2024-09-04 19:30:01,301 - DEBUG - VMI 0b830b16-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:30:01,301 - INFO - Verified Pod ctest-pod-55296689 in agent 10.0.0.46
2024-09-04 19:30:01,301 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=effa753b-f5d0-40ef-b612-cd36288fabe7
2024-09-04 19:30:01,305 - INFO - Pod ctest-pod-55296689 with uuid effa753b-f5d0-40ef-b612-cd36288fabe7 found in kube manager
2024-09-04 19:30:01,305 - INFO - Pod ctest-pod-55296689 verification passed
2024-09-04 19:30:01,310 - INFO - Pod ctest-pod-24881196 is in running state.Got IP 10.47.255.244
2024-09-04 19:30:01,362 - DEBUG - Pod ctest-pod-24881196 has vmi 0c725b26-6af4-11ef-8580-fa163ebed3cf
2024-09-04 19:30:01,362 - INFO - Verified pod ctest-pod-24881196 in contrail-api
2024-09-04 19:30:01,378 - DEBUG - VMI 0c725b26-6af4-11ef-8580-fa163ebed3cf is active in agent 10.0.0.46
2024-09-04 19:30:01,378 - INFO - Verified Pod ctest-pod-24881196 in agent 10.0.0.46
2024-09-04 19:30:01,378 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=7c161418-6926-48ee-a050-240e019b9c79
2024-09-04 19:30:01,383 - INFO - Pod ctest-pod-24881196 with uuid 7c161418-6926-48ee-a050-240e019b9c79 found in kube manager
2024-09-04 19:30:01,383 - INFO - Pod ctest-pod-24881196 verification passed
2024-09-04 19:30:01,384 - INFO - ================================================================================
2024-09-04 19:30:01,384 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-04 19:30:01,384 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-04 19:30:01,617 - DEBUG - Nothing to compare xmpp stats {'10.0.0.46': {'10.0.0.22': '0'}} with
2024-09-04 19:30:01,617 - INFO - Initial checks done. Running the testcase now
2024-09-04 19:30:01,617 - INFO -
2024-09-04 19:30:01,676 - DEBUG - [Pod ctest-pod-05505726] Cmd: echo ctest-pod-05505726 > /usr/share/nginx/html/index.html, Output:
2024-09-04 19:30:01,743 - DEBUG - [Pod ctest-pod-43033158] Cmd: echo ctest-pod-43033158 > /usr/share/nginx/html/index.html, Output:
2024-09-04 19:30:01,815 - DEBUG - [Pod ctest-pod-52767481] Cmd: echo ctest-pod-52767481 > /usr/share/nginx/html/index.html, Output:
2024-09-04 19:30:01,871 - DEBUG - [Pod ctest-pod-18747403] Cmd: echo ctest-pod-18747403 > /usr/share/nginx/html/index.html, Output:
2024-09-04 19:30:01,874 - DEBUG - Service ctest-nginx-svc-80422606 not present
2024-09-04 19:30:01,874 - INFO - Creating service ctest-nginx-svc-80422606
2024-09-04 19:30:01,903 - INFO - Created Service ctest-nginx-svc-80422606
2024-09-04 19:30:01,922 - WARNING - Service UUID 9f1ce178-88eb-43f7-8530-328b2d7e1194 not yet found in contrail-api
2024-09-04 19:30:02,941 - INFO - Validated that Service ctest-nginx-svc-80422606 is seen in contrail-api
2024-09-04 19:30:02,941 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=9f1ce178-88eb-43f7-8530-328b2d7e1194
2024-09-04 19:30:02,947 - INFO - Service ctest-nginx-svc-80422606 with uuid 9f1ce178-88eb-43f7-8530-328b2d7e1194 found in kube manager
2024-09-04 19:30:02,947 - INFO - Service ctest-nginx-svc-80422606 verification passed
2024-09-04 19:30:03,017 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:03,017 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:03,017 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:03,079 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43033158
2024-09-04 19:30:03,079 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:03,079 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43033158
2024-09-04 19:30:03,138 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:03,139 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:03,139 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:03,218 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-05505726
2024-09-04 19:30:03,218 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:03,218 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-05505726
2024-09-04 19:30:03,219 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05505726': 1, 'ctest-pod-43033158': 3}
2024-09-04 19:30:03,274 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-05505726
2024-09-04 19:30:03,274 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:03,274 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-05505726
2024-09-04 19:30:03,323 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43033158
2024-09-04 19:30:03,323 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:03,323 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43033158
2024-09-04 19:30:03,323 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05505726': 1, 'ctest-pod-43033158': 1}
2024-09-04 19:30:03,326 - DEBUG - Network policy ingress-on-service not present
2024-09-04 19:30:03,326 - INFO - Creating Network Policy ingress-on-service
2024-09-04 19:30:03,336 - INFO - Network policy found in k8s
2024-09-04 19:30:03,336 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2843651c-e703-4d88-83fd-50fe707b0433
2024-09-04 19:30:03,344 - INFO - Network Policy ingress-on-service with uuid 2843651c-e703-4d88-83fd-50fe707b0433 found in kube manager
2024-09-04 19:30:03,380 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-04 19:30:03,380 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-04 19:30:03,380 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2843651c-e703-4d88-83fd-50fe707b0433
2024-09-04 19:30:03,409 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-04 19:30:05,410 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2843651c-e703-4d88-83fd-50fe707b0433
2024-09-04 19:30:05,440 - INFO - Network policy with name ingress-on-service found in agent
2024-09-04 19:30:05,441 - INFO - Network Policy ingress-on-service verification passed
2024-09-04 19:30:10,505 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:10,506 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:10,506 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:15,561 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:15,561 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:15,561 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:20,625 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:20,626 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:20,626 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:25,684 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:25,684 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:25,684 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:30,749 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:30,749 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:30,749 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:35,805 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:35,805 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:35,805 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:40,884 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:40,884 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:40,884 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:45,941 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:45,941 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:45,941 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:51,002 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:51,003 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:51,003 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:56,052 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:56,052 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:56,053 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:30:56,053 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05505726': 0, 'ctest-pod-43033158': 0}
2024-09-04 19:30:56,126 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:56,126 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:56,126 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:56,193 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-05505726
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:56,194 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:30:56,194 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: ctest-pod-05505726
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:30:56,194 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05505726': 1, 'ctest-pod-43033158': 1}
2024-09-04 19:31:01,238 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:01,238 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:01,238 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:06,304 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:06,305 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:06,305 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:11,367 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:11,367 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:11,367 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:16,425 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:16,425 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:16,425 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:21,494 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:21,494 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:21,494 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:26,558 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:26,559 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:26,559 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:31,620 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:31,620 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:31,620 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:36,689 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:36,689 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:36,689 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:41,745 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:41,745 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:41,745 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:46,809 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:46,809 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:46,809 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:31:46,809 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05505726': 0, 'ctest-pod-43033158': 0}
2024-09-04 19:31:48,862 - DEBUG - [Pod ctest-pod-55296689] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.558 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.237/0.558 ms
2024-09-04 19:31:48,862 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55296689 with expectation True passed
2024-09-04 19:31:50,920 - DEBUG - [Pod ctest-pod-42520785] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.709 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.283/0.709 ms
2024-09-04 19:31:50,920 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42520785 with expectation True passed
2024-09-04 19:31:52,991 - DEBUG - [Pod ctest-pod-76647706] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.710 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.292/0.710 ms
2024-09-04 19:31:52,992 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76647706 with expectation True passed
2024-09-04 19:31:53,060 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:31:53,060 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 19:31:53,060 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:31:53,061 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55296689 passed
2024-09-04 19:31:53,123 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:31:53,124 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-04 19:31:53,124 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:31:53,124 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55296689 passed
2024-09-04 19:31:58,182 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 19:31:58,182 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 19:31:58,182 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 19:31:58,182 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42520785 passed
2024-09-04 19:32:03,236 - DEBUG - [Pod ctest-pod-24881196] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 19:32:03,237 - DEBUG - [Pod Pod ctest-pod-24881196] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 19:32:03,237 - DEBUG - [Pod Pod ctest-pod-24881196] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-04 19:32:03,237 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24881196 passed
2024-09-04 19:32:03,247 - INFO - Updating Network Policy ingress-on-service
2024-09-04 19:32:08,320 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:08,320 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:08,320 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:13,386 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:13,386 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:13,386 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:18,444 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:18,444 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:18,445 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:23,509 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:23,510 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:23,510 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:28,596 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:28,596 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:28,596 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:33,656 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:33,656 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:33,657 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:38,717 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:38,717 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:38,717 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:43,778 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:43,778 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:43,778 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:48,838 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:48,838 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:48,838 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:53,916 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:53,916 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:53,916 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
wget: download timed out
2024-09-04 19:32:53,917 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05505726': 0, 'ctest-pod-43033158': 0}
2024-09-04 19:32:53,974 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-05505726
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:32:53,975 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:32:53,975 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: ctest-pod-05505726
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:32:54,035 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:32:54,035 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:32:54,035 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: ctest-pod-43033158
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:32:54,035 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05505726': 1, 'ctest-pod-43033158': 1}
2024-09-04 19:32:54,094 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43033158
2024-09-04 19:32:54,094 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:32:54,094 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-43033158
2024-09-04 19:32:54,165 - DEBUG - [Pod ctest-pod-76647706] Cmd: wget http://10.100.57.128:80/ -O - -T 5 -t 1 , Output: ctest-pod-05505726
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:32:54,165 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd wget http://10.100.57.128:80/ -O - -T 5 -t 1 passed
2024-09-04 19:32:54,166 - DEBUG - [Pod Pod ctest-pod-76647706] Cmd output: ctest-pod-05505726
Connecting to 10.100.57.128:80 (10.100.57.128:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-04 19:32:54,166 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05505726': 1, 'ctest-pod-43033158': 1}
2024-09-04 19:32:56,225 - DEBUG - [Pod ctest-pod-55296689] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.451 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.106 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.210/0.451 ms
2024-09-04 19:32:56,225 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55296689 with expectation True passed
2024-09-04 19:32:58,299 - DEBUG - [Pod ctest-pod-42520785] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.571 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.247/0.571 ms
2024-09-04 19:32:58,299 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42520785 with expectation True passed
2024-09-04 19:33:00,360 - DEBUG - [Pod ctest-pod-76647706] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.614 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.257/0.614 ms
2024-09-04 19:33:00,361 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76647706 with expectation True passed
2024-09-04 19:33:00,425 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:33:00,425 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 19:33:00,425 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:33:00,425 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55296689 passed
2024-09-04 19:33:00,496 - DEBUG - [Pod ctest-pod-55296689] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:33:00,496 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-04 19:33:00,496 - DEBUG - [Pod Pod ctest-pod-55296689] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:33:00,496 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55296689 passed
2024-09-04 19:33:05,561 - DEBUG - [Pod ctest-pod-42520785] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 19:33:05,562 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 19:33:05,562 - DEBUG - [Pod Pod ctest-pod-42520785] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-04 19:33:05,562 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42520785 passed
2024-09-04 19:33:05,634 - DEBUG - [Pod ctest-pod-24881196] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:33:05,634 - DEBUG - [Pod Pod ctest-pod-24881196] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-04 19:33:05,634 - DEBUG - [Pod Pod ctest-pod-24881196] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-04 19:33:05,635 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24881196 passed
2024-09-04 19:33:05,635 - INFO - Deleting Network Policy : ingress-on-service
2024-09-04 19:33:05,635 - INFO - Deleting service : ctest-nginx-svc-80422606
2024-09-04 19:33:05,866 - DEBUG - No XMPP flaps were noticed during the test
2024-09-04 19:33:05,866 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:04]
2024-09-04 19:33:05,867 - INFO - --------------------------------------------------------------------------------
2024-09-04 19:33:05,873 - INFO - Deleting pod ctest-new-default-90002989:ctest-pod-05505726
2024-09-04 19:33:05,873 - INFO - Deleting pod ctest-new-default-90002989:ctest-pod-43033158
2024-09-04 19:33:05,874 - INFO - Deleting pod ctest-non-default-79038127:ctest-pod-52767481
2024-09-04 19:33:05,874 - INFO - Deleting pod ctest-non-default-79038127:ctest-pod-18747403
2024-09-04 19:33:05,875 - INFO - Deleting pod ctest-new-default-90002989:ctest-pod-42520785
2024-09-04 19:33:05,875 - INFO - Deleting pod ctest-new-default-90002989:ctest-pod-55296689
2024-09-04 19:33:05,875 - INFO - Deleting pod ctest-non-default-79038127:ctest-pod-76647706
2024-09-04 19:33:05,876 - INFO - Deleting pod ctest-non-default-79038127:ctest-pod-24881196
2024-09-04 19:33:05,979 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,037 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,038 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,039 - WARNING - Pod uuid 2d789185-9fb0-4360-b76f-fa95b829a5a0 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,039 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,042 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,043 - WARNING - Pod uuid a38b0a63-7543-4c1a-ba90-3e43cc4ef3c7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:06,043 - WARNING - Pod uuid 15a598d2-6a26-46c2-aa4c-f82b99ac0cd9 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:10,988 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:11,080 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:11,080 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:11,084 - DEBUG - Pod 2d789185-9fb0-4360-b76f-fa95b829a5a0 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:11,089 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:11,089 - DEBUG - Pod a38b0a63-7543-4c1a-ba90-3e43cc4ef3c7 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:11,091 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:11,091 - DEBUG - Pod 15a598d2-6a26-46c2-aa4c-f82b99ac0cd9 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:11,109 - DEBUG - VMI 096b613e-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:11,109 - INFO - Verified that pod ctest-pod-52767481 is removed in agent
2024-09-04 19:33:11,111 - DEBUG - VMI 07bd269c-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:11,111 - INFO - Verified that pod ctest-pod-05505726 is removed in agent
2024-09-04 19:33:11,111 - DEBUG - VMI 0a8fedd2-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:11,111 - INFO - Verified that pod ctest-pod-18747403 is removed in agent
2024-09-04 19:33:15,996 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:16,096 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:16,096 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:16,103 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:16,104 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:21,005 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:21,108 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:21,110 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:21,117 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:21,118 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:26,014 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:26,122 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:26,122 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:26,129 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:26,130 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:31,023 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:31,134 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:31,135 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:31,142 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:31,142 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:36,096 - WARNING - Pod uuid d0c44653-9cf0-4029-9c21-6819f63b94e1 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:36,147 - WARNING - Pod uuid effa753b-f5d0-40ef-b612-cd36288fabe7 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:36,148 - WARNING - Pod uuid 2eace709-ba57-40d5-8d07-87f0dae11c52 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:36,196 - WARNING - Pod uuid 7c161418-6926-48ee-a050-240e019b9c79 is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:36,197 - WARNING - Pod uuid 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is still seen in agent 10.0.0.46 VM list
2024-09-04 19:33:41,105 - DEBUG - Pod d0c44653-9cf0-4029-9c21-6819f63b94e1 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:41,112 - DEBUG - VMI 0bfd1398-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:41,112 - INFO - Verified that pod ctest-pod-76647706 is removed in agent
2024-09-04 19:33:41,158 - DEBUG - Pod 2eace709-ba57-40d5-8d07-87f0dae11c52 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:41,161 - DEBUG - Pod effa753b-f5d0-40ef-b612-cd36288fabe7 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:41,171 - DEBUG - VMI 0b1afc2e-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:41,172 - INFO - Verified that pod ctest-pod-42520785 is removed in agent
2024-09-04 19:33:41,172 - DEBUG - VMI 0b830b16-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:41,172 - INFO - Verified that pod ctest-pod-55296689 is removed in agent
2024-09-04 19:33:41,210 - DEBUG - Pod 7c161418-6926-48ee-a050-240e019b9c79 is not in agent 10.0.0.46 VM list
2024-09-04 19:33:41,212 - DEBUG - Pod 2a1f63e0-ced7-43e1-a9d5-7ef5616aef6e is not in agent 10.0.0.46 VM list
2024-09-04 19:33:41,223 - DEBUG - VMI 08bdd438-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:41,223 - INFO - Verified that pod ctest-pod-43033158 is removed in agent
2024-09-04 19:33:41,223 - DEBUG - VMI 0c725b26-6af4-11ef-8580-fa163ebed3cf is removed from agent 10.0.0.46
2024-09-04 19:33:41,223 - INFO - Verified that pod ctest-pod-24881196 is removed in agent
2024-09-04 19:33:41,223 - INFO - Deleting namespace ctest-non-default-79038127
2024-09-04 19:33:41,242 - DEBUG - Namespace ctest-non-default-79038127 still in k8s
2024-09-04 19:33:43,247 - DEBUG - Namespace ctest-non-default-79038127 still in k8s
2024-09-04 19:33:45,252 - DEBUG - Namespace ctest-non-default-79038127 still in k8s
2024-09-04 19:33:47,255 - DEBUG - Namespace ctest-non-default-79038127 is not in k8s
2024-09-04 19:33:47,255 - DEBUG - No need to check project deletion in contrail-api
2024-09-04 19:33:47,255 - INFO - Deleting namespace ctest-new-default-90002989
2024-09-04 19:33:47,264 - DEBUG - Namespace ctest-new-default-90002989 still in k8s
2024-09-04 19:33:49,269 - DEBUG - Namespace ctest-new-default-90002989 still in k8s
2024-09-04 19:33:51,275 - DEBUG - Namespace ctest-new-default-90002989 still in k8s
2024-09-04 19:33:53,278 - DEBUG - Namespace ctest-new-default-90002989 is not in k8s
2024-09-04 19:33:53,278 - DEBUG - No need to check project deletion in contrail-api