2025-02-11 11:45:59,848 - INFO - Using existing project ['default-domain', 'k8s-default'](b4971281-39ee-4b81-8a77-eaa0973c02e3)
2025-02-11 11:45:59,876 - DEBUG - Namespace ctest-new-default-94209125 not present
2025-02-11 11:45:59,887 - INFO - Created namespace ctest-new-default-94209125
2025-02-11 11:46:02,892 - DEBUG - Namespace ctest-non-default-42898081 not present
2025-02-11 11:46:02,905 - INFO - Created namespace ctest-non-default-42898081
2025-02-11 11:46:05,933 - DEBUG - Pod ctest-pod-24198992 not present
2025-02-11 11:46:05,933 - INFO - Creating Pod ctest-pod-24198992
2025-02-11 11:46:05,960 - DEBUG - Pod : ctest-pod-24198992 UUID is a9caa6fd-2e33-4d17-97c6-aefdf681205d
2025-02-11 11:46:05,972 - DEBUG - Pod ctest-pod-49419998 not present
2025-02-11 11:46:05,972 - INFO - Creating Pod ctest-pod-49419998
2025-02-11 11:46:06,031 - DEBUG - Pod : ctest-pod-49419998 UUID is b8d6e3a3-9546-4a6c-b6d6-61adf6bbe622
2025-02-11 11:46:06,035 - DEBUG - Pod ctest-pod-54887192 not present
2025-02-11 11:46:06,035 - INFO - Creating Pod ctest-pod-54887192
2025-02-11 11:46:06,068 - DEBUG - Pod : ctest-pod-54887192 UUID is ed2d158b-4465-4299-8d74-a3db80a4aed3
2025-02-11 11:46:06,073 - DEBUG - Pod ctest-pod-54190598 not present
2025-02-11 11:46:06,074 - INFO - Creating Pod ctest-pod-54190598
2025-02-11 11:46:06,144 - DEBUG - Pod : ctest-pod-54190598 UUID is bd3268f3-5fff-43ba-9002-d4896241cc2b
2025-02-11 11:46:06,147 - DEBUG - Pod ctest-pod-95195223 not present
2025-02-11 11:46:06,147 - INFO - Creating Pod ctest-pod-95195223
2025-02-11 11:46:06,180 - DEBUG - Pod : ctest-pod-95195223 UUID is 560469cc-43a1-4503-994a-ef0747c4b446
2025-02-11 11:46:06,186 - DEBUG - Pod ctest-pod-44969969 not present
2025-02-11 11:46:06,186 - INFO - Creating Pod ctest-pod-44969969
2025-02-11 11:46:06,223 - DEBUG - Pod : ctest-pod-44969969 UUID is 9ff18885-f571-4b5a-be04-95a431ffd5cd
2025-02-11 11:46:06,225 - DEBUG - Pod ctest-pod-69341894 not present
2025-02-11 11:46:06,225 - INFO - Creating Pod ctest-pod-69341894
2025-02-11 11:46:06,247 - DEBUG - Pod : ctest-pod-69341894 UUID is 296e2883-5b29-42e9-8d82-572aa472a1f2
2025-02-11 11:46:06,250 - DEBUG - Pod ctest-pod-53346572 not present
2025-02-11 11:46:06,250 - INFO - Creating Pod ctest-pod-53346572
2025-02-11 11:46:06,285 - DEBUG - Pod : ctest-pod-53346572 UUID is e4a2e84e-59ae-4d68-9deb-b0695c327bb3
2025-02-11 11:46:06,534 - INFO - Project default-domain:k8s-ctest-new-default-94209125 for Namespace ctest-new-default-94209125 is seen in contrail-api
2025-02-11 11:46:06,535 - DEBUG - Project uuid in Contrail is 17ac38f6-5535-4816-aafd-2d080addbd4b
2025-02-11 11:46:06,773 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=8ce69a6c-ff25-47ce-b0bd-35452515100c
2025-02-11 11:46:06,778 - INFO - Namespace ctest-new-default-94209125 with uuid 8ce69a6c-ff25-47ce-b0bd-35452515100c found in kube manager
2025-02-11 11:46:06,778 - INFO - Namespace ctest-new-default-94209125 verification passed
2025-02-11 11:46:07,032 - INFO - Project default-domain:k8s-ctest-non-default-42898081 for Namespace ctest-non-default-42898081 is seen in contrail-api
2025-02-11 11:46:07,033 - DEBUG - Project uuid in Contrail is 791493ca-eb96-47f0-a7c5-71b52f246991
2025-02-11 11:46:07,033 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=2a3f3e6c-fa7d-442b-a4db-90cbba04b121
2025-02-11 11:46:07,037 - INFO - Namespace ctest-non-default-42898081 with uuid 2a3f3e6c-fa7d-442b-a4db-90cbba04b121 found in kube manager
2025-02-11 11:46:07,038 - INFO - Namespace ctest-non-default-42898081 verification passed
2025-02-11 11:46:07,046 - DEBUG - Pod ctest-pod-24198992 not in running state.Currently in Pending
2025-02-11 11:46:12,052 - DEBUG - Pod ctest-pod-24198992 not in running state.Currently in Pending
2025-02-11 11:46:17,059 - INFO - Pod ctest-pod-24198992 is in running state.Got IP 10.47.255.251
2025-02-11 11:46:17,116 - DEBUG - Pod ctest-pod-24198992 has vmi c87295d8-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:17,116 - INFO - Verified pod ctest-pod-24198992 in contrail-api
2025-02-11 11:46:17,130 - DEBUG - VMI c87295d8-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:17,130 - INFO - Verified Pod ctest-pod-24198992 in agent 10.0.0.22
2025-02-11 11:46:17,130 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=a9caa6fd-2e33-4d17-97c6-aefdf681205d
2025-02-11 11:46:17,137 - INFO - Pod ctest-pod-24198992 with uuid a9caa6fd-2e33-4d17-97c6-aefdf681205d found in kube manager
2025-02-11 11:46:17,137 - INFO - Pod ctest-pod-24198992 verification passed
2025-02-11 11:46:17,143 - DEBUG - Pod ctest-pod-49419998 not in running state.Currently in Pending
2025-02-11 11:46:22,150 - INFO - Pod ctest-pod-49419998 is in running state.Got IP 10.47.255.250
2025-02-11 11:46:22,166 - DEBUG - Pod ctest-pod-49419998 has vmi c8f873b0-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:22,166 - INFO - Verified pod ctest-pod-49419998 in contrail-api
2025-02-11 11:46:22,186 - DEBUG - VMI c8f873b0-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:22,186 - INFO - Verified Pod ctest-pod-49419998 in agent 10.0.0.22
2025-02-11 11:46:22,186 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=b8d6e3a3-9546-4a6c-b6d6-61adf6bbe622
2025-02-11 11:46:22,191 - INFO - Pod ctest-pod-49419998 with uuid b8d6e3a3-9546-4a6c-b6d6-61adf6bbe622 found in kube manager
2025-02-11 11:46:22,191 - INFO - Pod ctest-pod-49419998 verification passed
2025-02-11 11:46:22,197 - INFO - Pod ctest-pod-54887192 is in running state.Got IP 10.47.255.249
2025-02-11 11:46:22,256 - DEBUG - Pod ctest-pod-54887192 has vmi c9bdf482-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:22,256 - INFO - Verified pod ctest-pod-54887192 in contrail-api
2025-02-11 11:46:22,273 - DEBUG - VMI c9bdf482-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:22,273 - INFO - Verified Pod ctest-pod-54887192 in agent 10.0.0.22
2025-02-11 11:46:22,274 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=ed2d158b-4465-4299-8d74-a3db80a4aed3
2025-02-11 11:46:22,280 - INFO - Pod ctest-pod-54887192 with uuid ed2d158b-4465-4299-8d74-a3db80a4aed3 found in kube manager
2025-02-11 11:46:22,280 - INFO - Pod ctest-pod-54887192 verification passed
2025-02-11 11:46:22,287 - DEBUG - Pod ctest-pod-54190598 not in running state.Currently in Pending
2025-02-11 11:46:27,296 - INFO - Pod ctest-pod-54190598 is in running state.Got IP 10.47.255.248
2025-02-11 11:46:27,311 - DEBUG - Pod ctest-pod-54190598 has vmi ca4c755e-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:27,312 - INFO - Verified pod ctest-pod-54190598 in contrail-api
2025-02-11 11:46:27,327 - DEBUG - VMI ca4c755e-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:27,327 - INFO - Verified Pod ctest-pod-54190598 in agent 10.0.0.22
2025-02-11 11:46:27,327 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=bd3268f3-5fff-43ba-9002-d4896241cc2b
2025-02-11 11:46:27,332 - INFO - Pod ctest-pod-54190598 with uuid bd3268f3-5fff-43ba-9002-d4896241cc2b found in kube manager
2025-02-11 11:46:27,332 - INFO - Pod ctest-pod-54190598 verification passed
2025-02-11 11:46:27,337 - INFO - Pod ctest-pod-95195223 is in running state.Got IP 10.47.255.247
2025-02-11 11:46:27,396 - DEBUG - Pod ctest-pod-95195223 has vmi caeeee1a-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:27,396 - INFO - Verified pod ctest-pod-95195223 in contrail-api
2025-02-11 11:46:27,412 - DEBUG - VMI caeeee1a-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:27,413 - INFO - Verified Pod ctest-pod-95195223 in agent 10.0.0.22
2025-02-11 11:46:27,413 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=560469cc-43a1-4503-994a-ef0747c4b446
2025-02-11 11:46:27,418 - INFO - Pod ctest-pod-95195223 with uuid 560469cc-43a1-4503-994a-ef0747c4b446 found in kube manager
2025-02-11 11:46:27,418 - INFO - Pod ctest-pod-95195223 verification passed
2025-02-11 11:46:27,491 - INFO - Pod ctest-pod-69341894 is in running state.Got IP 10.47.255.245
2025-02-11 11:46:27,508 - DEBUG - Pod ctest-pod-69341894 has vmi cc0bda2e-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:27,508 - INFO - Verified pod ctest-pod-69341894 in contrail-api
2025-02-11 11:46:27,521 - DEBUG - VMI cc0bda2e-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:27,521 - INFO - Verified Pod ctest-pod-69341894 in agent 10.0.0.22
2025-02-11 11:46:27,521 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=296e2883-5b29-42e9-8d82-572aa472a1f2
2025-02-11 11:46:27,526 - INFO - Pod ctest-pod-69341894 with uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 found in kube manager
2025-02-11 11:46:27,526 - INFO - Pod ctest-pod-69341894 verification passed
2025-02-11 11:46:27,533 - INFO - Pod ctest-pod-44969969 is in running state.Got IP 10.47.255.246
2025-02-11 11:46:27,592 - DEBUG - Pod ctest-pod-44969969 has vmi cb7f51c6-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:27,592 - INFO - Verified pod ctest-pod-44969969 in contrail-api
2025-02-11 11:46:27,607 - DEBUG - VMI cb7f51c6-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:27,608 - INFO - Verified Pod ctest-pod-44969969 in agent 10.0.0.22
2025-02-11 11:46:27,608 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=9ff18885-f571-4b5a-be04-95a431ffd5cd
2025-02-11 11:46:27,612 - INFO - Pod ctest-pod-44969969 with uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd found in kube manager
2025-02-11 11:46:27,612 - INFO - Pod ctest-pod-44969969 verification passed
2025-02-11 11:46:27,618 - INFO - Pod ctest-pod-53346572 is in running state.Got IP 10.47.255.244
2025-02-11 11:46:27,636 - DEBUG - Pod ctest-pod-53346572 has vmi cc91ca12-e86d-11ef-b587-fa163e226536
2025-02-11 11:46:27,637 - INFO - Verified pod ctest-pod-53346572 in contrail-api
2025-02-11 11:46:27,652 - DEBUG - VMI cc91ca12-e86d-11ef-b587-fa163e226536 is active in agent 10.0.0.22
2025-02-11 11:46:27,652 - INFO - Verified Pod ctest-pod-53346572 in agent 10.0.0.22
2025-02-11 11:46:27,652 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=e4a2e84e-59ae-4d68-9deb-b0695c327bb3
2025-02-11 11:46:27,657 - INFO - Pod ctest-pod-53346572 with uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 found in kube manager
2025-02-11 11:46:27,658 - INFO - Pod ctest-pod-53346572 verification passed
2025-02-11 11:46:27,658 - INFO - ================================================================================
2025-02-11 11:46:27,658 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-02-11 11:46:27,658 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-02-11 11:46:27,847 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.23': '0'}} with
2025-02-11 11:46:27,847 - INFO - Initial checks done. Running the testcase now
2025-02-11 11:46:27,847 - INFO -
2025-02-11 11:46:27,952 - DEBUG - [Pod ctest-pod-24198992] Cmd: echo ctest-pod-24198992 > /usr/share/nginx/html/index.html, Output:
2025-02-11 11:46:28,025 - DEBUG - [Pod ctest-pod-49419998] Cmd: echo ctest-pod-49419998 > /usr/share/nginx/html/index.html, Output:
2025-02-11 11:46:28,100 - DEBUG - [Pod ctest-pod-54887192] Cmd: echo ctest-pod-54887192 > /usr/share/nginx/html/index.html, Output:
2025-02-11 11:46:28,171 - DEBUG - [Pod ctest-pod-54190598] Cmd: echo ctest-pod-54190598 > /usr/share/nginx/html/index.html, Output:
2025-02-11 11:46:28,174 - DEBUG - Service ctest-nginx-svc-61220214 not present
2025-02-11 11:46:28,174 - INFO - Creating service ctest-nginx-svc-61220214
2025-02-11 11:46:28,190 - INFO - Created Service ctest-nginx-svc-61220214
2025-02-11 11:46:28,209 - WARNING - Service UUID 1022e9af-e0b1-4b89-a9e9-7b6a1e9fbe57 not yet found in contrail-api
2025-02-11 11:46:29,216 - INFO - Validated that Service ctest-nginx-svc-61220214 is seen in contrail-api
2025-02-11 11:46:29,216 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=1022e9af-e0b1-4b89-a9e9-7b6a1e9fbe57
2025-02-11 11:46:29,221 - INFO - Service ctest-nginx-svc-61220214 with uuid 1022e9af-e0b1-4b89-a9e9-7b6a1e9fbe57 found in kube manager
2025-02-11 11:46:29,221 - INFO - Service ctest-nginx-svc-61220214 verification passed
2025-02-11 11:46:30,268 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
ctest-pod-24198992
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:46:30,268 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:46:30,268 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
ctest-pod-24198992
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:46:30,326 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49419998
2025-02-11 11:46:30,326 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:46:30,326 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49419998
2025-02-11 11:46:30,326 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24198992': 1, 'ctest-pod-49419998': 1}
2025-02-11 11:46:30,391 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49419998
2025-02-11 11:46:30,391 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:46:30,391 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49419998
2025-02-11 11:46:30,460 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:46:30,460 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:46:30,460 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:46:30,460 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24198992': 1, 'ctest-pod-49419998': 1}
2025-02-11 11:46:30,464 - DEBUG - Network policy ingress-on-service not present
2025-02-11 11:46:30,464 - INFO - Creating Network Policy ingress-on-service
2025-02-11 11:46:30,482 - INFO - Network policy found in k8s
2025-02-11 11:46:30,482 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2d3e850d-eabb-4076-bcac-356cf8d1768f
2025-02-11 11:46:30,490 - INFO - Network Policy ingress-on-service with uuid 2d3e850d-eabb-4076-bcac-356cf8d1768f found in kube manager
2025-02-11 11:46:30,524 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-02-11 11:46:30,524 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-02-11 11:46:30,524 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2d3e850d-eabb-4076-bcac-356cf8d1768f
2025-02-11 11:46:30,554 - WARNING - Network policy with name ingress-on-service not found in agent
2025-02-11 11:46:32,555 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2d3e850d-eabb-4076-bcac-356cf8d1768f
2025-02-11 11:46:32,587 - INFO - Network policy with name ingress-on-service found in agent
2025-02-11 11:46:32,587 - INFO - Network Policy ingress-on-service verification passed
2025-02-11 11:46:37,651 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:37,651 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:37,651 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:42,711 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:42,711 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:42,711 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:47,770 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:47,770 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:47,770 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:52,841 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:52,842 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:52,842 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:57,906 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:57,906 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:46:57,906 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:02,982 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:02,982 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:02,982 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:08,050 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:08,050 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:08,050 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:13,104 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:13,104 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:13,104 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:18,167 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:18,167 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:18,167 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:23,238 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:23,238 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:23,238 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:23,238 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24198992': 0, 'ctest-pod-49419998': 0}
2025-02-11 11:47:23,308 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:47:23,308 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:47:23,308 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:47:23,373 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49419998
2025-02-11 11:47:23,373 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:47:23,373 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49419998
2025-02-11 11:47:23,373 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24198992': 1, 'ctest-pod-49419998': 1}
2025-02-11 11:47:28,442 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:28,443 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:28,443 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:33,519 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:33,519 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:33,519 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:38,576 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:38,576 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:38,576 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:43,642 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:43,642 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:43,642 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:48,734 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:48,734 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:48,734 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:53,813 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:53,814 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:53,814 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:58,883 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:58,883 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:47:58,883 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:03,947 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:03,947 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:03,947 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:09,018 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:09,018 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:09,018 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:14,092 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:14,092 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:14,092 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:14,092 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24198992': 0, 'ctest-pod-49419998': 0}
2025-02-11 11:48:16,163 - DEBUG - [Pod ctest-pod-44969969] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.457 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.114 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.550/1.457 ms
2025-02-11 11:48:16,163 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-44969969 with expectation True passed
2025-02-11 11:48:18,222 - DEBUG - [Pod ctest-pod-95195223] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.892 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.358/0.892 ms
2025-02-11 11:48:18,222 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-95195223 with expectation True passed
2025-02-11 11:48:20,294 - DEBUG - [Pod ctest-pod-69341894] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.717 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.629/1.717 ms
2025-02-11 11:48:20,294 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69341894 with expectation True passed
2025-02-11 11:48:20,352 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:48:20,352 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-11 11:48:20,352 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:48:20,352 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44969969 passed
2025-02-11 11:48:20,423 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:48:20,424 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-11 11:48:20,424 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:48:20,424 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44969969 passed
2025-02-11 11:48:25,491 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 11:48:25,491 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 11:48:25,491 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 11:48:25,491 - INFO - wget check of of http://10.47.255.250 from ctest-pod-95195223 passed
2025-02-11 11:48:30,554 - DEBUG - [Pod ctest-pod-53346572] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-11 11:48:30,554 - DEBUG - [Pod Pod ctest-pod-53346572] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-11 11:48:30,554 - DEBUG - [Pod Pod ctest-pod-53346572] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-11 11:48:30,554 - INFO - wget check of of http://10.47.255.251 from ctest-pod-53346572 passed
2025-02-11 11:48:30,563 - INFO - Updating Network Policy ingress-on-service
2025-02-11 11:48:35,647 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:35,647 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:35,647 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:40,719 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:40,719 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:40,719 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:45,792 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:45,792 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:45,792 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:50,855 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:50,855 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:50,855 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:55,939 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:55,939 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:48:55,939 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:01,008 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:01,008 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:01,008 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:06,070 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:06,070 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:06,070 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:11,138 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:11,138 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:11,138 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:16,191 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:16,191 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:16,191 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:21,254 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:21,254 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:21,254 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
wget: download timed out
2025-02-11 11:49:21,254 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24198992': 0, 'ctest-pod-49419998': 0}
2025-02-11 11:49:21,315 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
ctest-pod-24198992
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,315 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,315 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
ctest-pod-24198992
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,376 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,376 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,376 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,440 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24198992
2025-02-11 11:49:21,440 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,440 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24198992
2025-02-11 11:49:21,513 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,513 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,513 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,576 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-49419998
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,576 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,576 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: ctest-pod-49419998
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,576 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24198992': 4, 'ctest-pod-49419998': 1}
2025-02-11 11:49:21,672 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-49419998
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,672 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,672 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: ctest-pod-49419998
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,736 - DEBUG - [Pod ctest-pod-69341894] Cmd: wget http://10.98.100.50:80/ -O - -T 5 -t 1 , Output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,736 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd wget http://10.98.100.50:80/ -O - -T 5 -t 1 passed
2025-02-11 11:49:21,736 - DEBUG - [Pod Pod ctest-pod-69341894] Cmd output: ctest-pod-24198992
Connecting to 10.98.100.50:80 (10.98.100.50:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 11:49:21,736 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24198992': 1, 'ctest-pod-49419998': 1}
2025-02-11 11:49:23,803 - DEBUG - [Pod ctest-pod-44969969] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.188 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.452/1.188 ms
2025-02-11 11:49:23,803 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-44969969 with expectation True passed
2025-02-11 11:49:25,870 - DEBUG - [Pod ctest-pod-95195223] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.375 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.514/1.375 ms
2025-02-11 11:49:25,870 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-95195223 with expectation True passed
2025-02-11 11:49:27,941 - DEBUG - [Pod ctest-pod-69341894] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.373 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.182/0.373 ms
2025-02-11 11:49:27,941 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69341894 with expectation True passed
2025-02-11 11:49:28,006 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:49:28,006 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-11 11:49:28,006 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:49:28,006 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44969969 passed
2025-02-11 11:49:28,054 - DEBUG - [Pod ctest-pod-44969969] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:49:28,054 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-11 11:49:28,054 - DEBUG - [Pod Pod ctest-pod-44969969] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:49:28,054 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44969969 passed
2025-02-11 11:49:33,111 - DEBUG - [Pod ctest-pod-95195223] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 11:49:33,111 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 11:49:33,111 - DEBUG - [Pod Pod ctest-pod-95195223] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 11:49:33,111 - INFO - wget check of of http://10.47.255.250 from ctest-pod-95195223 passed
2025-02-11 11:49:33,177 - DEBUG - [Pod ctest-pod-53346572] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:49:33,177 - DEBUG - [Pod Pod ctest-pod-53346572] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-11 11:49:33,177 - DEBUG - [Pod Pod ctest-pod-53346572] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 11:49:33,177 - INFO - wget check of of http://10.47.255.251 from ctest-pod-53346572 passed
2025-02-11 11:49:33,178 - INFO - Deleting Network Policy : ingress-on-service
2025-02-11 11:49:33,178 - INFO - Deleting service : ctest-nginx-svc-61220214
2025-02-11 11:49:33,410 - DEBUG - No XMPP flaps were noticed during the test
2025-02-11 11:49:33,410 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-02-11 11:49:33,410 - INFO - --------------------------------------------------------------------------------
2025-02-11 11:49:33,415 - INFO - Deleting pod ctest-new-default-94209125:ctest-pod-24198992
2025-02-11 11:49:33,416 - INFO - Deleting pod ctest-new-default-94209125:ctest-pod-49419998
2025-02-11 11:49:33,416 - INFO - Deleting pod ctest-non-default-42898081:ctest-pod-54887192
2025-02-11 11:49:33,416 - INFO - Deleting pod ctest-non-default-42898081:ctest-pod-54190598
2025-02-11 11:49:33,417 - INFO - Deleting pod ctest-new-default-94209125:ctest-pod-95195223
2025-02-11 11:49:33,417 - INFO - Deleting pod ctest-new-default-94209125:ctest-pod-44969969
2025-02-11 11:49:33,418 - INFO - Deleting pod ctest-non-default-42898081:ctest-pod-69341894
2025-02-11 11:49:33,418 - INFO - Deleting pod ctest-non-default-42898081:ctest-pod-53346572
2025-02-11 11:49:33,464 - WARNING - Pod uuid a9caa6fd-2e33-4d17-97c6-aefdf681205d is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,558 - WARNING - Pod uuid ed2d158b-4465-4299-8d74-a3db80a4aed3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,560 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,560 - WARNING - Pod uuid b8d6e3a3-9546-4a6c-b6d6-61adf6bbe622 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,561 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,561 - WARNING - Pod uuid bd3268f3-5fff-43ba-9002-d4896241cc2b is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,563 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:33,563 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:38,473 - DEBUG - Pod a9caa6fd-2e33-4d17-97c6-aefdf681205d is not in agent 10.0.0.22 VM list
2025-02-11 11:49:38,491 - DEBUG - VMI c87295d8-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:49:38,491 - INFO - Verified that pod ctest-pod-24198992 is removed in agent
2025-02-11 11:49:38,596 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:38,600 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:38,601 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:38,601 - DEBUG - Pod bd3268f3-5fff-43ba-9002-d4896241cc2b is not in agent 10.0.0.22 VM list
2025-02-11 11:49:38,603 - DEBUG - Pod b8d6e3a3-9546-4a6c-b6d6-61adf6bbe622 is not in agent 10.0.0.22 VM list
2025-02-11 11:49:38,605 - DEBUG - Pod ed2d158b-4465-4299-8d74-a3db80a4aed3 is not in agent 10.0.0.22 VM list
2025-02-11 11:49:38,607 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:38,623 - DEBUG - VMI c8f873b0-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:49:38,623 - INFO - Verified that pod ctest-pod-49419998 is removed in agent
2025-02-11 11:49:38,625 - DEBUG - VMI ca4c755e-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:49:38,625 - INFO - Verified that pod ctest-pod-54190598 is removed in agent
2025-02-11 11:49:38,625 - DEBUG - VMI c9bdf482-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:49:38,625 - INFO - Verified that pod ctest-pod-54887192 is removed in agent
2025-02-11 11:49:43,606 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:43,611 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:43,614 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:43,614 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:48,619 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:48,630 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:48,631 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:48,632 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:53,629 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:53,645 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:53,647 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:53,647 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:58,638 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:58,659 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:58,661 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:49:58,661 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:50:03,666 - WARNING - Pod uuid e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:50:03,679 - WARNING - Pod uuid 296e2883-5b29-42e9-8d82-572aa472a1f2 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:50:03,680 - WARNING - Pod uuid 560469cc-43a1-4503-994a-ef0747c4b446 is still seen in agent 10.0.0.22 VM list
2025-02-11 11:50:03,681 - WARNING - Pod uuid 9ff18885-f571-4b5a-be04-95a431ffd5cd is still seen in agent 10.0.0.22 VM list
2025-02-11 11:50:08,675 - DEBUG - Pod e4a2e84e-59ae-4d68-9deb-b0695c327bb3 is not in agent 10.0.0.22 VM list
2025-02-11 11:50:08,686 - DEBUG - VMI cc91ca12-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:50:08,686 - INFO - Verified that pod ctest-pod-53346572 is removed in agent
2025-02-11 11:50:08,695 - DEBUG - Pod 296e2883-5b29-42e9-8d82-572aa472a1f2 is not in agent 10.0.0.22 VM list
2025-02-11 11:50:08,698 - DEBUG - Pod 560469cc-43a1-4503-994a-ef0747c4b446 is not in agent 10.0.0.22 VM list
2025-02-11 11:50:08,699 - DEBUG - Pod 9ff18885-f571-4b5a-be04-95a431ffd5cd is not in agent 10.0.0.22 VM list
2025-02-11 11:50:08,714 - DEBUG - VMI cc0bda2e-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:50:08,714 - INFO - Verified that pod ctest-pod-69341894 is removed in agent
2025-02-11 11:50:08,715 - DEBUG - VMI cb7f51c6-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:50:08,715 - INFO - Verified that pod ctest-pod-44969969 is removed in agent
2025-02-11 11:50:08,716 - DEBUG - VMI caeeee1a-e86d-11ef-b587-fa163e226536 is removed from agent 10.0.0.22
2025-02-11 11:50:08,716 - INFO - Verified that pod ctest-pod-95195223 is removed in agent
2025-02-11 11:50:08,716 - INFO - Deleting namespace ctest-non-default-42898081
2025-02-11 11:50:08,737 - DEBUG - Namespace ctest-non-default-42898081 still in k8s
2025-02-11 11:50:10,743 - DEBUG - Namespace ctest-non-default-42898081 still in k8s
2025-02-11 11:50:12,748 - DEBUG - Namespace ctest-non-default-42898081 still in k8s
2025-02-11 11:50:14,752 - DEBUG - Namespace ctest-non-default-42898081 is not in k8s
2025-02-11 11:50:14,753 - DEBUG - No need to check project deletion in contrail-api
2025-02-11 11:50:14,753 - INFO - Deleting namespace ctest-new-default-94209125
2025-02-11 11:50:14,763 - DEBUG - Namespace ctest-new-default-94209125 still in k8s
2025-02-11 11:50:16,767 - DEBUG - Namespace ctest-new-default-94209125 still in k8s
2025-02-11 11:50:18,772 - DEBUG - Namespace ctest-new-default-94209125 still in k8s
2025-02-11 11:50:20,776 - DEBUG - Namespace ctest-new-default-94209125 is not in k8s
2025-02-11 11:50:20,776 - DEBUG - No need to check project deletion in contrail-api