2025-09-19 03:56:41,923 - INFO - Using existing project ['default-domain', 'k8s-default'](88e9bec6-0e07-45e7-8e1f-583f6d8415e7)
2025-09-19 03:56:41,952 - DEBUG - Namespace ctest-new-default-46914637 not present
2025-09-19 03:56:41,961 - INFO - Created namespace ctest-new-default-46914637
2025-09-19 03:56:44,967 - DEBUG - Namespace ctest-non-default-70756784 not present
2025-09-19 03:56:44,985 - INFO - Created namespace ctest-non-default-70756784
2025-09-19 03:56:48,046 - DEBUG - Pod ctest-pod-25995893 not present
2025-09-19 03:56:48,048 - INFO - Creating Pod ctest-pod-25995893
2025-09-19 03:56:48,094 - DEBUG - Pod : ctest-pod-25995893 UUID is f7805506-a33e-4117-97cf-c512bfedd25e
2025-09-19 03:56:48,099 - DEBUG - Pod ctest-pod-94281686 not present
2025-09-19 03:56:48,100 - INFO - Creating Pod ctest-pod-94281686
2025-09-19 03:56:48,135 - DEBUG - Pod : ctest-pod-94281686 UUID is 3583be9f-9c78-4d51-add8-ff402e3ab945
2025-09-19 03:56:48,139 - DEBUG - Pod ctest-pod-05948725 not present
2025-09-19 03:56:48,139 - INFO - Creating Pod ctest-pod-05948725
2025-09-19 03:56:48,178 - DEBUG - Pod : ctest-pod-05948725 UUID is 1fec6ea7-e040-423a-bf98-a560458ba72c
2025-09-19 03:56:48,181 - DEBUG - Pod ctest-pod-91261329 not present
2025-09-19 03:56:48,182 - INFO - Creating Pod ctest-pod-91261329
2025-09-19 03:56:48,213 - DEBUG - Pod : ctest-pod-91261329 UUID is aabf3f61-aa09-4c4b-b150-e01e6c7b14e2
2025-09-19 03:56:48,215 - DEBUG - Pod ctest-pod-50360995 not present
2025-09-19 03:56:48,216 - INFO - Creating Pod ctest-pod-50360995
2025-09-19 03:56:48,249 - DEBUG - Pod : ctest-pod-50360995 UUID is 979dc3cc-b8d8-4d05-9288-aac69ca16856
2025-09-19 03:56:48,252 - DEBUG - Pod ctest-pod-94891514 not present
2025-09-19 03:56:48,252 - INFO - Creating Pod ctest-pod-94891514
2025-09-19 03:56:48,296 - DEBUG - Pod : ctest-pod-94891514 UUID is eaba3579-f6ce-4358-89b0-58c8148cec21
2025-09-19 03:56:48,298 - DEBUG - Pod ctest-pod-18473408 not present
2025-09-19 03:56:48,299 - INFO - Creating Pod ctest-pod-18473408
2025-09-19 03:56:48,323 - DEBUG - Pod : ctest-pod-18473408 UUID is 4df2949f-9299-4e1a-8ed1-811f4be3443d
2025-09-19 03:56:48,325 - DEBUG - Pod ctest-pod-01714618 not present
2025-09-19 03:56:48,325 - INFO - Creating Pod ctest-pod-01714618
2025-09-19 03:56:48,349 - DEBUG - Pod : ctest-pod-01714618 UUID is 3935f30c-f025-4449-b64a-85db9f6ece6b
2025-09-19 03:56:48,598 - INFO - Project default-domain:k8s-ctest-new-default-46914637 for Namespace ctest-new-default-46914637 is seen in contrail-api
2025-09-19 03:56:48,599 - DEBUG - Project uuid in Contrail is b026db68-197b-494d-879f-9ed1008a0166
2025-09-19 03:56:48,763 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=d2745c5c-baec-41fe-9794-c357b3603e80
2025-09-19 03:56:48,766 - INFO - Namespace ctest-new-default-46914637 with uuid d2745c5c-baec-41fe-9794-c357b3603e80 found in kube manager
2025-09-19 03:56:48,766 - INFO - Namespace ctest-new-default-46914637 verification passed
2025-09-19 03:56:48,967 - INFO - Project default-domain:k8s-ctest-non-default-70756784 for Namespace ctest-non-default-70756784 is seen in contrail-api
2025-09-19 03:56:48,970 - DEBUG - Project uuid in Contrail is 0cd24b29-e21b-43aa-8457-cddde193b33b
2025-09-19 03:56:48,970 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=892ae794-db93-4e50-92fd-e35d14d5f557
2025-09-19 03:56:48,978 - INFO - Namespace ctest-non-default-70756784 with uuid 892ae794-db93-4e50-92fd-e35d14d5f557 found in kube manager
2025-09-19 03:56:48,978 - INFO - Namespace ctest-non-default-70756784 verification passed
2025-09-19 03:56:48,984 - DEBUG - Pod ctest-pod-25995893 not in running state.Currently in Pending
2025-09-19 03:56:53,993 - DEBUG - Pod ctest-pod-25995893 not in running state.Currently in Pending
2025-09-19 03:56:59,002 - DEBUG - Pod ctest-pod-25995893 not in running state.Currently in Pending
2025-09-19 03:57:04,012 - INFO - Pod ctest-pod-25995893 is in running state.Got IP 10.47.255.251
2025-09-19 03:57:04,067 - DEBUG - Pod ctest-pod-25995893 has vmi ab7eab32-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:04,067 - INFO - Verified pod ctest-pod-25995893 in contrail-api
2025-09-19 03:57:04,083 - DEBUG - VMI ab7eab32-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:04,083 - INFO - Verified Pod ctest-pod-25995893 in agent 10.0.0.56
2025-09-19 03:57:04,083 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=f7805506-a33e-4117-97cf-c512bfedd25e
2025-09-19 03:57:04,091 - INFO - Pod ctest-pod-25995893 with uuid f7805506-a33e-4117-97cf-c512bfedd25e found in kube manager
2025-09-19 03:57:04,091 - INFO - Pod ctest-pod-25995893 verification passed
2025-09-19 03:57:04,097 - INFO - Pod ctest-pod-94281686 is in running state.Got IP 10.47.255.250
2025-09-19 03:57:04,109 - DEBUG - Pod ctest-pod-94281686 has vmi abf7f514-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:04,110 - INFO - Verified pod ctest-pod-94281686 in contrail-api
2025-09-19 03:57:04,122 - DEBUG - VMI abf7f514-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:04,122 - INFO - Verified Pod ctest-pod-94281686 in agent 10.0.0.56
2025-09-19 03:57:04,122 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=3583be9f-9c78-4d51-add8-ff402e3ab945
2025-09-19 03:57:04,127 - INFO - Pod ctest-pod-94281686 with uuid 3583be9f-9c78-4d51-add8-ff402e3ab945 found in kube manager
2025-09-19 03:57:04,127 - INFO - Pod ctest-pod-94281686 verification passed
2025-09-19 03:57:04,133 - INFO - Pod ctest-pod-05948725 is in running state.Got IP 10.47.255.249
2025-09-19 03:57:04,186 - DEBUG - Pod ctest-pod-05948725 has vmi ac8f9680-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:04,186 - INFO - Verified pod ctest-pod-05948725 in contrail-api
2025-09-19 03:57:04,199 - DEBUG - VMI ac8f9680-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:04,199 - INFO - Verified Pod ctest-pod-05948725 in agent 10.0.0.56
2025-09-19 03:57:04,199 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=1fec6ea7-e040-423a-bf98-a560458ba72c
2025-09-19 03:57:04,203 - INFO - Pod ctest-pod-05948725 with uuid 1fec6ea7-e040-423a-bf98-a560458ba72c found in kube manager
2025-09-19 03:57:04,204 - INFO - Pod ctest-pod-05948725 verification passed
2025-09-19 03:57:04,210 - INFO - Pod ctest-pod-91261329 is in running state.Got IP 10.47.255.248
2025-09-19 03:57:04,263 - DEBUG - Pod ctest-pod-91261329 has vmi ad07392e-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:04,263 - INFO - Verified pod ctest-pod-91261329 in contrail-api
2025-09-19 03:57:04,274 - DEBUG - VMI ad07392e-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:04,275 - INFO - Verified Pod ctest-pod-91261329 in agent 10.0.0.56
2025-09-19 03:57:04,275 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=aabf3f61-aa09-4c4b-b150-e01e6c7b14e2
2025-09-19 03:57:04,280 - INFO - Pod ctest-pod-91261329 with uuid aabf3f61-aa09-4c4b-b150-e01e6c7b14e2 found in kube manager
2025-09-19 03:57:04,280 - INFO - Pod ctest-pod-91261329 verification passed
2025-09-19 03:57:04,287 - DEBUG - Pod ctest-pod-50360995 not in running state.Currently in Pending
2025-09-19 03:57:09,295 - INFO - Pod ctest-pod-50360995 is in running state.Got IP 10.47.255.247
2025-09-19 03:57:09,307 - DEBUG - Pod ctest-pod-50360995 has vmi ad8aaf34-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:09,307 - INFO - Verified pod ctest-pod-50360995 in contrail-api
2025-09-19 03:57:09,319 - DEBUG - VMI ad8aaf34-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:09,320 - INFO - Verified Pod ctest-pod-50360995 in agent 10.0.0.56
2025-09-19 03:57:09,320 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=979dc3cc-b8d8-4d05-9288-aac69ca16856
2025-09-19 03:57:09,324 - INFO - Pod ctest-pod-50360995 with uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 found in kube manager
2025-09-19 03:57:09,324 - INFO - Pod ctest-pod-50360995 verification passed
2025-09-19 03:57:09,330 - INFO - Pod ctest-pod-18473408 is in running state.Got IP 10.47.255.245
2025-09-19 03:57:09,340 - DEBUG - Pod ctest-pod-18473408 has vmi ae699c12-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:09,340 - INFO - Verified pod ctest-pod-18473408 in contrail-api
2025-09-19 03:57:09,355 - DEBUG - VMI ae699c12-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:09,356 - INFO - Verified Pod ctest-pod-18473408 in agent 10.0.0.56
2025-09-19 03:57:09,356 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=4df2949f-9299-4e1a-8ed1-811f4be3443d
2025-09-19 03:57:09,359 - INFO - Pod ctest-pod-18473408 with uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d found in kube manager
2025-09-19 03:57:09,359 - INFO - Pod ctest-pod-18473408 verification passed
2025-09-19 03:57:09,366 - INFO - Pod ctest-pod-94891514 is in running state.Got IP 10.47.255.246
2025-09-19 03:57:09,422 - DEBUG - Pod ctest-pod-94891514 has vmi adf78d02-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:09,423 - INFO - Verified pod ctest-pod-94891514 in contrail-api
2025-09-19 03:57:09,435 - DEBUG - VMI adf78d02-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:09,435 - INFO - Verified Pod ctest-pod-94891514 in agent 10.0.0.56
2025-09-19 03:57:09,435 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=eaba3579-f6ce-4358-89b0-58c8148cec21
2025-09-19 03:57:09,439 - INFO - Pod ctest-pod-94891514 with uuid eaba3579-f6ce-4358-89b0-58c8148cec21 found in kube manager
2025-09-19 03:57:09,439 - INFO - Pod ctest-pod-94891514 verification passed
2025-09-19 03:57:09,445 - INFO - Pod ctest-pod-01714618 is in running state.Got IP 10.47.255.244
2025-09-19 03:57:09,499 - DEBUG - Pod ctest-pod-01714618 has vmi aed74cbc-950c-11f0-8e5e-fa163e656e8c
2025-09-19 03:57:09,499 - INFO - Verified pod ctest-pod-01714618 in contrail-api
2025-09-19 03:57:09,511 - DEBUG - VMI aed74cbc-950c-11f0-8e5e-fa163e656e8c is active in agent 10.0.0.56
2025-09-19 03:57:09,511 - INFO - Verified Pod ctest-pod-01714618 in agent 10.0.0.56
2025-09-19 03:57:09,511 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=3935f30c-f025-4449-b64a-85db9f6ece6b
2025-09-19 03:57:09,515 - INFO - Pod ctest-pod-01714618 with uuid 3935f30c-f025-4449-b64a-85db9f6ece6b found in kube manager
2025-09-19 03:57:09,515 - INFO - Pod ctest-pod-01714618 verification passed
2025-09-19 03:57:09,516 - INFO - ================================================================================
2025-09-19 03:57:09,516 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-09-19 03:57:09,516 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-09-19 03:57:09,755 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.65': '0'}} with
2025-09-19 03:57:09,755 - INFO - Initial checks done. Running the testcase now
2025-09-19 03:57:09,756 - INFO -
2025-09-19 03:57:09,809 - DEBUG - [Pod ctest-pod-25995893] Cmd: echo ctest-pod-25995893 > /usr/share/nginx/html/index.html, Output:
2025-09-19 03:57:09,881 - DEBUG - [Pod ctest-pod-94281686] Cmd: echo ctest-pod-94281686 > /usr/share/nginx/html/index.html, Output:
2025-09-19 03:57:09,942 - DEBUG - [Pod ctest-pod-05948725] Cmd: echo ctest-pod-05948725 > /usr/share/nginx/html/index.html, Output:
2025-09-19 03:57:10,004 - DEBUG - [Pod ctest-pod-91261329] Cmd: echo ctest-pod-91261329 > /usr/share/nginx/html/index.html, Output:
2025-09-19 03:57:10,007 - DEBUG - Service ctest-nginx-svc-24263621 not present
2025-09-19 03:57:10,008 - INFO - Creating service ctest-nginx-svc-24263621
2025-09-19 03:57:10,023 - INFO - Created Service ctest-nginx-svc-24263621
2025-09-19 03:57:10,030 - WARNING - Service UUID 8dc1a35f-a7d9-47f7-9370-da6813299a0c not yet found in contrail-api
2025-09-19 03:57:11,042 - INFO - Validated that Service ctest-nginx-svc-24263621 is seen in contrail-api
2025-09-19 03:57:11,043 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=8dc1a35f-a7d9-47f7-9370-da6813299a0c
2025-09-19 03:57:11,048 - INFO - Service ctest-nginx-svc-24263621 with uuid 8dc1a35f-a7d9-47f7-9370-da6813299a0c found in kube manager
2025-09-19 03:57:11,048 - INFO - Service ctest-nginx-svc-24263621 verification passed
2025-09-19 03:57:12,105 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25995893
2025-09-19 03:57:12,105 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:57:12,105 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25995893
2025-09-19 03:57:12,170 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: ctest-pod-25995893
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:57:12,170 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:57:12,170 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: ctest-pod-25995893
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:57:12,221 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94281686
2025-09-19 03:57:12,221 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:57:12,222 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94281686
2025-09-19 03:57:12,222 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25995893': 2, 'ctest-pod-94281686': 1}
2025-09-19 03:57:12,281 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: ctest-pod-94281686
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:57:12,281 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:57:12,281 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: ctest-pod-94281686
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:57:12,342 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
ctest-pod-25995893
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:57:12,342 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:57:12,342 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
ctest-pod-25995893
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:57:12,342 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25995893': 1, 'ctest-pod-94281686': 1}
2025-09-19 03:57:12,346 - DEBUG - Network policy ingress-on-service not present
2025-09-19 03:57:12,346 - INFO - Creating Network Policy ingress-on-service
2025-09-19 03:57:12,362 - INFO - Network policy found in k8s
2025-09-19 03:57:12,363 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3d97d5fe-23da-4fab-b476-abdcfc427d20
2025-09-19 03:57:12,368 - INFO - Network Policy ingress-on-service with uuid 3d97d5fe-23da-4fab-b476-abdcfc427d20 found in kube manager
2025-09-19 03:57:12,403 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-09-19 03:57:12,403 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-09-19 03:57:12,404 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3d97d5fe-23da-4fab-b476-abdcfc427d20
2025-09-19 03:57:12,427 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-19 03:57:14,428 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3d97d5fe-23da-4fab-b476-abdcfc427d20
2025-09-19 03:57:14,462 - INFO - Network policy with name ingress-on-service found in agent
2025-09-19 03:57:14,462 - INFO - Network Policy ingress-on-service verification passed
2025-09-19 03:57:19,514 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:19,514 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:19,514 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:24,564 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:24,565 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:24,565 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:29,617 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:29,617 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:29,617 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:34,669 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:34,669 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:34,669 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:39,725 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:39,725 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:39,725 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:44,778 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:44,778 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:44,778 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:49,829 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:49,829 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:49,829 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:54,888 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:54,889 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:54,889 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:59,940 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:59,940 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:57:59,940 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:04,988 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:04,989 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:04,989 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:04,989 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25995893': 0, 'ctest-pod-94281686': 0}
2025-09-19 03:58:05,045 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: ctest-pod-94281686
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:58:05,045 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:58:05,045 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: ctest-pod-94281686
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:58:05,102 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: ctest-pod-25995893
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:58:05,102 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 03:58:05,102 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: ctest-pod-25995893
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 03:58:05,102 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25995893': 1, 'ctest-pod-94281686': 1}
2025-09-19 03:58:10,161 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:10,161 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:10,161 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:15,218 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:15,218 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:15,218 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:20,266 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:20,266 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:20,266 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:25,314 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:25,314 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:25,314 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:30,365 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:30,365 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:30,365 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:35,417 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:35,417 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:35,417 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:40,483 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:40,483 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:40,483 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:44,830 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-09-19 03:58:54,894 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:54,894 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:54,894 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:59,957 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:59,957 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:58:59,957 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:05,013 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:05,014 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:05,014 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:05,014 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25995893': 0, 'ctest-pod-94281686': 0}
2025-09-19 03:59:07,067 - DEBUG - [Pod ctest-pod-94891514] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.441 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.199/0.441 ms
2025-09-19 03:59:07,067 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-94891514 with expectation True passed
2025-09-19 03:59:09,126 - DEBUG - [Pod ctest-pod-50360995] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.596 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.252/0.596 ms
2025-09-19 03:59:09,126 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50360995 with expectation True passed
2025-09-19 03:59:11,182 - DEBUG - [Pod ctest-pod-18473408] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.705 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.286/0.705 ms
2025-09-19 03:59:11,182 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18473408 with expectation True passed
2025-09-19 03:59:11,232 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 03:59:11,232 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-19 03:59:11,232 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 03:59:11,233 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94891514 passed
2025-09-19 03:59:11,286 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 03:59:11,286 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-19 03:59:11,286 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 03:59:11,286 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94891514 passed
2025-09-19 03:59:16,333 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-19 03:59:16,333 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-19 03:59:16,333 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-19 03:59:16,333 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50360995 passed
2025-09-19 03:59:21,386 - DEBUG - [Pod ctest-pod-01714618] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-19 03:59:21,386 - DEBUG - [Pod Pod ctest-pod-01714618] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-19 03:59:21,387 - DEBUG - [Pod Pod ctest-pod-01714618] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-19 03:59:21,387 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01714618 passed
2025-09-19 03:59:21,396 - INFO - Updating Network Policy ingress-on-service
2025-09-19 03:59:26,457 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:26,457 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:26,457 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:31,508 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:31,508 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:31,508 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:36,561 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:36,562 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:36,562 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:41,618 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:41,618 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:41,618 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:46,678 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:46,678 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:46,678 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:51,730 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:51,730 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:51,730 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:56,786 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:56,786 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 03:59:56,786 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:01,838 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:01,839 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:01,839 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:06,893 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:06,893 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:06,893 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:11,949 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:11,949 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:11,949 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
wget: download timed out
2025-09-19 04:00:11,949 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25995893': 0, 'ctest-pod-94281686': 0}
2025-09-19 04:00:11,991 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94281686
2025-09-19 04:00:11,991 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 04:00:11,991 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-94281686
2025-09-19 04:00:12,048 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25995893
2025-09-19 04:00:12,048 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 04:00:12,048 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25995893
2025-09-19 04:00:12,048 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25995893': 1, 'ctest-pod-94281686': 1}
2025-09-19 04:00:12,104 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: ctest-pod-94281686
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 04:00:12,104 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 04:00:12,104 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: ctest-pod-94281686
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 04:00:12,164 - DEBUG - [Pod ctest-pod-18473408] Cmd: wget http://10.103.160.189:80/ -O - -T 5 -t 1 , Output: ctest-pod-25995893
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 04:00:12,164 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd wget http://10.103.160.189:80/ -O - -T 5 -t 1 passed
2025-09-19 04:00:12,164 - DEBUG - [Pod Pod ctest-pod-18473408] Cmd output: ctest-pod-25995893
Connecting to 10.103.160.189:80 (10.103.160.189:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-19 04:00:12,164 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25995893': 1, 'ctest-pod-94281686': 1}
2025-09-19 04:00:14,224 - DEBUG - [Pod ctest-pod-94891514] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.902 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.095 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.695/1.902 ms
2025-09-19 04:00:14,225 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-94891514 with expectation True passed
2025-09-19 04:00:16,279 - DEBUG - [Pod ctest-pod-50360995] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.678 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.281/0.678 ms
2025-09-19 04:00:16,279 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50360995 with expectation True passed
2025-09-19 04:00:18,334 - DEBUG - [Pod ctest-pod-18473408] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.373 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.063 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.507/1.373 ms
2025-09-19 04:00:18,334 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18473408 with expectation True passed
2025-09-19 04:00:18,388 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 04:00:18,388 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-19 04:00:18,388 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 04:00:18,388 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94891514 passed
2025-09-19 04:00:18,443 - DEBUG - [Pod ctest-pod-94891514] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 04:00:18,444 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-19 04:00:18,444 - DEBUG - [Pod Pod ctest-pod-94891514] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 04:00:18,444 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94891514 passed
2025-09-19 04:00:23,498 - DEBUG - [Pod ctest-pod-50360995] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-19 04:00:23,498 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-19 04:00:23,498 - DEBUG - [Pod Pod ctest-pod-50360995] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-19 04:00:23,498 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50360995 passed
2025-09-19 04:00:23,556 - DEBUG - [Pod ctest-pod-01714618] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 04:00:23,556 - DEBUG - [Pod Pod ctest-pod-01714618] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-19 04:00:23,556 - DEBUG - [Pod Pod ctest-pod-01714618] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-19 04:00:23,556 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01714618 passed
2025-09-19 04:00:23,556 - INFO - Deleting Network Policy : ingress-on-service
2025-09-19 04:00:23,557 - INFO - Deleting service : ctest-nginx-svc-24263621
2025-09-19 04:00:23,816 - DEBUG - No XMPP flaps were noticed during the test
2025-09-19 04:00:23,816 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-09-19 04:00:23,816 - INFO - --------------------------------------------------------------------------------
2025-09-19 04:00:23,822 - INFO - Deleting pod ctest-new-default-46914637:ctest-pod-25995893
2025-09-19 04:00:23,823 - INFO - Deleting pod ctest-new-default-46914637:ctest-pod-94281686
2025-09-19 04:00:23,824 - INFO - Deleting pod ctest-non-default-70756784:ctest-pod-05948725
2025-09-19 04:00:23,824 - INFO - Deleting pod ctest-non-default-70756784:ctest-pod-91261329
2025-09-19 04:00:23,824 - INFO - Deleting pod ctest-new-default-46914637:ctest-pod-50360995
2025-09-19 04:00:23,825 - INFO - Deleting pod ctest-new-default-46914637:ctest-pod-94891514
2025-09-19 04:00:23,825 - INFO - Deleting pod ctest-non-default-70756784:ctest-pod-18473408
2025-09-19 04:00:23,825 - INFO - Deleting pod ctest-non-default-70756784:ctest-pod-01714618
2025-09-19 04:00:23,863 - WARNING - Pod uuid f7805506-a33e-4117-97cf-c512bfedd25e is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,934 - WARNING - Pod uuid aabf3f61-aa09-4c4b-b150-e01e6c7b14e2 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,949 - WARNING - Pod uuid 3583be9f-9c78-4d51-add8-ff402e3ab945 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,950 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,951 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,951 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,952 - WARNING - Pod uuid 1fec6ea7-e040-423a-bf98-a560458ba72c is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:23,952 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:28,871 - DEBUG - Pod f7805506-a33e-4117-97cf-c512bfedd25e is not in agent 10.0.0.56 VM list
2025-09-19 04:00:28,877 - DEBUG - VMI ab7eab32-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:28,877 - INFO - Verified that pod ctest-pod-25995893 is removed in agent
2025-09-19 04:00:28,941 - DEBUG - Pod aabf3f61-aa09-4c4b-b150-e01e6c7b14e2 is not in agent 10.0.0.56 VM list
2025-09-19 04:00:28,946 - DEBUG - VMI ad07392e-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:28,947 - INFO - Verified that pod ctest-pod-91261329 is removed in agent
2025-09-19 04:00:28,973 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:28,974 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:28,974 - DEBUG - Pod 1fec6ea7-e040-423a-bf98-a560458ba72c is not in agent 10.0.0.56 VM list
2025-09-19 04:00:28,977 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:28,977 - DEBUG - Pod 3583be9f-9c78-4d51-add8-ff402e3ab945 is not in agent 10.0.0.56 VM list
2025-09-19 04:00:28,978 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:28,984 - DEBUG - VMI abf7f514-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:28,984 - INFO - Verified that pod ctest-pod-94281686 is removed in agent
2025-09-19 04:00:28,985 - DEBUG - VMI ac8f9680-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:28,985 - INFO - Verified that pod ctest-pod-05948725 is removed in agent
2025-09-19 04:00:33,987 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:33,988 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:33,988 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:33,989 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:39,002 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:39,005 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:39,006 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:39,008 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:44,012 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:44,020 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:44,022 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:44,022 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:49,027 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:49,037 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:49,039 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:49,040 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:54,051 - WARNING - Pod uuid eaba3579-f6ce-4358-89b0-58c8148cec21 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:54,051 - WARNING - Pod uuid 4df2949f-9299-4e1a-8ed1-811f4be3443d is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:54,053 - WARNING - Pod uuid 979dc3cc-b8d8-4d05-9288-aac69ca16856 is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:54,053 - WARNING - Pod uuid 3935f30c-f025-4449-b64a-85db9f6ece6b is still seen in agent 10.0.0.56 VM list
2025-09-19 04:00:59,066 - DEBUG - Pod 4df2949f-9299-4e1a-8ed1-811f4be3443d is not in agent 10.0.0.56 VM list
2025-09-19 04:00:59,067 - DEBUG - Pod eaba3579-f6ce-4358-89b0-58c8148cec21 is not in agent 10.0.0.56 VM list
2025-09-19 04:00:59,071 - DEBUG - Pod 3935f30c-f025-4449-b64a-85db9f6ece6b is not in agent 10.0.0.56 VM list
2025-09-19 04:00:59,073 - DEBUG - Pod 979dc3cc-b8d8-4d05-9288-aac69ca16856 is not in agent 10.0.0.56 VM list
2025-09-19 04:00:59,084 - DEBUG - VMI adf78d02-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:59,084 - INFO - Verified that pod ctest-pod-94891514 is removed in agent
2025-09-19 04:00:59,085 - DEBUG - VMI aed74cbc-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:59,085 - INFO - Verified that pod ctest-pod-01714618 is removed in agent
2025-09-19 04:00:59,086 - DEBUG - VMI ad8aaf34-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:59,086 - INFO - Verified that pod ctest-pod-50360995 is removed in agent
2025-09-19 04:00:59,086 - DEBUG - VMI ae699c12-950c-11f0-8e5e-fa163e656e8c is removed from agent 10.0.0.56
2025-09-19 04:00:59,086 - INFO - Verified that pod ctest-pod-18473408 is removed in agent
2025-09-19 04:00:59,086 - INFO - Deleting namespace ctest-non-default-70756784
2025-09-19 04:00:59,111 - DEBUG - Namespace ctest-non-default-70756784 still in k8s
2025-09-19 04:01:01,116 - DEBUG - Namespace ctest-non-default-70756784 still in k8s
2025-09-19 04:01:03,121 - DEBUG - Namespace ctest-non-default-70756784 still in k8s
2025-09-19 04:01:05,126 - DEBUG - Namespace ctest-non-default-70756784 is not in k8s
2025-09-19 04:01:05,126 - DEBUG - No need to check project deletion in contrail-api
2025-09-19 04:01:05,126 - INFO - Deleting namespace ctest-new-default-46914637
2025-09-19 04:01:05,134 - DEBUG - Namespace ctest-new-default-46914637 still in k8s
2025-09-19 04:01:07,139 - DEBUG - Namespace ctest-new-default-46914637 still in k8s
2025-09-19 04:01:09,144 - DEBUG - Namespace ctest-new-default-46914637 still in k8s
2025-09-19 04:01:11,148 - DEBUG - Namespace ctest-new-default-46914637 is not in k8s
2025-09-19 04:01:11,149 - DEBUG - No need to check project deletion in contrail-api