2025-07-28 02:00:20,058 - INFO - Using existing project ['default-domain', 'k8s-default'](a75d6cf2-de2b-47ff-93b1-297007891501)
2025-07-28 02:00:20,089 - DEBUG - Namespace ctest-new-default-99242373 not present
2025-07-28 02:00:20,097 - INFO - Created namespace ctest-new-default-99242373
2025-07-28 02:00:23,102 - DEBUG - Namespace ctest-non-default-87325051 not present
2025-07-28 02:00:23,112 - INFO - Created namespace ctest-non-default-87325051
2025-07-28 02:00:26,130 - DEBUG - Pod ctest-pod-60183955 not present
2025-07-28 02:00:26,130 - INFO - Creating Pod ctest-pod-60183955
2025-07-28 02:00:26,160 - DEBUG - Pod : ctest-pod-60183955 UUID is 707daba3-7bdf-46d3-ac93-12cf9c73502c
2025-07-28 02:00:26,165 - DEBUG - Pod ctest-pod-05228527 not present
2025-07-28 02:00:26,165 - INFO - Creating Pod ctest-pod-05228527
2025-07-28 02:00:26,189 - DEBUG - Pod : ctest-pod-05228527 UUID is 14e298ba-21b6-4050-9877-b3ad9115728f
2025-07-28 02:00:26,193 - DEBUG - Pod ctest-pod-35264605 not present
2025-07-28 02:00:26,193 - INFO - Creating Pod ctest-pod-35264605
2025-07-28 02:00:26,220 - DEBUG - Pod : ctest-pod-35264605 UUID is 2c2facc3-18d3-4fe1-a2f5-acd068568b45
2025-07-28 02:00:26,223 - DEBUG - Pod ctest-pod-29934887 not present
2025-07-28 02:00:26,223 - INFO - Creating Pod ctest-pod-29934887
2025-07-28 02:00:26,241 - DEBUG - Pod : ctest-pod-29934887 UUID is 6da0acf7-1115-41a8-8404-db2dd465dbb7
2025-07-28 02:00:26,246 - DEBUG - Pod ctest-pod-51550570 not present
2025-07-28 02:00:26,246 - INFO - Creating Pod ctest-pod-51550570
2025-07-28 02:00:26,271 - DEBUG - Pod : ctest-pod-51550570 UUID is 53cfb2eb-e450-4298-b58c-ca943124894e
2025-07-28 02:00:26,278 - DEBUG - Pod ctest-pod-54870406 not present
2025-07-28 02:00:26,279 - INFO - Creating Pod ctest-pod-54870406
2025-07-28 02:00:26,305 - DEBUG - Pod : ctest-pod-54870406 UUID is 65a8d31c-cead-4c85-b5ea-037e139c5e52
2025-07-28 02:00:26,312 - DEBUG - Pod ctest-pod-41748684 not present
2025-07-28 02:00:26,312 - INFO - Creating Pod ctest-pod-41748684
2025-07-28 02:00:26,343 - DEBUG - Pod : ctest-pod-41748684 UUID is 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b
2025-07-28 02:00:26,346 - DEBUG - Pod ctest-pod-32715759 not present
2025-07-28 02:00:26,346 - INFO - Creating Pod ctest-pod-32715759
2025-07-28 02:00:26,370 - DEBUG - Pod : ctest-pod-32715759 UUID is 0e4eec07-fc23-461c-928a-bbf5146309b1
2025-07-28 02:00:26,875 - INFO - Project default-domain:k8s-ctest-new-default-99242373 for Namespace ctest-new-default-99242373 is seen in contrail-api
2025-07-28 02:00:26,875 - DEBUG - Project uuid in Contrail is 0676aa2b-24ab-444d-a659-ff40d50f946b
2025-07-28 02:00:27,077 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=cc360beb-4964-43b3-99f3-369e48f3d0e7
2025-07-28 02:00:27,087 - INFO - Namespace ctest-new-default-99242373 with uuid cc360beb-4964-43b3-99f3-369e48f3d0e7 found in kube manager
2025-07-28 02:00:27,087 - INFO - Namespace ctest-new-default-99242373 verification passed
2025-07-28 02:00:27,466 - INFO - Project default-domain:k8s-ctest-non-default-87325051 for Namespace ctest-non-default-87325051 is seen in contrail-api
2025-07-28 02:00:27,466 - DEBUG - Project uuid in Contrail is 182fb48e-63b3-47b1-94ad-6c99634cd280
2025-07-28 02:00:27,466 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=efcc1c86-1c17-489b-b3c4-45d761701ec5
2025-07-28 02:00:27,471 - INFO - Namespace ctest-non-default-87325051 with uuid efcc1c86-1c17-489b-b3c4-45d761701ec5 found in kube manager
2025-07-28 02:00:27,472 - INFO - Namespace ctest-non-default-87325051 verification passed
2025-07-28 02:00:27,478 - DEBUG - Pod ctest-pod-60183955 not in running state.Currently in Pending
2025-07-28 02:00:32,485 - DEBUG - Pod ctest-pod-60183955 not in running state.Currently in Pending
2025-07-28 02:00:37,493 - DEBUG - Pod ctest-pod-60183955 not in running state.Currently in Pending
2025-07-28 02:00:42,501 - INFO - Pod ctest-pod-60183955 is in running state.Got IP 10.47.255.250
2025-07-28 02:00:42,556 - DEBUG - Pod ctest-pod-60183955 has vmi a31ee23e-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:42,556 - INFO - Verified pod ctest-pod-60183955 in contrail-api
2025-07-28 02:00:42,570 - DEBUG - VMI a31ee23e-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:42,570 - INFO - Verified Pod ctest-pod-60183955 in agent 10.0.0.48
2025-07-28 02:00:42,570 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=707daba3-7bdf-46d3-ac93-12cf9c73502c
2025-07-28 02:00:42,576 - INFO - Pod ctest-pod-60183955 with uuid 707daba3-7bdf-46d3-ac93-12cf9c73502c found in kube manager
2025-07-28 02:00:42,576 - INFO - Pod ctest-pod-60183955 verification passed
2025-07-28 02:00:42,582 - INFO - Pod ctest-pod-05228527 is in running state.Got IP 10.47.255.249
2025-07-28 02:00:42,678 - DEBUG - Pod ctest-pod-05228527 has vmi a3e90ca8-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:42,678 - INFO - Verified pod ctest-pod-05228527 in contrail-api
2025-07-28 02:00:42,694 - DEBUG - VMI a3e90ca8-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:42,695 - INFO - Verified Pod ctest-pod-05228527 in agent 10.0.0.48
2025-07-28 02:00:42,697 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=14e298ba-21b6-4050-9877-b3ad9115728f
2025-07-28 02:00:42,706 - INFO - Pod ctest-pod-05228527 with uuid 14e298ba-21b6-4050-9877-b3ad9115728f found in kube manager
2025-07-28 02:00:42,706 - INFO - Pod ctest-pod-05228527 verification passed
2025-07-28 02:00:42,718 - INFO - Pod ctest-pod-35264605 is in running state.Got IP 10.47.255.248
2025-07-28 02:00:42,778 - DEBUG - Pod ctest-pod-35264605 has vmi a4e873b4-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:42,778 - INFO - Verified pod ctest-pod-35264605 in contrail-api
2025-07-28 02:00:42,791 - DEBUG - VMI a4e873b4-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:42,791 - INFO - Verified Pod ctest-pod-35264605 in agent 10.0.0.48
2025-07-28 02:00:42,792 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=2c2facc3-18d3-4fe1-a2f5-acd068568b45
2025-07-28 02:00:42,797 - INFO - Pod ctest-pod-35264605 with uuid 2c2facc3-18d3-4fe1-a2f5-acd068568b45 found in kube manager
2025-07-28 02:00:42,798 - INFO - Pod ctest-pod-35264605 verification passed
2025-07-28 02:00:42,804 - DEBUG - Pod ctest-pod-29934887 not in running state.Currently in Pending
2025-07-28 02:00:47,813 - INFO - Pod ctest-pod-29934887 is in running state.Got IP 10.47.255.247
2025-07-28 02:00:47,869 - DEBUG - Pod ctest-pod-29934887 has vmi a5a8b868-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:47,869 - INFO - Verified pod ctest-pod-29934887 in contrail-api
2025-07-28 02:00:47,881 - DEBUG - VMI a5a8b868-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:47,881 - INFO - Verified Pod ctest-pod-29934887 in agent 10.0.0.48
2025-07-28 02:00:47,881 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6da0acf7-1115-41a8-8404-db2dd465dbb7
2025-07-28 02:00:47,887 - INFO - Pod ctest-pod-29934887 with uuid 6da0acf7-1115-41a8-8404-db2dd465dbb7 found in kube manager
2025-07-28 02:00:47,887 - INFO - Pod ctest-pod-29934887 verification passed
2025-07-28 02:00:47,893 - INFO - Pod ctest-pod-51550570 is in running state.Got IP 10.47.255.246
2025-07-28 02:00:47,992 - DEBUG - Pod ctest-pod-51550570 has vmi a68f6e8e-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:47,992 - INFO - Verified pod ctest-pod-51550570 in contrail-api
2025-07-28 02:00:48,004 - DEBUG - VMI a68f6e8e-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:48,004 - INFO - Verified Pod ctest-pod-51550570 in agent 10.0.0.48
2025-07-28 02:00:48,004 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=53cfb2eb-e450-4298-b58c-ca943124894e
2025-07-28 02:00:48,010 - INFO - Pod ctest-pod-51550570 with uuid 53cfb2eb-e450-4298-b58c-ca943124894e found in kube manager
2025-07-28 02:00:48,010 - INFO - Pod ctest-pod-51550570 verification passed
2025-07-28 02:00:48,018 - DEBUG - Pod ctest-pod-41748684 not in running state.Currently in Pending
2025-07-28 02:00:53,025 - INFO - Pod ctest-pod-41748684 is in running state.Got IP 10.47.255.244
2025-07-28 02:00:53,080 - DEBUG - Pod ctest-pod-41748684 has vmi a8344eee-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:53,080 - INFO - Verified pod ctest-pod-41748684 in contrail-api
2025-07-28 02:00:53,092 - DEBUG - VMI a8344eee-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:53,092 - INFO - Verified Pod ctest-pod-41748684 in agent 10.0.0.48
2025-07-28 02:00:53,092 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6f59a2aa-f5b1-47ee-9dc0-a56162990d6b
2025-07-28 02:00:53,097 - INFO - Pod ctest-pod-41748684 with uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b found in kube manager
2025-07-28 02:00:53,097 - INFO - Pod ctest-pod-41748684 verification passed
2025-07-28 02:00:53,103 - INFO - Pod ctest-pod-54870406 is in running state.Got IP 10.47.255.245
2025-07-28 02:00:53,198 - DEBUG - Pod ctest-pod-54870406 has vmi a764400a-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:53,198 - INFO - Verified pod ctest-pod-54870406 in contrail-api
2025-07-28 02:00:53,213 - DEBUG - VMI a764400a-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:53,213 - INFO - Verified Pod ctest-pod-54870406 in agent 10.0.0.48
2025-07-28 02:00:53,213 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=65a8d31c-cead-4c85-b5ea-037e139c5e52
2025-07-28 02:00:53,219 - INFO - Pod ctest-pod-54870406 with uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 found in kube manager
2025-07-28 02:00:53,219 - INFO - Pod ctest-pod-54870406 verification passed
2025-07-28 02:00:53,227 - INFO - Pod ctest-pod-32715759 is in running state.Got IP 10.47.255.243
2025-07-28 02:00:53,324 - DEBUG - Pod ctest-pod-32715759 has vmi a945b25a-6b56-11f0-9087-0242e6b8f538
2025-07-28 02:00:53,324 - INFO - Verified pod ctest-pod-32715759 in contrail-api
2025-07-28 02:00:53,336 - DEBUG - VMI a945b25a-6b56-11f0-9087-0242e6b8f538 is active in agent 10.0.0.48
2025-07-28 02:00:53,337 - INFO - Verified Pod ctest-pod-32715759 in agent 10.0.0.48
2025-07-28 02:00:53,337 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=0e4eec07-fc23-461c-928a-bbf5146309b1
2025-07-28 02:00:53,342 - INFO - Pod ctest-pod-32715759 with uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 found in kube manager
2025-07-28 02:00:53,342 - INFO - Pod ctest-pod-32715759 verification passed
2025-07-28 02:00:53,342 - INFO - ================================================================================
2025-07-28 02:00:53,343 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-07-28 02:00:53,343 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-07-28 02:00:53,653 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with
2025-07-28 02:00:53,653 - INFO - Initial checks done. Running the testcase now
2025-07-28 02:00:53,653 - INFO -
2025-07-28 02:00:53,730 - DEBUG - [Pod ctest-pod-60183955] Cmd: echo ctest-pod-60183955 > /usr/share/nginx/html/index.html, Output:
2025-07-28 02:00:53,806 - DEBUG - [Pod ctest-pod-05228527] Cmd: echo ctest-pod-05228527 > /usr/share/nginx/html/index.html, Output:
2025-07-28 02:00:53,876 - DEBUG - [Pod ctest-pod-35264605] Cmd: echo ctest-pod-35264605 > /usr/share/nginx/html/index.html, Output:
2025-07-28 02:00:53,954 - DEBUG - [Pod ctest-pod-29934887] Cmd: echo ctest-pod-29934887 > /usr/share/nginx/html/index.html, Output:
2025-07-28 02:00:53,958 - DEBUG - Service ctest-nginx-svc-18520744 not present
2025-07-28 02:00:53,958 - INFO - Creating service ctest-nginx-svc-18520744
2025-07-28 02:00:53,975 - INFO - Created Service ctest-nginx-svc-18520744
2025-07-28 02:00:53,985 - WARNING - Service UUID 11a0ec38-0801-45d8-a933-9130520cf52c not yet found in contrail-api
2025-07-28 02:00:55,006 - INFO - Validated that Service ctest-nginx-svc-18520744 is seen in contrail-api
2025-07-28 02:00:55,006 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=11a0ec38-0801-45d8-a933-9130520cf52c
2025-07-28 02:00:55,015 - INFO - Service ctest-nginx-svc-18520744 with uuid 11a0ec38-0801-45d8-a933-9130520cf52c found in kube manager
2025-07-28 02:00:55,015 - INFO - Service ctest-nginx-svc-18520744 verification passed
2025-07-28 02:00:56,108 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,108 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,108 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,217 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
ctest-pod-60183955
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,217 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,217 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
ctest-pod-60183955
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,320 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
ctest-pod-60183955
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,320 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,320 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
ctest-pod-60183955
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,397 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,397 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,397 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,474 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-05228527
2025-07-28 02:00:56,474 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,474 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-05228527
2025-07-28 02:00:56,475 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60183955': 4, 'ctest-pod-05228527': 1}
2025-07-28 02:00:56,553 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-05228527
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,553 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,554 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-05228527
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,622 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,622 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:00:56,622 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:00:56,622 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60183955': 1, 'ctest-pod-05228527': 1}
2025-07-28 02:00:56,626 - DEBUG - Network policy ingress-on-service not present
2025-07-28 02:00:56,627 - INFO - Creating Network Policy ingress-on-service
2025-07-28 02:00:56,640 - INFO - Network policy found in k8s
2025-07-28 02:00:56,640 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=124c0b4b-5fc4-4fc2-94b9-8b27acf6b4e8
2025-07-28 02:00:56,649 - INFO - Network Policy ingress-on-service with uuid 124c0b4b-5fc4-4fc2-94b9-8b27acf6b4e8 found in kube manager
2025-07-28 02:00:56,678 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-07-28 02:00:56,678 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-07-28 02:00:56,678 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=124c0b4b-5fc4-4fc2-94b9-8b27acf6b4e8
2025-07-28 02:00:56,708 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-28 02:00:58,709 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=124c0b4b-5fc4-4fc2-94b9-8b27acf6b4e8
2025-07-28 02:00:58,736 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-28 02:01:00,738 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=124c0b4b-5fc4-4fc2-94b9-8b27acf6b4e8
2025-07-28 02:01:00,768 - INFO - Network policy with name ingress-on-service found in agent
2025-07-28 02:01:00,768 - INFO - Network Policy ingress-on-service verification passed
2025-07-28 02:01:05,843 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:05,843 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:05,843 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:10,925 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:10,925 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:10,925 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:16,033 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:16,033 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:16,033 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:21,138 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:21,139 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:21,139 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:26,225 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:26,225 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:26,225 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:31,309 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:31,310 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:31,310 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:36,424 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:36,424 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:36,424 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:41,529 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:41,529 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:41,529 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:46,604 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:46,604 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:46,605 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:51,694 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:51,694 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:51,694 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:51,695 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-60183955': 0, 'ctest-pod-05228527': 0}
2025-07-28 02:01:51,777 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-05228527
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:01:51,777 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:01:51,777 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-05228527
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:01:51,861 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:01:51,861 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:01:51,861 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-60183955
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:01:51,861 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60183955': 1, 'ctest-pod-05228527': 1}
2025-07-28 02:01:56,945 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:56,945 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:01:56,945 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:02,051 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:02,051 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:02,051 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:07,137 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:07,138 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:07,138 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:12,221 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:12,221 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:12,221 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:17,303 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:17,303 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:17,303 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:22,410 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:22,410 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:22,410 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:27,485 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:27,485 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:27,485 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:32,579 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:32,579 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:32,579 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:37,659 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:37,660 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:37,660 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:42,730 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:42,730 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:42,730 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:02:42,730 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-60183955': 0, 'ctest-pod-05228527': 0}
2025-07-28 02:02:44,807 - DEBUG - [Pod ctest-pod-54870406] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.802 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.326/0.802 ms
2025-07-28 02:02:44,807 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-54870406 with expectation True passed
2025-07-28 02:02:46,891 - DEBUG - [Pod ctest-pod-51550570] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.428 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.104 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.200/0.428 ms
2025-07-28 02:02:46,891 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-51550570 with expectation True passed
2025-07-28 02:02:48,966 - DEBUG - [Pod ctest-pod-41748684] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.752 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.306/0.752 ms
2025-07-28 02:02:48,966 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-41748684 with expectation True passed
2025-07-28 02:02:49,044 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:02:49,044 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-28 02:02:49,044 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:02:49,044 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54870406 passed
2025-07-28 02:02:49,112 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:02:49,113 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-07-28 02:02:49,113 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:02:49,113 - INFO - wget check of of http://10.47.255.249 from ctest-pod-54870406 passed
2025-07-28 02:02:54,190 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-28 02:02:54,191 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-28 02:02:54,191 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-28 02:02:54,191 - INFO - wget check of of http://10.47.255.249 from ctest-pod-51550570 passed
2025-07-28 02:02:59,261 - DEBUG - [Pod ctest-pod-32715759] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-28 02:02:59,261 - DEBUG - [Pod Pod ctest-pod-32715759] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-28 02:02:59,262 - DEBUG - [Pod Pod ctest-pod-32715759] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-28 02:02:59,262 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32715759 passed
2025-07-28 02:02:59,272 - INFO - Updating Network Policy ingress-on-service
2025-07-28 02:03:04,367 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:04,368 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:04,368 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:09,443 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:09,443 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:09,443 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:14,519 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:14,519 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:14,520 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:19,602 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:19,602 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:19,603 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:24,686 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:24,686 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:24,686 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:29,761 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:29,761 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:29,761 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:34,857 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:34,857 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:34,857 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:39,937 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:39,937 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:39,938 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:45,023 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:45,023 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:45,023 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:50,117 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:50,117 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:50,117 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
wget: download timed out
2025-07-28 02:03:50,117 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-60183955': 0, 'ctest-pod-05228527': 0}
2025-07-28 02:03:50,190 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: ctest-pod-05228527
Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,190 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:03:50,190 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: ctest-pod-05228527
Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,264 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: ctest-pod-60183955
Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,264 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:03:50,264 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: ctest-pod-60183955
Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,264 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60183955': 1, 'ctest-pod-05228527': 1}
2025-07-28 02:03:50,341 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-05228527
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,341 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:03:50,342 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
ctest-pod-05228527
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,439 - DEBUG - [Pod ctest-pod-41748684] Cmd: wget http://10.105.174.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
ctest-pod-60183955
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,439 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd wget http://10.105.174.7:80/ -O - -T 5 -t 1 passed
2025-07-28 02:03:50,439 - DEBUG - [Pod Pod ctest-pod-41748684] Cmd output: Connecting to 10.105.174.7:80 (10.105.174.7:80)
writing to stdout
ctest-pod-60183955
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-28 02:03:50,439 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60183955': 1, 'ctest-pod-05228527': 1}
2025-07-28 02:03:52,519 - DEBUG - [Pod ctest-pod-54870406] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.496 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.217/0.496 ms
2025-07-28 02:03:52,519 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-54870406 with expectation True passed
2025-07-28 02:03:54,596 - DEBUG - [Pod ctest-pod-51550570] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.538 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.068 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.226/0.538 ms
2025-07-28 02:03:54,596 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-51550570 with expectation True passed
2025-07-28 02:03:56,679 - DEBUG - [Pod ctest-pod-41748684] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.691 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.622/1.691 ms
2025-07-28 02:03:56,679 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-41748684 with expectation True passed
2025-07-28 02:03:56,754 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:03:56,754 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-28 02:03:56,754 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:03:56,754 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54870406 passed
2025-07-28 02:03:56,833 - DEBUG - [Pod ctest-pod-54870406] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:03:56,833 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-07-28 02:03:56,833 - DEBUG - [Pod Pod ctest-pod-54870406] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:03:56,833 - INFO - wget check of of http://10.47.255.249 from ctest-pod-54870406 passed
2025-07-28 02:04:01,910 - DEBUG - [Pod ctest-pod-51550570] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-28 02:04:01,910 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-28 02:04:01,910 - DEBUG - [Pod Pod ctest-pod-51550570] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-07-28 02:04:01,910 - INFO - wget check of of http://10.47.255.249 from ctest-pod-51550570 passed
2025-07-28 02:04:01,988 - DEBUG - [Pod ctest-pod-32715759] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:04:01,988 - DEBUG - [Pod Pod ctest-pod-32715759] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-28 02:04:01,988 - DEBUG - [Pod Pod ctest-pod-32715759] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-28 02:04:01,988 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32715759 passed
2025-07-28 02:04:01,988 - INFO - Deleting Network Policy : ingress-on-service
2025-07-28 02:04:01,990 - INFO - Deleting service : ctest-nginx-svc-18520744
2025-07-28 02:04:02,615 - DEBUG - No XMPP flaps were noticed during the test
2025-07-28 02:04:02,615 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2025-07-28 02:04:02,615 - INFO - --------------------------------------------------------------------------------
2025-07-28 02:04:02,620 - INFO - Deleting pod ctest-new-default-99242373:ctest-pod-60183955
2025-07-28 02:04:02,621 - INFO - Deleting pod ctest-new-default-99242373:ctest-pod-05228527
2025-07-28 02:04:02,621 - INFO - Deleting pod ctest-non-default-87325051:ctest-pod-35264605
2025-07-28 02:04:02,621 - INFO - Deleting pod ctest-non-default-87325051:ctest-pod-29934887
2025-07-28 02:04:02,622 - INFO - Deleting pod ctest-new-default-99242373:ctest-pod-51550570
2025-07-28 02:04:02,622 - INFO - Deleting pod ctest-new-default-99242373:ctest-pod-54870406
2025-07-28 02:04:02,622 - INFO - Deleting pod ctest-non-default-87325051:ctest-pod-41748684
2025-07-28 02:04:02,622 - INFO - Deleting pod ctest-non-default-87325051:ctest-pod-32715759
2025-07-28 02:04:02,752 - WARNING - Pod uuid 707daba3-7bdf-46d3-ac93-12cf9c73502c is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,763 - WARNING - Pod uuid 2c2facc3-18d3-4fe1-a2f5-acd068568b45 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,765 - WARNING - Pod uuid 14e298ba-21b6-4050-9877-b3ad9115728f is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,772 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,775 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,779 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,780 - WARNING - Pod uuid 6da0acf7-1115-41a8-8404-db2dd465dbb7 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:02,782 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:07,758 - DEBUG - Pod 707daba3-7bdf-46d3-ac93-12cf9c73502c is not in agent 10.0.0.48 VM list
2025-07-28 02:04:07,771 - DEBUG - VMI a31ee23e-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:07,771 - INFO - Verified that pod ctest-pod-60183955 is removed in agent
2025-07-28 02:04:07,773 - DEBUG - Pod 14e298ba-21b6-4050-9877-b3ad9115728f is not in agent 10.0.0.48 VM list
2025-07-28 02:04:07,787 - DEBUG - Pod 2c2facc3-18d3-4fe1-a2f5-acd068568b45 is not in agent 10.0.0.48 VM list
2025-07-28 02:04:07,795 - DEBUG - Pod 6da0acf7-1115-41a8-8404-db2dd465dbb7 is not in agent 10.0.0.48 VM list
2025-07-28 02:04:07,797 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:07,797 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:07,797 - DEBUG - VMI a3e90ca8-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:07,798 - INFO - Verified that pod ctest-pod-05228527 is removed in agent
2025-07-28 02:04:07,798 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:07,800 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:07,801 - DEBUG - VMI a4e873b4-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:07,801 - INFO - Verified that pod ctest-pod-35264605 is removed in agent
2025-07-28 02:04:07,807 - DEBUG - VMI a5a8b868-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:07,807 - INFO - Verified that pod ctest-pod-29934887 is removed in agent
2025-07-28 02:04:12,814 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:12,815 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:12,816 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:12,817 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:17,834 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:17,835 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:17,836 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:17,838 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:22,853 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:22,854 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:22,855 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:22,856 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:27,871 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:27,873 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:27,873 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:27,874 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:32,891 - WARNING - Pod uuid 0e4eec07-fc23-461c-928a-bbf5146309b1 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:32,892 - WARNING - Pod uuid 65a8d31c-cead-4c85-b5ea-037e139c5e52 is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:32,892 - WARNING - Pod uuid 53cfb2eb-e450-4298-b58c-ca943124894e is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:32,893 - WARNING - Pod uuid 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is still seen in agent 10.0.0.48 VM list
2025-07-28 02:04:37,911 - DEBUG - Pod 0e4eec07-fc23-461c-928a-bbf5146309b1 is not in agent 10.0.0.48 VM list
2025-07-28 02:04:37,915 - DEBUG - Pod 53cfb2eb-e450-4298-b58c-ca943124894e is not in agent 10.0.0.48 VM list
2025-07-28 02:04:37,917 - DEBUG - Pod 6f59a2aa-f5b1-47ee-9dc0-a56162990d6b is not in agent 10.0.0.48 VM list
2025-07-28 02:04:37,918 - DEBUG - Pod 65a8d31c-cead-4c85-b5ea-037e139c5e52 is not in agent 10.0.0.48 VM list
2025-07-28 02:04:37,933 - DEBUG - VMI a68f6e8e-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:37,933 - INFO - Verified that pod ctest-pod-51550570 is removed in agent
2025-07-28 02:04:37,934 - DEBUG - VMI a945b25a-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:37,934 - INFO - Verified that pod ctest-pod-32715759 is removed in agent
2025-07-28 02:04:37,936 - DEBUG - VMI a8344eee-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:37,936 - INFO - Verified that pod ctest-pod-41748684 is removed in agent
2025-07-28 02:04:37,936 - DEBUG - VMI a764400a-6b56-11f0-9087-0242e6b8f538 is removed from agent 10.0.0.48
2025-07-28 02:04:37,936 - INFO - Verified that pod ctest-pod-54870406 is removed in agent
2025-07-28 02:04:37,937 - INFO - Deleting namespace ctest-non-default-87325051
2025-07-28 02:04:37,951 - DEBUG - Namespace ctest-non-default-87325051 still in k8s
2025-07-28 02:04:39,957 - DEBUG - Namespace ctest-non-default-87325051 still in k8s
2025-07-28 02:04:41,964 - DEBUG - Namespace ctest-non-default-87325051 still in k8s
2025-07-28 02:04:43,970 - DEBUG - Namespace ctest-non-default-87325051 is not in k8s
2025-07-28 02:04:43,970 - DEBUG - No need to check project deletion in contrail-api
2025-07-28 02:04:43,970 - INFO - Deleting namespace ctest-new-default-99242373
2025-07-28 02:04:43,987 - DEBUG - Namespace ctest-new-default-99242373 still in k8s
2025-07-28 02:04:45,992 - DEBUG - Namespace ctest-new-default-99242373 still in k8s
2025-07-28 02:04:47,998 - DEBUG - Namespace ctest-new-default-99242373 still in k8s
2025-07-28 02:04:50,004 - DEBUG - Namespace ctest-new-default-99242373 is not in k8s
2025-07-28 02:04:50,004 - DEBUG - No need to check project deletion in contrail-api