2025-04-22 22:54:29,252 - INFO - Using existing project ['default-domain', 'k8s-default'](f511f9dc-de0e-49dd-8a79-58d35bad1c11)
2025-04-22 22:54:29,267 - DEBUG - Namespace ctest-new-default-70527966 not present
2025-04-22 22:54:29,274 - INFO - Created namespace ctest-new-default-70527966
2025-04-22 22:54:32,277 - DEBUG - Namespace ctest-non-default-82046157 not present
2025-04-22 22:54:32,283 - INFO - Created namespace ctest-non-default-82046157
2025-04-22 22:54:35,303 - DEBUG - Pod ctest-pod-21803108 not present
2025-04-22 22:54:35,303 - INFO - Creating Pod ctest-pod-21803108
2025-04-22 22:54:35,330 - DEBUG - Pod : ctest-pod-21803108 UUID is e5f8f84c-9e04-4207-bf4b-d4d354be71a9
2025-04-22 22:54:35,332 - DEBUG - Pod ctest-pod-40587719 not present
2025-04-22 22:54:35,332 - INFO - Creating Pod ctest-pod-40587719
2025-04-22 22:54:35,365 - DEBUG - Pod : ctest-pod-40587719 UUID is 877b1ef4-0119-460b-8c09-85f42b2bb175
2025-04-22 22:54:35,367 - DEBUG - Pod ctest-pod-23129046 not present
2025-04-22 22:54:35,367 - INFO - Creating Pod ctest-pod-23129046
2025-04-22 22:54:35,413 - DEBUG - Pod : ctest-pod-23129046 UUID is 75f8a098-b226-4229-a93f-7d6ac93913fa
2025-04-22 22:54:35,415 - DEBUG - Pod ctest-pod-17347588 not present
2025-04-22 22:54:35,415 - INFO - Creating Pod ctest-pod-17347588
2025-04-22 22:54:35,445 - DEBUG - Pod : ctest-pod-17347588 UUID is 1cb9b29e-738b-450e-a62d-999f5506a4a0
2025-04-22 22:54:35,447 - DEBUG - Pod ctest-pod-22270109 not present
2025-04-22 22:54:35,447 - INFO - Creating Pod ctest-pod-22270109
2025-04-22 22:54:35,461 - DEBUG - Pod : ctest-pod-22270109 UUID is 6cd5a2a5-4088-4835-8243-18e3e228c378
2025-04-22 22:54:35,462 - DEBUG - Pod ctest-pod-90129816 not present
2025-04-22 22:54:35,463 - INFO - Creating Pod ctest-pod-90129816
2025-04-22 22:54:35,477 - DEBUG - Pod : ctest-pod-90129816 UUID is 80470a0d-2cfe-4c52-9c66-ffe9637904f6
2025-04-22 22:54:35,479 - DEBUG - Pod ctest-pod-97945798 not present
2025-04-22 22:54:35,479 - INFO - Creating Pod ctest-pod-97945798
2025-04-22 22:54:35,504 - DEBUG - Pod : ctest-pod-97945798 UUID is 4518e106-4b51-4fa9-abed-96db5a4bf27a
2025-04-22 22:54:35,505 - DEBUG - Pod ctest-pod-28685829 not present
2025-04-22 22:54:35,505 - INFO - Creating Pod ctest-pod-28685829
2025-04-22 22:54:35,519 - DEBUG - Pod : ctest-pod-28685829 UUID is dc942c9c-8e8d-43f3-b717-c6bf362bc3f5
2025-04-22 22:54:35,663 - INFO - Project default-domain:k8s-ctest-new-default-70527966 for Namespace ctest-new-default-70527966 is seen in contrail-api
2025-04-22 22:54:35,663 - DEBUG - Project uuid in Contrail is c4b066fa-cfe1-4ef6-ab46-af765f8a088f
2025-04-22 22:54:35,779 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=7d93d985-8c4b-468c-b23a-1f54daf5e1da
2025-04-22 22:54:35,824 - INFO - Namespace ctest-new-default-70527966 with uuid 7d93d985-8c4b-468c-b23a-1f54daf5e1da found in kube manager
2025-04-22 22:54:35,824 - INFO - Namespace ctest-new-default-70527966 verification passed
2025-04-22 22:54:35,995 - INFO - Project default-domain:k8s-ctest-non-default-82046157 for Namespace ctest-non-default-82046157 is seen in contrail-api
2025-04-22 22:54:35,995 - DEBUG - Project uuid in Contrail is 8867ab7d-f52c-4431-ba3c-76d9dc949cea
2025-04-22 22:54:35,995 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=1f532e54-037b-4a9b-bfb7-e17fa0e25a19
2025-04-22 22:54:35,999 - INFO - Namespace ctest-non-default-82046157 with uuid 1f532e54-037b-4a9b-bfb7-e17fa0e25a19 found in kube manager
2025-04-22 22:54:35,999 - INFO - Namespace ctest-non-default-82046157 verification passed
2025-04-22 22:54:36,006 - DEBUG - Pod ctest-pod-21803108 not in running state.Currently in Pending
2025-04-22 22:54:41,018 - DEBUG - Pod ctest-pod-21803108 not in running state.Currently in Pending
2025-04-22 22:54:46,024 - DEBUG - Pod ctest-pod-21803108 not in running state.Currently in Pending
2025-04-22 22:54:51,030 - INFO - Pod ctest-pod-21803108 is in running state.Got IP 10.47.255.251
2025-04-22 22:54:51,042 - DEBUG - Pod ctest-pod-21803108 has vmi c3e9c432-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,042 - INFO - Verified pod ctest-pod-21803108 in contrail-api
2025-04-22 22:54:51,055 - DEBUG - VMI c3e9c432-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,055 - INFO - Verified Pod ctest-pod-21803108 in agent 10.0.0.19
2025-04-22 22:54:51,055 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=e5f8f84c-9e04-4207-bf4b-d4d354be71a9
2025-04-22 22:54:51,059 - INFO - Pod ctest-pod-21803108 with uuid e5f8f84c-9e04-4207-bf4b-d4d354be71a9 found in kube manager
2025-04-22 22:54:51,059 - INFO - Pod ctest-pod-21803108 verification passed
2025-04-22 22:54:51,063 - INFO - Pod ctest-pod-40587719 is in running state.Got IP 10.47.255.250
2025-04-22 22:54:51,073 - DEBUG - Pod ctest-pod-40587719 has vmi c44ee1d2-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,074 - INFO - Verified pod ctest-pod-40587719 in contrail-api
2025-04-22 22:54:51,084 - DEBUG - VMI c44ee1d2-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,085 - INFO - Verified Pod ctest-pod-40587719 in agent 10.0.0.19
2025-04-22 22:54:51,085 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=877b1ef4-0119-460b-8c09-85f42b2bb175
2025-04-22 22:54:51,088 - INFO - Pod ctest-pod-40587719 with uuid 877b1ef4-0119-460b-8c09-85f42b2bb175 found in kube manager
2025-04-22 22:54:51,088 - INFO - Pod ctest-pod-40587719 verification passed
2025-04-22 22:54:51,092 - INFO - Pod ctest-pod-23129046 is in running state.Got IP 10.47.255.249
2025-04-22 22:54:51,145 - DEBUG - Pod ctest-pod-23129046 has vmi c4e89a48-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,145 - INFO - Verified pod ctest-pod-23129046 in contrail-api
2025-04-22 22:54:51,157 - DEBUG - VMI c4e89a48-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,157 - INFO - Verified Pod ctest-pod-23129046 in agent 10.0.0.19
2025-04-22 22:54:51,157 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=75f8a098-b226-4229-a93f-7d6ac93913fa
2025-04-22 22:54:51,161 - INFO - Pod ctest-pod-23129046 with uuid 75f8a098-b226-4229-a93f-7d6ac93913fa found in kube manager
2025-04-22 22:54:51,161 - INFO - Pod ctest-pod-23129046 verification passed
2025-04-22 22:54:51,174 - INFO - Pod ctest-pod-17347588 is in running state.Got IP 10.47.255.248
2025-04-22 22:54:51,228 - DEBUG - Pod ctest-pod-17347588 has vmi c55caffa-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,228 - INFO - Verified pod ctest-pod-17347588 in contrail-api
2025-04-22 22:54:51,239 - DEBUG - VMI c55caffa-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,239 - INFO - Verified Pod ctest-pod-17347588 in agent 10.0.0.19
2025-04-22 22:54:51,240 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1cb9b29e-738b-450e-a62d-999f5506a4a0
2025-04-22 22:54:51,243 - INFO - Pod ctest-pod-17347588 with uuid 1cb9b29e-738b-450e-a62d-999f5506a4a0 found in kube manager
2025-04-22 22:54:51,243 - INFO - Pod ctest-pod-17347588 verification passed
2025-04-22 22:54:51,248 - INFO - Pod ctest-pod-22270109 is in running state.Got IP 10.47.255.247
2025-04-22 22:54:51,259 - DEBUG - Pod ctest-pod-22270109 has vmi c5d0cdfe-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,259 - INFO - Verified pod ctest-pod-22270109 in contrail-api
2025-04-22 22:54:51,271 - DEBUG - VMI c5d0cdfe-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,272 - INFO - Verified Pod ctest-pod-22270109 in agent 10.0.0.19
2025-04-22 22:54:51,272 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=6cd5a2a5-4088-4835-8243-18e3e228c378
2025-04-22 22:54:51,275 - INFO - Pod ctest-pod-22270109 with uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 found in kube manager
2025-04-22 22:54:51,275 - INFO - Pod ctest-pod-22270109 verification passed
2025-04-22 22:54:51,280 - INFO - Pod ctest-pod-97945798 is in running state.Got IP 10.47.255.245
2025-04-22 22:54:51,334 - DEBUG - Pod ctest-pod-97945798 has vmi c69ed8b6-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,334 - INFO - Verified pod ctest-pod-97945798 in contrail-api
2025-04-22 22:54:51,346 - DEBUG - VMI c69ed8b6-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,346 - INFO - Verified Pod ctest-pod-97945798 in agent 10.0.0.19
2025-04-22 22:54:51,346 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=4518e106-4b51-4fa9-abed-96db5a4bf27a
2025-04-22 22:54:51,350 - INFO - Pod ctest-pod-97945798 with uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a found in kube manager
2025-04-22 22:54:51,350 - INFO - Pod ctest-pod-97945798 verification passed
2025-04-22 22:54:51,412 - INFO - Pod ctest-pod-90129816 is in running state.Got IP 10.47.255.246
2025-04-22 22:54:51,424 - DEBUG - Pod ctest-pod-90129816 has vmi c63a2092-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,424 - INFO - Verified pod ctest-pod-90129816 in contrail-api
2025-04-22 22:54:51,436 - DEBUG - VMI c63a2092-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,436 - INFO - Verified Pod ctest-pod-90129816 in agent 10.0.0.19
2025-04-22 22:54:51,436 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=80470a0d-2cfe-4c52-9c66-ffe9637904f6
2025-04-22 22:54:51,440 - INFO - Pod ctest-pod-90129816 with uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 found in kube manager
2025-04-22 22:54:51,440 - INFO - Pod ctest-pod-90129816 verification passed
2025-04-22 22:54:51,445 - INFO - Pod ctest-pod-28685829 is in running state.Got IP 10.47.255.244
2025-04-22 22:54:51,497 - DEBUG - Pod ctest-pod-28685829 has vmi c7082988-1fcc-11f0-a200-fa163e252b8e
2025-04-22 22:54:51,497 - INFO - Verified pod ctest-pod-28685829 in contrail-api
2025-04-22 22:54:51,508 - DEBUG - VMI c7082988-1fcc-11f0-a200-fa163e252b8e is active in agent 10.0.0.19
2025-04-22 22:54:51,508 - INFO - Verified Pod ctest-pod-28685829 in agent 10.0.0.19
2025-04-22 22:54:51,508 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=dc942c9c-8e8d-43f3-b717-c6bf362bc3f5
2025-04-22 22:54:51,512 - INFO - Pod ctest-pod-28685829 with uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 found in kube manager
2025-04-22 22:54:51,512 - INFO - Pod ctest-pod-28685829 verification passed
2025-04-22 22:54:51,512 - INFO - ================================================================================
2025-04-22 22:54:51,512 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-22 22:54:51,512 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-22 22:54:51,730 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.249': '0'}} with
2025-04-22 22:54:51,730 - INFO - Initial checks done. Running the testcase now
2025-04-22 22:54:51,730 - INFO -
2025-04-22 22:54:51,784 - DEBUG - [Pod ctest-pod-21803108] Cmd: echo ctest-pod-21803108 > /usr/share/nginx/html/index.html, Output:
2025-04-22 22:54:51,834 - DEBUG - [Pod ctest-pod-40587719] Cmd: echo ctest-pod-40587719 > /usr/share/nginx/html/index.html, Output:
2025-04-22 22:54:51,883 - DEBUG - [Pod ctest-pod-23129046] Cmd: echo ctest-pod-23129046 > /usr/share/nginx/html/index.html, Output:
2025-04-22 22:54:51,930 - DEBUG - [Pod ctest-pod-17347588] Cmd: echo ctest-pod-17347588 > /usr/share/nginx/html/index.html, Output:
2025-04-22 22:54:51,932 - DEBUG - Service ctest-nginx-svc-28710662 not present
2025-04-22 22:54:51,933 - INFO - Creating service ctest-nginx-svc-28710662
2025-04-22 22:54:51,948 - INFO - Created Service ctest-nginx-svc-28710662
2025-04-22 22:54:51,957 - WARNING - Service UUID 989c26ea-cbbb-4152-b251-dfc9e2e2918c not yet found in contrail-api
2025-04-22 22:54:52,963 - INFO - Validated that Service ctest-nginx-svc-28710662 is seen in contrail-api
2025-04-22 22:54:52,963 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=989c26ea-cbbb-4152-b251-dfc9e2e2918c
2025-04-22 22:54:52,967 - INFO - Service ctest-nginx-svc-28710662 with uuid 989c26ea-cbbb-4152-b251-dfc9e2e2918c found in kube manager
2025-04-22 22:54:52,967 - INFO - Service ctest-nginx-svc-28710662 verification passed
2025-04-22 22:54:53,023 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,023 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,023 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,067 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,067 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,067 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,121 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:54:53,121 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,121 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:54:53,172 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:54:53,172 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,172 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:54:53,223 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,223 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,223 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,223 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21803108': 4, 'ctest-pod-40587719': 1}
2025-04-22 22:54:53,272 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,272 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,272 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,326 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,326 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,326 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,370 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:54:53,370 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,370 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:54:53,403 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,403 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:54:53,403 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:54:53,403 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21803108': 3, 'ctest-pod-40587719': 1}
2025-04-22 22:54:53,406 - DEBUG - Network policy ingress-on-service not present
2025-04-22 22:54:53,406 - INFO - Creating Network Policy ingress-on-service
2025-04-22 22:54:53,418 - INFO - Network policy found in k8s
2025-04-22 22:54:53,418 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=afeadbe1-0589-48f6-982e-8dd04a17019f
2025-04-22 22:54:53,424 - INFO - Network Policy ingress-on-service with uuid afeadbe1-0589-48f6-982e-8dd04a17019f found in kube manager
2025-04-22 22:54:53,455 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-22 22:54:53,456 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-22 22:54:53,456 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=afeadbe1-0589-48f6-982e-8dd04a17019f
2025-04-22 22:54:53,480 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-22 22:54:55,481 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=afeadbe1-0589-48f6-982e-8dd04a17019f
2025-04-22 22:54:55,510 - INFO - Network policy with name ingress-on-service found in agent
2025-04-22 22:54:55,510 - INFO - Network Policy ingress-on-service verification passed
2025-04-22 22:55:00,584 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:00,584 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:00,585 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:05,633 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:05,633 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:05,633 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:10,681 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:10,681 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:10,681 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:15,728 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:15,729 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:15,729 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:20,780 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:20,781 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:20,781 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:25,845 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:25,845 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:25,845 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:30,895 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:30,895 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:30,895 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:35,958 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:35,958 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:35,958 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:41,001 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:41,001 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:41,001 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:46,057 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:46,057 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:46,057 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:46,057 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21803108': 0, 'ctest-pod-40587719': 0}
2025-04-22 22:55:46,114 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:55:46,114 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:55:46,114 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:55:46,164 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:55:46,164 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:55:46,164 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21803108
2025-04-22 22:55:46,164 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21803108': 1, 'ctest-pod-40587719': 1}
2025-04-22 22:55:46,846 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-22 22:55:56,901 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:56,901 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:55:56,901 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:01,964 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:01,964 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:01,964 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:07,012 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:07,012 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:07,012 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:12,057 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:12,057 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:12,057 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:17,112 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:17,112 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:17,112 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:22,161 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:22,161 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:22,161 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:27,212 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:27,212 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:27,212 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:32,264 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:32,264 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:32,265 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:37,316 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:37,316 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:37,316 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:42,361 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:42,361 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:42,361 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:56:42,361 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21803108': 0, 'ctest-pod-40587719': 0}
2025-04-22 22:56:44,404 - DEBUG - [Pod ctest-pod-90129816] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.011 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.382/1.011 ms
2025-04-22 22:56:44,405 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-90129816 with expectation True passed
2025-04-22 22:56:46,463 - DEBUG - [Pod ctest-pod-22270109] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.223 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.459/1.223 ms
2025-04-22 22:56:46,464 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22270109 with expectation True passed
2025-04-22 22:56:48,509 - DEBUG - [Pod ctest-pod-97945798] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.297 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.055 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.055/0.140/0.297 ms
2025-04-22 22:56:48,509 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97945798 with expectation True passed
2025-04-22 22:56:48,562 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:56:48,562 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-22 22:56:48,562 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:56:48,562 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90129816 passed
2025-04-22 22:56:48,619 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:56:48,619 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-22 22:56:48,619 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:56:48,619 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90129816 passed
2025-04-22 22:56:53,664 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 22:56:53,664 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 22:56:53,664 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 22:56:53,664 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22270109 passed
2025-04-22 22:56:58,718 - DEBUG - [Pod ctest-pod-28685829] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-22 22:56:58,718 - DEBUG - [Pod Pod ctest-pod-28685829] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-22 22:56:58,718 - DEBUG - [Pod Pod ctest-pod-28685829] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-22 22:56:58,718 - INFO - wget check of of http://10.47.255.251 from ctest-pod-28685829 passed
2025-04-22 22:56:58,726 - INFO - Updating Network Policy ingress-on-service
2025-04-22 22:57:03,788 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:03,788 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:03,788 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:08,836 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:08,836 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:08,836 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:13,889 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:13,889 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:13,889 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:18,944 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:18,944 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:18,944 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:23,981 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:23,981 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:23,981 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:29,033 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:29,033 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:29,033 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:34,084 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:34,084 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:34,084 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:39,141 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:39,141 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:39,141 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:44,189 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:44,189 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:44,189 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:49,241 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:49,241 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:49,241 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.106.134.146:80 (10.106.134.146:80)
wget: download timed out
2025-04-22 22:57:49,242 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21803108': 0, 'ctest-pod-40587719': 0}
2025-04-22 22:57:49,299 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,299 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:57:49,299 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,332 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,332 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:57:49,332 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,377 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,377 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:57:49,377 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,377 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21803108': 1, 'ctest-pod-40587719': 2}
2025-04-22 22:57:49,426 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,427 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:57:49,427 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,477 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,477 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:57:49,477 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: ctest-pod-40587719
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,522 - DEBUG - [Pod ctest-pod-97945798] Cmd: wget http://10.106.134.146:80/ -O - -T 5 -t 1 , Output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,522 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd wget http://10.106.134.146:80/ -O - -T 5 -t 1 passed
2025-04-22 22:57:49,522 - DEBUG - [Pod Pod ctest-pod-97945798] Cmd output: ctest-pod-21803108
Connecting to 10.106.134.146:80 (10.106.134.146:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 22:57:49,522 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21803108': 1, 'ctest-pod-40587719': 2}
2025-04-22 22:57:51,552 - DEBUG - [Pod ctest-pod-90129816] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.400 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.059 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.175/0.400 ms
2025-04-22 22:57:51,552 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-90129816 with expectation True passed
2025-04-22 22:57:53,600 - DEBUG - [Pod ctest-pod-22270109] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.896 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.351/0.896 ms
2025-04-22 22:57:53,600 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22270109 with expectation True passed
2025-04-22 22:57:55,648 - DEBUG - [Pod ctest-pod-97945798] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.340 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.162/0.340 ms
2025-04-22 22:57:55,648 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97945798 with expectation True passed
2025-04-22 22:57:55,703 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:57:55,703 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-22 22:57:55,703 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:57:55,703 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90129816 passed
2025-04-22 22:57:55,750 - DEBUG - [Pod ctest-pod-90129816] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:57:55,750 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-22 22:57:55,750 - DEBUG - [Pod Pod ctest-pod-90129816] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:57:55,750 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90129816 passed
2025-04-22 22:58:00,800 - DEBUG - [Pod ctest-pod-22270109] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 22:58:00,800 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 22:58:00,800 - DEBUG - [Pod Pod ctest-pod-22270109] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 22:58:00,800 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22270109 passed
2025-04-22 22:58:00,854 - DEBUG - [Pod ctest-pod-28685829] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:58:00,855 - DEBUG - [Pod Pod ctest-pod-28685829] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-22 22:58:00,855 - DEBUG - [Pod Pod ctest-pod-28685829] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 22:58:00,855 - INFO - wget check of of http://10.47.255.251 from ctest-pod-28685829 passed
2025-04-22 22:58:00,855 - INFO - Deleting Network Policy : ingress-on-service
2025-04-22 22:58:00,855 - INFO - Deleting service : ctest-nginx-svc-28710662
2025-04-22 22:58:01,086 - DEBUG - No XMPP flaps were noticed during the test
2025-04-22 22:58:01,086 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-04-22 22:58:01,086 - INFO - --------------------------------------------------------------------------------
2025-04-22 22:58:01,091 - INFO - Deleting pod ctest-new-default-70527966:ctest-pod-21803108
2025-04-22 22:58:01,091 - INFO - Deleting pod ctest-new-default-70527966:ctest-pod-40587719
2025-04-22 22:58:01,091 - INFO - Deleting pod ctest-non-default-82046157:ctest-pod-23129046
2025-04-22 22:58:01,092 - INFO - Deleting pod ctest-non-default-82046157:ctest-pod-17347588
2025-04-22 22:58:01,092 - INFO - Deleting pod ctest-new-default-70527966:ctest-pod-22270109
2025-04-22 22:58:01,092 - INFO - Deleting pod ctest-new-default-70527966:ctest-pod-90129816
2025-04-22 22:58:01,093 - INFO - Deleting pod ctest-non-default-82046157:ctest-pod-97945798
2025-04-22 22:58:01,093 - INFO - Deleting pod ctest-non-default-82046157:ctest-pod-28685829
2025-04-22 22:58:01,244 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,245 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,245 - WARNING - Pod uuid 75f8a098-b226-4229-a93f-7d6ac93913fa is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,246 - WARNING - Pod uuid 1cb9b29e-738b-450e-a62d-999f5506a4a0 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,246 - WARNING - Pod uuid 877b1ef4-0119-460b-8c09-85f42b2bb175 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,247 - WARNING - Pod uuid e5f8f84c-9e04-4207-bf4b-d4d354be71a9 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,254 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:01,254 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:06,274 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:06,274 - DEBUG - Pod 1cb9b29e-738b-450e-a62d-999f5506a4a0 is not in agent 10.0.0.19 VM list
2025-04-22 22:58:06,276 - DEBUG - Pod e5f8f84c-9e04-4207-bf4b-d4d354be71a9 is not in agent 10.0.0.19 VM list
2025-04-22 22:58:06,277 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:06,277 - DEBUG - Pod 877b1ef4-0119-460b-8c09-85f42b2bb175 is not in agent 10.0.0.19 VM list
2025-04-22 22:58:06,278 - DEBUG - Pod 75f8a098-b226-4229-a93f-7d6ac93913fa is not in agent 10.0.0.19 VM list
2025-04-22 22:58:06,281 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:06,282 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:06,292 - DEBUG - VMI c3e9c432-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:06,293 - INFO - Verified that pod ctest-pod-21803108 is removed in agent
2025-04-22 22:58:06,293 - DEBUG - VMI c55caffa-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:06,293 - INFO - Verified that pod ctest-pod-17347588 is removed in agent
2025-04-22 22:58:06,294 - DEBUG - VMI c4e89a48-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:06,294 - INFO - Verified that pod ctest-pod-23129046 is removed in agent
2025-04-22 22:58:06,295 - DEBUG - VMI c44ee1d2-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:06,295 - INFO - Verified that pod ctest-pod-40587719 is removed in agent
2025-04-22 22:58:11,287 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:11,287 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:11,294 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:11,295 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:16,300 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:16,300 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:16,307 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:16,308 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:21,313 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:21,314 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:21,320 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:21,321 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:26,325 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:26,328 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:26,330 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:26,331 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:31,385 - WARNING - Pod uuid dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:31,386 - WARNING - Pod uuid 4518e106-4b51-4fa9-abed-96db5a4bf27a is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:31,387 - WARNING - Pod uuid 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:31,388 - WARNING - Pod uuid 6cd5a2a5-4088-4835-8243-18e3e228c378 is still seen in agent 10.0.0.19 VM list
2025-04-22 22:58:36,412 - DEBUG - Pod 6cd5a2a5-4088-4835-8243-18e3e228c378 is not in agent 10.0.0.19 VM list
2025-04-22 22:58:36,413 - DEBUG - Pod 4518e106-4b51-4fa9-abed-96db5a4bf27a is not in agent 10.0.0.19 VM list
2025-04-22 22:58:36,414 - DEBUG - Pod dc942c9c-8e8d-43f3-b717-c6bf362bc3f5 is not in agent 10.0.0.19 VM list
2025-04-22 22:58:36,426 - DEBUG - Pod 80470a0d-2cfe-4c52-9c66-ffe9637904f6 is not in agent 10.0.0.19 VM list
2025-04-22 22:58:36,443 - DEBUG - VMI c63a2092-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:36,443 - INFO - Verified that pod ctest-pod-90129816 is removed in agent
2025-04-22 22:58:36,444 - DEBUG - VMI c7082988-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:36,444 - INFO - Verified that pod ctest-pod-28685829 is removed in agent
2025-04-22 22:58:36,444 - DEBUG - VMI c69ed8b6-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:36,444 - INFO - Verified that pod ctest-pod-97945798 is removed in agent
2025-04-22 22:58:36,444 - DEBUG - VMI c5d0cdfe-1fcc-11f0-a200-fa163e252b8e is removed from agent 10.0.0.19
2025-04-22 22:58:36,445 - INFO - Verified that pod ctest-pod-22270109 is removed in agent
2025-04-22 22:58:36,445 - INFO - Deleting namespace ctest-non-default-82046157
2025-04-22 22:58:36,463 - DEBUG - Namespace ctest-non-default-82046157 still in k8s
2025-04-22 22:58:38,467 - DEBUG - Namespace ctest-non-default-82046157 still in k8s
2025-04-22 22:58:40,472 - DEBUG - Namespace ctest-non-default-82046157 still in k8s
2025-04-22 22:58:42,475 - DEBUG - Namespace ctest-non-default-82046157 is not in k8s
2025-04-22 22:58:42,475 - DEBUG - No need to check project deletion in contrail-api
2025-04-22 22:58:42,475 - INFO - Deleting namespace ctest-new-default-70527966
2025-04-22 22:58:42,484 - DEBUG - Namespace ctest-new-default-70527966 still in k8s
2025-04-22 22:58:44,488 - DEBUG - Namespace ctest-new-default-70527966 still in k8s
2025-04-22 22:58:46,492 - DEBUG - Namespace ctest-new-default-70527966 still in k8s
2025-04-22 22:58:48,504 - DEBUG - Namespace ctest-new-default-70527966 is not in k8s
2025-04-22 22:58:48,504 - DEBUG - No need to check project deletion in contrail-api