2025-08-25 18:37:31,053 - INFO - Using existing project ['default-domain', 'k8s-default'](7b5558d2-61f2-43e2-a020-ddc326c2b533)
2025-08-25 18:37:31,073 - DEBUG - Namespace ctest-new-default-31410727 not present
2025-08-25 18:37:31,088 - INFO - Created namespace ctest-new-default-31410727
2025-08-25 18:37:34,092 - DEBUG - Namespace ctest-non-default-08360932 not present
2025-08-25 18:37:34,112 - INFO - Created namespace ctest-non-default-08360932
2025-08-25 18:37:37,158 - DEBUG - Pod ctest-pod-24966619 not present
2025-08-25 18:37:37,159 - INFO - Creating Pod ctest-pod-24966619
2025-08-25 18:37:37,254 - DEBUG - Pod : ctest-pod-24966619 UUID is 9aedca34-372e-4a90-a6b3-38ec06157888
2025-08-25 18:37:37,260 - DEBUG - Pod ctest-pod-73664936 not present
2025-08-25 18:37:37,261 - INFO - Creating Pod ctest-pod-73664936
2025-08-25 18:37:37,319 - DEBUG - Pod : ctest-pod-73664936 UUID is 161d0aaa-0c85-4647-8743-4dc0ed607681
2025-08-25 18:37:37,327 - DEBUG - Pod ctest-pod-97497946 not present
2025-08-25 18:37:37,328 - INFO - Creating Pod ctest-pod-97497946
2025-08-25 18:37:37,365 - DEBUG - Pod : ctest-pod-97497946 UUID is 4b928cb7-1ee1-4b23-998d-a222215a7885
2025-08-25 18:37:37,367 - DEBUG - Pod ctest-pod-09046688 not present
2025-08-25 18:37:37,367 - INFO - Creating Pod ctest-pod-09046688
2025-08-25 18:37:37,405 - DEBUG - Pod : ctest-pod-09046688 UUID is ea7d1ab2-776b-4d83-a006-c690c029f6e4
2025-08-25 18:37:37,408 - DEBUG - Pod ctest-pod-01095287 not present
2025-08-25 18:37:37,408 - INFO - Creating Pod ctest-pod-01095287
2025-08-25 18:37:37,435 - DEBUG - Pod : ctest-pod-01095287 UUID is 9bb70f46-53d0-4901-8ed3-dfe92c34ea09
2025-08-25 18:37:37,437 - DEBUG - Pod ctest-pod-05271586 not present
2025-08-25 18:37:37,438 - INFO - Creating Pod ctest-pod-05271586
2025-08-25 18:37:37,456 - DEBUG - Pod : ctest-pod-05271586 UUID is 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c
2025-08-25 18:37:37,459 - DEBUG - Pod ctest-pod-91082164 not present
2025-08-25 18:37:37,459 - INFO - Creating Pod ctest-pod-91082164
2025-08-25 18:37:37,490 - DEBUG - Pod : ctest-pod-91082164 UUID is 6f7fad08-cee2-4ae2-9d80-fc5c5c017001
2025-08-25 18:37:37,499 - DEBUG - Pod ctest-pod-20486908 not present
2025-08-25 18:37:37,499 - INFO - Creating Pod ctest-pod-20486908
2025-08-25 18:37:37,520 - DEBUG - Pod : ctest-pod-20486908 UUID is 4067d67b-c958-4cbc-a3de-70e5eb1f46de
2025-08-25 18:37:37,762 - INFO - Project default-domain:k8s-ctest-new-default-31410727 for Namespace ctest-new-default-31410727 is seen in contrail-api
2025-08-25 18:37:37,762 - DEBUG - Project uuid in Contrail is e3be3696-aff7-4d9e-ab4a-fa57053231cf
2025-08-25 18:37:38,030 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=35cac0ef-9718-46d3-ae9d-4a49f03c8aad
2025-08-25 18:37:38,037 - INFO - Namespace ctest-new-default-31410727 with uuid 35cac0ef-9718-46d3-ae9d-4a49f03c8aad found in kube manager
2025-08-25 18:37:38,037 - INFO - Namespace ctest-new-default-31410727 verification passed
2025-08-25 18:37:38,321 - INFO - Project default-domain:k8s-ctest-non-default-08360932 for Namespace ctest-non-default-08360932 is seen in contrail-api
2025-08-25 18:37:38,321 - DEBUG - Project uuid in Contrail is 0086a179-0ba4-43c1-8de5-4d392aa75cba
2025-08-25 18:37:38,321 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=8b5769b5-1d05-4a5f-a576-7611eadf4710
2025-08-25 18:37:38,325 - INFO - Namespace ctest-non-default-08360932 with uuid 8b5769b5-1d05-4a5f-a576-7611eadf4710 found in kube manager
2025-08-25 18:37:38,326 - INFO - Namespace ctest-non-default-08360932 verification passed
2025-08-25 18:37:38,334 - DEBUG - Pod ctest-pod-24966619 not in running state.Currently in Pending
2025-08-25 18:37:43,341 - DEBUG - Pod ctest-pod-24966619 not in running state.Currently in Pending
2025-08-25 18:37:48,347 - INFO - Pod ctest-pod-24966619 is in running state.Got IP 10.47.255.251
2025-08-25 18:37:48,410 - DEBUG - Pod ctest-pod-24966619 has vmi 93f3aed2-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:48,410 - INFO - Verified pod ctest-pod-24966619 in contrail-api
2025-08-25 18:37:48,431 - DEBUG - VMI 93f3aed2-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:48,431 - INFO - Verified Pod ctest-pod-24966619 in agent 10.0.0.50
2025-08-25 18:37:48,431 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=9aedca34-372e-4a90-a6b3-38ec06157888
2025-08-25 18:37:48,437 - INFO - Pod ctest-pod-24966619 with uuid 9aedca34-372e-4a90-a6b3-38ec06157888 found in kube manager
2025-08-25 18:37:48,437 - INFO - Pod ctest-pod-24966619 verification passed
2025-08-25 18:37:48,443 - INFO - Pod ctest-pod-73664936 is in running state.Got IP 10.47.255.250
2025-08-25 18:37:48,464 - DEBUG - Pod ctest-pod-73664936 has vmi 94779314-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:48,465 - INFO - Verified pod ctest-pod-73664936 in contrail-api
2025-08-25 18:37:48,485 - DEBUG - VMI 94779314-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:48,486 - INFO - Verified Pod ctest-pod-73664936 in agent 10.0.0.50
2025-08-25 18:37:48,486 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=161d0aaa-0c85-4647-8743-4dc0ed607681
2025-08-25 18:37:48,494 - INFO - Pod ctest-pod-73664936 with uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 found in kube manager
2025-08-25 18:37:48,499 - INFO - Pod ctest-pod-73664936 verification passed
2025-08-25 18:37:48,504 - DEBUG - Pod ctest-pod-97497946 not in running state.Currently in Pending
2025-08-25 18:37:53,516 - INFO - Pod ctest-pod-97497946 is in running state.Got IP 10.47.255.249
2025-08-25 18:37:53,539 - DEBUG - Pod ctest-pod-97497946 has vmi 95415f1e-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:53,539 - INFO - Verified pod ctest-pod-97497946 in contrail-api
2025-08-25 18:37:53,554 - DEBUG - VMI 95415f1e-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:53,554 - INFO - Verified Pod ctest-pod-97497946 in agent 10.0.0.50
2025-08-25 18:37:53,554 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=4b928cb7-1ee1-4b23-998d-a222215a7885
2025-08-25 18:37:53,561 - INFO - Pod ctest-pod-97497946 with uuid 4b928cb7-1ee1-4b23-998d-a222215a7885 found in kube manager
2025-08-25 18:37:53,561 - INFO - Pod ctest-pod-97497946 verification passed
2025-08-25 18:37:53,566 - INFO - Pod ctest-pod-09046688 is in running state.Got IP 10.47.255.248
2025-08-25 18:37:53,634 - DEBUG - Pod ctest-pod-09046688 has vmi 95d32368-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:53,634 - INFO - Verified pod ctest-pod-09046688 in contrail-api
2025-08-25 18:37:53,648 - DEBUG - VMI 95d32368-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:53,649 - INFO - Verified Pod ctest-pod-09046688 in agent 10.0.0.50
2025-08-25 18:37:53,649 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=ea7d1ab2-776b-4d83-a006-c690c029f6e4
2025-08-25 18:37:53,654 - INFO - Pod ctest-pod-09046688 with uuid ea7d1ab2-776b-4d83-a006-c690c029f6e4 found in kube manager
2025-08-25 18:37:53,654 - INFO - Pod ctest-pod-09046688 verification passed
2025-08-25 18:37:53,659 - DEBUG - Pod ctest-pod-01095287 not in running state.Currently in Pending
2025-08-25 18:37:58,668 - INFO - Pod ctest-pod-01095287 is in running state.Got IP 10.47.255.247
2025-08-25 18:37:58,697 - DEBUG - Pod ctest-pod-01095287 has vmi 9686ce86-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:58,698 - INFO - Verified pod ctest-pod-01095287 in contrail-api
2025-08-25 18:37:58,718 - DEBUG - VMI 9686ce86-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:58,718 - INFO - Verified Pod ctest-pod-01095287 in agent 10.0.0.50
2025-08-25 18:37:58,719 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=9bb70f46-53d0-4901-8ed3-dfe92c34ea09
2025-08-25 18:37:58,726 - INFO - Pod ctest-pod-01095287 with uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 found in kube manager
2025-08-25 18:37:58,726 - INFO - Pod ctest-pod-01095287 verification passed
2025-08-25 18:37:58,733 - INFO - Pod ctest-pod-91082164 is in running state.Got IP 10.47.255.245
2025-08-25 18:37:58,758 - DEBUG - Pod ctest-pod-91082164 has vmi 97b0797e-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:58,758 - INFO - Verified pod ctest-pod-91082164 in contrail-api
2025-08-25 18:37:58,786 - DEBUG - VMI 97b0797e-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:58,787 - INFO - Verified Pod ctest-pod-91082164 in agent 10.0.0.50
2025-08-25 18:37:58,788 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=6f7fad08-cee2-4ae2-9d80-fc5c5c017001
2025-08-25 18:37:58,795 - INFO - Pod ctest-pod-91082164 with uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 found in kube manager
2025-08-25 18:37:58,796 - INFO - Pod ctest-pod-91082164 verification passed
2025-08-25 18:37:58,805 - INFO - Pod ctest-pod-05271586 is in running state.Got IP 10.47.255.246
2025-08-25 18:37:58,829 - DEBUG - Pod ctest-pod-05271586 has vmi 9718b9f4-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:58,829 - INFO - Verified pod ctest-pod-05271586 in contrail-api
2025-08-25 18:37:58,848 - DEBUG - VMI 9718b9f4-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:58,848 - INFO - Verified Pod ctest-pod-05271586 in agent 10.0.0.50
2025-08-25 18:37:58,848 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=3e237e4c-ecd6-4f51-9951-08ebc0e20e7c
2025-08-25 18:37:58,856 - INFO - Pod ctest-pod-05271586 with uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c found in kube manager
2025-08-25 18:37:58,856 - INFO - Pod ctest-pod-05271586 verification passed
2025-08-25 18:37:58,864 - INFO - Pod ctest-pod-20486908 is in running state.Got IP 10.47.255.244
2025-08-25 18:37:58,931 - DEBUG - Pod ctest-pod-20486908 has vmi 983bf03a-81e2-11f0-a4ad-fa163e14a160
2025-08-25 18:37:58,931 - INFO - Verified pod ctest-pod-20486908 in contrail-api
2025-08-25 18:37:58,947 - DEBUG - VMI 983bf03a-81e2-11f0-a4ad-fa163e14a160 is active in agent 10.0.0.50
2025-08-25 18:37:58,947 - INFO - Verified Pod ctest-pod-20486908 in agent 10.0.0.50
2025-08-25 18:37:58,947 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=4067d67b-c958-4cbc-a3de-70e5eb1f46de
2025-08-25 18:37:58,953 - INFO - Pod ctest-pod-20486908 with uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de found in kube manager
2025-08-25 18:37:58,953 - INFO - Pod ctest-pod-20486908 verification passed
2025-08-25 18:37:58,953 - INFO - ================================================================================
2025-08-25 18:37:58,953 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-08-25 18:37:58,954 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-08-25 18:37:59,252 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.38': '0'}} with
2025-08-25 18:37:59,253 - INFO - Initial checks done. Running the testcase now
2025-08-25 18:37:59,253 - INFO -
2025-08-25 18:37:59,316 - DEBUG - [Pod ctest-pod-24966619] Cmd: echo ctest-pod-24966619 > /usr/share/nginx/html/index.html, Output:
2025-08-25 18:37:59,375 - DEBUG - [Pod ctest-pod-73664936] Cmd: echo ctest-pod-73664936 > /usr/share/nginx/html/index.html, Output:
2025-08-25 18:37:59,435 - DEBUG - [Pod ctest-pod-97497946] Cmd: echo ctest-pod-97497946 > /usr/share/nginx/html/index.html, Output:
2025-08-25 18:37:59,492 - DEBUG - [Pod ctest-pod-09046688] Cmd: echo ctest-pod-09046688 > /usr/share/nginx/html/index.html, Output:
2025-08-25 18:37:59,495 - DEBUG - Service ctest-nginx-svc-42126920 not present
2025-08-25 18:37:59,495 - INFO - Creating service ctest-nginx-svc-42126920
2025-08-25 18:37:59,536 - INFO - Created Service ctest-nginx-svc-42126920
2025-08-25 18:37:59,585 - WARNING - Service UUID 9eaa0f78-7754-4eb5-96f7-6fb0d73e5e22 not yet found in contrail-api
2025-08-25 18:38:00,594 - INFO - Validated that Service ctest-nginx-svc-42126920 is seen in contrail-api
2025-08-25 18:38:00,594 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=9eaa0f78-7754-4eb5-96f7-6fb0d73e5e22
2025-08-25 18:38:00,600 - INFO - Service ctest-nginx-svc-42126920 with uuid 9eaa0f78-7754-4eb5-96f7-6fb0d73e5e22 found in kube manager
2025-08-25 18:38:00,601 - INFO - Service ctest-nginx-svc-42126920 verification passed
2025-08-25 18:38:01,673 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73664936
2025-08-25 18:38:01,673 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:01,673 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73664936
2025-08-25 18:38:01,739 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,739 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:01,739 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,786 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73664936
2025-08-25 18:38:01,786 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:01,786 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73664936
2025-08-25 18:38:01,847 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,847 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:01,847 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,847 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24966619': 1, 'ctest-pod-73664936': 3}
2025-08-25 18:38:01,924 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,924 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:01,924 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,979 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:01,979 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:01,980 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:02,037 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:02,037 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:38:02,037 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:38:02,037 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24966619': 1, 'ctest-pod-73664936': 2}
2025-08-25 18:38:02,040 - DEBUG - Network policy ingress-on-service not present
2025-08-25 18:38:02,040 - INFO - Creating Network Policy ingress-on-service
2025-08-25 18:38:02,086 - INFO - Network policy found in k8s
2025-08-25 18:38:02,088 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ce298352-a836-4014-9301-1d2e5b2846e0
2025-08-25 18:38:02,104 - INFO - Network Policy ingress-on-service with uuid ce298352-a836-4014-9301-1d2e5b2846e0 found in kube manager
2025-08-25 18:38:02,325 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-08-25 18:38:02,336 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-08-25 18:38:02,336 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ce298352-a836-4014-9301-1d2e5b2846e0
2025-08-25 18:38:02,385 - WARNING - Network policy with name ingress-on-service not found in agent
2025-08-25 18:38:04,388 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ce298352-a836-4014-9301-1d2e5b2846e0
2025-08-25 18:38:04,428 - INFO - Network policy with name ingress-on-service found in agent
2025-08-25 18:38:04,429 - INFO - Network Policy ingress-on-service verification passed
2025-08-25 18:38:09,487 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:09,487 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:09,487 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:11,558 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-08-25 18:38:21,618 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:21,618 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:21,618 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:26,664 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:26,664 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:26,664 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:31,728 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:31,728 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:31,729 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:36,795 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:36,796 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:36,796 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:41,848 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:41,848 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:41,848 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:46,900 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:46,901 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:46,901 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:51,952 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:51,952 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:51,952 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:57,004 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:57,004 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:38:57,004 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:02,058 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:02,058 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:02,058 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:02,058 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24966619': 0, 'ctest-pod-73664936': 0}
2025-08-25 18:39:02,120 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:39:02,120 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:39:02,120 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:39:02,173 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:39:02,173 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:39:02,173 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:39:02,173 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24966619': 1, 'ctest-pod-73664936': 1}
2025-08-25 18:39:07,236 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:07,236 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:07,236 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:12,289 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:12,289 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:12,289 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:17,338 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:17,338 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:17,338 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:22,388 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:22,388 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:22,388 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:27,440 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:27,441 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:27,441 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:32,512 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:32,512 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:32,512 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:37,562 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:37,562 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:37,562 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:42,615 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:42,615 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:42,615 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:47,669 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:47,669 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:47,669 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:52,725 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:52,725 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:52,725 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:39:52,725 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24966619': 0, 'ctest-pod-73664936': 0}
2025-08-25 18:39:54,777 - DEBUG - [Pod ctest-pod-05271586] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.892 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.061 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.061/0.347/0.892 ms
2025-08-25 18:39:54,778 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-05271586 with expectation True passed
2025-08-25 18:39:56,830 - DEBUG - [Pod ctest-pod-01095287] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.712 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.062 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.062/0.285/0.712 ms
2025-08-25 18:39:56,830 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01095287 with expectation True passed
2025-08-25 18:39:58,889 - DEBUG - [Pod ctest-pod-91082164] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.366 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.173/0.366 ms
2025-08-25 18:39:58,889 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91082164 with expectation True passed
2025-08-25 18:39:58,945 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:39:58,945 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-08-25 18:39:58,945 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:39:58,945 - INFO - wget check of of http://10.47.255.251 from ctest-pod-05271586 passed
2025-08-25 18:39:59,019 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:39:59,019 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-08-25 18:39:59,019 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:39:59,019 - INFO - wget check of of http://10.47.255.250 from ctest-pod-05271586 passed
2025-08-25 18:40:04,063 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-25 18:40:04,064 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-25 18:40:04,064 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-25 18:40:04,064 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01095287 passed
2025-08-25 18:40:09,114 - DEBUG - [Pod ctest-pod-20486908] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-08-25 18:40:09,114 - DEBUG - [Pod Pod ctest-pod-20486908] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-08-25 18:40:09,114 - DEBUG - [Pod Pod ctest-pod-20486908] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-08-25 18:40:09,115 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20486908 passed
2025-08-25 18:40:09,125 - INFO - Updating Network Policy ingress-on-service
2025-08-25 18:40:14,234 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:14,234 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:14,234 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:19,284 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:19,284 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:19,284 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:24,341 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:24,341 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:24,342 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:29,396 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:29,396 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:29,396 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:34,457 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:34,457 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:34,457 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:39,504 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:39,505 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:39,505 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:44,557 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:44,557 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:44,557 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:49,615 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:49,615 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:49,615 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:54,670 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:54,670 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:54,670 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:59,729 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:59,729 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:59,729 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
wget: download timed out
2025-08-25 18:40:59,729 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24966619': 0, 'ctest-pod-73664936': 0}
2025-08-25 18:40:59,788 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,788 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:40:59,788 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,843 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,843 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:40:59,843 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,843 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24966619': 1, 'ctest-pod-73664936': 1}
2025-08-25 18:40:59,894 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,894 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:40:59,894 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: ctest-pod-24966619
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,947 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24966619
2025-08-25 18:40:59,948 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:40:59,948 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24966619
2025-08-25 18:40:59,998 - DEBUG - [Pod ctest-pod-91082164] Cmd: wget http://10.104.128.111:80/ -O - -T 5 -t 1 , Output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,998 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd wget http://10.104.128.111:80/ -O - -T 5 -t 1 passed
2025-08-25 18:40:59,998 - DEBUG - [Pod Pod ctest-pod-91082164] Cmd output: ctest-pod-73664936
Connecting to 10.104.128.111:80 (10.104.128.111:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-25 18:40:59,998 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24966619': 2, 'ctest-pod-73664936': 1}
2025-08-25 18:41:02,052 - DEBUG - [Pod ctest-pod-05271586] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.870 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.343/0.870 ms
2025-08-25 18:41:02,052 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-05271586 with expectation True passed
2025-08-25 18:41:04,097 - DEBUG - [Pod ctest-pod-01095287] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.864 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.345/0.864 ms
2025-08-25 18:41:04,097 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01095287 with expectation True passed
2025-08-25 18:41:06,152 - DEBUG - [Pod ctest-pod-91082164] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.681 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.287/0.681 ms
2025-08-25 18:41:06,152 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91082164 with expectation True passed
2025-08-25 18:41:06,215 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:41:06,216 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-08-25 18:41:06,216 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:41:06,216 - INFO - wget check of of http://10.47.255.251 from ctest-pod-05271586 passed
2025-08-25 18:41:06,278 - DEBUG - [Pod ctest-pod-05271586] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:41:06,278 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-08-25 18:41:06,278 - DEBUG - [Pod Pod ctest-pod-05271586] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:41:06,278 - INFO - wget check of of http://10.47.255.250 from ctest-pod-05271586 passed
2025-08-25 18:41:11,323 - DEBUG - [Pod ctest-pod-01095287] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-25 18:41:11,323 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-25 18:41:11,323 - DEBUG - [Pod Pod ctest-pod-01095287] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-25 18:41:11,323 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01095287 passed
2025-08-25 18:41:11,378 - DEBUG - [Pod ctest-pod-20486908] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:41:11,378 - DEBUG - [Pod Pod ctest-pod-20486908] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-08-25 18:41:11,378 - DEBUG - [Pod Pod ctest-pod-20486908] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-25 18:41:11,378 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20486908 passed
2025-08-25 18:41:11,378 - INFO - Deleting Network Policy : ingress-on-service
2025-08-25 18:41:11,379 - INFO - Deleting service : ctest-nginx-svc-42126920
2025-08-25 18:41:11,603 - DEBUG - No XMPP flaps were noticed during the test
2025-08-25 18:41:11,603 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-08-25 18:41:11,603 - INFO - --------------------------------------------------------------------------------
2025-08-25 18:41:11,609 - INFO - Deleting pod ctest-new-default-31410727:ctest-pod-24966619
2025-08-25 18:41:11,610 - INFO - Deleting pod ctest-new-default-31410727:ctest-pod-73664936
2025-08-25 18:41:11,610 - INFO - Deleting pod ctest-non-default-08360932:ctest-pod-97497946
2025-08-25 18:41:11,611 - INFO - Deleting pod ctest-non-default-08360932:ctest-pod-09046688
2025-08-25 18:41:11,611 - INFO - Deleting pod ctest-new-default-31410727:ctest-pod-01095287
2025-08-25 18:41:11,612 - INFO - Deleting pod ctest-new-default-31410727:ctest-pod-05271586
2025-08-25 18:41:11,613 - INFO - Deleting pod ctest-non-default-08360932:ctest-pod-91082164
2025-08-25 18:41:11,614 - INFO - Deleting pod ctest-non-default-08360932:ctest-pod-20486908
2025-08-25 18:41:11,801 - WARNING - Pod uuid 9aedca34-372e-4a90-a6b3-38ec06157888 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,843 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,844 - WARNING - Pod uuid 4b928cb7-1ee1-4b23-998d-a222215a7885 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,845 - WARNING - Pod uuid ea7d1ab2-776b-4d83-a006-c690c029f6e4 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,849 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,871 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,872 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:11,874 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:16,811 - DEBUG - Pod 9aedca34-372e-4a90-a6b3-38ec06157888 is not in agent 10.0.0.50 VM list
2025-08-25 18:41:16,817 - DEBUG - VMI 93f3aed2-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:16,817 - INFO - Verified that pod ctest-pod-24966619 is removed in agent
2025-08-25 18:41:16,864 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:16,868 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:16,869 - DEBUG - Pod ea7d1ab2-776b-4d83-a006-c690c029f6e4 is not in agent 10.0.0.50 VM list
2025-08-25 18:41:16,872 - DEBUG - Pod 4b928cb7-1ee1-4b23-998d-a222215a7885 is not in agent 10.0.0.50 VM list
2025-08-25 18:41:16,897 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:16,898 - DEBUG - VMI 95415f1e-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:16,898 - INFO - Verified that pod ctest-pod-97497946 is removed in agent
2025-08-25 18:41:16,899 - DEBUG - VMI 95d32368-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:16,899 - INFO - Verified that pod ctest-pod-09046688 is removed in agent
2025-08-25 18:41:16,903 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:16,903 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:21,872 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:21,876 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:21,909 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:21,916 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:21,918 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:26,883 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:26,884 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:26,917 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:26,928 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:26,929 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:31,898 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:31,899 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:31,926 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:31,958 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:31,959 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:36,914 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:36,916 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:36,934 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:36,970 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:36,971 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:41,950 - WARNING - Pod uuid 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:41,951 - WARNING - Pod uuid 161d0aaa-0c85-4647-8743-4dc0ed607681 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:41,952 - WARNING - Pod uuid 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:41,982 - WARNING - Pod uuid 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:41,995 - WARNING - Pod uuid 4067d67b-c958-4cbc-a3de-70e5eb1f46de is still seen in agent 10.0.0.50 VM list
2025-08-25 18:41:46,965 - DEBUG - Pod 3e237e4c-ecd6-4f51-9951-08ebc0e20e7c is not in agent 10.0.0.50 VM list
2025-08-25 18:41:46,968 - DEBUG - Pod 161d0aaa-0c85-4647-8743-4dc0ed607681 is not in agent 10.0.0.50 VM list
2025-08-25 18:41:46,970 - DEBUG - Pod 6f7fad08-cee2-4ae2-9d80-fc5c5c017001 is not in agent 10.0.0.50 VM list
2025-08-25 18:41:46,979 - DEBUG - VMI 9718b9f4-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:46,980 - INFO - Verified that pod ctest-pod-05271586 is removed in agent
2025-08-25 18:41:46,982 - DEBUG - VMI 97b0797e-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:46,982 - INFO - Verified that pod ctest-pod-91082164 is removed in agent
2025-08-25 18:41:46,983 - DEBUG - VMI 94779314-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:46,983 - INFO - Verified that pod ctest-pod-73664936 is removed in agent
2025-08-25 18:41:46,991 - DEBUG - Pod 9bb70f46-53d0-4901-8ed3-dfe92c34ea09 is not in agent 10.0.0.50 VM list
2025-08-25 18:41:46,996 - DEBUG - VMI 9686ce86-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:46,996 - INFO - Verified that pod ctest-pod-01095287 is removed in agent
2025-08-25 18:41:47,016 - DEBUG - Pod 4067d67b-c958-4cbc-a3de-70e5eb1f46de is not in agent 10.0.0.50 VM list
2025-08-25 18:41:47,023 - DEBUG - VMI 983bf03a-81e2-11f0-a4ad-fa163e14a160 is removed from agent 10.0.0.50
2025-08-25 18:41:47,024 - INFO - Verified that pod ctest-pod-20486908 is removed in agent
2025-08-25 18:41:47,024 - INFO - Deleting namespace ctest-non-default-08360932
2025-08-25 18:41:47,048 - DEBUG - Namespace ctest-non-default-08360932 still in k8s
2025-08-25 18:41:49,053 - DEBUG - Namespace ctest-non-default-08360932 still in k8s
2025-08-25 18:41:51,057 - DEBUG - Namespace ctest-non-default-08360932 still in k8s
2025-08-25 18:41:53,061 - DEBUG - Namespace ctest-non-default-08360932 is not in k8s
2025-08-25 18:41:53,062 - DEBUG - No need to check project deletion in contrail-api
2025-08-25 18:41:53,062 - INFO - Deleting namespace ctest-new-default-31410727
2025-08-25 18:41:53,090 - DEBUG - Namespace ctest-new-default-31410727 still in k8s
2025-08-25 18:41:55,097 - DEBUG - Namespace ctest-new-default-31410727 still in k8s
2025-08-25 18:41:57,104 - DEBUG - Namespace ctest-new-default-31410727 still in k8s
2025-08-25 18:41:59,108 - DEBUG - Namespace ctest-new-default-31410727 is not in k8s
2025-08-25 18:41:59,108 - DEBUG - No need to check project deletion in contrail-api