2025-11-06 08:32:51,603 - INFO - Using existing project ['default-domain', 'k8s-default'](10f09ac2-1a25-475a-8d94-f8c2df08be53)
2025-11-06 08:32:51,621 - DEBUG - Namespace ctest-new-default-44261694 not present
2025-11-06 08:32:51,630 - INFO - Created namespace ctest-new-default-44261694
2025-11-06 08:32:54,634 - DEBUG - Namespace ctest-non-default-29005345 not present
2025-11-06 08:32:54,647 - INFO - Created namespace ctest-non-default-29005345
2025-11-06 08:32:57,669 - DEBUG - Pod ctest-pod-47752836 not present
2025-11-06 08:32:57,669 - INFO - Creating Pod ctest-pod-47752836
2025-11-06 08:32:57,689 - DEBUG - Node for Pod ctest-pod-47752836 not yet populated
2025-11-06 08:33:00,698 - DEBUG - Pod : ctest-pod-47752836 UUID is 0570d429-bb8d-4f6c-b903-69edbd299976
2025-11-06 08:33:00,700 - DEBUG - Pod ctest-pod-55396726 not present
2025-11-06 08:33:00,701 - INFO - Creating Pod ctest-pod-55396726
2025-11-06 08:33:00,730 - DEBUG - Pod : ctest-pod-55396726 UUID is a98128b7-5804-4ea4-856c-904e7dc09c1c
2025-11-06 08:33:00,743 - DEBUG - Pod ctest-pod-86050151 not present
2025-11-06 08:33:00,744 - INFO - Creating Pod ctest-pod-86050151
2025-11-06 08:33:00,776 - DEBUG - Pod : ctest-pod-86050151 UUID is baaf8a6a-c1c8-4c99-882a-c098e361bcda
2025-11-06 08:33:00,778 - DEBUG - Pod ctest-pod-31784612 not present
2025-11-06 08:33:00,779 - INFO - Creating Pod ctest-pod-31784612
2025-11-06 08:33:00,820 - DEBUG - Pod : ctest-pod-31784612 UUID is 63f64d8a-4275-4389-a281-7a636b04cbd1
2025-11-06 08:33:00,825 - DEBUG - Pod ctest-pod-07318601 not present
2025-11-06 08:33:00,826 - INFO - Creating Pod ctest-pod-07318601
2025-11-06 08:33:00,870 - DEBUG - Pod : ctest-pod-07318601 UUID is a83dbf3c-ca11-46b8-9af5-6d15f27db140
2025-11-06 08:33:00,888 - DEBUG - Pod ctest-pod-40129902 not present
2025-11-06 08:33:00,889 - INFO - Creating Pod ctest-pod-40129902
2025-11-06 08:33:00,920 - DEBUG - Pod : ctest-pod-40129902 UUID is 856add6e-2999-4664-9e28-3204d292de30
2025-11-06 08:33:00,926 - DEBUG - Pod ctest-pod-80573215 not present
2025-11-06 08:33:00,926 - INFO - Creating Pod ctest-pod-80573215
2025-11-06 08:33:00,963 - DEBUG - Pod : ctest-pod-80573215 UUID is 96069c7c-6c28-40ef-8936-c6dde4ca7d2a
2025-11-06 08:33:00,966 - DEBUG - Pod ctest-pod-57768320 not present
2025-11-06 08:33:00,967 - INFO - Creating Pod ctest-pod-57768320
2025-11-06 08:33:00,992 - DEBUG - Pod : ctest-pod-57768320 UUID is 71a73953-f3ac-4f62-a849-3eb94605be3b
2025-11-06 08:33:01,194 - INFO - Project default-domain:k8s-ctest-new-default-44261694 for Namespace ctest-new-default-44261694 is seen in contrail-api
2025-11-06 08:33:01,195 - DEBUG - Project uuid in Contrail is 114c0af2-1583-432e-9b9d-efb6ba1c657a
2025-11-06 08:33:01,371 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=c1431152-0495-4413-b96e-58b4f7faf2e5
2025-11-06 08:33:01,376 - INFO - Namespace ctest-new-default-44261694 with uuid c1431152-0495-4413-b96e-58b4f7faf2e5 found in kube manager
2025-11-06 08:33:01,376 - INFO - Namespace ctest-new-default-44261694 verification passed
2025-11-06 08:33:01,576 - INFO - Project default-domain:k8s-ctest-non-default-29005345 for Namespace ctest-non-default-29005345 is seen in contrail-api
2025-11-06 08:33:01,576 - DEBUG - Project uuid in Contrail is 2f1b023d-cb3f-48eb-86a1-cd78aab4a3ce
2025-11-06 08:33:01,576 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=148d4b30-813a-409a-bce2-4f522577775f
2025-11-06 08:33:01,580 - INFO - Namespace ctest-non-default-29005345 with uuid 148d4b30-813a-409a-bce2-4f522577775f found in kube manager
2025-11-06 08:33:01,580 - INFO - Namespace ctest-non-default-29005345 verification passed
2025-11-06 08:33:01,589 - DEBUG - Pod ctest-pod-47752836 not in running state.Currently in Pending
2025-11-06 08:33:06,603 - DEBUG - Pod ctest-pod-47752836 not in running state.Currently in Pending
2025-11-06 08:33:11,611 - DEBUG - Pod ctest-pod-47752836 not in running state.Currently in Pending
2025-11-06 08:33:16,619 - INFO - Pod ctest-pod-47752836 is in running state.Got IP 10.47.255.251
2025-11-06 08:33:16,638 - DEBUG - Pod ctest-pod-47752836 has vmi 337dd874-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:16,638 - INFO - Verified pod ctest-pod-47752836 in contrail-api
2025-11-06 08:33:16,653 - DEBUG - VMI 337dd874-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:16,654 - INFO - Verified Pod ctest-pod-47752836 in agent 10.0.0.249
2025-11-06 08:33:16,654 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=0570d429-bb8d-4f6c-b903-69edbd299976
2025-11-06 08:33:16,658 - INFO - Pod ctest-pod-47752836 with uuid 0570d429-bb8d-4f6c-b903-69edbd299976 found in kube manager
2025-11-06 08:33:16,659 - INFO - Pod ctest-pod-47752836 verification passed
2025-11-06 08:33:16,666 - INFO - Pod ctest-pod-55396726 is in running state.Got IP 10.47.255.250
2025-11-06 08:33:16,720 - DEBUG - Pod ctest-pod-55396726 has vmi 347c8d92-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:16,720 - INFO - Verified pod ctest-pod-55396726 in contrail-api
2025-11-06 08:33:16,738 - DEBUG - VMI 347c8d92-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:16,739 - INFO - Verified Pod ctest-pod-55396726 in agent 10.0.0.249
2025-11-06 08:33:16,739 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=a98128b7-5804-4ea4-856c-904e7dc09c1c
2025-11-06 08:33:16,744 - INFO - Pod ctest-pod-55396726 with uuid a98128b7-5804-4ea4-856c-904e7dc09c1c found in kube manager
2025-11-06 08:33:16,745 - INFO - Pod ctest-pod-55396726 verification passed
2025-11-06 08:33:16,752 - INFO - Pod ctest-pod-86050151 is in running state.Got IP 10.47.255.249
2025-11-06 08:33:16,766 - DEBUG - Pod ctest-pod-86050151 has vmi 3534eae0-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:16,766 - INFO - Verified pod ctest-pod-86050151 in contrail-api
2025-11-06 08:33:16,780 - DEBUG - VMI 3534eae0-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:16,780 - INFO - Verified Pod ctest-pod-86050151 in agent 10.0.0.249
2025-11-06 08:33:16,780 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=baaf8a6a-c1c8-4c99-882a-c098e361bcda
2025-11-06 08:33:16,785 - INFO - Pod ctest-pod-86050151 with uuid baaf8a6a-c1c8-4c99-882a-c098e361bcda found in kube manager
2025-11-06 08:33:16,785 - INFO - Pod ctest-pod-86050151 verification passed
2025-11-06 08:33:16,792 - INFO - Pod ctest-pod-31784612 is in running state.Got IP 10.47.255.248
2025-11-06 08:33:16,849 - DEBUG - Pod ctest-pod-31784612 has vmi 35b5d308-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:16,849 - INFO - Verified pod ctest-pod-31784612 in contrail-api
2025-11-06 08:33:16,861 - DEBUG - VMI 35b5d308-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:16,862 - INFO - Verified Pod ctest-pod-31784612 in agent 10.0.0.249
2025-11-06 08:33:16,862 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=63f64d8a-4275-4389-a281-7a636b04cbd1
2025-11-06 08:33:16,867 - INFO - Pod ctest-pod-31784612 with uuid 63f64d8a-4275-4389-a281-7a636b04cbd1 found in kube manager
2025-11-06 08:33:16,868 - INFO - Pod ctest-pod-31784612 verification passed
2025-11-06 08:33:16,874 - INFO - Pod ctest-pod-07318601 is in running state.Got IP 10.47.255.247
2025-11-06 08:33:16,944 - DEBUG - Pod ctest-pod-07318601 has vmi 3640c24c-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:16,944 - INFO - Verified pod ctest-pod-07318601 in contrail-api
2025-11-06 08:33:16,958 - DEBUG - VMI 3640c24c-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:16,959 - INFO - Verified Pod ctest-pod-07318601 in agent 10.0.0.249
2025-11-06 08:33:16,959 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=a83dbf3c-ca11-46b8-9af5-6d15f27db140
2025-11-06 08:33:16,965 - INFO - Pod ctest-pod-07318601 with uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 found in kube manager
2025-11-06 08:33:16,965 - INFO - Pod ctest-pod-07318601 verification passed
2025-11-06 08:33:16,973 - INFO - Pod ctest-pod-80573215 is in running state.Got IP 10.47.255.245
2025-11-06 08:33:16,987 - DEBUG - Pod ctest-pod-80573215 has vmi 37435a9c-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:16,987 - INFO - Verified pod ctest-pod-80573215 in contrail-api
2025-11-06 08:33:17,004 - DEBUG - VMI 37435a9c-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:17,004 - INFO - Verified Pod ctest-pod-80573215 in agent 10.0.0.249
2025-11-06 08:33:17,004 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=96069c7c-6c28-40ef-8936-c6dde4ca7d2a
2025-11-06 08:33:17,008 - INFO - Pod ctest-pod-80573215 with uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a found in kube manager
2025-11-06 08:33:17,008 - INFO - Pod ctest-pod-80573215 verification passed
2025-11-06 08:33:17,016 - INFO - Pod ctest-pod-40129902 is in running state.Got IP 10.47.255.246
2025-11-06 08:33:17,072 - DEBUG - Pod ctest-pod-40129902 has vmi 36c0b948-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:17,072 - INFO - Verified pod ctest-pod-40129902 in contrail-api
2025-11-06 08:33:17,084 - DEBUG - VMI 36c0b948-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:17,084 - INFO - Verified Pod ctest-pod-40129902 in agent 10.0.0.249
2025-11-06 08:33:17,084 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=856add6e-2999-4664-9e28-3204d292de30
2025-11-06 08:33:17,088 - INFO - Pod ctest-pod-40129902 with uuid 856add6e-2999-4664-9e28-3204d292de30 found in kube manager
2025-11-06 08:33:17,089 - INFO - Pod ctest-pod-40129902 verification passed
2025-11-06 08:33:17,095 - INFO - Pod ctest-pod-57768320 is in running state.Got IP 10.47.255.244
2025-11-06 08:33:17,152 - DEBUG - Pod ctest-pod-57768320 has vmi 37c1a712-baeb-11f0-a654-fa163ef57e0e
2025-11-06 08:33:17,152 - INFO - Verified pod ctest-pod-57768320 in contrail-api
2025-11-06 08:33:17,166 - DEBUG - VMI 37c1a712-baeb-11f0-a654-fa163ef57e0e is active in agent 10.0.0.249
2025-11-06 08:33:17,167 - INFO - Verified Pod ctest-pod-57768320 in agent 10.0.0.249
2025-11-06 08:33:17,167 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=71a73953-f3ac-4f62-a849-3eb94605be3b
2025-11-06 08:33:17,172 - INFO - Pod ctest-pod-57768320 with uuid 71a73953-f3ac-4f62-a849-3eb94605be3b found in kube manager
2025-11-06 08:33:17,172 - INFO - Pod ctest-pod-57768320 verification passed
2025-11-06 08:33:17,172 - INFO - ================================================================================
2025-11-06 08:33:17,172 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-11-06 08:33:17,172 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-11-06 08:33:17,442 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.0.0.50': '0'}} with
2025-11-06 08:33:17,442 - INFO - Initial checks done. Running the testcase now
2025-11-06 08:33:17,442 - INFO -
2025-11-06 08:33:17,508 - DEBUG - [Pod ctest-pod-47752836] Cmd: echo ctest-pod-47752836 > /usr/share/nginx/html/index.html, Output:
2025-11-06 08:33:17,658 - DEBUG - [Pod ctest-pod-55396726] Cmd: echo ctest-pod-55396726 > /usr/share/nginx/html/index.html, Output:
2025-11-06 08:33:17,721 - DEBUG - [Pod ctest-pod-86050151] Cmd: echo ctest-pod-86050151 > /usr/share/nginx/html/index.html, Output:
2025-11-06 08:33:17,830 - DEBUG - [Pod ctest-pod-31784612] Cmd: echo ctest-pod-31784612 > /usr/share/nginx/html/index.html, Output:
2025-11-06 08:33:17,833 - DEBUG - Service ctest-nginx-svc-82905781 not present
2025-11-06 08:33:17,834 - INFO - Creating service ctest-nginx-svc-82905781
2025-11-06 08:33:17,858 - INFO - Created Service ctest-nginx-svc-82905781
2025-11-06 08:33:17,872 - WARNING - Service UUID 65ba2300-119e-460e-9e2c-9a5ce67d21b2 not yet found in contrail-api
2025-11-06 08:33:18,886 - INFO - Validated that Service ctest-nginx-svc-82905781 is seen in contrail-api
2025-11-06 08:33:18,886 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=65ba2300-119e-460e-9e2c-9a5ce67d21b2
2025-11-06 08:33:18,893 - INFO - Service ctest-nginx-svc-82905781 with uuid 65ba2300-119e-460e-9e2c-9a5ce67d21b2 found in kube manager
2025-11-06 08:33:18,893 - INFO - Service ctest-nginx-svc-82905781 verification passed
2025-11-06 08:33:19,967 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
ctest-pod-55396726
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:33:19,967 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:33:19,968 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
ctest-pod-55396726
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:33:20,033 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-47752836
2025-11-06 08:33:20,033 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:33:20,033 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-47752836
2025-11-06 08:33:20,033 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47752836': 1, 'ctest-pod-55396726': 1}
2025-11-06 08:33:20,093 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:33:20,093 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:33:20,093 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:33:20,155 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
ctest-pod-47752836
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:33:20,156 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:33:20,156 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
ctest-pod-47752836
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:33:20,156 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47752836': 1, 'ctest-pod-55396726': 1}
2025-11-06 08:33:20,160 - DEBUG - Network policy ingress-on-service not present
2025-11-06 08:33:20,161 - INFO - Creating Network Policy ingress-on-service
2025-11-06 08:33:20,176 - INFO - Network policy found in k8s
2025-11-06 08:33:20,176 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6f26b0eb-089d-4da9-b5cb-b7e0df922fdf
2025-11-06 08:33:20,187 - INFO - Network Policy ingress-on-service with uuid 6f26b0eb-089d-4da9-b5cb-b7e0df922fdf found in kube manager
2025-11-06 08:33:20,225 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-11-06 08:33:20,226 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-11-06 08:33:20,226 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6f26b0eb-089d-4da9-b5cb-b7e0df922fdf
2025-11-06 08:33:20,262 - WARNING - Network policy with name ingress-on-service not found in agent
2025-11-06 08:33:22,263 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6f26b0eb-089d-4da9-b5cb-b7e0df922fdf
2025-11-06 08:33:22,298 - INFO - Network policy with name ingress-on-service found in agent
2025-11-06 08:33:22,299 - INFO - Network Policy ingress-on-service verification passed
2025-11-06 08:33:27,351 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:27,351 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:27,352 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:32,410 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:32,410 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:32,410 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:37,474 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:37,474 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:37,474 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:42,523 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:42,523 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:42,524 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:47,573 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:47,573 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:47,573 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:52,635 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:52,635 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:52,635 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:57,690 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:57,690 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:33:57,690 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:02,742 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:02,742 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:02,742 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:07,821 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:07,821 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:07,821 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:12,870 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:12,870 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:12,870 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:12,870 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-47752836': 0, 'ctest-pod-55396726': 0}
2025-11-06 08:34:12,951 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:12,951 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:34:12,951 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,009 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
ctest-pod-47752836
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,009 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:34:13,009 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
ctest-pod-47752836
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,064 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,064 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:34:13,065 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,113 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,114 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:34:13,114 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:34:13,114 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47752836': 3, 'ctest-pod-55396726': 1}
2025-11-06 08:34:18,170 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:18,170 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:18,170 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:23,222 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:23,222 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:23,222 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:28,277 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:28,278 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:28,278 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:33,331 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:33,331 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:33,331 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:38,398 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:38,398 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:38,398 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:43,454 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:43,454 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:43,454 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:48,511 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:48,511 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:48,511 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:53,563 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:53,563 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:53,563 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:58,621 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:58,621 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:34:58,621 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:03,677 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:03,677 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:03,677 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:03,677 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-47752836': 0, 'ctest-pod-55396726': 0}
2025-11-06 08:35:05,741 - DEBUG - [Pod ctest-pod-40129902] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.549 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.593 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.095/0.745/1.549 ms
2025-11-06 08:35:05,741 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-40129902 with expectation True passed
2025-11-06 08:35:07,791 - DEBUG - [Pod ctest-pod-07318601] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.413 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.522/1.413 ms
2025-11-06 08:35:07,791 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07318601 with expectation True passed
2025-11-06 08:35:08,019 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-11-06 08:35:15,083 - DEBUG - [Pod ctest-pod-80573215] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.882 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.352/0.882 ms
2025-11-06 08:35:15,083 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80573215 with expectation True passed
2025-11-06 08:35:15,145 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:35:15,145 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-11-06 08:35:15,145 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:35:15,145 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40129902 passed
2025-11-06 08:35:15,204 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:35:15,204 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-11-06 08:35:15,204 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:35:15,204 - INFO - wget check of of http://10.47.255.250 from ctest-pod-40129902 passed
2025-11-06 08:35:20,255 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-06 08:35:20,255 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-06 08:35:20,255 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-06 08:35:20,255 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07318601 passed
2025-11-06 08:35:25,317 - DEBUG - [Pod ctest-pod-57768320] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-11-06 08:35:25,317 - DEBUG - [Pod Pod ctest-pod-57768320] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-11-06 08:35:25,317 - DEBUG - [Pod Pod ctest-pod-57768320] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-11-06 08:35:25,317 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57768320 passed
2025-11-06 08:35:25,326 - INFO - Updating Network Policy ingress-on-service
2025-11-06 08:35:30,396 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:30,396 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:30,396 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:35,450 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:35,450 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:35,450 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:40,512 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:40,512 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:40,512 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:45,581 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:45,581 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:45,581 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:50,639 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:50,639 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:50,639 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:55,694 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:55,694 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:35:55,694 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:00,746 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:00,746 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:00,746 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:05,797 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:05,798 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:05,798 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:10,854 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:10,855 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:10,855 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:15,923 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:15,923 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:15,923 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.111.149.89:80 (10.111.149.89:80)
wget: download timed out
2025-11-06 08:36:15,924 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-47752836': 0, 'ctest-pod-55396726': 0}
2025-11-06 08:36:15,990 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:15,990 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:36:15,990 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,050 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,050 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:36:16,050 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,050 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47752836': 1, 'ctest-pod-55396726': 1}
2025-11-06 08:36:16,103 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,103 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:36:16,103 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: ctest-pod-47752836
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,160 - DEBUG - [Pod ctest-pod-80573215] Cmd: wget http://10.111.149.89:80/ -O - -T 5 -t 1 , Output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,160 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd wget http://10.111.149.89:80/ -O - -T 5 -t 1 passed
2025-11-06 08:36:16,160 - DEBUG - [Pod Pod ctest-pod-80573215] Cmd output: ctest-pod-55396726
Connecting to 10.111.149.89:80 (10.111.149.89:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-06 08:36:16,160 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-47752836': 1, 'ctest-pod-55396726': 1}
2025-11-06 08:36:18,215 - DEBUG - [Pod ctest-pod-40129902] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.714 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.135 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.306/0.714 ms
2025-11-06 08:36:18,215 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-40129902 with expectation True passed
2025-11-06 08:36:20,275 - DEBUG - [Pod ctest-pod-07318601] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.149 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.125 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.452/1.149 ms
2025-11-06 08:36:20,275 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07318601 with expectation True passed
2025-11-06 08:36:22,335 - DEBUG - [Pod ctest-pod-80573215] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.115 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.422/1.115 ms
2025-11-06 08:36:22,335 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80573215 with expectation True passed
2025-11-06 08:36:22,393 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:36:22,393 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-11-06 08:36:22,393 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:36:22,393 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40129902 passed
2025-11-06 08:36:22,450 - DEBUG - [Pod ctest-pod-40129902] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:36:22,451 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-11-06 08:36:22,451 - DEBUG - [Pod Pod ctest-pod-40129902] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:36:22,451 - INFO - wget check of of http://10.47.255.250 from ctest-pod-40129902 passed
2025-11-06 08:36:27,511 - DEBUG - [Pod ctest-pod-07318601] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-06 08:36:27,511 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-06 08:36:27,511 - DEBUG - [Pod Pod ctest-pod-07318601] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-06 08:36:27,511 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07318601 passed
2025-11-06 08:36:27,578 - DEBUG - [Pod ctest-pod-57768320] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:36:27,578 - DEBUG - [Pod Pod ctest-pod-57768320] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-11-06 08:36:27,578 - DEBUG - [Pod Pod ctest-pod-57768320] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-06 08:36:27,578 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57768320 passed
2025-11-06 08:36:27,578 - INFO - Deleting Network Policy : ingress-on-service
2025-11-06 08:36:27,579 - INFO - Deleting service : ctest-nginx-svc-82905781
2025-11-06 08:36:27,814 - DEBUG - No XMPP flaps were noticed during the test
2025-11-06 08:36:27,814 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-11-06 08:36:27,814 - INFO - --------------------------------------------------------------------------------
2025-11-06 08:36:27,818 - INFO - Deleting pod ctest-new-default-44261694:ctest-pod-47752836
2025-11-06 08:36:27,819 - INFO - Deleting pod ctest-new-default-44261694:ctest-pod-55396726
2025-11-06 08:36:27,819 - INFO - Deleting pod ctest-non-default-29005345:ctest-pod-86050151
2025-11-06 08:36:27,820 - INFO - Deleting pod ctest-non-default-29005345:ctest-pod-31784612
2025-11-06 08:36:27,820 - INFO - Deleting pod ctest-new-default-44261694:ctest-pod-07318601
2025-11-06 08:36:27,820 - INFO - Deleting pod ctest-new-default-44261694:ctest-pod-40129902
2025-11-06 08:36:27,821 - INFO - Deleting pod ctest-non-default-29005345:ctest-pod-80573215
2025-11-06 08:36:27,821 - INFO - Deleting pod ctest-non-default-29005345:ctest-pod-57768320
2025-11-06 08:36:27,920 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,920 - WARNING - Pod uuid 0570d429-bb8d-4f6c-b903-69edbd299976 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,922 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,987 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,988 - WARNING - Pod uuid baaf8a6a-c1c8-4c99-882a-c098e361bcda is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,988 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,989 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:27,989 - WARNING - Pod uuid 63f64d8a-4275-4389-a281-7a636b04cbd1 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:32,936 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:32,938 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:32,938 - DEBUG - Pod 0570d429-bb8d-4f6c-b903-69edbd299976 is not in agent 10.0.0.249 VM list
2025-11-06 08:36:32,946 - DEBUG - VMI 337dd874-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:36:32,946 - INFO - Verified that pod ctest-pod-47752836 is removed in agent
2025-11-06 08:36:33,011 - DEBUG - Pod baaf8a6a-c1c8-4c99-882a-c098e361bcda is not in agent 10.0.0.249 VM list
2025-11-06 08:36:33,013 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:33,013 - DEBUG - Pod 63f64d8a-4275-4389-a281-7a636b04cbd1 is not in agent 10.0.0.249 VM list
2025-11-06 08:36:33,016 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:33,016 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:33,024 - DEBUG - VMI 3534eae0-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:36:33,024 - INFO - Verified that pod ctest-pod-86050151 is removed in agent
2025-11-06 08:36:33,026 - DEBUG - VMI 35b5d308-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:36:33,026 - INFO - Verified that pod ctest-pod-31784612 is removed in agent
2025-11-06 08:36:37,948 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:37,949 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:38,028 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:38,030 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:38,030 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:42,961 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:42,962 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:43,046 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:43,048 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:43,048 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:47,972 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:47,973 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:48,061 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:48,062 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:48,063 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:52,982 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:52,983 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:53,077 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:53,079 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:53,080 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:57,992 - WARNING - Pod uuid 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:57,993 - WARNING - Pod uuid 856add6e-2999-4664-9e28-3204d292de30 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:58,089 - WARNING - Pod uuid 71a73953-f3ac-4f62-a849-3eb94605be3b is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:58,091 - WARNING - Pod uuid a83dbf3c-ca11-46b8-9af5-6d15f27db140 is still seen in agent 10.0.0.249 VM list
2025-11-06 08:36:58,091 - WARNING - Pod uuid a98128b7-5804-4ea4-856c-904e7dc09c1c is still seen in agent 10.0.0.249 VM list
2025-11-06 08:37:03,005 - DEBUG - Pod 856add6e-2999-4664-9e28-3204d292de30 is not in agent 10.0.0.249 VM list
2025-11-06 08:37:03,007 - DEBUG - Pod 96069c7c-6c28-40ef-8936-c6dde4ca7d2a is not in agent 10.0.0.249 VM list
2025-11-06 08:37:03,017 - DEBUG - VMI 36c0b948-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:37:03,017 - INFO - Verified that pod ctest-pod-40129902 is removed in agent
2025-11-06 08:37:03,018 - DEBUG - VMI 37435a9c-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:37:03,018 - INFO - Verified that pod ctest-pod-80573215 is removed in agent
2025-11-06 08:37:03,105 - DEBUG - Pod 71a73953-f3ac-4f62-a849-3eb94605be3b is not in agent 10.0.0.249 VM list
2025-11-06 08:37:03,108 - DEBUG - Pod a98128b7-5804-4ea4-856c-904e7dc09c1c is not in agent 10.0.0.249 VM list
2025-11-06 08:37:03,110 - DEBUG - Pod a83dbf3c-ca11-46b8-9af5-6d15f27db140 is not in agent 10.0.0.249 VM list
2025-11-06 08:37:03,119 - DEBUG - VMI 37c1a712-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:37:03,119 - INFO - Verified that pod ctest-pod-57768320 is removed in agent
2025-11-06 08:37:03,121 - DEBUG - VMI 347c8d92-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:37:03,121 - INFO - Verified that pod ctest-pod-55396726 is removed in agent
2025-11-06 08:37:03,121 - DEBUG - VMI 3640c24c-baeb-11f0-a654-fa163ef57e0e is removed from agent 10.0.0.249
2025-11-06 08:37:03,121 - INFO - Verified that pod ctest-pod-07318601 is removed in agent
2025-11-06 08:37:03,121 - INFO - Deleting namespace ctest-non-default-29005345
2025-11-06 08:37:03,146 - DEBUG - Namespace ctest-non-default-29005345 still in k8s
2025-11-06 08:37:05,152 - DEBUG - Namespace ctest-non-default-29005345 still in k8s
2025-11-06 08:37:07,164 - DEBUG - Namespace ctest-non-default-29005345 still in k8s
2025-11-06 08:37:09,171 - DEBUG - Namespace ctest-non-default-29005345 is not in k8s
2025-11-06 08:37:09,172 - DEBUG - No need to check project deletion in contrail-api
2025-11-06 08:37:09,172 - INFO - Deleting namespace ctest-new-default-44261694
2025-11-06 08:37:09,190 - DEBUG - Namespace ctest-new-default-44261694 still in k8s
2025-11-06 08:37:11,196 - DEBUG - Namespace ctest-new-default-44261694 still in k8s
2025-11-06 08:37:13,202 - DEBUG - Namespace ctest-new-default-44261694 still in k8s
2025-11-06 08:37:15,206 - DEBUG - Namespace ctest-new-default-44261694 is not in k8s
2025-11-06 08:37:15,206 - DEBUG - No need to check project deletion in contrail-api