2025-04-03 02:05:55,817 - INFO - Using existing project ['default-domain', 'k8s-default'](f0be8183-413b-407f-bdd1-d09594d031ee)
2025-04-03 02:05:55,843 - DEBUG - Namespace ctest-new-default-03490515 not present
2025-04-03 02:05:55,850 - INFO - Created namespace ctest-new-default-03490515
2025-04-03 02:05:58,854 - DEBUG - Namespace ctest-non-default-14705179 not present
2025-04-03 02:05:58,860 - INFO - Created namespace ctest-non-default-14705179
2025-04-03 02:06:01,885 - DEBUG - Pod ctest-pod-16584521 not present
2025-04-03 02:06:01,886 - INFO - Creating Pod ctest-pod-16584521
2025-04-03 02:06:01,912 - DEBUG - Pod : ctest-pod-16584521 UUID is c9f70e02-61de-4cd2-87bd-4921a9345c64
2025-04-03 02:06:01,918 - DEBUG - Pod ctest-pod-35428807 not present
2025-04-03 02:06:01,919 - INFO - Creating Pod ctest-pod-35428807
2025-04-03 02:06:01,958 - DEBUG - Pod : ctest-pod-35428807 UUID is 690e44f5-06e5-452c-85fe-89e5cce7c94a
2025-04-03 02:06:01,961 - DEBUG - Pod ctest-pod-72985884 not present
2025-04-03 02:06:01,961 - INFO - Creating Pod ctest-pod-72985884
2025-04-03 02:06:02,011 - DEBUG - Pod : ctest-pod-72985884 UUID is 2d5e1ef1-0c40-4cd5-b747-51f7534051aa
2025-04-03 02:06:02,013 - DEBUG - Pod ctest-pod-61759158 not present
2025-04-03 02:06:02,013 - INFO - Creating Pod ctest-pod-61759158
2025-04-03 02:06:02,039 - DEBUG - Pod : ctest-pod-61759158 UUID is c19472e0-4c43-4838-a941-3f13bb2433b6
2025-04-03 02:06:02,042 - DEBUG - Pod ctest-pod-98682198 not present
2025-04-03 02:06:02,042 - INFO - Creating Pod ctest-pod-98682198
2025-04-03 02:06:02,067 - DEBUG - Pod : ctest-pod-98682198 UUID is 3912c22c-1098-4c46-888f-8c00395c24c6
2025-04-03 02:06:02,070 - DEBUG - Pod ctest-pod-83290661 not present
2025-04-03 02:06:02,070 - INFO - Creating Pod ctest-pod-83290661
2025-04-03 02:06:02,094 - DEBUG - Pod : ctest-pod-83290661 UUID is 346dd549-7753-4656-bee1-ddf87551e8a2
2025-04-03 02:06:02,097 - DEBUG - Pod ctest-pod-29381192 not present
2025-04-03 02:06:02,097 - INFO - Creating Pod ctest-pod-29381192
2025-04-03 02:06:02,136 - DEBUG - Pod : ctest-pod-29381192 UUID is 20e7ef52-d893-47a8-a959-ff37a6e9d9ae
2025-04-03 02:06:02,140 - DEBUG - Pod ctest-pod-25967645 not present
2025-04-03 02:06:02,140 - INFO - Creating Pod ctest-pod-25967645
2025-04-03 02:06:02,173 - DEBUG - Pod : ctest-pod-25967645 UUID is 09d24839-720f-4601-a16e-aa78831d5f0b
2025-04-03 02:06:02,398 - INFO - Project default-domain:k8s-ctest-new-default-03490515 for Namespace ctest-new-default-03490515 is seen in contrail-api
2025-04-03 02:06:02,398 - DEBUG - Project uuid in Contrail is 0f426010-153d-4dd8-ad84-19da68a1d790
2025-04-03 02:06:02,562 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_NamespaceDatabaseList?namespace_uuid=3bc5519b-9706-43e7-85b1-7b261df4db6b
2025-04-03 02:06:02,566 - INFO - Namespace ctest-new-default-03490515 with uuid 3bc5519b-9706-43e7-85b1-7b261df4db6b found in kube manager
2025-04-03 02:06:02,566 - INFO - Namespace ctest-new-default-03490515 verification passed
2025-04-03 02:06:02,802 - INFO - Project default-domain:k8s-ctest-non-default-14705179 for Namespace ctest-non-default-14705179 is seen in contrail-api
2025-04-03 02:06:02,802 - DEBUG - Project uuid in Contrail is ca0497d4-2585-4227-901d-5e4cd9b0593b
2025-04-03 02:06:02,802 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_NamespaceDatabaseList?namespace_uuid=3852cbd1-3151-493c-8ab2-2b32c6f06720
2025-04-03 02:06:02,807 - INFO - Namespace ctest-non-default-14705179 with uuid 3852cbd1-3151-493c-8ab2-2b32c6f06720 found in kube manager
2025-04-03 02:06:02,807 - INFO - Namespace ctest-non-default-14705179 verification passed
2025-04-03 02:06:02,812 - DEBUG - Pod ctest-pod-16584521 not in running state.Currently in Pending
2025-04-03 02:06:07,820 - DEBUG - Pod ctest-pod-16584521 not in running state.Currently in Pending
2025-04-03 02:06:12,826 - INFO - Pod ctest-pod-16584521 is in running state.Got IP 10.47.255.251
2025-04-03 02:06:12,890 - DEBUG - Pod ctest-pod-16584521 has vmi 326675e2-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:12,891 - INFO - Verified pod ctest-pod-16584521 in contrail-api
2025-04-03 02:06:12,909 - DEBUG - VMI 326675e2-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:12,910 - INFO - Verified Pod ctest-pod-16584521 in agent 10.0.0.31
2025-04-03 02:06:12,910 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=c9f70e02-61de-4cd2-87bd-4921a9345c64
2025-04-03 02:06:12,914 - INFO - Pod ctest-pod-16584521 with uuid c9f70e02-61de-4cd2-87bd-4921a9345c64 found in kube manager
2025-04-03 02:06:12,915 - INFO - Pod ctest-pod-16584521 verification passed
2025-04-03 02:06:12,920 - INFO - Pod ctest-pod-35428807 is in running state.Got IP 10.47.255.250
2025-04-03 02:06:12,946 - DEBUG - Pod ctest-pod-35428807 has vmi 32e3468a-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:12,946 - INFO - Verified pod ctest-pod-35428807 in contrail-api
2025-04-03 02:06:12,961 - DEBUG - VMI 32e3468a-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:12,961 - INFO - Verified Pod ctest-pod-35428807 in agent 10.0.0.31
2025-04-03 02:06:12,961 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=690e44f5-06e5-452c-85fe-89e5cce7c94a
2025-04-03 02:06:12,966 - INFO - Pod ctest-pod-35428807 with uuid 690e44f5-06e5-452c-85fe-89e5cce7c94a found in kube manager
2025-04-03 02:06:12,966 - INFO - Pod ctest-pod-35428807 verification passed
2025-04-03 02:06:12,974 - DEBUG - Pod ctest-pod-72985884 not in running state.Currently in Pending
2025-04-03 02:06:17,981 - INFO - Pod ctest-pod-72985884 is in running state.Got IP 10.47.255.249
2025-04-03 02:06:18,038 - DEBUG - Pod ctest-pod-72985884 has vmi 3387f450-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:18,039 - INFO - Verified pod ctest-pod-72985884 in contrail-api
2025-04-03 02:06:18,054 - DEBUG - VMI 3387f450-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:18,054 - INFO - Verified Pod ctest-pod-72985884 in agent 10.0.0.31
2025-04-03 02:06:18,054 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=2d5e1ef1-0c40-4cd5-b747-51f7534051aa
2025-04-03 02:06:18,059 - INFO - Pod ctest-pod-72985884 with uuid 2d5e1ef1-0c40-4cd5-b747-51f7534051aa found in kube manager
2025-04-03 02:06:18,060 - INFO - Pod ctest-pod-72985884 verification passed
2025-04-03 02:06:18,067 - INFO - Pod ctest-pod-61759158 is in running state.Got IP 10.47.255.248
2025-04-03 02:06:18,082 - DEBUG - Pod ctest-pod-61759158 has vmi 34079322-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:18,082 - INFO - Verified pod ctest-pod-61759158 in contrail-api
2025-04-03 02:06:18,108 - DEBUG - VMI 34079322-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:18,108 - INFO - Verified Pod ctest-pod-61759158 in agent 10.0.0.31
2025-04-03 02:06:18,109 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=c19472e0-4c43-4838-a941-3f13bb2433b6
2025-04-03 02:06:18,113 - INFO - Pod ctest-pod-61759158 with uuid c19472e0-4c43-4838-a941-3f13bb2433b6 found in kube manager
2025-04-03 02:06:18,114 - INFO - Pod ctest-pod-61759158 verification passed
2025-04-03 02:06:18,119 - DEBUG - Pod ctest-pod-98682198 not in running state.Currently in Pending
2025-04-03 02:06:23,126 - INFO - Pod ctest-pod-98682198 is in running state.Got IP 10.47.255.247
2025-04-03 02:06:23,182 - DEBUG - Pod ctest-pod-98682198 has vmi 3499bcb6-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:23,183 - INFO - Verified pod ctest-pod-98682198 in contrail-api
2025-04-03 02:06:23,200 - DEBUG - VMI 3499bcb6-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:23,200 - INFO - Verified Pod ctest-pod-98682198 in agent 10.0.0.31
2025-04-03 02:06:23,200 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=3912c22c-1098-4c46-888f-8c00395c24c6
2025-04-03 02:06:23,205 - INFO - Pod ctest-pod-98682198 with uuid 3912c22c-1098-4c46-888f-8c00395c24c6 found in kube manager
2025-04-03 02:06:23,205 - INFO - Pod ctest-pod-98682198 verification passed
2025-04-03 02:06:23,280 - INFO - Pod ctest-pod-29381192 is in running state.Got IP 10.47.255.245
2025-04-03 02:06:23,295 - DEBUG - Pod ctest-pod-29381192 has vmi 3595ef22-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:23,295 - INFO - Verified pod ctest-pod-29381192 in contrail-api
2025-04-03 02:06:23,312 - DEBUG - VMI 3595ef22-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:23,312 - INFO - Verified Pod ctest-pod-29381192 in agent 10.0.0.31
2025-04-03 02:06:23,312 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=20e7ef52-d893-47a8-a959-ff37a6e9d9ae
2025-04-03 02:06:23,316 - INFO - Pod ctest-pod-29381192 with uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae found in kube manager
2025-04-03 02:06:23,316 - INFO - Pod ctest-pod-29381192 verification passed
2025-04-03 02:06:23,322 - INFO - Pod ctest-pod-83290661 is in running state.Got IP 10.47.255.246
2025-04-03 02:06:23,378 - DEBUG - Pod ctest-pod-83290661 has vmi 3516eca4-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:23,379 - INFO - Verified pod ctest-pod-83290661 in contrail-api
2025-04-03 02:06:23,395 - DEBUG - VMI 3516eca4-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:23,395 - INFO - Verified Pod ctest-pod-83290661 in agent 10.0.0.31
2025-04-03 02:06:23,395 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=346dd549-7753-4656-bee1-ddf87551e8a2
2025-04-03 02:06:23,401 - INFO - Pod ctest-pod-83290661 with uuid 346dd549-7753-4656-bee1-ddf87551e8a2 found in kube manager
2025-04-03 02:06:23,401 - INFO - Pod ctest-pod-83290661 verification passed
2025-04-03 02:06:23,407 - INFO - Pod ctest-pod-25967645 is in running state.Got IP 10.47.255.244
2025-04-03 02:06:23,424 - DEBUG - Pod ctest-pod-25967645 has vmi 36146eb0-1030-11f0-9232-fa163e03942b
2025-04-03 02:06:23,424 - INFO - Verified pod ctest-pod-25967645 in contrail-api
2025-04-03 02:06:23,439 - DEBUG - VMI 36146eb0-1030-11f0-9232-fa163e03942b is active in agent 10.0.0.31
2025-04-03 02:06:23,440 - INFO - Verified Pod ctest-pod-25967645 in agent 10.0.0.31
2025-04-03 02:06:23,440 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_VirtualMachineDatabaseList?x=09d24839-720f-4601-a16e-aa78831d5f0b
2025-04-03 02:06:23,444 - INFO - Pod ctest-pod-25967645 with uuid 09d24839-720f-4601-a16e-aa78831d5f0b found in kube manager
2025-04-03 02:06:23,444 - INFO - Pod ctest-pod-25967645 verification passed
2025-04-03 02:06:23,445 - INFO - ================================================================================
2025-04-03 02:06:23,445 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-03 02:06:23,445 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-03 02:06:23,682 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.0.0.47': '0'}} with
2025-04-03 02:06:23,682 - INFO - Initial checks done. Running the testcase now
2025-04-03 02:06:23,682 - INFO -
2025-04-03 02:06:23,766 - DEBUG - [Pod ctest-pod-16584521] Cmd: echo ctest-pod-16584521 > /usr/share/nginx/html/index.html, Output:
2025-04-03 02:06:23,828 - DEBUG - [Pod ctest-pod-35428807] Cmd: echo ctest-pod-35428807 > /usr/share/nginx/html/index.html, Output:
2025-04-03 02:06:23,879 - DEBUG - [Pod ctest-pod-72985884] Cmd: echo ctest-pod-72985884 > /usr/share/nginx/html/index.html, Output:
2025-04-03 02:06:23,947 - DEBUG - [Pod ctest-pod-61759158] Cmd: echo ctest-pod-61759158 > /usr/share/nginx/html/index.html, Output:
2025-04-03 02:06:23,950 - DEBUG - Service ctest-nginx-svc-84136392 not present
2025-04-03 02:06:23,950 - INFO - Creating service ctest-nginx-svc-84136392
2025-04-03 02:06:23,962 - INFO - Created Service ctest-nginx-svc-84136392
2025-04-03 02:06:23,967 - WARNING - Service UUID 9864e0d0-0d53-482e-9e1c-7024daa95f5f not yet found in contrail-api
2025-04-03 02:06:24,976 - INFO - Validated that Service ctest-nginx-svc-84136392 is seen in contrail-api
2025-04-03 02:06:24,976 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_LoadbalancerDatabaseList?x=9864e0d0-0d53-482e-9e1c-7024daa95f5f
2025-04-03 02:06:24,981 - INFO - Service ctest-nginx-svc-84136392 with uuid 9864e0d0-0d53-482e-9e1c-7024daa95f5f found in kube manager
2025-04-03 02:06:24,981 - INFO - Service ctest-nginx-svc-84136392 verification passed
2025-04-03 02:06:26,076 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:06:26,076 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:06:26,076 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:06:26,145 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:06:26,145 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:06:26,145 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:06:26,145 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16584521': 1, 'ctest-pod-35428807': 1}
2025-04-03 02:06:26,219 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:06:26,219 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:06:26,219 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:06:26,293 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:06:26,293 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:06:26,293 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:06:26,372 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:06:26,372 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:06:26,372 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:06:26,372 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16584521': 2, 'ctest-pod-35428807': 1}
2025-04-03 02:06:26,375 - DEBUG - Network policy ingress-on-service not present
2025-04-03 02:06:26,376 - INFO - Creating Network Policy ingress-on-service
2025-04-03 02:06:26,388 - INFO - Network policy found in k8s
2025-04-03 02:06:26,388 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=43b6491f-5e22-40ee-99e0-af5d57cbcdad
2025-04-03 02:06:26,392 - INFO - Network Policy ingress-on-service with uuid 43b6491f-5e22-40ee-99e0-af5d57cbcdad found in kube manager
2025-04-03 02:06:26,437 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-03 02:06:26,437 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-03 02:06:26,437 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=43b6491f-5e22-40ee-99e0-af5d57cbcdad
2025-04-03 02:06:26,492 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-03 02:06:28,493 - DEBUG - Requesting: http://10.0.0.47:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=43b6491f-5e22-40ee-99e0-af5d57cbcdad
2025-04-03 02:06:28,525 - INFO - Network policy with name ingress-on-service found in agent
2025-04-03 02:06:28,525 - INFO - Network Policy ingress-on-service verification passed
2025-04-03 02:06:33,595 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:33,595 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:33,595 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:38,646 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:38,646 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:38,646 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:43,695 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:43,695 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:43,695 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:48,758 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:48,759 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:48,759 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:53,815 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:53,815 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:53,815 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:58,880 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:58,886 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:06:58,886 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:03,957 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:03,957 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:03,958 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:09,019 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:09,019 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:09,019 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:14,084 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:14,084 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:14,084 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:19,146 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:19,146 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:19,146 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:19,146 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16584521': 0, 'ctest-pod-35428807': 0}
2025-04-03 02:07:19,219 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:07:19,219 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:07:19,219 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:07:19,288 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:07:19,288 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:07:19,288 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:07:19,361 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:07:19,361 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:07:19,361 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:07:19,448 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:07:19,448 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:07:19,448 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:07:19,448 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16584521': 3, 'ctest-pod-35428807': 1}
2025-04-03 02:07:24,522 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:24,522 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:24,522 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:29,602 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:29,602 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:29,602 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:31,116 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-03 02:07:41,184 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:41,184 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:41,184 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:46,263 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:46,263 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:46,263 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:51,326 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:51,326 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:51,326 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:56,371 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:56,371 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:07:56,371 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:01,430 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:01,430 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:01,430 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:06,496 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:06,496 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:06,497 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:11,549 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:11,549 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:11,549 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:16,622 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:16,622 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:16,622 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:16,622 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16584521': 0, 'ctest-pod-35428807': 0}
2025-04-03 02:08:18,698 - DEBUG - [Pod ctest-pod-83290661] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.237 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.467/1.237 ms
2025-04-03 02:08:18,698 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-83290661 with expectation True passed
2025-04-03 02:08:20,771 - DEBUG - [Pod ctest-pod-98682198] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.359 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.166 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.533/1.359 ms
2025-04-03 02:08:20,771 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-98682198 with expectation True passed
2025-04-03 02:08:22,843 - DEBUG - [Pod ctest-pod-29381192] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.935 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.367/0.935 ms
2025-04-03 02:08:22,843 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29381192 with expectation True passed
2025-04-03 02:08:22,907 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:08:22,907 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-03 02:08:22,907 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:08:22,907 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83290661 passed
2025-04-03 02:08:22,968 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:08:22,969 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-03 02:08:22,969 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:08:22,969 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83290661 passed
2025-04-03 02:08:28,047 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-03 02:08:28,047 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-03 02:08:28,047 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-03 02:08:28,047 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98682198 passed
2025-04-03 02:08:33,117 - DEBUG - [Pod ctest-pod-25967645] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-03 02:08:33,117 - DEBUG - [Pod Pod ctest-pod-25967645] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-03 02:08:33,117 - DEBUG - [Pod Pod ctest-pod-25967645] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-03 02:08:33,117 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25967645 passed
2025-04-03 02:08:33,125 - INFO - Updating Network Policy ingress-on-service
2025-04-03 02:08:38,196 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:38,196 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:38,197 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:43,271 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:43,271 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:43,271 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:48,336 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:48,336 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:48,336 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:53,413 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:53,413 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:53,413 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:58,479 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:58,479 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:08:58,479 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:03,534 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:03,534 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:03,534 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:08,615 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:08,615 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:08,615 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:13,678 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:13,679 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:13,679 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:18,753 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:18,753 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:18,753 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:23,822 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:23,822 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:23,822 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
wget: download timed out
2025-04-03 02:09:23,822 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16584521': 0, 'ctest-pod-35428807': 0}
2025-04-03 02:09:23,889 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35428807
2025-04-03 02:09:23,889 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:23,889 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35428807
2025-04-03 02:09:23,971 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:23,971 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:23,972 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,048 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,048 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:24,048 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: ctest-pod-35428807
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,127 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:09:24,127 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:24,127 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:09:24,127 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16584521': 1, 'ctest-pod-35428807': 3}
2025-04-03 02:09:24,225 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,225 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:24,225 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,290 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,291 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:24,291 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: ctest-pod-16584521
Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-03 02:09:24,365 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:09:24,365 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:24,365 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-16584521
2025-04-03 02:09:24,441 - DEBUG - [Pod ctest-pod-29381192] Cmd: wget http://10.100.217.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35428807
2025-04-03 02:09:24,441 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd wget http://10.100.217.49:80/ -O - -T 5 -t 1 passed
2025-04-03 02:09:24,441 - DEBUG - [Pod Pod ctest-pod-29381192] Cmd output: Connecting to 10.100.217.49:80 (10.100.217.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-35428807
2025-04-03 02:09:24,441 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16584521': 3, 'ctest-pod-35428807': 1}
2025-04-03 02:09:26,517 - DEBUG - [Pod ctest-pod-83290661] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.135 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.106 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.089/0.443/1.135 ms
2025-04-03 02:09:26,517 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-83290661 with expectation True passed
2025-04-03 02:09:28,582 - DEBUG - [Pod ctest-pod-98682198] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.355 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.506/1.355 ms
2025-04-03 02:09:28,582 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-98682198 with expectation True passed
2025-04-03 02:09:30,656 - DEBUG - [Pod ctest-pod-29381192] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.619 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.143 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.280/0.619 ms
2025-04-03 02:09:30,656 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29381192 with expectation True passed
2025-04-03 02:09:30,726 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:09:30,727 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-03 02:09:30,727 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:09:30,727 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83290661 passed
2025-04-03 02:09:30,800 - DEBUG - [Pod ctest-pod-83290661] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:09:30,800 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-03 02:09:30,800 - DEBUG - [Pod Pod ctest-pod-83290661] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:09:30,800 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83290661 passed
2025-04-03 02:09:35,870 - DEBUG - [Pod ctest-pod-98682198] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-03 02:09:35,870 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-03 02:09:35,870 - DEBUG - [Pod Pod ctest-pod-98682198] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-03 02:09:35,870 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98682198 passed
2025-04-03 02:09:35,952 - DEBUG - [Pod ctest-pod-25967645] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:09:35,952 - DEBUG - [Pod Pod ctest-pod-25967645] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-03 02:09:35,952 - DEBUG - [Pod Pod ctest-pod-25967645] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-03 02:09:35,952 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25967645 passed
2025-04-03 02:09:35,953 - INFO - Deleting Network Policy : ingress-on-service
2025-04-03 02:09:35,953 - INFO - Deleting service : ctest-nginx-svc-84136392
2025-04-03 02:09:36,218 - DEBUG - No XMPP flaps were noticed during the test
2025-04-03 02:09:36,218 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-04-03 02:09:36,218 - INFO - --------------------------------------------------------------------------------
2025-04-03 02:09:36,223 - INFO - Deleting pod ctest-new-default-03490515:ctest-pod-16584521
2025-04-03 02:09:36,223 - INFO - Deleting pod ctest-new-default-03490515:ctest-pod-35428807
2025-04-03 02:09:36,223 - INFO - Deleting pod ctest-non-default-14705179:ctest-pod-72985884
2025-04-03 02:09:36,224 - INFO - Deleting pod ctest-non-default-14705179:ctest-pod-61759158
2025-04-03 02:09:36,224 - INFO - Deleting pod ctest-new-default-03490515:ctest-pod-98682198
2025-04-03 02:09:36,224 - INFO - Deleting pod ctest-new-default-03490515:ctest-pod-83290661
2025-04-03 02:09:36,225 - INFO - Deleting pod ctest-non-default-14705179:ctest-pod-29381192
2025-04-03 02:09:36,225 - INFO - Deleting pod ctest-non-default-14705179:ctest-pod-25967645
2025-04-03 02:09:36,305 - WARNING - Pod uuid c9f70e02-61de-4cd2-87bd-4921a9345c64 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,353 - WARNING - Pod uuid c19472e0-4c43-4838-a941-3f13bb2433b6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,354 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,359 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,359 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,360 - WARNING - Pod uuid 2d5e1ef1-0c40-4cd5-b747-51f7534051aa is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,361 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:36,361 - WARNING - Pod uuid 690e44f5-06e5-452c-85fe-89e5cce7c94a is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:41,313 - DEBUG - Pod c9f70e02-61de-4cd2-87bd-4921a9345c64 is not in agent 10.0.0.31 VM list
2025-04-03 02:09:41,320 - DEBUG - VMI 326675e2-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:09:41,320 - INFO - Verified that pod ctest-pod-16584521 is removed in agent
2025-04-03 02:09:41,369 - DEBUG - Pod c19472e0-4c43-4838-a941-3f13bb2433b6 is not in agent 10.0.0.31 VM list
2025-04-03 02:09:41,370 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:41,399 - DEBUG - Pod 2d5e1ef1-0c40-4cd5-b747-51f7534051aa is not in agent 10.0.0.31 VM list
2025-04-03 02:09:41,401 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:41,402 - DEBUG - VMI 34079322-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:09:41,402 - INFO - Verified that pod ctest-pod-61759158 is removed in agent
2025-04-03 02:09:41,403 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:41,403 - DEBUG - Pod 690e44f5-06e5-452c-85fe-89e5cce7c94a is not in agent 10.0.0.31 VM list
2025-04-03 02:09:41,404 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:41,414 - DEBUG - VMI 32e3468a-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:09:41,414 - INFO - Verified that pod ctest-pod-35428807 is removed in agent
2025-04-03 02:09:41,415 - DEBUG - VMI 3387f450-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:09:41,415 - INFO - Verified that pod ctest-pod-72985884 is removed in agent
2025-04-03 02:09:46,379 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:46,417 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:46,417 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:46,418 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:51,388 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:51,431 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:51,433 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:51,433 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:56,398 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:56,448 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:56,449 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:09:56,450 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:01,407 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:01,465 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:01,467 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:01,467 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:06,420 - WARNING - Pod uuid 3912c22c-1098-4c46-888f-8c00395c24c6 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:06,481 - WARNING - Pod uuid 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:06,485 - WARNING - Pod uuid 346dd549-7753-4656-bee1-ddf87551e8a2 is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:06,486 - WARNING - Pod uuid 09d24839-720f-4601-a16e-aa78831d5f0b is still seen in agent 10.0.0.31 VM list
2025-04-03 02:10:11,429 - DEBUG - Pod 3912c22c-1098-4c46-888f-8c00395c24c6 is not in agent 10.0.0.31 VM list
2025-04-03 02:10:11,435 - DEBUG - VMI 3499bcb6-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:10:11,435 - INFO - Verified that pod ctest-pod-98682198 is removed in agent
2025-04-03 02:10:11,492 - DEBUG - Pod 20e7ef52-d893-47a8-a959-ff37a6e9d9ae is not in agent 10.0.0.31 VM list
2025-04-03 02:10:11,504 - DEBUG - Pod 346dd549-7753-4656-bee1-ddf87551e8a2 is not in agent 10.0.0.31 VM list
2025-04-03 02:10:11,507 - DEBUG - VMI 3595ef22-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:10:11,507 - INFO - Verified that pod ctest-pod-29381192 is removed in agent
2025-04-03 02:10:11,507 - DEBUG - Pod 09d24839-720f-4601-a16e-aa78831d5f0b is not in agent 10.0.0.31 VM list
2025-04-03 02:10:11,518 - DEBUG - VMI 3516eca4-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:10:11,518 - INFO - Verified that pod ctest-pod-83290661 is removed in agent
2025-04-03 02:10:11,519 - DEBUG - VMI 36146eb0-1030-11f0-9232-fa163e03942b is removed from agent 10.0.0.31
2025-04-03 02:10:11,519 - INFO - Verified that pod ctest-pod-25967645 is removed in agent
2025-04-03 02:10:11,519 - INFO - Deleting namespace ctest-non-default-14705179
2025-04-03 02:10:11,536 - DEBUG - Namespace ctest-non-default-14705179 still in k8s
2025-04-03 02:10:13,541 - DEBUG - Namespace ctest-non-default-14705179 still in k8s
2025-04-03 02:10:15,546 - DEBUG - Namespace ctest-non-default-14705179 still in k8s
2025-04-03 02:10:17,550 - DEBUG - Namespace ctest-non-default-14705179 is not in k8s
2025-04-03 02:10:17,550 - DEBUG - No need to check project deletion in contrail-api
2025-04-03 02:10:17,550 - INFO - Deleting namespace ctest-new-default-03490515
2025-04-03 02:10:17,558 - DEBUG - Namespace ctest-new-default-03490515 still in k8s
2025-04-03 02:10:19,563 - DEBUG - Namespace ctest-new-default-03490515 still in k8s
2025-04-03 02:10:21,569 - DEBUG - Namespace ctest-new-default-03490515 still in k8s
2025-04-03 02:10:23,573 - DEBUG - Namespace ctest-new-default-03490515 is not in k8s
2025-04-03 02:10:23,573 - DEBUG - No need to check project deletion in contrail-api