2024-08-26 13:06:36,036 - INFO - Using existing project ['default-domain', 'k8s-default'](33a4a95b-d005-4668-a1f5-d40b6a4b9969)
2024-08-26 13:06:36,066 - DEBUG - Namespace ctest-new-default-74493362 not present
2024-08-26 13:06:36,076 - INFO - Created namespace ctest-new-default-74493362
2024-08-26 13:06:39,080 - DEBUG - Namespace ctest-non-default-83867831 not present
2024-08-26 13:06:39,094 - INFO - Created namespace ctest-non-default-83867831
2024-08-26 13:06:42,115 - DEBUG - Pod ctest-pod-95771729 not present
2024-08-26 13:06:42,116 - INFO - Creating Pod ctest-pod-95771729
2024-08-26 13:06:42,144 - DEBUG - Pod : ctest-pod-95771729 UUID is d7039339-2c32-4a6a-8e11-f661313825cb
2024-08-26 13:06:42,152 - DEBUG - Pod ctest-pod-67077591 not present
2024-08-26 13:06:42,153 - INFO - Creating Pod ctest-pod-67077591
2024-08-26 13:06:42,182 - DEBUG - Pod : ctest-pod-67077591 UUID is 7fdc2796-ff58-4aa2-aab0-497315724fcb
2024-08-26 13:06:42,184 - DEBUG - Pod ctest-pod-98010420 not present
2024-08-26 13:06:42,184 - INFO - Creating Pod ctest-pod-98010420
2024-08-26 13:06:42,204 - DEBUG - Pod : ctest-pod-98010420 UUID is 9f53760c-1233-42ba-8200-39d3a198ddfb
2024-08-26 13:06:42,207 - DEBUG - Pod ctest-pod-29420038 not present
2024-08-26 13:06:42,207 - INFO - Creating Pod ctest-pod-29420038
2024-08-26 13:06:42,239 - DEBUG - Pod : ctest-pod-29420038 UUID is 24c477e0-3bc0-462b-b6cd-86dd2f1f8055
2024-08-26 13:06:42,242 - DEBUG - Pod ctest-pod-38069884 not present
2024-08-26 13:06:42,242 - INFO - Creating Pod ctest-pod-38069884
2024-08-26 13:06:42,259 - DEBUG - Pod : ctest-pod-38069884 UUID is 69f97901-737c-45d1-b569-be6d209f32b6
2024-08-26 13:06:42,261 - DEBUG - Pod ctest-pod-59861378 not present
2024-08-26 13:06:42,261 - INFO - Creating Pod ctest-pod-59861378
2024-08-26 13:06:42,277 - DEBUG - Pod : ctest-pod-59861378 UUID is b6427d26-f155-4dc3-8ffc-16ab6e255355
2024-08-26 13:06:42,282 - DEBUG - Pod ctest-pod-29144375 not present
2024-08-26 13:06:42,283 - INFO - Creating Pod ctest-pod-29144375
2024-08-26 13:06:42,298 - DEBUG - Pod : ctest-pod-29144375 UUID is 150f5345-3b5e-4cf7-999f-9dc4f9477877
2024-08-26 13:06:42,300 - DEBUG - Pod ctest-pod-46857874 not present
2024-08-26 13:06:42,300 - INFO - Creating Pod ctest-pod-46857874
2024-08-26 13:06:42,316 - DEBUG - Pod : ctest-pod-46857874 UUID is cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8
2024-08-26 13:06:42,475 - INFO - Project default-domain:k8s-ctest-new-default-74493362 for Namespace ctest-new-default-74493362 is seen in contrail-api
2024-08-26 13:06:42,475 - DEBUG - Project uuid in Contrail is 3101e108-3c2a-4f17-9734-436b4c481e23
2024-08-26 13:06:42,647 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=dc9321ae-4c5c-43ed-8c44-fe70b7854995
2024-08-26 13:06:42,653 - INFO - Namespace ctest-new-default-74493362 with uuid dc9321ae-4c5c-43ed-8c44-fe70b7854995 found in kube manager
2024-08-26 13:06:42,653 - INFO - Namespace ctest-new-default-74493362 verification passed
2024-08-26 13:06:42,853 - INFO - Project default-domain:k8s-ctest-non-default-83867831 for Namespace ctest-non-default-83867831 is seen in contrail-api
2024-08-26 13:06:42,853 - DEBUG - Project uuid in Contrail is 4d3317e0-7238-4848-a8d2-435583c3c92f
2024-08-26 13:06:42,853 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=43dea1a2-7a1b-43c5-9063-e9f753e5ccaf
2024-08-26 13:06:42,866 - INFO - Namespace ctest-non-default-83867831 with uuid 43dea1a2-7a1b-43c5-9063-e9f753e5ccaf found in kube manager
2024-08-26 13:06:42,866 - INFO - Namespace ctest-non-default-83867831 verification passed
2024-08-26 13:06:42,871 - DEBUG - Pod ctest-pod-95771729 not in running state.Currently in Pending
2024-08-26 13:06:47,881 - DEBUG - Pod ctest-pod-95771729 not in running state.Currently in Pending
2024-08-26 13:06:52,887 - DEBUG - Pod ctest-pod-95771729 not in running state.Currently in Pending
2024-08-26 13:06:57,893 - INFO - Pod ctest-pod-95771729 is in running state.Got IP 10.47.255.251
2024-08-26 13:06:57,946 - DEBUG - Pod ctest-pod-95771729 has vmi 0aa9990c-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:06:57,946 - INFO - Verified pod ctest-pod-95771729 in contrail-api
2024-08-26 13:06:57,964 - DEBUG - VMI 0aa9990c-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:06:57,965 - INFO - Verified Pod ctest-pod-95771729 in agent 10.0.0.62
2024-08-26 13:06:57,965 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=d7039339-2c32-4a6a-8e11-f661313825cb
2024-08-26 13:06:57,971 - INFO - Pod ctest-pod-95771729 with uuid d7039339-2c32-4a6a-8e11-f661313825cb found in kube manager
2024-08-26 13:06:57,974 - INFO - Pod ctest-pod-95771729 verification passed
2024-08-26 13:06:57,979 - INFO - Pod ctest-pod-67077591 is in running state.Got IP 10.47.255.250
2024-08-26 13:06:57,990 - DEBUG - Pod ctest-pod-67077591 has vmi 0b1cd0fc-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:06:57,990 - INFO - Verified pod ctest-pod-67077591 in contrail-api
2024-08-26 13:06:58,005 - DEBUG - VMI 0b1cd0fc-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:06:58,005 - INFO - Verified Pod ctest-pod-67077591 in agent 10.0.0.62
2024-08-26 13:06:58,005 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=7fdc2796-ff58-4aa2-aab0-497315724fcb
2024-08-26 13:06:58,010 - INFO - Pod ctest-pod-67077591 with uuid 7fdc2796-ff58-4aa2-aab0-497315724fcb found in kube manager
2024-08-26 13:06:58,010 - INFO - Pod ctest-pod-67077591 verification passed
2024-08-26 13:06:58,015 - INFO - Pod ctest-pod-98010420 is in running state.Got IP 10.47.255.249
2024-08-26 13:06:58,026 - DEBUG - Pod ctest-pod-98010420 has vmi 0bab32ca-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:06:58,026 - INFO - Verified pod ctest-pod-98010420 in contrail-api
2024-08-26 13:06:58,039 - DEBUG - VMI 0bab32ca-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:06:58,040 - INFO - Verified Pod ctest-pod-98010420 in agent 10.0.0.62
2024-08-26 13:06:58,040 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=9f53760c-1233-42ba-8200-39d3a198ddfb
2024-08-26 13:06:58,045 - INFO - Pod ctest-pod-98010420 with uuid 9f53760c-1233-42ba-8200-39d3a198ddfb found in kube manager
2024-08-26 13:06:58,045 - INFO - Pod ctest-pod-98010420 verification passed
2024-08-26 13:06:58,051 - INFO - Pod ctest-pod-29420038 is in running state.Got IP 10.47.255.248
2024-08-26 13:06:58,102 - DEBUG - Pod ctest-pod-29420038 has vmi 0c1fff38-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:06:58,102 - INFO - Verified pod ctest-pod-29420038 in contrail-api
2024-08-26 13:06:58,115 - DEBUG - VMI 0c1fff38-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:06:58,115 - INFO - Verified Pod ctest-pod-29420038 in agent 10.0.0.62
2024-08-26 13:06:58,115 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=24c477e0-3bc0-462b-b6cd-86dd2f1f8055
2024-08-26 13:06:58,120 - INFO - Pod ctest-pod-29420038 with uuid 24c477e0-3bc0-462b-b6cd-86dd2f1f8055 found in kube manager
2024-08-26 13:06:58,120 - INFO - Pod ctest-pod-29420038 verification passed
2024-08-26 13:06:58,129 - INFO - Pod ctest-pod-38069884 is in running state.Got IP 10.47.255.247
2024-08-26 13:06:58,139 - DEBUG - Pod ctest-pod-38069884 has vmi 0c9eb102-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:06:58,140 - INFO - Verified pod ctest-pod-38069884 in contrail-api
2024-08-26 13:06:58,153 - DEBUG - VMI 0c9eb102-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:06:58,154 - INFO - Verified Pod ctest-pod-38069884 in agent 10.0.0.62
2024-08-26 13:06:58,154 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=69f97901-737c-45d1-b569-be6d209f32b6
2024-08-26 13:06:58,158 - INFO - Pod ctest-pod-38069884 with uuid 69f97901-737c-45d1-b569-be6d209f32b6 found in kube manager
2024-08-26 13:06:58,158 - INFO - Pod ctest-pod-38069884 verification passed
2024-08-26 13:06:58,164 - INFO - Pod ctest-pod-29144375 is in running state.Got IP 10.47.255.245
2024-08-26 13:06:58,216 - DEBUG - Pod ctest-pod-29144375 has vmi 0d746ef0-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:06:58,216 - INFO - Verified pod ctest-pod-29144375 in contrail-api
2024-08-26 13:06:58,232 - DEBUG - VMI 0d746ef0-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:06:58,232 - INFO - Verified Pod ctest-pod-29144375 in agent 10.0.0.62
2024-08-26 13:06:58,233 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=150f5345-3b5e-4cf7-999f-9dc4f9477877
2024-08-26 13:06:58,241 - INFO - Pod ctest-pod-29144375 with uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 found in kube manager
2024-08-26 13:06:58,241 - INFO - Pod ctest-pod-29144375 verification passed
2024-08-26 13:06:58,246 - DEBUG - Pod ctest-pod-59861378 not in running state.Currently in Pending
2024-08-26 13:07:03,253 - INFO - Pod ctest-pod-59861378 is in running state.Got IP 10.47.255.246
2024-08-26 13:07:03,265 - DEBUG - Pod ctest-pod-59861378 has vmi 0d0a2216-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:07:03,265 - INFO - Verified pod ctest-pod-59861378 in contrail-api
2024-08-26 13:07:03,280 - DEBUG - VMI 0d0a2216-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:07:03,280 - INFO - Verified Pod ctest-pod-59861378 in agent 10.0.0.62
2024-08-26 13:07:03,280 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=b6427d26-f155-4dc3-8ffc-16ab6e255355
2024-08-26 13:07:03,285 - INFO - Pod ctest-pod-59861378 with uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 found in kube manager
2024-08-26 13:07:03,285 - INFO - Pod ctest-pod-59861378 verification passed
2024-08-26 13:07:03,294 - INFO - Pod ctest-pod-46857874 is in running state.Got IP 10.47.255.244
2024-08-26 13:07:03,346 - DEBUG - Pod ctest-pod-46857874 has vmi 0ddc0934-63ac-11ef-ae57-fa163e13254c
2024-08-26 13:07:03,346 - INFO - Verified pod ctest-pod-46857874 in contrail-api
2024-08-26 13:07:03,360 - DEBUG - VMI 0ddc0934-63ac-11ef-ae57-fa163e13254c is active in agent 10.0.0.62
2024-08-26 13:07:03,360 - INFO - Verified Pod ctest-pod-46857874 in agent 10.0.0.62
2024-08-26 13:07:03,360 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8
2024-08-26 13:07:03,365 - INFO - Pod ctest-pod-46857874 with uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 found in kube manager
2024-08-26 13:07:03,365 - INFO - Pod ctest-pod-46857874 verification passed
2024-08-26 13:07:03,365 - INFO - ================================================================================
2024-08-26 13:07:03,365 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-08-26 13:07:03,365 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-08-26 13:07:03,620 - DEBUG - Nothing to compare xmpp stats {'10.0.0.62': {'10.0.0.41': '0'}} with
2024-08-26 13:07:03,620 - INFO - Initial checks done. Running the testcase now
2024-08-26 13:07:03,620 - INFO -
2024-08-26 13:07:03,682 - DEBUG - [Pod ctest-pod-95771729] Cmd: echo ctest-pod-95771729 > /usr/share/nginx/html/index.html, Output:
2024-08-26 13:07:03,753 - DEBUG - [Pod ctest-pod-67077591] Cmd: echo ctest-pod-67077591 > /usr/share/nginx/html/index.html, Output:
2024-08-26 13:07:03,824 - DEBUG - [Pod ctest-pod-98010420] Cmd: echo ctest-pod-98010420 > /usr/share/nginx/html/index.html, Output:
2024-08-26 13:07:03,891 - DEBUG - [Pod ctest-pod-29420038] Cmd: echo ctest-pod-29420038 > /usr/share/nginx/html/index.html, Output:
2024-08-26 13:07:03,894 - DEBUG - Service ctest-nginx-svc-58459337 not present
2024-08-26 13:07:03,894 - INFO - Creating service ctest-nginx-svc-58459337
2024-08-26 13:07:03,912 - INFO - Created Service ctest-nginx-svc-58459337
2024-08-26 13:07:03,923 - WARNING - Service UUID 63137242-7865-43db-8938-9566d82f05f6 not yet found in contrail-api
2024-08-26 13:07:04,939 - INFO - Validated that Service ctest-nginx-svc-58459337 is seen in contrail-api
2024-08-26 13:07:04,939 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=63137242-7865-43db-8938-9566d82f05f6
2024-08-26 13:07:04,945 - INFO - Service ctest-nginx-svc-58459337 with uuid 63137242-7865-43db-8938-9566d82f05f6 found in kube manager
2024-08-26 13:07:04,945 - INFO - Service ctest-nginx-svc-58459337 verification passed
2024-08-26 13:07:06,016 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67077591
2024-08-26 13:07:06,016 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:06,016 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67077591
2024-08-26 13:07:06,119 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,120 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:06,120 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,196 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,196 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:06,196 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,196 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95771729': 1, 'ctest-pod-67077591': 2}
2024-08-26 13:07:06,264 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,265 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:06,265 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,322 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,322 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:06,323 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:06,323 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95771729': 1, 'ctest-pod-67077591': 1}
2024-08-26 13:07:06,325 - DEBUG - Network policy ingress-on-service not present
2024-08-26 13:07:06,326 - INFO - Creating Network Policy ingress-on-service
2024-08-26 13:07:06,337 - INFO - Network policy found in k8s
2024-08-26 13:07:06,337 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8fb491f-1623-4041-b199-ae76cd98dda3
2024-08-26 13:07:06,342 - INFO - Network Policy ingress-on-service with uuid e8fb491f-1623-4041-b199-ae76cd98dda3 found in kube manager
2024-08-26 13:07:06,390 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-08-26 13:07:06,391 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-08-26 13:07:06,391 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8fb491f-1623-4041-b199-ae76cd98dda3
2024-08-26 13:07:06,424 - WARNING - Network policy with name ingress-on-service not found in agent
2024-08-26 13:07:08,424 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e8fb491f-1623-4041-b199-ae76cd98dda3
2024-08-26 13:07:08,456 - INFO - Network policy with name ingress-on-service found in agent
2024-08-26 13:07:08,457 - INFO - Network Policy ingress-on-service verification passed
2024-08-26 13:07:13,506 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:13,507 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:13,507 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:18,581 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:18,581 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:18,581 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:23,657 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:23,657 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:23,657 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:28,727 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:28,727 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:28,728 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:33,786 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:33,786 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:33,786 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:38,855 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:38,855 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:38,855 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:43,938 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:43,938 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:43,938 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:49,014 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:49,014 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:49,014 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:54,098 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:54,098 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:54,098 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:59,161 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:59,161 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:59,161 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:07:59,161 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95771729': 0, 'ctest-pod-67077591': 0}
2024-08-26 13:07:59,232 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:59,232 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:59,232 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:59,318 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:59,318 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:07:59,318 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:07:59,318 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95771729': 1, 'ctest-pod-67077591': 1}
2024-08-26 13:08:04,379 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:04,379 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:04,379 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:09,450 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:09,450 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:09,450 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:14,506 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:14,506 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:14,506 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:19,569 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:19,569 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:19,569 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:24,650 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:24,650 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:24,650 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:29,723 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:29,723 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:29,723 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:34,778 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:34,778 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:34,778 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:39,846 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:39,846 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:39,846 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:44,978 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:44,978 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:44,978 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:50,058 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:50,058 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:50,058 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:08:50,058 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95771729': 0, 'ctest-pod-67077591': 0}
2024-08-26 13:08:52,118 - DEBUG - [Pod ctest-pod-59861378] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.587 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.106 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.122 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.106/0.271/0.587 ms
2024-08-26 13:08:52,118 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-59861378 with expectation True passed
2024-08-26 13:08:54,279 - DEBUG - [Pod ctest-pod-38069884] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.835 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.100/0.345/0.835 ms
2024-08-26 13:08:54,279 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-38069884 with expectation True passed
2024-08-26 13:08:56,347 - DEBUG - [Pod ctest-pod-29144375] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.427 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.121 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.208/0.427 ms
2024-08-26 13:08:56,347 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29144375 with expectation True passed
2024-08-26 13:08:56,408 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:08:56,408 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-26 13:08:56,408 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:08:56,408 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59861378 passed
2024-08-26 13:08:56,455 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:08:56,455 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-26 13:08:56,455 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:08:56,455 - INFO - wget check of of http://10.47.255.250 from ctest-pod-59861378 passed
2024-08-26 13:09:01,549 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-26 13:09:01,550 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-26 13:09:01,550 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-26 13:09:01,550 - INFO - wget check of of http://10.47.255.250 from ctest-pod-38069884 passed
2024-08-26 13:09:06,616 - DEBUG - [Pod ctest-pod-46857874] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-26 13:09:06,616 - DEBUG - [Pod Pod ctest-pod-46857874] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-26 13:09:06,616 - DEBUG - [Pod Pod ctest-pod-46857874] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-26 13:09:06,616 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46857874 passed
2024-08-26 13:09:06,629 - INFO - Updating Network Policy ingress-on-service
2024-08-26 13:09:11,710 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:11,710 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:11,710 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:16,782 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:16,782 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:16,782 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:21,839 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:21,839 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:21,839 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:26,894 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:26,894 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:26,894 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:31,948 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:31,948 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:31,948 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:37,025 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:37,026 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:37,026 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:39,165 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-08-26 13:09:49,251 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:49,251 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:49,251 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:54,338 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:54,338 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:54,339 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:59,390 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:59,390 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:09:59,390 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:10:04,465 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:10:04,466 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:10:04,466 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
wget: download timed out
2024-08-26 13:10:04,466 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95771729': 0, 'ctest-pod-67077591': 0}
2024-08-26 13:10:04,547 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:10:04,547 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:10:04,547 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:10:04,614 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:10:04,614 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:10:04,614 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: ctest-pod-95771729
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:10:04,614 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95771729': 1, 'ctest-pod-67077591': 1}
2024-08-26 13:10:04,682 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:10:04,682 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:10:04,682 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: ctest-pod-67077591
Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-26 13:10:04,765 - DEBUG - [Pod ctest-pod-29144375] Cmd: wget http://10.104.32.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95771729
2024-08-26 13:10:04,765 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd wget http://10.104.32.197:80/ -O - -T 5 -t 1 passed
2024-08-26 13:10:04,765 - DEBUG - [Pod Pod ctest-pod-29144375] Cmd output: Connecting to 10.104.32.197:80 (10.104.32.197:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95771729
2024-08-26 13:10:04,765 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95771729': 1, 'ctest-pod-67077591': 1}
2024-08-26 13:10:06,826 - DEBUG - [Pod ctest-pod-59861378] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.034 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.404/1.034 ms
2024-08-26 13:10:06,826 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-59861378 with expectation True passed
2024-08-26 13:10:08,879 - DEBUG - [Pod ctest-pod-38069884] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.982 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.125 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.396/0.982 ms
2024-08-26 13:10:08,879 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-38069884 with expectation True passed
2024-08-26 13:10:10,965 - DEBUG - [Pod ctest-pod-29144375] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.533 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.097/0.913/2.533 ms
2024-08-26 13:10:10,965 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29144375 with expectation True passed
2024-08-26 13:10:11,027 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:10:11,027 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-26 13:10:11,027 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:10:11,027 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59861378 passed
2024-08-26 13:10:11,104 - DEBUG - [Pod ctest-pod-59861378] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:10:11,104 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-26 13:10:11,104 - DEBUG - [Pod Pod ctest-pod-59861378] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:10:11,104 - INFO - wget check of of http://10.47.255.250 from ctest-pod-59861378 passed
2024-08-26 13:10:16,166 - DEBUG - [Pod ctest-pod-38069884] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-26 13:10:16,166 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-26 13:10:16,166 - DEBUG - [Pod Pod ctest-pod-38069884] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-26 13:10:16,166 - INFO - wget check of of http://10.47.255.250 from ctest-pod-38069884 passed
2024-08-26 13:10:16,258 - DEBUG - [Pod ctest-pod-46857874] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:10:16,258 - DEBUG - [Pod Pod ctest-pod-46857874] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-26 13:10:16,258 - DEBUG - [Pod Pod ctest-pod-46857874] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-26 13:10:16,258 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46857874 passed
2024-08-26 13:10:16,259 - INFO - Deleting Network Policy : ingress-on-service
2024-08-26 13:10:16,260 - INFO - Deleting service : ctest-nginx-svc-58459337
2024-08-26 13:10:16,503 - DEBUG - No XMPP flaps were noticed during the test
2024-08-26 13:10:16,503 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2024-08-26 13:10:16,503 - INFO - --------------------------------------------------------------------------------
2024-08-26 13:10:16,509 - INFO - Deleting pod ctest-new-default-74493362:ctest-pod-95771729
2024-08-26 13:10:16,510 - INFO - Deleting pod ctest-new-default-74493362:ctest-pod-67077591
2024-08-26 13:10:16,510 - INFO - Deleting pod ctest-non-default-83867831:ctest-pod-98010420
2024-08-26 13:10:16,510 - INFO - Deleting pod ctest-non-default-83867831:ctest-pod-29420038
2024-08-26 13:10:16,511 - INFO - Deleting pod ctest-new-default-74493362:ctest-pod-38069884
2024-08-26 13:10:16,511 - INFO - Deleting pod ctest-new-default-74493362:ctest-pod-59861378
2024-08-26 13:10:16,511 - INFO - Deleting pod ctest-non-default-83867831:ctest-pod-29144375
2024-08-26 13:10:16,512 - INFO - Deleting pod ctest-non-default-83867831:ctest-pod-46857874
2024-08-26 13:10:16,703 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,703 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,704 - WARNING - Pod uuid d7039339-2c32-4a6a-8e11-f661313825cb is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,705 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,706 - WARNING - Pod uuid 7fdc2796-ff58-4aa2-aab0-497315724fcb is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,706 - WARNING - Pod uuid 24c477e0-3bc0-462b-b6cd-86dd2f1f8055 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,706 - WARNING - Pod uuid 9f53760c-1233-42ba-8200-39d3a198ddfb is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:16,707 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:21,738 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:21,742 - DEBUG - Pod 24c477e0-3bc0-462b-b6cd-86dd2f1f8055 is not in agent 10.0.0.62 VM list
2024-08-26 13:10:21,747 - DEBUG - Pod 9f53760c-1233-42ba-8200-39d3a198ddfb is not in agent 10.0.0.62 VM list
2024-08-26 13:10:21,749 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:21,751 - DEBUG - Pod 7fdc2796-ff58-4aa2-aab0-497315724fcb is not in agent 10.0.0.62 VM list
2024-08-26 13:10:21,753 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:21,753 - DEBUG - Pod d7039339-2c32-4a6a-8e11-f661313825cb is not in agent 10.0.0.62 VM list
2024-08-26 13:10:21,755 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:21,771 - DEBUG - VMI 0c1fff38-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:21,771 - INFO - Verified that pod ctest-pod-29420038 is removed in agent
2024-08-26 13:10:21,773 - DEBUG - VMI 0bab32ca-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:21,773 - INFO - Verified that pod ctest-pod-98010420 is removed in agent
2024-08-26 13:10:21,774 - DEBUG - VMI 0b1cd0fc-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:21,774 - INFO - Verified that pod ctest-pod-67077591 is removed in agent
2024-08-26 13:10:21,774 - DEBUG - VMI 0aa9990c-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:21,774 - INFO - Verified that pod ctest-pod-95771729 is removed in agent
2024-08-26 13:10:26,747 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:26,758 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:26,768 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:26,769 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:31,755 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:31,766 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:31,779 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:31,780 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:36,765 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:36,774 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:36,793 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:36,794 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:41,779 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:41,784 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:41,804 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:41,806 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:46,788 - WARNING - Pod uuid cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:46,794 - WARNING - Pod uuid 69f97901-737c-45d1-b569-be6d209f32b6 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:46,817 - WARNING - Pod uuid b6427d26-f155-4dc3-8ffc-16ab6e255355 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:46,818 - WARNING - Pod uuid 150f5345-3b5e-4cf7-999f-9dc4f9477877 is still seen in agent 10.0.0.62 VM list
2024-08-26 13:10:51,797 - DEBUG - Pod cb01cbb6-9eb7-4df9-b203-7e5e772ff7a8 is not in agent 10.0.0.62 VM list
2024-08-26 13:10:51,806 - DEBUG - Pod 69f97901-737c-45d1-b569-be6d209f32b6 is not in agent 10.0.0.62 VM list
2024-08-26 13:10:51,808 - DEBUG - VMI 0ddc0934-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:51,808 - INFO - Verified that pod ctest-pod-46857874 is removed in agent
2024-08-26 13:10:51,813 - DEBUG - VMI 0c9eb102-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:51,813 - INFO - Verified that pod ctest-pod-38069884 is removed in agent
2024-08-26 13:10:51,828 - DEBUG - Pod 150f5345-3b5e-4cf7-999f-9dc4f9477877 is not in agent 10.0.0.62 VM list
2024-08-26 13:10:51,830 - DEBUG - Pod b6427d26-f155-4dc3-8ffc-16ab6e255355 is not in agent 10.0.0.62 VM list
2024-08-26 13:10:51,839 - DEBUG - VMI 0d746ef0-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:51,839 - INFO - Verified that pod ctest-pod-29144375 is removed in agent
2024-08-26 13:10:51,840 - DEBUG - VMI 0d0a2216-63ac-11ef-ae57-fa163e13254c is removed from agent 10.0.0.62
2024-08-26 13:10:51,840 - INFO - Verified that pod ctest-pod-59861378 is removed in agent
2024-08-26 13:10:51,840 - INFO - Deleting namespace ctest-non-default-83867831
2024-08-26 13:10:51,849 - DEBUG - Namespace ctest-non-default-83867831 still in k8s
2024-08-26 13:10:53,853 - DEBUG - Namespace ctest-non-default-83867831 still in k8s
2024-08-26 13:10:55,857 - DEBUG - Namespace ctest-non-default-83867831 still in k8s
2024-08-26 13:10:57,861 - DEBUG - Namespace ctest-non-default-83867831 is not in k8s
2024-08-26 13:10:57,861 - DEBUG - No need to check project deletion in contrail-api
2024-08-26 13:10:57,861 - INFO - Deleting namespace ctest-new-default-74493362
2024-08-26 13:10:57,871 - DEBUG - Namespace ctest-new-default-74493362 still in k8s
2024-08-26 13:10:59,876 - DEBUG - Namespace ctest-new-default-74493362 still in k8s
2024-08-26 13:11:01,879 - DEBUG - Namespace ctest-new-default-74493362 still in k8s
2024-08-26 13:11:03,883 - DEBUG - Namespace ctest-new-default-74493362 is not in k8s
2024-08-26 13:11:03,883 - DEBUG - No need to check project deletion in contrail-api