2024-08-24 01:50:24,345 - INFO - Using existing project ['default-domain', 'k8s-default'](c52fb3e2-e8a2-4c45-905a-6821740576e4)
2024-08-24 01:50:24,363 - DEBUG - Namespace ctest-new-default-90435807 not present
2024-08-24 01:50:24,373 - INFO - Created namespace ctest-new-default-90435807
2024-08-24 01:50:27,378 - DEBUG - Namespace ctest-non-default-69761171 not present
2024-08-24 01:50:27,385 - INFO - Created namespace ctest-non-default-69761171
2024-08-24 01:50:30,401 - DEBUG - Pod ctest-pod-42562420 not present
2024-08-24 01:50:30,402 - INFO - Creating Pod ctest-pod-42562420
2024-08-24 01:50:30,443 - DEBUG - Pod : ctest-pod-42562420 UUID is 1aa6bb33-3b97-44f9-9e6a-59ee7c2db329
2024-08-24 01:50:30,447 - DEBUG - Pod ctest-pod-03937666 not present
2024-08-24 01:50:30,447 - INFO - Creating Pod ctest-pod-03937666
2024-08-24 01:50:30,462 - DEBUG - Pod : ctest-pod-03937666 UUID is 9c6c96d7-fdda-47a9-b98a-44741bac2f47
2024-08-24 01:50:30,464 - DEBUG - Pod ctest-pod-87162625 not present
2024-08-24 01:50:30,464 - INFO - Creating Pod ctest-pod-87162625
2024-08-24 01:50:30,837 - DEBUG - Pod : ctest-pod-87162625 UUID is 7e9d033e-a12c-4f92-a51e-556d8fcb1f52
2024-08-24 01:50:30,839 - DEBUG - Pod ctest-pod-46428918 not present
2024-08-24 01:50:30,839 - INFO - Creating Pod ctest-pod-46428918
2024-08-24 01:50:30,858 - DEBUG - Pod : ctest-pod-46428918 UUID is 17c8ff40-9f45-44ce-9218-b25b70c9cf73
2024-08-24 01:50:30,860 - DEBUG - Pod ctest-pod-42374218 not present
2024-08-24 01:50:30,860 - INFO - Creating Pod ctest-pod-42374218
2024-08-24 01:50:30,886 - DEBUG - Pod : ctest-pod-42374218 UUID is 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9
2024-08-24 01:50:30,889 - DEBUG - Pod ctest-pod-97269066 not present
2024-08-24 01:50:30,889 - INFO - Creating Pod ctest-pod-97269066
2024-08-24 01:50:30,908 - DEBUG - Pod : ctest-pod-97269066 UUID is 65ec1192-4af1-41c8-80b0-709f9acd6214
2024-08-24 01:50:30,910 - DEBUG - Pod ctest-pod-44212692 not present
2024-08-24 01:50:30,911 - INFO - Creating Pod ctest-pod-44212692
2024-08-24 01:50:30,927 - DEBUG - Pod : ctest-pod-44212692 UUID is a39421a7-e646-40a5-8110-98fb24ac9a83
2024-08-24 01:50:30,931 - DEBUG - Pod ctest-pod-24992353 not present
2024-08-24 01:50:30,931 - INFO - Creating Pod ctest-pod-24992353
2024-08-24 01:50:30,948 - DEBUG - Pod : ctest-pod-24992353 UUID is 720c6929-1201-47b6-ad06-2ae21f0903f3
2024-08-24 01:50:31,119 - INFO - Project default-domain:k8s-ctest-new-default-90435807 for Namespace ctest-new-default-90435807 is seen in contrail-api
2024-08-24 01:50:31,119 - DEBUG - Project uuid in Contrail is ee234d29-1bf9-484f-a6b3-cca2909c51c5
2024-08-24 01:50:31,256 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=2700297e-09f9-477e-bbbc-e048b7f1aa40
2024-08-24 01:50:31,265 - INFO - Namespace ctest-new-default-90435807 with uuid 2700297e-09f9-477e-bbbc-e048b7f1aa40 found in kube manager
2024-08-24 01:50:31,265 - INFO - Namespace ctest-new-default-90435807 verification passed
2024-08-24 01:50:31,493 - INFO - Project default-domain:k8s-ctest-non-default-69761171 for Namespace ctest-non-default-69761171 is seen in contrail-api
2024-08-24 01:50:31,493 - DEBUG - Project uuid in Contrail is d8895ec6-a610-4874-858e-a9292c3e6666
2024-08-24 01:50:31,494 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=7212ad51-5f89-46a5-a40e-6e4dcb26a5e0
2024-08-24 01:50:31,498 - INFO - Namespace ctest-non-default-69761171 with uuid 7212ad51-5f89-46a5-a40e-6e4dcb26a5e0 found in kube manager
2024-08-24 01:50:31,498 - INFO - Namespace ctest-non-default-69761171 verification passed
2024-08-24 01:50:31,506 - DEBUG - Pod ctest-pod-42562420 not in running state.Currently in Pending
2024-08-24 01:50:36,518 - DEBUG - Pod ctest-pod-42562420 not in running state.Currently in Pending
2024-08-24 01:50:41,526 - INFO - Pod ctest-pod-42562420 is in running state.Got IP 10.47.255.251
2024-08-24 01:50:41,539 - DEBUG - Pod ctest-pod-42562420 has vmi 3f736fe8-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:41,539 - INFO - Verified pod ctest-pod-42562420 in contrail-api
2024-08-24 01:50:41,553 - DEBUG - VMI 3f736fe8-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:41,553 - INFO - Verified Pod ctest-pod-42562420 in agent 10.0.0.28
2024-08-24 01:50:41,553 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=1aa6bb33-3b97-44f9-9e6a-59ee7c2db329
2024-08-24 01:50:41,558 - INFO - Pod ctest-pod-42562420 with uuid 1aa6bb33-3b97-44f9-9e6a-59ee7c2db329 found in kube manager
2024-08-24 01:50:41,558 - INFO - Pod ctest-pod-42562420 verification passed
2024-08-24 01:50:41,562 - DEBUG - Pod ctest-pod-03937666 not in running state.Currently in Pending
2024-08-24 01:50:46,569 - INFO - Pod ctest-pod-03937666 is in running state.Got IP 10.47.255.250
2024-08-24 01:50:46,592 - DEBUG - Pod ctest-pod-03937666 has vmi 3fe449a2-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:46,592 - INFO - Verified pod ctest-pod-03937666 in contrail-api
2024-08-24 01:50:46,621 - DEBUG - VMI 3fe449a2-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:46,622 - INFO - Verified Pod ctest-pod-03937666 in agent 10.0.0.28
2024-08-24 01:50:46,622 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=9c6c96d7-fdda-47a9-b98a-44741bac2f47
2024-08-24 01:50:46,632 - INFO - Pod ctest-pod-03937666 with uuid 9c6c96d7-fdda-47a9-b98a-44741bac2f47 found in kube manager
2024-08-24 01:50:46,632 - INFO - Pod ctest-pod-03937666 verification passed
2024-08-24 01:50:46,638 - INFO - Pod ctest-pod-87162625 is in running state.Got IP 10.47.255.249
2024-08-24 01:50:46,689 - DEBUG - Pod ctest-pod-87162625 has vmi 4072b5e8-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:46,689 - INFO - Verified pod ctest-pod-87162625 in contrail-api
2024-08-24 01:50:46,749 - DEBUG - VMI 4072b5e8-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:46,749 - INFO - Verified Pod ctest-pod-87162625 in agent 10.0.0.28
2024-08-24 01:50:46,749 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=7e9d033e-a12c-4f92-a51e-556d8fcb1f52
2024-08-24 01:50:46,766 - INFO - Pod ctest-pod-87162625 with uuid 7e9d033e-a12c-4f92-a51e-556d8fcb1f52 found in kube manager
2024-08-24 01:50:46,766 - INFO - Pod ctest-pod-87162625 verification passed
2024-08-24 01:50:46,772 - INFO - Pod ctest-pod-46428918 is in running state.Got IP 10.47.255.248
2024-08-24 01:50:46,783 - DEBUG - Pod ctest-pod-46428918 has vmi 40e81270-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:46,783 - INFO - Verified pod ctest-pod-46428918 in contrail-api
2024-08-24 01:50:46,801 - DEBUG - VMI 40e81270-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:46,801 - INFO - Verified Pod ctest-pod-46428918 in agent 10.0.0.28
2024-08-24 01:50:46,802 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=17c8ff40-9f45-44ce-9218-b25b70c9cf73
2024-08-24 01:50:46,806 - INFO - Pod ctest-pod-46428918 with uuid 17c8ff40-9f45-44ce-9218-b25b70c9cf73 found in kube manager
2024-08-24 01:50:46,806 - INFO - Pod ctest-pod-46428918 verification passed
2024-08-24 01:50:46,811 - DEBUG - Pod ctest-pod-42374218 not in running state.Currently in Pending
2024-08-24 01:50:51,818 - INFO - Pod ctest-pod-42374218 is in running state.Got IP 10.47.255.247
2024-08-24 01:50:51,828 - DEBUG - Pod ctest-pod-42374218 has vmi 415b6b4e-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:51,828 - INFO - Verified pod ctest-pod-42374218 in contrail-api
2024-08-24 01:50:51,855 - DEBUG - VMI 415b6b4e-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:51,855 - INFO - Verified Pod ctest-pod-42374218 in agent 10.0.0.28
2024-08-24 01:50:51,855 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=63d1b4e1-5fde-4f2d-a772-3fe49cf908f9
2024-08-24 01:50:51,860 - INFO - Pod ctest-pod-42374218 with uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 found in kube manager
2024-08-24 01:50:51,860 - INFO - Pod ctest-pod-42374218 verification passed
2024-08-24 01:50:51,866 - INFO - Pod ctest-pod-44212692 is in running state.Got IP 10.47.255.245
2024-08-24 01:50:51,917 - DEBUG - Pod ctest-pod-44212692 has vmi 42394f86-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:51,917 - INFO - Verified pod ctest-pod-44212692 in contrail-api
2024-08-24 01:50:51,946 - DEBUG - VMI 42394f86-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:51,947 - INFO - Verified Pod ctest-pod-44212692 in agent 10.0.0.28
2024-08-24 01:50:51,947 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=a39421a7-e646-40a5-8110-98fb24ac9a83
2024-08-24 01:50:51,951 - INFO - Pod ctest-pod-44212692 with uuid a39421a7-e646-40a5-8110-98fb24ac9a83 found in kube manager
2024-08-24 01:50:51,951 - INFO - Pod ctest-pod-44212692 verification passed
2024-08-24 01:50:51,957 - INFO - Pod ctest-pod-97269066 is in running state.Got IP 10.47.255.246
2024-08-24 01:50:51,969 - DEBUG - Pod ctest-pod-97269066 has vmi 41c522c8-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:51,969 - INFO - Verified pod ctest-pod-97269066 in contrail-api
2024-08-24 01:50:51,999 - DEBUG - VMI 41c522c8-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:51,999 - INFO - Verified Pod ctest-pod-97269066 in agent 10.0.0.28
2024-08-24 01:50:51,999 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=65ec1192-4af1-41c8-80b0-709f9acd6214
2024-08-24 01:50:52,004 - INFO - Pod ctest-pod-97269066 with uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 found in kube manager
2024-08-24 01:50:52,004 - INFO - Pod ctest-pod-97269066 verification passed
2024-08-24 01:50:52,009 - INFO - Pod ctest-pod-24992353 is in running state.Got IP 10.47.255.244
2024-08-24 01:50:52,019 - DEBUG - Pod ctest-pod-24992353 has vmi 42aafd84-61bb-11ef-bf3a-fa163e095e1e
2024-08-24 01:50:52,019 - INFO - Verified pod ctest-pod-24992353 in contrail-api
2024-08-24 01:50:52,044 - DEBUG - VMI 42aafd84-61bb-11ef-bf3a-fa163e095e1e is active in agent 10.0.0.28
2024-08-24 01:50:52,044 - INFO - Verified Pod ctest-pod-24992353 in agent 10.0.0.28
2024-08-24 01:50:52,044 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=720c6929-1201-47b6-ad06-2ae21f0903f3
2024-08-24 01:50:52,049 - INFO - Pod ctest-pod-24992353 with uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 found in kube manager
2024-08-24 01:50:52,049 - INFO - Pod ctest-pod-24992353 verification passed
2024-08-24 01:50:52,049 - INFO - ================================================================================
2024-08-24 01:50:52,049 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-08-24 01:50:52,049 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-08-24 01:50:52,386 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.24': '0'}} with
2024-08-24 01:50:52,386 - INFO - Initial checks done. Running the testcase now
2024-08-24 01:50:52,386 - INFO -
2024-08-24 01:50:52,521 - DEBUG - [Pod ctest-pod-42562420] Cmd: echo ctest-pod-42562420 > /usr/share/nginx/html/index.html, Output:
2024-08-24 01:50:52,604 - DEBUG - [Pod ctest-pod-03937666] Cmd: echo ctest-pod-03937666 > /usr/share/nginx/html/index.html, Output:
2024-08-24 01:50:52,697 - DEBUG - [Pod ctest-pod-87162625] Cmd: echo ctest-pod-87162625 > /usr/share/nginx/html/index.html, Output:
2024-08-24 01:50:52,780 - DEBUG - [Pod ctest-pod-46428918] Cmd: echo ctest-pod-46428918 > /usr/share/nginx/html/index.html, Output:
2024-08-24 01:50:52,783 - DEBUG - Service ctest-nginx-svc-82763991 not present
2024-08-24 01:50:52,783 - INFO - Creating service ctest-nginx-svc-82763991
2024-08-24 01:50:52,796 - INFO - Created Service ctest-nginx-svc-82763991
2024-08-24 01:50:52,802 - WARNING - Service UUID 274c854a-8e82-45ff-b351-2250013156ed not yet found in contrail-api
2024-08-24 01:50:53,808 - INFO - Validated that Service ctest-nginx-svc-82763991 is seen in contrail-api
2024-08-24 01:50:53,808 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=274c854a-8e82-45ff-b351-2250013156ed
2024-08-24 01:50:53,815 - INFO - Service ctest-nginx-svc-82763991 with uuid 274c854a-8e82-45ff-b351-2250013156ed found in kube manager
2024-08-24 01:50:53,815 - INFO - Service ctest-nginx-svc-82763991 verification passed
2024-08-24 01:50:53,977 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:50:53,977 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:50:53,977 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:50:54,077 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42562420
2024-08-24 01:50:54,077 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:50:54,077 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42562420
2024-08-24 01:50:54,151 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03937666
2024-08-24 01:50:54,151 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:50:54,151 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03937666
2024-08-24 01:50:54,151 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42562420': 2, 'ctest-pod-03937666': 1}
2024-08-24 01:50:54,229 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:50:54,230 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:50:54,230 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:50:54,292 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03937666
2024-08-24 01:50:54,292 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:50:54,292 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03937666
2024-08-24 01:50:54,292 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42562420': 1, 'ctest-pod-03937666': 1}
2024-08-24 01:50:54,295 - DEBUG - Network policy ingress-on-service not present
2024-08-24 01:50:54,295 - INFO - Creating Network Policy ingress-on-service
2024-08-24 01:50:54,305 - INFO - Network policy found in k8s
2024-08-24 01:50:54,305 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2ee48348-99d0-43f1-8c04-0f4610c92f20
2024-08-24 01:50:54,310 - INFO - Network Policy ingress-on-service with uuid 2ee48348-99d0-43f1-8c04-0f4610c92f20 found in kube manager
2024-08-24 01:50:54,348 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-08-24 01:50:54,348 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-08-24 01:50:54,348 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2ee48348-99d0-43f1-8c04-0f4610c92f20
2024-08-24 01:50:54,378 - WARNING - Network policy with name ingress-on-service not found in agent
2024-08-24 01:50:56,379 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2ee48348-99d0-43f1-8c04-0f4610c92f20
2024-08-24 01:50:56,421 - INFO - Network policy with name ingress-on-service found in agent
2024-08-24 01:50:56,421 - INFO - Network Policy ingress-on-service verification passed
2024-08-24 01:51:01,535 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:01,535 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:01,535 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:06,641 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:06,641 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:06,641 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:11,795 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:11,795 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:11,795 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:16,942 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:16,943 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:16,943 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:22,076 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:22,077 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:22,077 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:27,154 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:27,154 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:27,154 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:32,257 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:32,257 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:32,257 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:37,373 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:37,373 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:37,373 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:42,499 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:42,499 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:42,499 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:47,658 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:47,658 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:47,658 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:47,658 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42562420': 0, 'ctest-pod-03937666': 0}
2024-08-24 01:51:47,768 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-03937666
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:51:47,768 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:51:47,768 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: ctest-pod-03937666
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:51:47,873 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42562420
2024-08-24 01:51:47,873 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:51:47,873 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42562420
2024-08-24 01:51:47,873 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42562420': 1, 'ctest-pod-03937666': 1}
2024-08-24 01:51:52,942 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:52,942 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:52,942 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:58,070 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:58,070 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:51:58,070 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:03,189 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:03,189 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:03,189 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:08,347 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:08,347 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:08,347 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:13,651 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:13,651 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:13,651 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:18,760 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:18,760 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:18,760 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:23,890 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:23,890 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:23,890 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:28,990 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:28,990 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:28,990 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:34,068 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:34,069 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:34,069 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:39,158 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:39,158 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:39,158 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:52:39,158 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42562420': 0, 'ctest-pod-03937666': 0}
2024-08-24 01:52:41,329 - DEBUG - [Pod ctest-pod-97269066] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=4.382 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.134 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.143 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.134/1.553/4.382 ms
2024-08-24 01:52:41,329 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97269066 with expectation True passed
2024-08-24 01:52:43,466 - DEBUG - [Pod ctest-pod-42374218] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=4.124 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.138 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.166 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.138/1.476/4.124 ms
2024-08-24 01:52:43,466 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42374218 with expectation True passed
2024-08-24 01:52:45,587 - DEBUG - [Pod ctest-pod-44212692] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.764 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.268 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.142 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.142/1.058/2.764 ms
2024-08-24 01:52:45,587 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-44212692 with expectation True passed
2024-08-24 01:52:45,694 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:52:45,694 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-24 01:52:45,694 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:52:45,694 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97269066 passed
2024-08-24 01:52:45,783 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:52:45,783 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-24 01:52:45,783 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:52:45,783 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97269066 passed
2024-08-24 01:52:50,878 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-24 01:52:50,878 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-24 01:52:50,878 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-24 01:52:50,878 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42374218 passed
2024-08-24 01:52:55,996 - DEBUG - [Pod ctest-pod-24992353] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-24 01:52:55,996 - DEBUG - [Pod Pod ctest-pod-24992353] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-24 01:52:55,996 - DEBUG - [Pod Pod ctest-pod-24992353] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-24 01:52:55,996 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24992353 passed
2024-08-24 01:52:56,004 - INFO - Updating Network Policy ingress-on-service
2024-08-24 01:53:01,125 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:01,125 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:01,125 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:06,255 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:06,255 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:06,255 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:11,399 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:11,399 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:11,399 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:16,509 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:16,509 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:16,509 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:21,617 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:21,617 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:21,617 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:26,715 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:26,715 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:26,715 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:31,828 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:31,828 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:31,828 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:36,936 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:36,936 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:36,936 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:42,044 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:42,044 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:42,044 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:47,168 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:47,168 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:47,168 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
wget: download timed out
2024-08-24 01:53:47,168 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42562420': 0, 'ctest-pod-03937666': 0}
2024-08-24 01:53:47,302 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
ctest-pod-03937666
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,302 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:53:47,302 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: Connecting to 10.102.212.120:80 (10.102.212.120:80)
ctest-pod-03937666
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,399 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-03937666
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,399 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:53:47,399 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: ctest-pod-03937666
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,477 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,477 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:53:47,477 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,477 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42562420': 1, 'ctest-pod-03937666': 2}
2024-08-24 01:53:47,563 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,563 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:53:47,563 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: ctest-pod-42562420
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,633 - DEBUG - [Pod ctest-pod-44212692] Cmd: wget http://10.102.212.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-03937666
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,633 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd wget http://10.102.212.120:80/ -O - -T 5 -t 1 passed
2024-08-24 01:53:47,633 - DEBUG - [Pod Pod ctest-pod-44212692] Cmd output: ctest-pod-03937666
Connecting to 10.102.212.120:80 (10.102.212.120:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-24 01:53:47,633 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42562420': 1, 'ctest-pod-03937666': 1}
2024-08-24 01:53:49,707 - DEBUG - [Pod ctest-pod-97269066] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.945 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.127 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.143 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.127/0.405/0.945 ms
2024-08-24 01:53:49,707 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97269066 with expectation True passed
2024-08-24 01:53:51,845 - DEBUG - [Pod ctest-pod-42374218] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.906 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.135 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.133 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.133/1.058/2.906 ms
2024-08-24 01:53:51,845 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42374218 with expectation True passed
2024-08-24 01:53:53,948 - DEBUG - [Pod ctest-pod-44212692] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.936 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.185 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.148 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.148/1.089/2.936 ms
2024-08-24 01:53:53,948 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-44212692 with expectation True passed
2024-08-24 01:53:54,093 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:53:54,093 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-24 01:53:54,093 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:53:54,093 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97269066 passed
2024-08-24 01:53:54,180 - DEBUG - [Pod ctest-pod-97269066] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:53:54,181 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-24 01:53:54,181 - DEBUG - [Pod Pod ctest-pod-97269066] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:53:54,181 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97269066 passed
2024-08-24 01:53:59,266 - DEBUG - [Pod ctest-pod-42374218] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-24 01:53:59,267 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-24 01:53:59,267 - DEBUG - [Pod Pod ctest-pod-42374218] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-24 01:53:59,267 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42374218 passed
2024-08-24 01:53:59,390 - DEBUG - [Pod ctest-pod-24992353] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:53:59,390 - DEBUG - [Pod Pod ctest-pod-24992353] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-24 01:53:59,390 - DEBUG - [Pod Pod ctest-pod-24992353] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-24 01:53:59,390 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24992353 passed
2024-08-24 01:53:59,390 - INFO - Deleting Network Policy : ingress-on-service
2024-08-24 01:53:59,391 - INFO - Deleting service : ctest-nginx-svc-82763991
2024-08-24 01:53:59,713 - DEBUG - No XMPP flaps were noticed during the test
2024-08-24 01:53:59,713 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07]
2024-08-24 01:53:59,713 - INFO - --------------------------------------------------------------------------------
2024-08-24 01:53:59,718 - INFO - Deleting pod ctest-new-default-90435807:ctest-pod-42562420
2024-08-24 01:53:59,719 - INFO - Deleting pod ctest-new-default-90435807:ctest-pod-03937666
2024-08-24 01:53:59,719 - INFO - Deleting pod ctest-non-default-69761171:ctest-pod-87162625
2024-08-24 01:53:59,719 - INFO - Deleting pod ctest-non-default-69761171:ctest-pod-46428918
2024-08-24 01:53:59,720 - INFO - Deleting pod ctest-new-default-90435807:ctest-pod-42374218
2024-08-24 01:53:59,720 - INFO - Deleting pod ctest-new-default-90435807:ctest-pod-97269066
2024-08-24 01:53:59,720 - INFO - Deleting pod ctest-non-default-69761171:ctest-pod-44212692
2024-08-24 01:53:59,721 - INFO - Deleting pod ctest-non-default-69761171:ctest-pod-24992353
2024-08-24 01:53:59,803 - WARNING - Pod uuid 1aa6bb33-3b97-44f9-9e6a-59ee7c2db329 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,866 - WARNING - Pod uuid 17c8ff40-9f45-44ce-9218-b25b70c9cf73 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,867 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,868 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,868 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,869 - WARNING - Pod uuid 9c6c96d7-fdda-47a9-b98a-44741bac2f47 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,869 - WARNING - Pod uuid 7e9d033e-a12c-4f92-a51e-556d8fcb1f52 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:53:59,869 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:04,820 - DEBUG - Pod 1aa6bb33-3b97-44f9-9e6a-59ee7c2db329 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:04,832 - DEBUG - VMI 3f736fe8-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:04,832 - INFO - Verified that pod ctest-pod-42562420 is removed in agent
2024-08-24 01:54:04,936 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:04,936 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:04,938 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:04,938 - DEBUG - Pod 7e9d033e-a12c-4f92-a51e-556d8fcb1f52 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:04,940 - DEBUG - Pod 17c8ff40-9f45-44ce-9218-b25b70c9cf73 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:04,941 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:04,942 - DEBUG - Pod 9c6c96d7-fdda-47a9-b98a-44741bac2f47 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:04,970 - DEBUG - VMI 4072b5e8-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:04,970 - INFO - Verified that pod ctest-pod-87162625 is removed in agent
2024-08-24 01:54:04,971 - DEBUG - VMI 40e81270-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:04,971 - INFO - Verified that pod ctest-pod-46428918 is removed in agent
2024-08-24 01:54:04,971 - DEBUG - VMI 3fe449a2-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:04,971 - INFO - Verified that pod ctest-pod-03937666 is removed in agent
2024-08-24 01:54:09,977 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:09,983 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:09,983 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:09,984 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:14,993 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:15,026 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:15,028 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:15,028 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:20,008 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:20,063 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:20,064 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:20,065 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:25,024 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:25,094 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:25,096 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:25,097 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:30,042 - WARNING - Pod uuid 65ec1192-4af1-41c8-80b0-709f9acd6214 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:30,125 - WARNING - Pod uuid a39421a7-e646-40a5-8110-98fb24ac9a83 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:30,126 - WARNING - Pod uuid 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:30,127 - WARNING - Pod uuid 720c6929-1201-47b6-ad06-2ae21f0903f3 is still seen in agent 10.0.0.28 VM list
2024-08-24 01:54:35,057 - DEBUG - Pod 65ec1192-4af1-41c8-80b0-709f9acd6214 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:35,073 - DEBUG - VMI 41c522c8-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:35,074 - INFO - Verified that pod ctest-pod-97269066 is removed in agent
2024-08-24 01:54:35,160 - DEBUG - Pod a39421a7-e646-40a5-8110-98fb24ac9a83 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:35,166 - DEBUG - Pod 63d1b4e1-5fde-4f2d-a772-3fe49cf908f9 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:35,168 - DEBUG - Pod 720c6929-1201-47b6-ad06-2ae21f0903f3 is not in agent 10.0.0.28 VM list
2024-08-24 01:54:35,198 - DEBUG - VMI 42aafd84-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:35,198 - INFO - Verified that pod ctest-pod-24992353 is removed in agent
2024-08-24 01:54:35,200 - DEBUG - VMI 415b6b4e-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:35,200 - INFO - Verified that pod ctest-pod-42374218 is removed in agent
2024-08-24 01:54:35,200 - DEBUG - VMI 42394f86-61bb-11ef-bf3a-fa163e095e1e is removed from agent 10.0.0.28
2024-08-24 01:54:35,200 - INFO - Verified that pod ctest-pod-44212692 is removed in agent
2024-08-24 01:54:35,201 - INFO - Deleting namespace ctest-non-default-69761171
2024-08-24 01:54:35,218 - DEBUG - Namespace ctest-non-default-69761171 still in k8s
2024-08-24 01:54:37,226 - DEBUG - Namespace ctest-non-default-69761171 still in k8s
2024-08-24 01:54:39,231 - DEBUG - Namespace ctest-non-default-69761171 still in k8s
2024-08-24 01:54:41,234 - DEBUG - Namespace ctest-non-default-69761171 is not in k8s
2024-08-24 01:54:41,234 - DEBUG - No need to check project deletion in contrail-api
2024-08-24 01:54:41,234 - INFO - Deleting namespace ctest-new-default-90435807
2024-08-24 01:54:41,246 - DEBUG - Namespace ctest-new-default-90435807 still in k8s
2024-08-24 01:54:43,250 - DEBUG - Namespace ctest-new-default-90435807 still in k8s
2024-08-24 01:54:45,255 - DEBUG - Namespace ctest-new-default-90435807 still in k8s
2024-08-24 01:54:47,294 - DEBUG - Namespace ctest-new-default-90435807 is not in k8s
2024-08-24 01:54:47,295 - DEBUG - No need to check project deletion in contrail-api