2024-08-20 08:11:50,588 - INFO - Using existing project ['default-domain', 'k8s-default'](b6c19a81-b625-474d-b4b3-d8d9edd108a3)
2024-08-20 08:11:50,619 - DEBUG - Namespace ctest-new-default-40465301 not present
2024-08-20 08:11:50,630 - INFO - Created namespace ctest-new-default-40465301
2024-08-20 08:11:53,634 - DEBUG - Namespace ctest-non-default-60545310 not present
2024-08-20 08:11:53,642 - INFO - Created namespace ctest-non-default-60545310
2024-08-20 08:11:56,680 - DEBUG - Pod ctest-pod-82652917 not present
2024-08-20 08:11:56,681 - INFO - Creating Pod ctest-pod-82652917
2024-08-20 08:11:56,743 - DEBUG - Pod : ctest-pod-82652917 UUID is b5ad2009-92f7-45d6-875a-250f5bd1f74c
2024-08-20 08:11:56,746 - DEBUG - Pod ctest-pod-19627368 not present
2024-08-20 08:11:56,747 - INFO - Creating Pod ctest-pod-19627368
2024-08-20 08:11:56,768 - DEBUG - Pod : ctest-pod-19627368 UUID is 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2
2024-08-20 08:11:56,770 - DEBUG - Pod ctest-pod-51827786 not present
2024-08-20 08:11:56,770 - INFO - Creating Pod ctest-pod-51827786
2024-08-20 08:11:56,792 - DEBUG - Pod : ctest-pod-51827786 UUID is 2f7a0b2b-b9ca-4434-a710-d430c7772e40
2024-08-20 08:11:56,800 - DEBUG - Pod ctest-pod-04779540 not present
2024-08-20 08:11:56,801 - INFO - Creating Pod ctest-pod-04779540
2024-08-20 08:11:56,827 - DEBUG - Pod : ctest-pod-04779540 UUID is d5386cf3-1ebd-410a-8f42-1fc3d72b83a6
2024-08-20 08:11:56,830 - DEBUG - Pod ctest-pod-21508578 not present
2024-08-20 08:11:56,830 - INFO - Creating Pod ctest-pod-21508578
2024-08-20 08:11:56,850 - DEBUG - Pod : ctest-pod-21508578 UUID is 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd
2024-08-20 08:11:56,852 - DEBUG - Pod ctest-pod-98754504 not present
2024-08-20 08:11:56,852 - INFO - Creating Pod ctest-pod-98754504
2024-08-20 08:11:56,869 - DEBUG - Pod : ctest-pod-98754504 UUID is f40a7a24-0790-4a8a-ac68-bed362b1ed45
2024-08-20 08:11:56,871 - DEBUG - Pod ctest-pod-71135215 not present
2024-08-20 08:11:56,871 - INFO - Creating Pod ctest-pod-71135215
2024-08-20 08:11:56,895 - DEBUG - Pod : ctest-pod-71135215 UUID is c5c978eb-078d-4bfa-b814-77e40edacc48
2024-08-20 08:11:56,899 - DEBUG - Pod ctest-pod-98724141 not present
2024-08-20 08:11:56,899 - INFO - Creating Pod ctest-pod-98724141
2024-08-20 08:11:56,921 - DEBUG - Pod : ctest-pod-98724141 UUID is 5c7285fb-1cd1-45b4-ab66-82fbb332aee0
2024-08-20 08:11:57,066 - INFO - Project default-domain:k8s-ctest-new-default-40465301 for Namespace ctest-new-default-40465301 is seen in contrail-api
2024-08-20 08:11:57,067 - DEBUG - Project uuid in Contrail is b13d0b7e-9d44-4ef6-b10d-a85ac28216d2
2024-08-20 08:11:57,223 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=0a227d95-2727-4620-9ef1-f89e0958f7ed
2024-08-20 08:11:57,228 - INFO - Namespace ctest-new-default-40465301 with uuid 0a227d95-2727-4620-9ef1-f89e0958f7ed found in kube manager
2024-08-20 08:11:57,228 - INFO - Namespace ctest-new-default-40465301 verification passed
2024-08-20 08:11:57,390 - INFO - Project default-domain:k8s-ctest-non-default-60545310 for Namespace ctest-non-default-60545310 is seen in contrail-api
2024-08-20 08:11:57,390 - DEBUG - Project uuid in Contrail is fd244f9b-2717-445b-96e3-6c5c9ee3e87c
2024-08-20 08:11:57,390 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=965b1703-b5b3-4f2f-add6-d9b7eefd2411
2024-08-20 08:11:57,395 - INFO - Namespace ctest-non-default-60545310 with uuid 965b1703-b5b3-4f2f-add6-d9b7eefd2411 found in kube manager
2024-08-20 08:11:57,395 - INFO - Namespace ctest-non-default-60545310 verification passed
2024-08-20 08:11:57,403 - DEBUG - Pod ctest-pod-82652917 not in running state.Currently in Pending
2024-08-20 08:12:02,419 - DEBUG - Pod ctest-pod-82652917 not in running state.Currently in Pending
2024-08-20 08:12:07,427 - DEBUG - Pod ctest-pod-82652917 not in running state.Currently in Pending
2024-08-20 08:12:12,433 - DEBUG - Pod ctest-pod-82652917 not in running state.Currently in Pending
2024-08-20 08:12:17,439 - INFO - Pod ctest-pod-82652917 is in running state.Got IP 10.47.255.251
2024-08-20 08:12:17,449 - DEBUG - Pod ctest-pod-82652917 has vmi dee1be42-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,449 - INFO - Verified pod ctest-pod-82652917 in contrail-api
2024-08-20 08:12:17,463 - DEBUG - VMI dee1be42-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,463 - INFO - Verified Pod ctest-pod-82652917 in agent 10.0.0.35
2024-08-20 08:12:17,463 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=b5ad2009-92f7-45d6-875a-250f5bd1f74c
2024-08-20 08:12:17,468 - INFO - Pod ctest-pod-82652917 with uuid b5ad2009-92f7-45d6-875a-250f5bd1f74c found in kube manager
2024-08-20 08:12:17,468 - INFO - Pod ctest-pod-82652917 verification passed
2024-08-20 08:12:17,473 - INFO - Pod ctest-pod-19627368 is in running state.Got IP 10.47.255.250
2024-08-20 08:12:17,526 - DEBUG - Pod ctest-pod-19627368 has vmi df54876a-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,526 - INFO - Verified pod ctest-pod-19627368 in contrail-api
2024-08-20 08:12:17,538 - DEBUG - VMI df54876a-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,539 - INFO - Verified Pod ctest-pod-19627368 in agent 10.0.0.35
2024-08-20 08:12:17,539 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2
2024-08-20 08:12:17,543 - INFO - Pod ctest-pod-19627368 with uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 found in kube manager
2024-08-20 08:12:17,543 - INFO - Pod ctest-pod-19627368 verification passed
2024-08-20 08:12:17,549 - INFO - Pod ctest-pod-51827786 is in running state.Got IP 10.47.255.249
2024-08-20 08:12:17,601 - DEBUG - Pod ctest-pod-51827786 has vmi dff52d0a-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,601 - INFO - Verified pod ctest-pod-51827786 in contrail-api
2024-08-20 08:12:17,613 - DEBUG - VMI dff52d0a-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,613 - INFO - Verified Pod ctest-pod-51827786 in agent 10.0.0.35
2024-08-20 08:12:17,613 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=2f7a0b2b-b9ca-4434-a710-d430c7772e40
2024-08-20 08:12:17,619 - INFO - Pod ctest-pod-51827786 with uuid 2f7a0b2b-b9ca-4434-a710-d430c7772e40 found in kube manager
2024-08-20 08:12:17,619 - INFO - Pod ctest-pod-51827786 verification passed
2024-08-20 08:12:17,624 - INFO - Pod ctest-pod-04779540 is in running state.Got IP 10.47.255.248
2024-08-20 08:12:17,636 - DEBUG - Pod ctest-pod-04779540 has vmi e07bb32a-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,636 - INFO - Verified pod ctest-pod-04779540 in contrail-api
2024-08-20 08:12:17,649 - DEBUG - VMI e07bb32a-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,649 - INFO - Verified Pod ctest-pod-04779540 in agent 10.0.0.35
2024-08-20 08:12:17,650 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=d5386cf3-1ebd-410a-8f42-1fc3d72b83a6
2024-08-20 08:12:17,654 - INFO - Pod ctest-pod-04779540 with uuid d5386cf3-1ebd-410a-8f42-1fc3d72b83a6 found in kube manager
2024-08-20 08:12:17,654 - INFO - Pod ctest-pod-04779540 verification passed
2024-08-20 08:12:17,659 - INFO - Pod ctest-pod-21508578 is in running state.Got IP 10.47.255.247
2024-08-20 08:12:17,710 - DEBUG - Pod ctest-pod-21508578 has vmi e12485f4-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,710 - INFO - Verified pod ctest-pod-21508578 in contrail-api
2024-08-20 08:12:17,722 - DEBUG - VMI e12485f4-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,722 - INFO - Verified Pod ctest-pod-21508578 in agent 10.0.0.35
2024-08-20 08:12:17,722 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd
2024-08-20 08:12:17,727 - INFO - Pod ctest-pod-21508578 with uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd found in kube manager
2024-08-20 08:12:17,727 - INFO - Pod ctest-pod-21508578 verification passed
2024-08-20 08:12:17,732 - INFO - Pod ctest-pod-71135215 is in running state.Got IP 10.47.255.245
2024-08-20 08:12:17,785 - DEBUG - Pod ctest-pod-71135215 has vmi e21ff3d0-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,785 - INFO - Verified pod ctest-pod-71135215 in contrail-api
2024-08-20 08:12:17,798 - DEBUG - VMI e21ff3d0-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,799 - INFO - Verified Pod ctest-pod-71135215 in agent 10.0.0.35
2024-08-20 08:12:17,799 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=c5c978eb-078d-4bfa-b814-77e40edacc48
2024-08-20 08:12:17,804 - INFO - Pod ctest-pod-71135215 with uuid c5c978eb-078d-4bfa-b814-77e40edacc48 found in kube manager
2024-08-20 08:12:17,804 - INFO - Pod ctest-pod-71135215 verification passed
2024-08-20 08:12:17,810 - INFO - Pod ctest-pod-98754504 is in running state.Got IP 10.47.255.246
2024-08-20 08:12:17,821 - DEBUG - Pod ctest-pod-98754504 has vmi e19a514e-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:17,821 - INFO - Verified pod ctest-pod-98754504 in contrail-api
2024-08-20 08:12:17,834 - DEBUG - VMI e19a514e-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:17,834 - INFO - Verified Pod ctest-pod-98754504 in agent 10.0.0.35
2024-08-20 08:12:17,835 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=f40a7a24-0790-4a8a-ac68-bed362b1ed45
2024-08-20 08:12:17,841 - INFO - Pod ctest-pod-98754504 with uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 found in kube manager
2024-08-20 08:12:17,841 - INFO - Pod ctest-pod-98754504 verification passed
2024-08-20 08:12:17,845 - DEBUG - Pod ctest-pod-98724141 not in running state.Currently in Pending
2024-08-20 08:12:22,852 - INFO - Pod ctest-pod-98724141 is in running state.Got IP 10.47.255.244
2024-08-20 08:12:22,905 - DEBUG - Pod ctest-pod-98724141 has vmi e29b8bda-5ecb-11ef-82c0-fa163ed59112
2024-08-20 08:12:22,905 - INFO - Verified pod ctest-pod-98724141 in contrail-api
2024-08-20 08:12:22,918 - DEBUG - VMI e29b8bda-5ecb-11ef-82c0-fa163ed59112 is active in agent 10.0.0.35
2024-08-20 08:12:22,919 - INFO - Verified Pod ctest-pod-98724141 in agent 10.0.0.35
2024-08-20 08:12:22,919 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=5c7285fb-1cd1-45b4-ab66-82fbb332aee0
2024-08-20 08:12:22,924 - INFO - Pod ctest-pod-98724141 with uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 found in kube manager
2024-08-20 08:12:22,924 - INFO - Pod ctest-pod-98724141 verification passed
2024-08-20 08:12:22,924 - INFO - ================================================================================
2024-08-20 08:12:22,924 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-08-20 08:12:22,924 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-08-20 08:12:23,157 - DEBUG - Nothing to compare xmpp stats {'10.0.0.35': {'10.0.0.12': '0'}} with
2024-08-20 08:12:23,157 - INFO - Initial checks done. Running the testcase now
2024-08-20 08:12:23,157 - INFO -
2024-08-20 08:12:23,210 - DEBUG - [Pod ctest-pod-82652917] Cmd: echo ctest-pod-82652917 > /usr/share/nginx/html/index.html, Output:
2024-08-20 08:12:23,277 - DEBUG - [Pod ctest-pod-19627368] Cmd: echo ctest-pod-19627368 > /usr/share/nginx/html/index.html, Output:
2024-08-20 08:12:23,344 - DEBUG - [Pod ctest-pod-51827786] Cmd: echo ctest-pod-51827786 > /usr/share/nginx/html/index.html, Output:
2024-08-20 08:12:23,417 - DEBUG - [Pod ctest-pod-04779540] Cmd: echo ctest-pod-04779540 > /usr/share/nginx/html/index.html, Output:
2024-08-20 08:12:23,419 - DEBUG - Service ctest-nginx-svc-61582897 not present
2024-08-20 08:12:23,420 - INFO - Creating service ctest-nginx-svc-61582897
2024-08-20 08:12:23,441 - INFO - Created Service ctest-nginx-svc-61582897
2024-08-20 08:12:23,449 - WARNING - Service UUID 1103bfb5-4319-4707-9f8a-ba1c4d3163fd not yet found in contrail-api
2024-08-20 08:12:24,456 - INFO - Validated that Service ctest-nginx-svc-61582897 is seen in contrail-api
2024-08-20 08:12:24,457 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=1103bfb5-4319-4707-9f8a-ba1c4d3163fd
2024-08-20 08:12:24,461 - INFO - Service ctest-nginx-svc-61582897 with uuid 1103bfb5-4319-4707-9f8a-ba1c4d3163fd found in kube manager
2024-08-20 08:12:24,462 - INFO - Service ctest-nginx-svc-61582897 verification passed
2024-08-20 08:12:25,540 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-82652917
2024-08-20 08:12:25,540 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:12:25,540 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-82652917
2024-08-20 08:12:25,604 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:12:25,604 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:12:25,604 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:12:25,604 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82652917': 1, 'ctest-pod-19627368': 1}
2024-08-20 08:12:25,679 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:12:25,680 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:12:25,680 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:12:25,744 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:12:25,744 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:12:25,744 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:12:25,744 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82652917': 1, 'ctest-pod-19627368': 1}
2024-08-20 08:12:25,749 - DEBUG - Network policy ingress-on-service not present
2024-08-20 08:12:25,749 - INFO - Creating Network Policy ingress-on-service
2024-08-20 08:12:25,762 - INFO - Network policy found in k8s
2024-08-20 08:12:25,763 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1e172daa-7ea6-4965-bf62-f9042fa1435f
2024-08-20 08:12:25,770 - INFO - Network Policy ingress-on-service with uuid 1e172daa-7ea6-4965-bf62-f9042fa1435f found in kube manager
2024-08-20 08:12:25,806 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-08-20 08:12:25,806 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-08-20 08:12:25,807 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1e172daa-7ea6-4965-bf62-f9042fa1435f
2024-08-20 08:12:25,837 - WARNING - Network policy with name ingress-on-service not found in agent
2024-08-20 08:12:27,840 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1e172daa-7ea6-4965-bf62-f9042fa1435f
2024-08-20 08:12:27,875 - INFO - Network policy with name ingress-on-service found in agent
2024-08-20 08:12:27,875 - INFO - Network Policy ingress-on-service verification passed
2024-08-20 08:12:32,936 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:32,936 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:32,936 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:38,004 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:38,004 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:38,004 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:43,076 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:43,076 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:43,076 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:49,260 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:49,260 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:49,261 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:54,310 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:54,310 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:54,310 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:59,377 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:59,377 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:12:59,377 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:04,431 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:04,431 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:04,431 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:09,496 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:09,496 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:09,496 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:14,556 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:14,556 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:14,556 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:19,602 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:19,602 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:19,602 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:19,602 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-82652917': 0, 'ctest-pod-19627368': 0}
2024-08-20 08:13:19,668 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19627368
2024-08-20 08:13:19,668 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:13:19,668 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19627368
2024-08-20 08:13:19,715 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:13:19,715 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:13:19,715 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:13:19,715 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82652917': 1, 'ctest-pod-19627368': 1}
2024-08-20 08:13:24,768 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:24,768 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:24,768 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:29,830 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:29,830 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:29,830 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:34,907 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:34,907 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:34,907 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:39,969 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:39,969 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:39,969 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:45,019 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:45,019 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:45,019 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:50,073 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:50,073 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:50,073 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:55,142 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:55,142 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:13:55,143 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:00,207 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:00,207 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:00,207 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:07,509 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:07,509 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:07,509 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:12,576 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:12,576 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:12,576 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:12,576 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-82652917': 0, 'ctest-pod-19627368': 0}
2024-08-20 08:14:17,053 - DEBUG - [Pod ctest-pod-98754504] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.746 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.308/0.746 ms
2024-08-20 08:14:17,053 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-98754504 with expectation True passed
2024-08-20 08:14:19,116 - DEBUG - [Pod ctest-pod-21508578] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.053 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.398/1.053 ms
2024-08-20 08:14:19,116 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21508578 with expectation True passed
2024-08-20 08:14:21,169 - DEBUG - [Pod ctest-pod-71135215] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.971 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.371/0.971 ms
2024-08-20 08:14:21,169 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71135215 with expectation True passed
2024-08-20 08:14:21,228 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:14:21,228 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-20 08:14:21,229 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:14:21,229 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98754504 passed
2024-08-20 08:14:21,281 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:14:21,281 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-20 08:14:21,281 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:14:21,281 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98754504 passed
2024-08-20 08:14:26,331 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 08:14:26,331 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 08:14:26,331 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 08:14:26,331 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21508578 passed
2024-08-20 08:14:31,387 - DEBUG - [Pod ctest-pod-98724141] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-20 08:14:31,387 - DEBUG - [Pod Pod ctest-pod-98724141] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-20 08:14:31,387 - DEBUG - [Pod Pod ctest-pod-98724141] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-08-20 08:14:31,387 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98724141 passed
2024-08-20 08:14:31,394 - INFO - Updating Network Policy ingress-on-service
2024-08-20 08:14:36,475 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:36,475 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:36,475 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:41,543 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:41,543 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:41,543 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:48,445 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:48,445 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:48,445 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:53,496 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:53,496 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:53,496 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:58,555 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:58,555 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:14:58,555 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:05,471 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:05,471 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:05,471 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:10,542 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:10,543 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:10,543 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:15,616 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:15,616 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:15,616 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:20,676 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:20,676 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:20,676 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:25,742 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:25,742 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:25,742 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
wget: download timed out
2024-08-20 08:15:25,742 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-82652917': 0, 'ctest-pod-19627368': 0}
2024-08-20 08:15:25,806 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:25,806 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:15:25,806 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:25,866 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-82652917
2024-08-20 08:15:25,866 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:15:25,866 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-82652917
2024-08-20 08:15:25,938 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:25,938 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:15:25,938 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:25,938 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82652917': 2, 'ctest-pod-19627368': 1}
2024-08-20 08:15:26,004 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:26,005 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:15:26,005 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: ctest-pod-82652917
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:26,059 - DEBUG - [Pod ctest-pod-71135215] Cmd: wget http://10.96.143.14:80/ -O - -T 5 -t 1 , Output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:26,059 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd wget http://10.96.143.14:80/ -O - -T 5 -t 1 passed
2024-08-20 08:15:26,060 - DEBUG - [Pod Pod ctest-pod-71135215] Cmd output: ctest-pod-19627368
Connecting to 10.96.143.14:80 (10.96.143.14:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-08-20 08:15:26,060 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82652917': 1, 'ctest-pod-19627368': 1}
2024-08-20 08:15:29,581 - DEBUG - [Pod ctest-pod-98754504] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.910 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.353/0.910 ms
2024-08-20 08:15:29,581 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-98754504 with expectation True passed
2024-08-20 08:15:31,633 - DEBUG - [Pod ctest-pod-21508578] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.101 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.145 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.439/1.101 ms
2024-08-20 08:15:31,633 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21508578 with expectation True passed
2024-08-20 08:15:33,700 - DEBUG - [Pod ctest-pod-71135215] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.699 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.288/0.699 ms
2024-08-20 08:15:33,700 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-71135215 with expectation True passed
2024-08-20 08:15:33,766 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:15:33,766 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-20 08:15:33,766 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:15:33,766 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98754504 passed
2024-08-20 08:15:33,837 - DEBUG - [Pod ctest-pod-98754504] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:15:33,837 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-08-20 08:15:33,837 - DEBUG - [Pod Pod ctest-pod-98754504] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:15:33,837 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98754504 passed
2024-08-20 08:15:38,889 - DEBUG - [Pod ctest-pod-21508578] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 08:15:38,889 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 08:15:38,889 - DEBUG - [Pod Pod ctest-pod-21508578] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-08-20 08:15:38,889 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21508578 passed
2024-08-20 08:15:38,957 - DEBUG - [Pod ctest-pod-98724141] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:15:38,957 - DEBUG - [Pod Pod ctest-pod-98724141] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-08-20 08:15:38,957 - DEBUG - [Pod Pod ctest-pod-98724141] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-08-20 08:15:38,957 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98724141 passed
2024-08-20 08:15:38,957 - INFO - Deleting Network Policy : ingress-on-service
2024-08-20 08:15:38,958 - INFO - Deleting service : ctest-nginx-svc-61582897
2024-08-20 08:15:39,188 - DEBUG - No XMPP flaps were noticed during the test
2024-08-20 08:15:39,189 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:17]
2024-08-20 08:15:39,189 - INFO - --------------------------------------------------------------------------------
2024-08-20 08:15:39,194 - INFO - Deleting pod ctest-new-default-40465301:ctest-pod-82652917
2024-08-20 08:15:39,194 - INFO - Deleting pod ctest-new-default-40465301:ctest-pod-19627368
2024-08-20 08:15:39,195 - INFO - Deleting pod ctest-non-default-60545310:ctest-pod-51827786
2024-08-20 08:15:39,195 - INFO - Deleting pod ctest-non-default-60545310:ctest-pod-04779540
2024-08-20 08:15:39,196 - INFO - Deleting pod ctest-new-default-40465301:ctest-pod-21508578
2024-08-20 08:15:39,196 - INFO - Deleting pod ctest-new-default-40465301:ctest-pod-98754504
2024-08-20 08:15:39,196 - INFO - Deleting pod ctest-non-default-60545310:ctest-pod-71135215
2024-08-20 08:15:39,197 - INFO - Deleting pod ctest-non-default-60545310:ctest-pod-98724141
2024-08-20 08:15:39,301 - WARNING - Pod uuid b5ad2009-92f7-45d6-875a-250f5bd1f74c is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,302 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,318 - WARNING - Pod uuid d5386cf3-1ebd-410a-8f42-1fc3d72b83a6 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,327 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,328 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,328 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,329 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:39,946 - WARNING - Pod uuid 2f7a0b2b-b9ca-4434-a710-d430c7772e40 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:44,314 - DEBUG - Pod b5ad2009-92f7-45d6-875a-250f5bd1f74c is not in agent 10.0.0.35 VM list
2024-08-20 08:15:44,317 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:44,322 - DEBUG - VMI dee1be42-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:15:44,322 - INFO - Verified that pod ctest-pod-82652917 is removed in agent
2024-08-20 08:15:44,326 - DEBUG - Pod d5386cf3-1ebd-410a-8f42-1fc3d72b83a6 is not in agent 10.0.0.35 VM list
2024-08-20 08:15:44,349 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:44,350 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:44,350 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:44,351 - DEBUG - VMI e07bb32a-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:15:44,351 - INFO - Verified that pod ctest-pod-04779540 is removed in agent
2024-08-20 08:15:44,351 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:44,955 - DEBUG - Pod 2f7a0b2b-b9ca-4434-a710-d430c7772e40 is not in agent 10.0.0.35 VM list
2024-08-20 08:15:44,961 - DEBUG - VMI dff52d0a-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:15:44,961 - INFO - Verified that pod ctest-pod-51827786 is removed in agent
2024-08-20 08:15:49,325 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:49,368 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:49,370 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:49,371 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:49,371 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:54,333 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:54,390 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:54,392 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:54,392 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:54,393 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:59,343 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:59,408 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:59,410 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:59,411 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:15:59,411 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:04,353 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:04,431 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:04,433 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:04,434 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:04,434 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:09,366 - WARNING - Pod uuid c5c978eb-078d-4bfa-b814-77e40edacc48 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:09,449 - WARNING - Pod uuid f40a7a24-0790-4a8a-ac68-bed362b1ed45 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:09,449 - WARNING - Pod uuid 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:09,451 - WARNING - Pod uuid 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:09,451 - WARNING - Pod uuid 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is still seen in agent 10.0.0.35 VM list
2024-08-20 08:16:14,375 - DEBUG - Pod c5c978eb-078d-4bfa-b814-77e40edacc48 is not in agent 10.0.0.35 VM list
2024-08-20 08:16:14,381 - DEBUG - VMI e21ff3d0-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:16:14,381 - INFO - Verified that pod ctest-pod-71135215 is removed in agent
2024-08-20 08:16:14,472 - DEBUG - Pod 5c7285fb-1cd1-45b4-ab66-82fbb332aee0 is not in agent 10.0.0.35 VM list
2024-08-20 08:16:14,476 - DEBUG - Pod 5056f642-9e3f-4cc6-a9ed-d2ac4e9f02c2 is not in agent 10.0.0.35 VM list
2024-08-20 08:16:14,478 - DEBUG - Pod f40a7a24-0790-4a8a-ac68-bed362b1ed45 is not in agent 10.0.0.35 VM list
2024-08-20 08:16:14,479 - DEBUG - Pod 53e5b2b2-ffe4-44c9-9c15-8ddf89e1eecd is not in agent 10.0.0.35 VM list
2024-08-20 08:16:14,494 - DEBUG - VMI e29b8bda-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:16:14,494 - INFO - Verified that pod ctest-pod-98724141 is removed in agent
2024-08-20 08:16:14,497 - DEBUG - VMI e19a514e-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:16:14,497 - INFO - Verified that pod ctest-pod-98754504 is removed in agent
2024-08-20 08:16:14,497 - DEBUG - VMI df54876a-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:16:14,497 - INFO - Verified that pod ctest-pod-19627368 is removed in agent
2024-08-20 08:16:14,498 - DEBUG - VMI e12485f4-5ecb-11ef-82c0-fa163ed59112 is removed from agent 10.0.0.35
2024-08-20 08:16:14,498 - INFO - Verified that pod ctest-pod-21508578 is removed in agent
2024-08-20 08:16:14,498 - INFO - Deleting namespace ctest-non-default-60545310
2024-08-20 08:16:14,522 - DEBUG - Namespace ctest-non-default-60545310 still in k8s
2024-08-20 08:16:16,528 - DEBUG - Namespace ctest-non-default-60545310 still in k8s
2024-08-20 08:16:18,532 - DEBUG - Namespace ctest-non-default-60545310 still in k8s
2024-08-20 08:16:20,539 - DEBUG - Namespace ctest-non-default-60545310 is not in k8s
2024-08-20 08:16:20,539 - DEBUG - No need to check project deletion in contrail-api
2024-08-20 08:16:20,539 - INFO - Deleting namespace ctest-new-default-40465301
2024-08-20 08:16:20,549 - DEBUG - Namespace ctest-new-default-40465301 still in k8s
2024-08-20 08:16:22,554 - DEBUG - Namespace ctest-new-default-40465301 still in k8s
2024-08-20 08:16:24,558 - DEBUG - Namespace ctest-new-default-40465301 still in k8s
2024-08-20 08:16:26,562 - DEBUG - Namespace ctest-new-default-40465301 is not in k8s
2024-08-20 08:16:26,562 - DEBUG - No need to check project deletion in contrail-api