2025-04-25 06:54:55,659 - INFO - Using existing project ['default-domain', 'k8s-default'](854c7994-e4dd-4471-8296-ca6d26c778a5) 2025-04-25 06:54:55,681 - DEBUG - Namespace ctest-new-default-36737894 not present 2025-04-25 06:54:55,694 - INFO - Created namespace ctest-new-default-36737894 2025-04-25 06:54:58,700 - DEBUG - Namespace ctest-non-default-34546206 not present 2025-04-25 06:54:58,712 - INFO - Created namespace ctest-non-default-34546206 2025-04-25 06:55:01,746 - DEBUG - Pod ctest-pod-32987434 not present 2025-04-25 06:55:01,747 - INFO - Creating Pod ctest-pod-32987434 2025-04-25 06:55:01,832 - DEBUG - Pod : ctest-pod-32987434 UUID is 89ebf034-ded1-4776-b51f-a5600119cb37 2025-04-25 06:55:01,835 - DEBUG - Pod ctest-pod-57080366 not present 2025-04-25 06:55:01,836 - INFO - Creating Pod ctest-pod-57080366 2025-04-25 06:55:01,892 - DEBUG - Pod : ctest-pod-57080366 UUID is f2b89370-005f-4476-bfca-31d2e63ad718 2025-04-25 06:55:01,896 - DEBUG - Pod ctest-pod-52710772 not present 2025-04-25 06:55:01,897 - INFO - Creating Pod ctest-pod-52710772 2025-04-25 06:55:01,936 - DEBUG - Pod : ctest-pod-52710772 UUID is 35e6e46a-af23-4909-a996-aadb3dc0bac6 2025-04-25 06:55:01,949 - DEBUG - Pod ctest-pod-59054674 not present 2025-04-25 06:55:01,949 - INFO - Creating Pod ctest-pod-59054674 2025-04-25 06:55:02,005 - DEBUG - Pod : ctest-pod-59054674 UUID is ee382585-663f-4050-9d6b-fb81dc74a744 2025-04-25 06:55:02,011 - DEBUG - Pod ctest-pod-79575455 not present 2025-04-25 06:55:02,012 - INFO - Creating Pod ctest-pod-79575455 2025-04-25 06:55:02,067 - DEBUG - Pod : ctest-pod-79575455 UUID is acb29399-1de2-4853-9acc-9b630003d236 2025-04-25 06:55:02,075 - DEBUG - Pod ctest-pod-67204532 not present 2025-04-25 06:55:02,076 - INFO - Creating Pod ctest-pod-67204532 2025-04-25 06:55:02,113 - DEBUG - Pod : ctest-pod-67204532 UUID is 0d9857db-2f2d-47b7-a096-a2a612bd1829 2025-04-25 06:55:02,116 - DEBUG - Pod ctest-pod-44812470 not present 2025-04-25 06:55:02,116 - INFO - Creating Pod ctest-pod-44812470 2025-04-25 06:55:02,148 - DEBUG - Pod : ctest-pod-44812470 UUID is 627721d9-6c30-4dec-b22f-9efd00977658 2025-04-25 06:55:02,172 - DEBUG - Pod ctest-pod-76849082 not present 2025-04-25 06:55:02,172 - INFO - Creating Pod ctest-pod-76849082 2025-04-25 06:55:02,207 - DEBUG - Pod : ctest-pod-76849082 UUID is f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 2025-04-25 06:55:02,577 - INFO - Project default-domain:k8s-ctest-new-default-36737894 for Namespace ctest-new-default-36737894 is seen in contrail-api 2025-04-25 06:55:02,577 - DEBUG - Project uuid in Contrail is 19f2a9fa-36b4-4f87-8379-9681878d37bf 2025-04-25 06:55:02,814 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=61019502-802b-4b4b-9a96-239a8de491ee 2025-04-25 06:55:02,829 - INFO - Namespace ctest-new-default-36737894 with uuid 61019502-802b-4b4b-9a96-239a8de491ee found in kube manager 2025-04-25 06:55:02,829 - INFO - Namespace ctest-new-default-36737894 verification passed 2025-04-25 06:55:03,234 - INFO - Project default-domain:k8s-ctest-non-default-34546206 for Namespace ctest-non-default-34546206 is seen in contrail-api 2025-04-25 06:55:03,234 - DEBUG - Project uuid in Contrail is 85824c74-c95a-442c-8f46-ccc4aaaa7200 2025-04-25 06:55:03,234 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=bd15ea6f-22dc-401b-bdc9-001e51974506 2025-04-25 06:55:03,246 - INFO - Namespace ctest-non-default-34546206 with uuid bd15ea6f-22dc-401b-bdc9-001e51974506 found in kube manager 2025-04-25 06:55:03,246 - INFO - Namespace ctest-non-default-34546206 verification passed 2025-04-25 06:55:03,274 - DEBUG - Pod ctest-pod-32987434 not in running state.Currently in Pending 2025-04-25 06:55:08,282 - DEBUG - Pod ctest-pod-32987434 not in running state.Currently in Pending 2025-04-25 06:55:13,293 - DEBUG - Pod ctest-pod-32987434 not in running state.Currently in Pending 2025-04-25 06:55:18,300 - INFO - Pod ctest-pod-32987434 is in running state.Got IP 10.47.255.251 2025-04-25 06:55:18,314 - DEBUG - Pod ctest-pod-32987434 has vmi 36faad52-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:18,314 - INFO - Verified pod ctest-pod-32987434 in contrail-api 2025-04-25 06:55:18,333 - DEBUG - VMI 36faad52-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:18,333 - INFO - Verified Pod ctest-pod-32987434 in agent 10.0.0.19 2025-04-25 06:55:18,333 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=89ebf034-ded1-4776-b51f-a5600119cb37 2025-04-25 06:55:18,338 - INFO - Pod ctest-pod-32987434 with uuid 89ebf034-ded1-4776-b51f-a5600119cb37 found in kube manager 2025-04-25 06:55:18,338 - INFO - Pod ctest-pod-32987434 verification passed 2025-04-25 06:55:18,351 - INFO - Pod ctest-pod-57080366 is in running state.Got IP 10.47.255.250 2025-04-25 06:55:18,369 - DEBUG - Pod ctest-pod-57080366 has vmi 379a9812-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:18,369 - INFO - Verified pod ctest-pod-57080366 in contrail-api 2025-04-25 06:55:18,383 - DEBUG - VMI 379a9812-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:18,383 - INFO - Verified Pod ctest-pod-57080366 in agent 10.0.0.19 2025-04-25 06:55:18,383 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=f2b89370-005f-4476-bfca-31d2e63ad718 2025-04-25 06:55:18,388 - INFO - Pod ctest-pod-57080366 with uuid f2b89370-005f-4476-bfca-31d2e63ad718 found in kube manager 2025-04-25 06:55:18,388 - INFO - Pod ctest-pod-57080366 verification passed 2025-04-25 06:55:18,395 - INFO - Pod ctest-pod-52710772 is in running state.Got IP 10.47.255.249 2025-04-25 06:55:18,455 - DEBUG - Pod ctest-pod-52710772 has vmi 385f94f0-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:18,456 - INFO - Verified pod ctest-pod-52710772 in contrail-api 2025-04-25 06:55:18,475 - DEBUG - VMI 385f94f0-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:18,475 - INFO - Verified Pod ctest-pod-52710772 in agent 10.0.0.19 2025-04-25 06:55:18,475 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=35e6e46a-af23-4909-a996-aadb3dc0bac6 2025-04-25 06:55:18,481 - INFO - Pod ctest-pod-52710772 with uuid 35e6e46a-af23-4909-a996-aadb3dc0bac6 found in kube manager 2025-04-25 06:55:18,481 - INFO - Pod ctest-pod-52710772 verification passed 2025-04-25 06:55:18,491 - INFO - Pod ctest-pod-59054674 is in running state.Got IP 10.47.255.248 2025-04-25 06:55:18,510 - DEBUG - Pod ctest-pod-59054674 has vmi 3908d48e-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:18,510 - INFO - Verified pod ctest-pod-59054674 in contrail-api 2025-04-25 06:55:18,531 - DEBUG - VMI 3908d48e-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:18,531 - INFO - Verified Pod ctest-pod-59054674 in agent 10.0.0.19 2025-04-25 06:55:18,531 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=ee382585-663f-4050-9d6b-fb81dc74a744 2025-04-25 06:55:18,536 - INFO - Pod ctest-pod-59054674 with uuid ee382585-663f-4050-9d6b-fb81dc74a744 found in kube manager 2025-04-25 06:55:18,536 - INFO - Pod ctest-pod-59054674 verification passed 2025-04-25 06:55:18,542 - DEBUG - Pod ctest-pod-79575455 not in running state.Currently in Pending 2025-04-25 06:55:23,551 - INFO - Pod ctest-pod-79575455 is in running state.Got IP 10.47.255.247 2025-04-25 06:55:23,610 - DEBUG - Pod ctest-pod-79575455 has vmi 39a7695a-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:23,610 - INFO - Verified pod ctest-pod-79575455 in contrail-api 2025-04-25 06:55:23,628 - DEBUG - VMI 39a7695a-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:23,629 - INFO - Verified Pod ctest-pod-79575455 in agent 10.0.0.19 2025-04-25 06:55:23,629 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=acb29399-1de2-4853-9acc-9b630003d236 2025-04-25 06:55:23,635 - INFO - Pod ctest-pod-79575455 with uuid acb29399-1de2-4853-9acc-9b630003d236 found in kube manager 2025-04-25 06:55:23,635 - INFO - Pod ctest-pod-79575455 verification passed 2025-04-25 06:55:23,642 - INFO - Pod ctest-pod-44812470 is in running state.Got IP 10.47.255.245 2025-04-25 06:55:23,662 - DEBUG - Pod ctest-pod-44812470 has vmi 3ab20508-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:23,662 - INFO - Verified pod ctest-pod-44812470 in contrail-api 2025-04-25 06:55:23,679 - DEBUG - VMI 3ab20508-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:23,680 - INFO - Verified Pod ctest-pod-44812470 in agent 10.0.0.19 2025-04-25 06:55:23,680 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=627721d9-6c30-4dec-b22f-9efd00977658 2025-04-25 06:55:23,687 - INFO - Pod ctest-pod-44812470 with uuid 627721d9-6c30-4dec-b22f-9efd00977658 found in kube manager 2025-04-25 06:55:23,687 - INFO - Pod ctest-pod-44812470 verification passed 2025-04-25 06:55:23,794 - INFO - Pod ctest-pod-67204532 is in running state.Got IP 10.47.255.246 2025-04-25 06:55:23,854 - DEBUG - Pod ctest-pod-67204532 has vmi 3a2f162a-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:23,854 - INFO - Verified pod ctest-pod-67204532 in contrail-api 2025-04-25 06:55:23,868 - DEBUG - VMI 3a2f162a-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:23,868 - INFO - Verified Pod ctest-pod-67204532 in agent 10.0.0.19 2025-04-25 06:55:23,868 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=0d9857db-2f2d-47b7-a096-a2a612bd1829 2025-04-25 06:55:23,874 - INFO - Pod ctest-pod-67204532 with uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 found in kube manager 2025-04-25 06:55:23,874 - INFO - Pod ctest-pod-67204532 verification passed 2025-04-25 06:55:23,882 - INFO - Pod ctest-pod-76849082 is in running state.Got IP 10.47.255.244 2025-04-25 06:55:23,898 - DEBUG - Pod ctest-pod-76849082 has vmi 3b312f18-21a2-11f0-bb58-fa163ecffd8f 2025-04-25 06:55:23,898 - INFO - Verified pod ctest-pod-76849082 in contrail-api 2025-04-25 06:55:23,914 - DEBUG - VMI 3b312f18-21a2-11f0-bb58-fa163ecffd8f is active in agent 10.0.0.19 2025-04-25 06:55:23,915 - INFO - Verified Pod ctest-pod-76849082 in agent 10.0.0.19 2025-04-25 06:55:23,915 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 2025-04-25 06:55:23,921 - INFO - Pod ctest-pod-76849082 with uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 found in kube manager 2025-04-25 06:55:23,921 - INFO - Pod ctest-pod-76849082 verification passed 2025-04-25 06:55:23,921 - INFO - ================================================================================ 2025-04-25 06:55:23,921 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-25 06:55:23,921 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-25 06:55:24,170 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.249': '0'}} with 2025-04-25 06:55:24,170 - INFO - Initial checks done. Running the testcase now 2025-04-25 06:55:24,170 - INFO - 2025-04-25 06:55:24,226 - DEBUG - [Pod ctest-pod-32987434] Cmd: echo ctest-pod-32987434 > /usr/share/nginx/html/index.html, Output: 2025-04-25 06:55:24,287 - DEBUG - [Pod ctest-pod-57080366] Cmd: echo ctest-pod-57080366 > /usr/share/nginx/html/index.html, Output: 2025-04-25 06:55:24,350 - DEBUG - [Pod ctest-pod-52710772] Cmd: echo ctest-pod-52710772 > /usr/share/nginx/html/index.html, Output: 2025-04-25 06:55:24,410 - DEBUG - [Pod ctest-pod-59054674] Cmd: echo ctest-pod-59054674 > /usr/share/nginx/html/index.html, Output: 2025-04-25 06:55:24,414 - DEBUG - Service ctest-nginx-svc-79591047 not present 2025-04-25 06:55:24,414 - INFO - Creating service ctest-nginx-svc-79591047 2025-04-25 06:55:24,456 - INFO - Created Service ctest-nginx-svc-79591047 2025-04-25 06:55:24,470 - WARNING - Service UUID 36aa71c3-e90b-4645-942b-1b08e89b75fc not yet found in contrail-api 2025-04-25 06:55:25,482 - INFO - Validated that Service ctest-nginx-svc-79591047 is seen in contrail-api 2025-04-25 06:55:25,482 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=36aa71c3-e90b-4645-942b-1b08e89b75fc 2025-04-25 06:55:25,487 - INFO - Service ctest-nginx-svc-79591047 with uuid 36aa71c3-e90b-4645-942b-1b08e89b75fc found in kube manager 2025-04-25 06:55:25,487 - INFO - Service ctest-nginx-svc-79591047 verification passed 2025-04-25 06:55:26,592 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32987434 2025-04-25 06:55:26,592 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:55:26,593 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32987434 2025-04-25 06:55:26,652 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,652 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:55:26,652 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,713 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) ctest-pod-57080366 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,713 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:55:26,713 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) ctest-pod-57080366 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,714 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32987434': 2, 'ctest-pod-57080366': 1} 2025-04-25 06:55:26,772 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,773 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:55:26,773 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,845 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,845 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:55:26,845 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:55:26,845 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32987434': 1, 'ctest-pod-57080366': 1} 2025-04-25 06:55:26,849 - DEBUG - Network policy ingress-on-service not present 2025-04-25 06:55:26,850 - INFO - Creating Network Policy ingress-on-service 2025-04-25 06:55:26,866 - INFO - Network policy found in k8s 2025-04-25 06:55:26,866 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c294a6b8-5a9e-4276-a468-650430a18c1b 2025-04-25 06:55:26,872 - INFO - Network Policy ingress-on-service with uuid c294a6b8-5a9e-4276-a468-650430a18c1b found in kube manager 2025-04-25 06:55:26,918 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-25 06:55:26,919 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-25 06:55:26,919 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c294a6b8-5a9e-4276-a468-650430a18c1b 2025-04-25 06:55:26,953 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-25 06:55:28,954 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c294a6b8-5a9e-4276-a468-650430a18c1b 2025-04-25 06:55:28,990 - INFO - Network policy with name ingress-on-service found in agent 2025-04-25 06:55:28,990 - INFO - Network Policy ingress-on-service verification passed 2025-04-25 06:55:34,077 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:34,077 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:34,077 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:39,135 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:39,135 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:39,135 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:44,194 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:44,194 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:44,194 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:49,249 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:49,249 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:49,249 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:54,309 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:54,309 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:54,309 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:59,362 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:59,362 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:55:59,362 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:04,421 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:04,422 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:04,422 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:09,487 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:09,487 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:09,487 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:14,548 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:14,548 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:14,548 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:19,617 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:19,617 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:19,617 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:19,618 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-32987434': 0, 'ctest-pod-57080366': 0} 2025-04-25 06:56:19,676 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:56:19,677 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:56:19,677 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:56:19,764 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:56:19,764 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:56:19,764 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:56:19,764 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32987434': 1, 'ctest-pod-57080366': 1} 2025-04-25 06:56:24,822 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:24,822 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:24,822 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:29,877 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:29,878 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:29,878 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:34,933 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:34,933 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:34,934 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:39,991 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:39,991 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:39,991 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:45,054 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:45,054 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:45,054 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:50,113 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:50,113 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:50,113 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:55,166 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:55,166 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:55,166 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:56:58,840 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-04-25 06:57:08,903 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:08,904 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:08,904 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:13,955 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:13,955 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:13,955 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:19,010 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:19,010 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:19,010 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:19,010 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-32987434': 0, 'ctest-pod-57080366': 0} 2025-04-25 06:57:21,069 - DEBUG - [Pod ctest-pod-67204532] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.671 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.108 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.142 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.108/0.307/0.671 ms 2025-04-25 06:57:21,070 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67204532 with expectation True passed 2025-04-25 06:57:23,128 - DEBUG - [Pod ctest-pod-79575455] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.350 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.134 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.108 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.108/0.530/1.350 ms 2025-04-25 06:57:23,129 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79575455 with expectation True passed 2025-04-25 06:57:25,193 - DEBUG - [Pod ctest-pod-44812470] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.647 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.115 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.137 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.115/0.299/0.647 ms 2025-04-25 06:57:25,193 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-44812470 with expectation True passed 2025-04-25 06:57:25,250 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:57:25,250 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-25 06:57:25,250 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:57:25,250 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67204532 passed 2025-04-25 06:57:25,308 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:57:25,308 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-25 06:57:25,308 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:57:25,308 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67204532 passed 2025-04-25 06:57:30,358 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-25 06:57:30,358 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-25 06:57:30,358 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-25 06:57:30,358 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79575455 passed 2025-04-25 06:57:35,416 - DEBUG - [Pod ctest-pod-76849082] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-25 06:57:35,417 - DEBUG - [Pod Pod ctest-pod-76849082] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-25 06:57:35,417 - DEBUG - [Pod Pod ctest-pod-76849082] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-25 06:57:35,417 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76849082 passed 2025-04-25 06:57:35,428 - INFO - Updating Network Policy ingress-on-service 2025-04-25 06:57:40,513 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:40,513 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:40,513 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:45,574 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:45,574 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:45,574 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:50,629 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:50,629 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:50,629 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:55,680 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:55,680 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:57:55,680 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:00,737 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:00,738 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:00,738 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:05,798 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:05,798 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:05,798 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:10,854 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:10,854 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:10,854 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:15,928 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:15,928 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:15,928 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:21,008 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:21,008 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:21,008 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:26,060 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:26,060 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:26,060 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) wget: download timed out 2025-04-25 06:58:26,060 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-32987434': 0, 'ctest-pod-57080366': 0} 2025-04-25 06:58:26,119 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,119 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:58:26,119 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: ctest-pod-32987434 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,165 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,166 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:58:26,166 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,166 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32987434': 1, 'ctest-pod-57080366': 1} 2025-04-25 06:58:26,224 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,224 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:58:26,224 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,294 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,294 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:58:26,295 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,352 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,352 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:58:26,352 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: ctest-pod-57080366 Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-25 06:58:26,416 - DEBUG - [Pod ctest-pod-44812470] Cmd: wget http://10.105.71.72:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32987434 2025-04-25 06:58:26,417 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd wget http://10.105.71.72:80/ -O - -T 5 -t 1 passed 2025-04-25 06:58:26,417 - DEBUG - [Pod Pod ctest-pod-44812470] Cmd output: Connecting to 10.105.71.72:80 (10.105.71.72:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32987434 2025-04-25 06:58:26,417 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32987434': 1, 'ctest-pod-57080366': 3} 2025-04-25 06:58:28,475 - DEBUG - [Pod ctest-pod-67204532] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.318 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.125 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.131 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.125/0.524/1.318 ms 2025-04-25 06:58:28,475 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67204532 with expectation True passed 2025-04-25 06:58:30,528 - DEBUG - [Pod ctest-pod-79575455] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.574 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.134 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.143 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.134/0.617/1.574 ms 2025-04-25 06:58:30,528 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79575455 with expectation True passed 2025-04-25 06:58:32,586 - DEBUG - [Pod ctest-pod-44812470] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.959 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.127 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.137 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.127/0.407/0.959 ms 2025-04-25 06:58:32,586 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-44812470 with expectation True passed 2025-04-25 06:58:32,646 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:58:32,646 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-25 06:58:32,646 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:58:32,646 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67204532 passed 2025-04-25 06:58:32,701 - DEBUG - [Pod ctest-pod-67204532] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:58:32,702 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-25 06:58:32,702 - DEBUG - [Pod Pod ctest-pod-67204532] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:58:32,702 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67204532 passed 2025-04-25 06:58:37,753 - DEBUG - [Pod ctest-pod-79575455] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-25 06:58:37,753 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-25 06:58:37,753 - DEBUG - [Pod Pod ctest-pod-79575455] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-25 06:58:37,753 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79575455 passed 2025-04-25 06:58:37,799 - DEBUG - [Pod ctest-pod-76849082] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:58:37,799 - DEBUG - [Pod Pod ctest-pod-76849082] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-25 06:58:37,799 - DEBUG - [Pod Pod ctest-pod-76849082] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-25 06:58:37,799 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76849082 passed 2025-04-25 06:58:37,799 - INFO - Deleting Network Policy : ingress-on-service 2025-04-25 06:58:37,799 - INFO - Deleting service : ctest-nginx-svc-79591047 2025-04-25 06:58:38,032 - DEBUG - No XMPP flaps were noticed during the test 2025-04-25 06:58:38,032 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2025-04-25 06:58:38,032 - INFO - -------------------------------------------------------------------------------- 2025-04-25 06:58:38,037 - INFO - Deleting pod ctest-new-default-36737894:ctest-pod-32987434 2025-04-25 06:58:38,038 - INFO - Deleting pod ctest-new-default-36737894:ctest-pod-57080366 2025-04-25 06:58:38,038 - INFO - Deleting pod ctest-non-default-34546206:ctest-pod-52710772 2025-04-25 06:58:38,039 - INFO - Deleting pod ctest-non-default-34546206:ctest-pod-59054674 2025-04-25 06:58:38,039 - INFO - Deleting pod ctest-new-default-36737894:ctest-pod-79575455 2025-04-25 06:58:38,039 - INFO - Deleting pod ctest-new-default-36737894:ctest-pod-67204532 2025-04-25 06:58:38,040 - INFO - Deleting pod ctest-non-default-34546206:ctest-pod-44812470 2025-04-25 06:58:38,040 - INFO - Deleting pod ctest-non-default-34546206:ctest-pod-76849082 2025-04-25 06:58:38,159 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,159 - WARNING - Pod uuid 89ebf034-ded1-4776-b51f-a5600119cb37 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,213 - WARNING - Pod uuid 35e6e46a-af23-4909-a996-aadb3dc0bac6 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,214 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,214 - WARNING - Pod uuid f2b89370-005f-4476-bfca-31d2e63ad718 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,215 - WARNING - Pod uuid ee382585-663f-4050-9d6b-fb81dc74a744 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,215 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:38,216 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:43,172 - DEBUG - Pod 89ebf034-ded1-4776-b51f-a5600119cb37 is not in agent 10.0.0.19 VM list 2025-04-25 06:58:43,176 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:43,188 - DEBUG - VMI 36faad52-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:58:43,188 - INFO - Verified that pod ctest-pod-32987434 is removed in agent 2025-04-25 06:58:43,251 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:43,252 - DEBUG - Pod 35e6e46a-af23-4909-a996-aadb3dc0bac6 is not in agent 10.0.0.19 VM list 2025-04-25 06:58:43,257 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:43,258 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:43,258 - DEBUG - Pod ee382585-663f-4050-9d6b-fb81dc74a744 is not in agent 10.0.0.19 VM list 2025-04-25 06:58:43,260 - DEBUG - Pod f2b89370-005f-4476-bfca-31d2e63ad718 is not in agent 10.0.0.19 VM list 2025-04-25 06:58:43,276 - DEBUG - VMI 379a9812-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:58:43,276 - INFO - Verified that pod ctest-pod-57080366 is removed in agent 2025-04-25 06:58:43,277 - DEBUG - VMI 385f94f0-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:58:43,277 - INFO - Verified that pod ctest-pod-52710772 is removed in agent 2025-04-25 06:58:43,279 - DEBUG - VMI 3908d48e-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:58:43,279 - INFO - Verified that pod ctest-pod-59054674 is removed in agent 2025-04-25 06:58:48,193 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:48,263 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:48,273 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:48,274 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:53,205 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:53,273 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:53,286 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:53,287 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:58,217 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:58,283 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:58,298 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:58:58,299 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:03,228 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:03,291 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:03,310 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:03,312 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:08,251 - WARNING - Pod uuid 0d9857db-2f2d-47b7-a096-a2a612bd1829 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:08,303 - WARNING - Pod uuid f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:08,321 - WARNING - Pod uuid acb29399-1de2-4853-9acc-9b630003d236 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:08,322 - WARNING - Pod uuid 627721d9-6c30-4dec-b22f-9efd00977658 is still seen in agent 10.0.0.19 VM list 2025-04-25 06:59:13,258 - DEBUG - Pod 0d9857db-2f2d-47b7-a096-a2a612bd1829 is not in agent 10.0.0.19 VM list 2025-04-25 06:59:13,266 - DEBUG - VMI 3a2f162a-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:59:13,266 - INFO - Verified that pod ctest-pod-67204532 is removed in agent 2025-04-25 06:59:13,311 - DEBUG - Pod f4d8ca13-5252-4b5c-9dac-fcee46bb4d48 is not in agent 10.0.0.19 VM list 2025-04-25 06:59:13,318 - DEBUG - VMI 3b312f18-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:59:13,318 - INFO - Verified that pod ctest-pod-76849082 is removed in agent 2025-04-25 06:59:13,335 - DEBUG - Pod acb29399-1de2-4853-9acc-9b630003d236 is not in agent 10.0.0.19 VM list 2025-04-25 06:59:13,337 - DEBUG - Pod 627721d9-6c30-4dec-b22f-9efd00977658 is not in agent 10.0.0.19 VM list 2025-04-25 06:59:13,347 - DEBUG - VMI 39a7695a-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:59:13,347 - INFO - Verified that pod ctest-pod-79575455 is removed in agent 2025-04-25 06:59:13,348 - DEBUG - VMI 3ab20508-21a2-11f0-bb58-fa163ecffd8f is removed from agent 10.0.0.19 2025-04-25 06:59:13,348 - INFO - Verified that pod ctest-pod-44812470 is removed in agent 2025-04-25 06:59:13,348 - INFO - Deleting namespace ctest-non-default-34546206 2025-04-25 06:59:13,368 - DEBUG - Namespace ctest-non-default-34546206 still in k8s 2025-04-25 06:59:15,373 - DEBUG - Namespace ctest-non-default-34546206 still in k8s 2025-04-25 06:59:17,381 - DEBUG - Namespace ctest-non-default-34546206 still in k8s 2025-04-25 06:59:19,385 - DEBUG - Namespace ctest-non-default-34546206 is not in k8s 2025-04-25 06:59:19,385 - DEBUG - No need to check project deletion in contrail-api 2025-04-25 06:59:19,385 - INFO - Deleting namespace ctest-new-default-36737894 2025-04-25 06:59:19,399 - DEBUG - Namespace ctest-new-default-36737894 still in k8s 2025-04-25 06:59:21,404 - DEBUG - Namespace ctest-new-default-36737894 still in k8s 2025-04-25 06:59:23,409 - DEBUG - Namespace ctest-new-default-36737894 still in k8s 2025-04-25 06:59:25,414 - DEBUG - Namespace ctest-new-default-36737894 is not in k8s 2025-04-25 06:59:25,414 - DEBUG - No need to check project deletion in contrail-api