2025-06-02 02:13:28,638 - INFO - Using existing project ['default-domain', 'k8s-default'](784c97b1-5719-42ed-864e-f2f82c91ae98)
2025-06-02 02:13:28,660 - DEBUG - Namespace ctest-new-default-66371326 not present
2025-06-02 02:13:28,669 - INFO - Created namespace ctest-new-default-66371326
2025-06-02 02:13:31,674 - DEBUG - Namespace ctest-non-default-84825279 not present
2025-06-02 02:13:31,681 - INFO - Created namespace ctest-non-default-84825279
2025-06-02 02:13:34,705 - DEBUG - Pod ctest-pod-93922462 not present
2025-06-02 02:13:34,706 - INFO - Creating Pod ctest-pod-93922462
2025-06-02 02:13:34,740 - DEBUG - Pod : ctest-pod-93922462 UUID is 79bc30d6-18c2-41e2-a482-a7737005f8f6
2025-06-02 02:13:34,756 - DEBUG - Pod ctest-pod-42152544 not present
2025-06-02 02:13:34,756 - INFO - Creating Pod ctest-pod-42152544
2025-06-02 02:13:34,776 - DEBUG - Pod : ctest-pod-42152544 UUID is ffd02559-f816-4d17-86b1-e32b5d2acaa9
2025-06-02 02:13:34,782 - DEBUG - Pod ctest-pod-63866394 not present
2025-06-02 02:13:34,782 - INFO - Creating Pod ctest-pod-63866394
2025-06-02 02:13:34,803 - DEBUG - Pod : ctest-pod-63866394 UUID is 22dd1b71-56d3-46f5-837f-51cd0e7e8914
2025-06-02 02:13:34,807 - DEBUG - Pod ctest-pod-11234110 not present
2025-06-02 02:13:34,807 - INFO - Creating Pod ctest-pod-11234110
2025-06-02 02:13:34,827 - DEBUG - Pod : ctest-pod-11234110 UUID is b5037c37-c75a-4c80-a7c8-7120b971ad42
2025-06-02 02:13:34,831 - DEBUG - Pod ctest-pod-05241507 not present
2025-06-02 02:13:34,831 - INFO - Creating Pod ctest-pod-05241507
2025-06-02 02:13:34,849 - DEBUG - Pod : ctest-pod-05241507 UUID is d161d3d9-d8d6-4159-8874-e70724245b3b
2025-06-02 02:13:34,851 - DEBUG - Pod ctest-pod-92981493 not present
2025-06-02 02:13:34,851 - INFO - Creating Pod ctest-pod-92981493
2025-06-02 02:13:34,879 - DEBUG - Pod : ctest-pod-92981493 UUID is 5b8ac004-a6db-4427-b939-7e4da77cbaca
2025-06-02 02:13:34,881 - DEBUG - Pod ctest-pod-10205417 not present
2025-06-02 02:13:34,881 - INFO - Creating Pod ctest-pod-10205417
2025-06-02 02:13:34,904 - DEBUG - Pod : ctest-pod-10205417 UUID is 01e5fdb9-b39d-415e-8f22-6ba0748b97d3
2025-06-02 02:13:34,906 - DEBUG - Pod ctest-pod-68238387 not present
2025-06-02 02:13:34,906 - INFO - Creating Pod ctest-pod-68238387
2025-06-02 02:13:34,939 - DEBUG - Pod : ctest-pod-68238387 UUID is a4bbd180-2b71-484a-b058-9a1ce103f72d
2025-06-02 02:13:35,161 - INFO - Project default-domain:k8s-ctest-new-default-66371326 for Namespace ctest-new-default-66371326 is seen in contrail-api
2025-06-02 02:13:35,162 - DEBUG - Project uuid in Contrail is 95fc2477-797a-46d2-8e9c-1b425da02873
2025-06-02 02:13:35,311 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=ae68e43e-78d4-4f6b-a1fb-c0b482651f03
2025-06-02 02:13:35,324 - INFO - Namespace ctest-new-default-66371326 with uuid ae68e43e-78d4-4f6b-a1fb-c0b482651f03 found in kube manager
2025-06-02 02:13:35,324 - INFO - Namespace ctest-new-default-66371326 verification passed
2025-06-02 02:13:35,568 - INFO - Project default-domain:k8s-ctest-non-default-84825279 for Namespace ctest-non-default-84825279 is seen in contrail-api
2025-06-02 02:13:35,568 - DEBUG - Project uuid in Contrail is 22a94624-62e0-44ad-919b-f301dd7a2754
2025-06-02 02:13:35,568 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=d3a1ba34-cfce-4d5c-8da2-0cad2509a46e
2025-06-02 02:13:35,574 - INFO - Namespace ctest-non-default-84825279 with uuid d3a1ba34-cfce-4d5c-8da2-0cad2509a46e found in kube manager
2025-06-02 02:13:35,574 - INFO - Namespace ctest-non-default-84825279 verification passed
2025-06-02 02:13:35,581 - DEBUG - Pod ctest-pod-93922462 not in running state.Currently in Pending
2025-06-02 02:13:40,589 - DEBUG - Pod ctest-pod-93922462 not in running state.Currently in Pending
2025-06-02 02:13:45,596 - DEBUG - Pod ctest-pod-93922462 not in running state.Currently in Pending
2025-06-02 02:13:50,605 - INFO - Pod ctest-pod-93922462 is in running state.Got IP 10.47.255.251
2025-06-02 02:13:50,662 - DEBUG - Pod ctest-pod-93922462 has vmi 3112746a-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:50,662 - INFO - Verified pod ctest-pod-93922462 in contrail-api
2025-06-02 02:13:50,676 - DEBUG - VMI 3112746a-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:50,677 - INFO - Verified Pod ctest-pod-93922462 in agent 10.0.0.22
2025-06-02 02:13:50,677 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=79bc30d6-18c2-41e2-a482-a7737005f8f6
2025-06-02 02:13:50,681 - INFO - Pod ctest-pod-93922462 with uuid 79bc30d6-18c2-41e2-a482-a7737005f8f6 found in kube manager
2025-06-02 02:13:50,681 - INFO - Pod ctest-pod-93922462 verification passed
2025-06-02 02:13:50,686 - INFO - Pod ctest-pod-42152544 is in running state.Got IP 10.47.255.250
2025-06-02 02:13:50,699 - DEBUG - Pod ctest-pod-42152544 has vmi 319ebde4-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:50,699 - INFO - Verified pod ctest-pod-42152544 in contrail-api
2025-06-02 02:13:50,712 - DEBUG - VMI 319ebde4-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:50,713 - INFO - Verified Pod ctest-pod-42152544 in agent 10.0.0.22
2025-06-02 02:13:50,714 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ffd02559-f816-4d17-86b1-e32b5d2acaa9
2025-06-02 02:13:50,718 - INFO - Pod ctest-pod-42152544 with uuid ffd02559-f816-4d17-86b1-e32b5d2acaa9 found in kube manager
2025-06-02 02:13:50,718 - INFO - Pod ctest-pod-42152544 verification passed
2025-06-02 02:13:50,723 - INFO - Pod ctest-pod-63866394 is in running state.Got IP 10.47.255.249
2025-06-02 02:13:50,777 - DEBUG - Pod ctest-pod-63866394 has vmi 32657e2a-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:50,777 - INFO - Verified pod ctest-pod-63866394 in contrail-api
2025-06-02 02:13:50,801 - DEBUG - VMI 32657e2a-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:50,801 - INFO - Verified Pod ctest-pod-63866394 in agent 10.0.0.22
2025-06-02 02:13:50,801 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=22dd1b71-56d3-46f5-837f-51cd0e7e8914
2025-06-02 02:13:50,806 - INFO - Pod ctest-pod-63866394 with uuid 22dd1b71-56d3-46f5-837f-51cd0e7e8914 found in kube manager
2025-06-02 02:13:50,806 - INFO - Pod ctest-pod-63866394 verification passed
2025-06-02 02:13:50,811 - INFO - Pod ctest-pod-11234110 is in running state.Got IP 10.47.255.248
2025-06-02 02:13:50,866 - DEBUG - Pod ctest-pod-11234110 has vmi 32ecefea-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:50,866 - INFO - Verified pod ctest-pod-11234110 in contrail-api
2025-06-02 02:13:50,879 - DEBUG - VMI 32ecefea-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:50,879 - INFO - Verified Pod ctest-pod-11234110 in agent 10.0.0.22
2025-06-02 02:13:50,880 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b5037c37-c75a-4c80-a7c8-7120b971ad42
2025-06-02 02:13:50,884 - INFO - Pod ctest-pod-11234110 with uuid b5037c37-c75a-4c80-a7c8-7120b971ad42 found in kube manager
2025-06-02 02:13:50,884 - INFO - Pod ctest-pod-11234110 verification passed
2025-06-02 02:13:50,893 - INFO - Pod ctest-pod-05241507 is in running state.Got IP 10.47.255.247
2025-06-02 02:13:50,906 - DEBUG - Pod ctest-pod-05241507 has vmi 3377d9d4-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:50,906 - INFO - Verified pod ctest-pod-05241507 in contrail-api
2025-06-02 02:13:50,918 - DEBUG - VMI 3377d9d4-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:50,918 - INFO - Verified Pod ctest-pod-05241507 in agent 10.0.0.22
2025-06-02 02:13:50,919 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=d161d3d9-d8d6-4159-8874-e70724245b3b
2025-06-02 02:13:50,924 - INFO - Pod ctest-pod-05241507 with uuid d161d3d9-d8d6-4159-8874-e70724245b3b found in kube manager
2025-06-02 02:13:50,924 - INFO - Pod ctest-pod-05241507 verification passed
2025-06-02 02:13:50,930 - DEBUG - Pod ctest-pod-10205417 not in running state.Currently in Pending
2025-06-02 02:13:55,944 - INFO - Pod ctest-pod-10205417 is in running state.Got IP 10.47.255.245
2025-06-02 02:13:56,006 - DEBUG - Pod ctest-pod-10205417 has vmi 3452fe4c-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:56,006 - INFO - Verified pod ctest-pod-10205417 in contrail-api
2025-06-02 02:13:56,020 - DEBUG - VMI 3452fe4c-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:56,020 - INFO - Verified Pod ctest-pod-10205417 in agent 10.0.0.22
2025-06-02 02:13:56,021 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=01e5fdb9-b39d-415e-8f22-6ba0748b97d3
2025-06-02 02:13:56,028 - INFO - Pod ctest-pod-10205417 with uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 found in kube manager
2025-06-02 02:13:56,030 - INFO - Pod ctest-pod-10205417 verification passed
2025-06-02 02:13:56,037 - INFO - Pod ctest-pod-92981493 is in running state.Got IP 10.47.255.246
2025-06-02 02:13:56,052 - DEBUG - Pod ctest-pod-92981493 has vmi 33e69432-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:56,052 - INFO - Verified pod ctest-pod-92981493 in contrail-api
2025-06-02 02:13:56,069 - DEBUG - VMI 33e69432-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:56,070 - INFO - Verified Pod ctest-pod-92981493 in agent 10.0.0.22
2025-06-02 02:13:56,070 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5b8ac004-a6db-4427-b939-7e4da77cbaca
2025-06-02 02:13:56,079 - INFO - Pod ctest-pod-92981493 with uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca found in kube manager
2025-06-02 02:13:56,079 - INFO - Pod ctest-pod-92981493 verification passed
2025-06-02 02:13:56,088 - INFO - Pod ctest-pod-68238387 is in running state.Got IP 10.47.255.244
2025-06-02 02:13:56,146 - DEBUG - Pod ctest-pod-68238387 has vmi 34bc3826-3f57-11f0-9511-fa163e961c9d
2025-06-02 02:13:56,146 - INFO - Verified pod ctest-pod-68238387 in contrail-api
2025-06-02 02:13:56,163 - DEBUG - VMI 34bc3826-3f57-11f0-9511-fa163e961c9d is active in agent 10.0.0.22
2025-06-02 02:13:56,163 - INFO - Verified Pod ctest-pod-68238387 in agent 10.0.0.22
2025-06-02 02:13:56,163 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=a4bbd180-2b71-484a-b058-9a1ce103f72d
2025-06-02 02:13:56,168 - INFO - Pod ctest-pod-68238387 with uuid a4bbd180-2b71-484a-b058-9a1ce103f72d found in kube manager
2025-06-02 02:13:56,169 - INFO - Pod ctest-pod-68238387 verification passed
2025-06-02 02:13:56,169 - INFO - ================================================================================
2025-06-02 02:13:56,169 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-06-02 02:13:56,169 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-06-02 02:13:56,351 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with
2025-06-02 02:13:56,351 - INFO - Initial checks done. Running the testcase now
2025-06-02 02:13:56,351 - INFO -
2025-06-02 02:13:56,403 - DEBUG - [Pod ctest-pod-93922462] Cmd: echo ctest-pod-93922462 > /usr/share/nginx/html/index.html, Output:
2025-06-02 02:13:56,452 - DEBUG - [Pod ctest-pod-42152544] Cmd: echo ctest-pod-42152544 > /usr/share/nginx/html/index.html, Output:
2025-06-02 02:13:56,511 - DEBUG - [Pod ctest-pod-63866394] Cmd: echo ctest-pod-63866394 > /usr/share/nginx/html/index.html, Output:
2025-06-02 02:13:56,567 - DEBUG - [Pod ctest-pod-11234110] Cmd: echo ctest-pod-11234110 > /usr/share/nginx/html/index.html, Output:
2025-06-02 02:13:56,571 - DEBUG - Service ctest-nginx-svc-21196715 not present
2025-06-02 02:13:56,571 - INFO - Creating service ctest-nginx-svc-21196715
2025-06-02 02:13:56,594 - INFO - Created Service ctest-nginx-svc-21196715
2025-06-02 02:13:56,606 - WARNING - Service UUID 84d2a141-742b-4b47-bb1c-4c1c70b3b92f not yet found in contrail-api
2025-06-02 02:13:57,615 - INFO - Validated that Service ctest-nginx-svc-21196715 is seen in contrail-api
2025-06-02 02:13:57,615 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=84d2a141-742b-4b47-bb1c-4c1c70b3b92f
2025-06-02 02:13:57,628 - INFO - Service ctest-nginx-svc-21196715 with uuid 84d2a141-742b-4b47-bb1c-4c1c70b3b92f found in kube manager
2025-06-02 02:13:57,628 - INFO - Service ctest-nginx-svc-21196715 verification passed
2025-06-02 02:13:58,715 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42152544
2025-06-02 02:13:58,715 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:13:58,715 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42152544
2025-06-02 02:13:58,774 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,774 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:13:58,774 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,774 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93922462': 1, 'ctest-pod-42152544': 1}
2025-06-02 02:13:58,832 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,832 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:13:58,832 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,866 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
ctest-pod-93922462
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,866 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:13:58,867 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
ctest-pod-93922462
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,920 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,920 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:13:58,920 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,974 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-42152544
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,974 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:13:58,974 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: ctest-pod-42152544
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:13:58,974 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93922462': 3, 'ctest-pod-42152544': 1}
2025-06-02 02:13:58,977 - DEBUG - Network policy ingress-on-service not present
2025-06-02 02:13:58,977 - INFO - Creating Network Policy ingress-on-service
2025-06-02 02:13:59,054 - INFO - Network policy found in k8s
2025-06-02 02:13:59,054 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=21773e89-25bb-416b-b523-6964e18d8bc1
2025-06-02 02:13:59,060 - INFO - Network Policy ingress-on-service with uuid 21773e89-25bb-416b-b523-6964e18d8bc1 found in kube manager
2025-06-02 02:13:59,092 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-06-02 02:13:59,092 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-06-02 02:13:59,093 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=21773e89-25bb-416b-b523-6964e18d8bc1
2025-06-02 02:13:59,124 - WARNING - Network policy with name ingress-on-service not found in agent
2025-06-02 02:14:01,125 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=21773e89-25bb-416b-b523-6964e18d8bc1
2025-06-02 02:14:01,177 - INFO - Network policy with name ingress-on-service found in agent
2025-06-02 02:14:01,177 - INFO - Network Policy ingress-on-service verification passed
2025-06-02 02:14:06,243 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:06,243 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:06,243 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:11,291 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:11,291 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:11,291 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:16,340 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:16,340 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:16,340 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:21,390 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:21,391 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:21,391 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:26,443 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:26,443 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:26,443 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:31,496 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:31,496 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:31,496 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:36,551 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:36,551 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:36,551 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:41,601 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:41,601 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:41,601 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:44,363 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-06-02 02:14:54,423 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:54,423 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:54,423 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:59,499 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:59,499 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:59,499 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:14:59,499 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93922462': 0, 'ctest-pod-42152544': 0}
2025-06-02 02:14:59,574 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-42152544
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:14:59,574 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:14:59,574 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: ctest-pod-42152544
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:14:59,625 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93922462
2025-06-02 02:14:59,625 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:14:59,625 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93922462
2025-06-02 02:14:59,625 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93922462': 1, 'ctest-pod-42152544': 1}
2025-06-02 02:15:04,657 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:04,657 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:04,657 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:09,723 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:09,723 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:09,723 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:14,781 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:14,781 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:14,782 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:19,840 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:19,840 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:19,840 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:24,886 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:24,886 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:24,886 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:29,940 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:29,940 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:29,940 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:34,992 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:34,992 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:34,992 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:40,057 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:40,057 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:40,057 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:45,109 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:45,109 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:45,109 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:50,163 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:50,164 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:50,164 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:15:50,164 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93922462': 0, 'ctest-pod-42152544': 0}
2025-06-02 02:15:52,220 - DEBUG - [Pod ctest-pod-92981493] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.810 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.330/0.810 ms
2025-06-02 02:15:52,220 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92981493 with expectation True passed
2025-06-02 02:15:54,272 - DEBUG - [Pod ctest-pod-05241507] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.656 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.278/0.656 ms
2025-06-02 02:15:54,272 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05241507 with expectation True passed
2025-06-02 02:15:56,329 - DEBUG - [Pod ctest-pod-10205417] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.922 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.367/0.922 ms
2025-06-02 02:15:56,329 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10205417 with expectation True passed
2025-06-02 02:15:56,389 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:15:56,389 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-02 02:15:56,389 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:15:56,389 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92981493 passed
2025-06-02 02:15:56,447 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:15:56,447 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-02 02:15:56,447 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:15:56,447 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92981493 passed
2025-06-02 02:16:01,499 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-02 02:16:01,499 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-02 02:16:01,500 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-02 02:16:01,500 - INFO - wget check of of http://10.47.255.250 from ctest-pod-05241507 passed
2025-06-02 02:16:06,557 - DEBUG - [Pod ctest-pod-68238387] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-02 02:16:06,557 - DEBUG - [Pod Pod ctest-pod-68238387] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-02 02:16:06,557 - DEBUG - [Pod Pod ctest-pod-68238387] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-02 02:16:06,558 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68238387 passed
2025-06-02 02:16:06,576 - INFO - Updating Network Policy ingress-on-service
2025-06-02 02:16:11,636 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:11,636 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:11,636 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:16,688 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:16,688 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:16,688 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:21,738 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:21,739 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:21,739 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:26,792 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:26,792 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:26,792 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:31,844 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:31,844 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:31,844 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:36,901 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:36,901 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:36,901 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:41,956 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:41,956 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:41,956 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:47,012 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:47,012 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:47,012 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:52,063 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:52,063 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:52,063 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:57,116 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:57,116 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:57,116 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
wget: download timed out
2025-06-02 02:16:57,116 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93922462': 0, 'ctest-pod-42152544': 0}
2025-06-02 02:16:57,180 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,180 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:16:57,180 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,239 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,239 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:16:57,240 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,295 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42152544
2025-06-02 02:16:57,295 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:16:57,295 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42152544
2025-06-02 02:16:57,295 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93922462': 2, 'ctest-pod-42152544': 1}
2025-06-02 02:16:57,331 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-42152544
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,331 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:16:57,331 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: ctest-pod-42152544
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,381 - DEBUG - [Pod ctest-pod-10205417] Cmd: wget http://10.107.34.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,381 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd wget http://10.107.34.98:80/ -O - -T 5 -t 1 passed
2025-06-02 02:16:57,382 - DEBUG - [Pod Pod ctest-pod-10205417] Cmd output: ctest-pod-93922462
Connecting to 10.107.34.98:80 (10.107.34.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-02 02:16:57,382 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93922462': 1, 'ctest-pod-42152544': 1}
2025-06-02 02:16:59,442 - DEBUG - [Pod ctest-pod-92981493] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.041 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.408/1.041 ms
2025-06-02 02:16:59,442 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92981493 with expectation True passed
2025-06-02 02:17:01,501 - DEBUG - [Pod ctest-pod-05241507] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.367 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.176/0.367 ms
2025-06-02 02:17:01,502 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05241507 with expectation True passed
2025-06-02 02:17:03,551 - DEBUG - [Pod ctest-pod-10205417] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.377 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.517/1.377 ms
2025-06-02 02:17:03,551 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10205417 with expectation True passed
2025-06-02 02:17:03,607 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:17:03,607 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-02 02:17:03,607 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:17:03,607 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92981493 passed
2025-06-02 02:17:03,661 - DEBUG - [Pod ctest-pod-92981493] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:17:03,661 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-02 02:17:03,661 - DEBUG - [Pod Pod ctest-pod-92981493] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:17:03,661 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92981493 passed
2025-06-02 02:17:08,715 - DEBUG - [Pod ctest-pod-05241507] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-02 02:17:08,715 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-02 02:17:08,715 - DEBUG - [Pod Pod ctest-pod-05241507] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-02 02:17:08,715 - INFO - wget check of of http://10.47.255.250 from ctest-pod-05241507 passed
2025-06-02 02:17:08,776 - DEBUG - [Pod ctest-pod-68238387] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:17:08,776 - DEBUG - [Pod Pod ctest-pod-68238387] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-02 02:17:08,776 - DEBUG - [Pod Pod ctest-pod-68238387] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-02 02:17:08,776 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68238387 passed
2025-06-02 02:17:08,776 - INFO - Deleting Network Policy : ingress-on-service
2025-06-02 02:17:08,777 - INFO - Deleting service : ctest-nginx-svc-21196715
2025-06-02 02:17:08,931 - DEBUG - No XMPP flaps were noticed during the test
2025-06-02 02:17:08,931 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-06-02 02:17:08,931 - INFO - --------------------------------------------------------------------------------
2025-06-02 02:17:08,936 - INFO - Deleting pod ctest-new-default-66371326:ctest-pod-93922462
2025-06-02 02:17:08,937 - INFO - Deleting pod ctest-new-default-66371326:ctest-pod-42152544
2025-06-02 02:17:08,937 - INFO - Deleting pod ctest-non-default-84825279:ctest-pod-63866394
2025-06-02 02:17:08,938 - INFO - Deleting pod ctest-non-default-84825279:ctest-pod-11234110
2025-06-02 02:17:08,938 - INFO - Deleting pod ctest-new-default-66371326:ctest-pod-05241507
2025-06-02 02:17:08,938 - INFO - Deleting pod ctest-new-default-66371326:ctest-pod-92981493
2025-06-02 02:17:08,939 - INFO - Deleting pod ctest-non-default-84825279:ctest-pod-10205417
2025-06-02 02:17:08,939 - INFO - Deleting pod ctest-non-default-84825279:ctest-pod-68238387
2025-06-02 02:17:09,083 - WARNING - Pod uuid 79bc30d6-18c2-41e2-a482-a7737005f8f6 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,086 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,086 - WARNING - Pod uuid b5037c37-c75a-4c80-a7c8-7120b971ad42 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,087 - WARNING - Pod uuid ffd02559-f816-4d17-86b1-e32b5d2acaa9 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,087 - WARNING - Pod uuid 22dd1b71-56d3-46f5-837f-51cd0e7e8914 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,087 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,088 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:09,088 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:14,100 - DEBUG - Pod 79bc30d6-18c2-41e2-a482-a7737005f8f6 is not in agent 10.0.0.22 VM list
2025-06-02 02:17:14,124 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:14,124 - DEBUG - Pod 22dd1b71-56d3-46f5-837f-51cd0e7e8914 is not in agent 10.0.0.22 VM list
2025-06-02 02:17:14,126 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:14,126 - DEBUG - Pod b5037c37-c75a-4c80-a7c8-7120b971ad42 is not in agent 10.0.0.22 VM list
2025-06-02 02:17:14,128 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:14,130 - DEBUG - VMI 3112746a-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:14,130 - INFO - Verified that pod ctest-pod-93922462 is removed in agent
2025-06-02 02:17:14,130 - DEBUG - Pod ffd02559-f816-4d17-86b1-e32b5d2acaa9 is not in agent 10.0.0.22 VM list
2025-06-02 02:17:14,132 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:14,144 - DEBUG - VMI 319ebde4-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:14,145 - INFO - Verified that pod ctest-pod-42152544 is removed in agent
2025-06-02 02:17:14,145 - DEBUG - VMI 32657e2a-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:14,145 - INFO - Verified that pod ctest-pod-63866394 is removed in agent
2025-06-02 02:17:14,145 - DEBUG - VMI 32ecefea-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:14,145 - INFO - Verified that pod ctest-pod-11234110 is removed in agent
2025-06-02 02:17:19,140 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:19,142 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:19,143 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:19,144 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:24,161 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:24,163 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:24,164 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:24,164 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:29,182 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:29,182 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:29,184 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:29,184 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:34,205 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:34,207 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:34,207 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:34,208 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:39,334 - WARNING - Pod uuid 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:39,334 - WARNING - Pod uuid a4bbd180-2b71-484a-b058-9a1ce103f72d is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:39,335 - WARNING - Pod uuid d161d3d9-d8d6-4159-8874-e70724245b3b is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:39,335 - WARNING - Pod uuid 5b8ac004-a6db-4427-b939-7e4da77cbaca is still seen in agent 10.0.0.22 VM list
2025-06-02 02:17:44,352 - DEBUG - Pod 01e5fdb9-b39d-415e-8f22-6ba0748b97d3 is not in agent 10.0.0.22 VM list
2025-06-02 02:17:44,355 - DEBUG - Pod d161d3d9-d8d6-4159-8874-e70724245b3b is not in agent 10.0.0.22 VM list
2025-06-02 02:17:44,357 - DEBUG - Pod a4bbd180-2b71-484a-b058-9a1ce103f72d is not in agent 10.0.0.22 VM list
2025-06-02 02:17:44,358 - DEBUG - Pod 5b8ac004-a6db-4427-b939-7e4da77cbaca is not in agent 10.0.0.22 VM list
2025-06-02 02:17:44,371 - DEBUG - VMI 3452fe4c-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:44,371 - INFO - Verified that pod ctest-pod-10205417 is removed in agent
2025-06-02 02:17:44,373 - DEBUG - VMI 34bc3826-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:44,373 - INFO - Verified that pod ctest-pod-68238387 is removed in agent
2025-06-02 02:17:44,374 - DEBUG - VMI 3377d9d4-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:44,374 - INFO - Verified that pod ctest-pod-05241507 is removed in agent
2025-06-02 02:17:44,374 - DEBUG - VMI 33e69432-3f57-11f0-9511-fa163e961c9d is removed from agent 10.0.0.22
2025-06-02 02:17:44,374 - INFO - Verified that pod ctest-pod-92981493 is removed in agent
2025-06-02 02:17:44,374 - INFO - Deleting namespace ctest-non-default-84825279
2025-06-02 02:17:44,386 - DEBUG - Namespace ctest-non-default-84825279 still in k8s
2025-06-02 02:17:46,391 - DEBUG - Namespace ctest-non-default-84825279 still in k8s
2025-06-02 02:17:48,396 - DEBUG - Namespace ctest-non-default-84825279 still in k8s
2025-06-02 02:17:50,400 - DEBUG - Namespace ctest-non-default-84825279 is not in k8s
2025-06-02 02:17:50,400 - DEBUG - No need to check project deletion in contrail-api
2025-06-02 02:17:50,400 - INFO - Deleting namespace ctest-new-default-66371326
2025-06-02 02:17:50,414 - DEBUG - Namespace ctest-new-default-66371326 still in k8s
2025-06-02 02:17:52,418 - DEBUG - Namespace ctest-new-default-66371326 still in k8s
2025-06-02 02:17:54,424 - DEBUG - Namespace ctest-new-default-66371326 still in k8s
2025-06-02 02:17:56,428 - DEBUG - Namespace ctest-new-default-66371326 is not in k8s
2025-06-02 02:17:56,428 - DEBUG - No need to check project deletion in contrail-api