2025-03-29 10:39:41,249 - INFO - Using existing project ['default-domain', 'k8s-default'](38cb9ed1-7870-4950-b352-c68df4391919)
2025-03-29 10:39:41,268 - DEBUG - Namespace ctest-new-default-53250646 not present
2025-03-29 10:39:41,283 - INFO - Created namespace ctest-new-default-53250646
2025-03-29 10:39:44,287 - DEBUG - Namespace ctest-non-default-45253667 not present
2025-03-29 10:39:44,295 - INFO - Created namespace ctest-non-default-45253667
2025-03-29 10:39:47,325 - DEBUG - Pod ctest-pod-80457695 not present
2025-03-29 10:39:47,325 - INFO - Creating Pod ctest-pod-80457695
2025-03-29 10:39:47,369 - DEBUG - Pod : ctest-pod-80457695 UUID is 1fb5dfca-974e-4ccb-9ebb-e9a4a8862a23
2025-03-29 10:39:47,373 - DEBUG - Pod ctest-pod-71205216 not present
2025-03-29 10:39:47,373 - INFO - Creating Pod ctest-pod-71205216
2025-03-29 10:39:47,420 - DEBUG - Pod : ctest-pod-71205216 UUID is 2aa9a93b-1418-4e0d-bae6-5ebdc991ef5a
2025-03-29 10:39:47,423 - DEBUG - Pod ctest-pod-90054094 not present
2025-03-29 10:39:47,423 - INFO - Creating Pod ctest-pod-90054094
2025-03-29 10:39:47,446 - DEBUG - Pod : ctest-pod-90054094 UUID is 2c85d485-dd37-4ae9-8bdf-623baed7e896
2025-03-29 10:39:47,448 - DEBUG - Pod ctest-pod-00987150 not present
2025-03-29 10:39:47,448 - INFO - Creating Pod ctest-pod-00987150
2025-03-29 10:39:47,472 - DEBUG - Pod : ctest-pod-00987150 UUID is f02b34cc-82de-4fea-90f5-e08b3d55cb03
2025-03-29 10:39:47,475 - DEBUG - Pod ctest-pod-13771373 not present
2025-03-29 10:39:47,475 - INFO - Creating Pod ctest-pod-13771373
2025-03-29 10:39:47,495 - DEBUG - Pod : ctest-pod-13771373 UUID is 6dbd6591-4240-4eaf-b495-247c4fa52868
2025-03-29 10:39:47,497 - DEBUG - Pod ctest-pod-18213189 not present
2025-03-29 10:39:47,497 - INFO - Creating Pod ctest-pod-18213189
2025-03-29 10:39:47,518 - DEBUG - Pod : ctest-pod-18213189 UUID is 15732940-5636-4f1c-94f9-e35428ca0b66
2025-03-29 10:39:47,520 - DEBUG - Pod ctest-pod-51058575 not present
2025-03-29 10:39:47,520 - INFO - Creating Pod ctest-pod-51058575
2025-03-29 10:39:47,544 - DEBUG - Pod : ctest-pod-51058575 UUID is 8ed32cac-515c-4af6-899b-ad5c902fa44e
2025-03-29 10:39:47,547 - DEBUG - Pod ctest-pod-38245866 not present
2025-03-29 10:39:47,547 - INFO - Creating Pod ctest-pod-38245866
2025-03-29 10:39:47,570 - DEBUG - Pod : ctest-pod-38245866 UUID is 524c2587-4542-45d3-89ca-b04c4f5ac639
2025-03-29 10:39:47,773 - INFO - Project default-domain:k8s-ctest-new-default-53250646 for Namespace ctest-new-default-53250646 is seen in contrail-api
2025-03-29 10:39:47,773 - DEBUG - Project uuid in Contrail is 300a472d-c8da-49b9-99c6-5ba8f64945b2
2025-03-29 10:39:47,965 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NamespaceDatabaseList?namespace_uuid=e45f7bef-38fa-499a-8bff-68e4b91597ef
2025-03-29 10:39:47,973 - INFO - Namespace ctest-new-default-53250646 with uuid e45f7bef-38fa-499a-8bff-68e4b91597ef found in kube manager
2025-03-29 10:39:47,973 - INFO - Namespace ctest-new-default-53250646 verification passed
2025-03-29 10:39:48,214 - INFO - Project default-domain:k8s-ctest-non-default-45253667 for Namespace ctest-non-default-45253667 is seen in contrail-api
2025-03-29 10:39:48,214 - DEBUG - Project uuid in Contrail is d4bc433a-34c9-4c44-803b-a34e1b81159f
2025-03-29 10:39:48,214 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NamespaceDatabaseList?namespace_uuid=942d5fd5-bc03-427b-ba61-ddfc596552c0
2025-03-29 10:39:48,218 - INFO - Namespace ctest-non-default-45253667 with uuid 942d5fd5-bc03-427b-ba61-ddfc596552c0 found in kube manager
2025-03-29 10:39:48,218 - INFO - Namespace ctest-non-default-45253667 verification passed
2025-03-29 10:39:48,223 - DEBUG - Pod ctest-pod-80457695 not in running state.Currently in Pending
2025-03-29 10:39:53,238 - DEBUG - Pod ctest-pod-80457695 not in running state.Currently in Pending
2025-03-29 10:39:58,245 - INFO - Pod ctest-pod-80457695 is in running state.Got IP 10.47.255.251
2025-03-29 10:39:58,261 - DEBUG - Pod ctest-pod-80457695 has vmi 23b0a1b6-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:39:58,261 - INFO - Verified pod ctest-pod-80457695 in contrail-api
2025-03-29 10:39:58,274 - DEBUG - VMI 23b0a1b6-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:39:58,274 - INFO - Verified Pod ctest-pod-80457695 in agent 10.0.0.22
2025-03-29 10:39:58,274 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=1fb5dfca-974e-4ccb-9ebb-e9a4a8862a23
2025-03-29 10:39:58,280 - INFO - Pod ctest-pod-80457695 with uuid 1fb5dfca-974e-4ccb-9ebb-e9a4a8862a23 found in kube manager
2025-03-29 10:39:58,280 - INFO - Pod ctest-pod-80457695 verification passed
2025-03-29 10:39:58,285 - INFO - Pod ctest-pod-71205216 is in running state.Got IP 10.47.255.250
2025-03-29 10:39:58,342 - DEBUG - Pod ctest-pod-71205216 has vmi 243d1574-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:39:58,342 - INFO - Verified pod ctest-pod-71205216 in contrail-api
2025-03-29 10:39:58,355 - DEBUG - VMI 243d1574-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:39:58,355 - INFO - Verified Pod ctest-pod-71205216 in agent 10.0.0.22
2025-03-29 10:39:58,355 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=2aa9a93b-1418-4e0d-bae6-5ebdc991ef5a
2025-03-29 10:39:58,360 - INFO - Pod ctest-pod-71205216 with uuid 2aa9a93b-1418-4e0d-bae6-5ebdc991ef5a found in kube manager
2025-03-29 10:39:58,360 - INFO - Pod ctest-pod-71205216 verification passed
2025-03-29 10:39:58,365 - INFO - Pod ctest-pod-90054094 is in running state.Got IP 10.47.255.249
2025-03-29 10:39:58,382 - DEBUG - Pod ctest-pod-90054094 has vmi 24e58c86-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:39:58,382 - INFO - Verified pod ctest-pod-90054094 in contrail-api
2025-03-29 10:39:58,396 - DEBUG - VMI 24e58c86-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:39:58,396 - INFO - Verified Pod ctest-pod-90054094 in agent 10.0.0.22
2025-03-29 10:39:58,396 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=2c85d485-dd37-4ae9-8bdf-623baed7e896
2025-03-29 10:39:58,401 - INFO - Pod ctest-pod-90054094 with uuid 2c85d485-dd37-4ae9-8bdf-623baed7e896 found in kube manager
2025-03-29 10:39:58,401 - INFO - Pod ctest-pod-90054094 verification passed
2025-03-29 10:39:58,408 - INFO - Pod ctest-pod-00987150 is in running state.Got IP 10.47.255.248
2025-03-29 10:39:58,468 - DEBUG - Pod ctest-pod-00987150 has vmi 256e8ab8-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:39:58,468 - INFO - Verified pod ctest-pod-00987150 in contrail-api
2025-03-29 10:39:58,483 - DEBUG - VMI 256e8ab8-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:39:58,483 - INFO - Verified Pod ctest-pod-00987150 in agent 10.0.0.22
2025-03-29 10:39:58,483 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=f02b34cc-82de-4fea-90f5-e08b3d55cb03
2025-03-29 10:39:58,488 - INFO - Pod ctest-pod-00987150 with uuid f02b34cc-82de-4fea-90f5-e08b3d55cb03 found in kube manager
2025-03-29 10:39:58,488 - INFO - Pod ctest-pod-00987150 verification passed
2025-03-29 10:39:58,493 - DEBUG - Pod ctest-pod-13771373 not in running state.Currently in Pending
2025-03-29 10:40:03,502 - INFO - Pod ctest-pod-13771373 is in running state.Got IP 10.47.255.247
2025-03-29 10:40:03,519 - DEBUG - Pod ctest-pod-13771373 has vmi 26035e86-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:40:03,519 - INFO - Verified pod ctest-pod-13771373 in contrail-api
2025-03-29 10:40:03,534 - DEBUG - VMI 26035e86-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:40:03,535 - INFO - Verified Pod ctest-pod-13771373 in agent 10.0.0.22
2025-03-29 10:40:03,535 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=6dbd6591-4240-4eaf-b495-247c4fa52868
2025-03-29 10:40:03,539 - INFO - Pod ctest-pod-13771373 with uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 found in kube manager
2025-03-29 10:40:03,540 - INFO - Pod ctest-pod-13771373 verification passed
2025-03-29 10:40:03,546 - DEBUG - Pod ctest-pod-51058575 not in running state.Currently in Pending
2025-03-29 10:40:08,553 - INFO - Pod ctest-pod-51058575 is in running state.Got IP 10.47.255.245
2025-03-29 10:40:08,626 - DEBUG - Pod ctest-pod-51058575 has vmi 27040c2c-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:40:08,626 - INFO - Verified pod ctest-pod-51058575 in contrail-api
2025-03-29 10:40:08,644 - DEBUG - VMI 27040c2c-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:40:08,645 - INFO - Verified Pod ctest-pod-51058575 in agent 10.0.0.22
2025-03-29 10:40:08,645 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=8ed32cac-515c-4af6-899b-ad5c902fa44e
2025-03-29 10:40:08,650 - INFO - Pod ctest-pod-51058575 with uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e found in kube manager
2025-03-29 10:40:08,650 - INFO - Pod ctest-pod-51058575 verification passed
2025-03-29 10:40:08,656 - INFO - Pod ctest-pod-18213189 is in running state.Got IP 10.47.255.246
2025-03-29 10:40:08,671 - DEBUG - Pod ctest-pod-18213189 has vmi 268789a4-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:40:08,671 - INFO - Verified pod ctest-pod-18213189 in contrail-api
2025-03-29 10:40:08,689 - DEBUG - VMI 268789a4-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:40:08,689 - INFO - Verified Pod ctest-pod-18213189 in agent 10.0.0.22
2025-03-29 10:40:08,689 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=15732940-5636-4f1c-94f9-e35428ca0b66
2025-03-29 10:40:08,695 - INFO - Pod ctest-pod-18213189 with uuid 15732940-5636-4f1c-94f9-e35428ca0b66 found in kube manager
2025-03-29 10:40:08,695 - INFO - Pod ctest-pod-18213189 verification passed
2025-03-29 10:40:08,701 - INFO - Pod ctest-pod-38245866 is in running state.Got IP 10.47.255.244
2025-03-29 10:40:08,759 - DEBUG - Pod ctest-pod-38245866 has vmi 27820b68-0c8a-11f0-8fcc-fa163ea61601
2025-03-29 10:40:08,759 - INFO - Verified pod ctest-pod-38245866 in contrail-api
2025-03-29 10:40:08,774 - DEBUG - VMI 27820b68-0c8a-11f0-8fcc-fa163ea61601 is active in agent 10.0.0.22
2025-03-29 10:40:08,774 - INFO - Verified Pod ctest-pod-38245866 in agent 10.0.0.22
2025-03-29 10:40:08,774 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=524c2587-4542-45d3-89ca-b04c4f5ac639
2025-03-29 10:40:08,779 - INFO - Pod ctest-pod-38245866 with uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 found in kube manager
2025-03-29 10:40:08,779 - INFO - Pod ctest-pod-38245866 verification passed
2025-03-29 10:40:08,779 - INFO - ================================================================================
2025-03-29 10:40:08,779 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-29 10:40:08,779 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-29 10:40:09,027 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.52': '0'}} with
2025-03-29 10:40:09,027 - INFO - Initial checks done. Running the testcase now
2025-03-29 10:40:09,027 - INFO -
2025-03-29 10:40:09,097 - DEBUG - [Pod ctest-pod-80457695] Cmd: echo ctest-pod-80457695 > /usr/share/nginx/html/index.html, Output:
2025-03-29 10:40:09,176 - DEBUG - [Pod ctest-pod-71205216] Cmd: echo ctest-pod-71205216 > /usr/share/nginx/html/index.html, Output:
2025-03-29 10:40:09,253 - DEBUG - [Pod ctest-pod-90054094] Cmd: echo ctest-pod-90054094 > /usr/share/nginx/html/index.html, Output:
2025-03-29 10:40:09,317 - DEBUG - [Pod ctest-pod-00987150] Cmd: echo ctest-pod-00987150 > /usr/share/nginx/html/index.html, Output:
2025-03-29 10:40:09,320 - DEBUG - Service ctest-nginx-svc-77983238 not present
2025-03-29 10:40:09,320 - INFO - Creating service ctest-nginx-svc-77983238
2025-03-29 10:40:09,339 - INFO - Created Service ctest-nginx-svc-77983238
2025-03-29 10:40:09,351 - WARNING - Service UUID 0dfaf844-6985-407b-b7d6-384f59940529 not yet found in contrail-api
2025-03-29 10:40:10,360 - INFO - Validated that Service ctest-nginx-svc-77983238 is seen in contrail-api
2025-03-29 10:40:10,360 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_LoadbalancerDatabaseList?x=0dfaf844-6985-407b-b7d6-384f59940529
2025-03-29 10:40:10,377 - INFO - Service ctest-nginx-svc-77983238 with uuid 0dfaf844-6985-407b-b7d6-384f59940529 found in kube manager
2025-03-29 10:40:10,377 - INFO - Service ctest-nginx-svc-77983238 verification passed
2025-03-29 10:40:11,476 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
ctest-pod-71205216
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,476 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:40:11,476 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
ctest-pod-71205216
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,558 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,558 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:40:11,558 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,621 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80457695
2025-03-29 10:40:11,622 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:40:11,622 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80457695
2025-03-29 10:40:11,622 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80457695': 1, 'ctest-pod-71205216': 2}
2025-03-29 10:40:11,699 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80457695
2025-03-29 10:40:11,699 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:40:11,699 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80457695
2025-03-29 10:40:11,768 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,768 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:40:11,768 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,898 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,898 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:40:11,898 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:40:11,898 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80457695': 2, 'ctest-pod-71205216': 1}
2025-03-29 10:40:11,902 - DEBUG - Network policy ingress-on-service not present
2025-03-29 10:40:11,902 - INFO - Creating Network Policy ingress-on-service
2025-03-29 10:40:11,914 - INFO - Network policy found in k8s
2025-03-29 10:40:11,915 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf16d131-bbbc-4b1c-9f4d-e5af53a23416
2025-03-29 10:40:11,920 - INFO - Network Policy ingress-on-service with uuid bf16d131-bbbc-4b1c-9f4d-e5af53a23416 found in kube manager
2025-03-29 10:40:11,956 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-29 10:40:11,957 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-29 10:40:11,957 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf16d131-bbbc-4b1c-9f4d-e5af53a23416
2025-03-29 10:40:11,988 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-29 10:40:13,988 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf16d131-bbbc-4b1c-9f4d-e5af53a23416
2025-03-29 10:40:14,023 - INFO - Network policy with name ingress-on-service found in agent
2025-03-29 10:40:14,023 - INFO - Network Policy ingress-on-service verification passed
2025-03-29 10:40:19,097 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:19,097 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:19,097 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:24,151 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:24,151 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:24,151 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:29,216 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:29,216 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:29,216 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:34,272 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:34,272 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:34,272 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:39,317 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:39,317 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:39,317 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:44,379 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:44,379 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:44,379 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:49,449 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:49,449 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:49,449 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:54,521 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:54,521 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:54,521 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:59,587 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:59,587 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:40:59,588 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:04,640 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:04,640 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:04,640 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:04,640 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80457695': 0, 'ctest-pod-71205216': 0}
2025-03-29 10:41:04,703 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
ctest-pod-80457695
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:41:04,703 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:41:04,703 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
ctest-pod-80457695
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:41:04,762 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:41:04,762 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:41:04,762 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:41:04,823 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
ctest-pod-71205216
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:41:04,823 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:41:04,823 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
ctest-pod-71205216
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:41:04,823 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80457695': 2, 'ctest-pod-71205216': 1}
2025-03-29 10:41:09,887 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:09,887 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:09,887 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:14,940 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:14,941 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:14,941 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:20,004 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:20,005 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:20,005 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:25,067 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:25,068 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:25,068 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:30,126 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:30,126 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:30,126 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:35,184 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:35,184 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:35,184 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:40,243 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:40,243 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:40,243 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:45,316 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:45,316 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:45,316 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:50,376 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:50,376 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:50,376 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:55,461 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:55,461 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:55,461 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:41:55,461 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80457695': 0, 'ctest-pod-71205216': 0}
2025-03-29 10:41:57,541 - DEBUG - [Pod ctest-pod-18213189] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.131 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.436/1.131 ms
2025-03-29 10:41:57,541 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18213189 with expectation True passed
2025-03-29 10:41:59,603 - DEBUG - [Pod ctest-pod-13771373] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.522 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.095 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.095/0.242/0.522 ms
2025-03-29 10:41:59,604 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13771373 with expectation True passed
2025-03-29 10:42:01,663 - DEBUG - [Pod ctest-pod-51058575] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.683 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.626/1.683 ms
2025-03-29 10:42:01,663 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51058575 with expectation True passed
2025-03-29 10:42:01,722 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:42:01,722 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 10:42:01,722 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:42:01,722 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18213189 passed
2025-03-29 10:42:01,801 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:42:01,801 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 10:42:01,801 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:42:01,801 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18213189 passed
2025-03-29 10:42:06,871 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 10:42:06,871 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 10:42:06,871 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 10:42:06,871 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13771373 passed
2025-03-29 10:42:11,935 - DEBUG - [Pod ctest-pod-38245866] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 10:42:11,936 - DEBUG - [Pod Pod ctest-pod-38245866] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 10:42:11,936 - DEBUG - [Pod Pod ctest-pod-38245866] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 10:42:11,936 - INFO - wget check of of http://10.47.255.251 from ctest-pod-38245866 passed
2025-03-29 10:42:11,945 - INFO - Updating Network Policy ingress-on-service
2025-03-29 10:42:17,008 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:17,008 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:17,008 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:22,092 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:22,092 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:22,092 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:27,147 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:27,147 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:27,147 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:32,208 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:32,208 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:32,208 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:37,271 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:37,271 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:37,271 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:42,329 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:42,329 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:42,329 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:47,377 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:47,377 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:47,377 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:52,436 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:52,436 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:52,436 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:57,500 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:57,500 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:42:57,500 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:43:02,579 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:43:02,580 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:43:02,580 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
wget: download timed out
2025-03-29 10:43:02,580 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80457695': 0, 'ctest-pod-71205216': 0}
2025-03-29 10:43:02,641 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,641 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:02,642 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,706 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,706 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:02,706 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,772 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80457695
2025-03-29 10:43:02,772 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:02,772 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80457695
2025-03-29 10:43:02,825 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71205216
2025-03-29 10:43:02,825 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:02,825 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71205216
2025-03-29 10:43:02,825 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80457695': 3, 'ctest-pod-71205216': 1}
2025-03-29 10:43:02,912 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,912 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:02,912 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,970 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:02,970 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:02,970 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: ctest-pod-71205216
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:03,029 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71205216
2025-03-29 10:43:03,029 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:03,030 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-71205216
2025-03-29 10:43:03,102 - DEBUG - [Pod ctest-pod-51058575] Cmd: wget http://10.96.197.49:80/ -O - -T 5 -t 1 , Output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:03,102 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd wget http://10.96.197.49:80/ -O - -T 5 -t 1 passed
2025-03-29 10:43:03,102 - DEBUG - [Pod Pod ctest-pod-51058575] Cmd output: ctest-pod-80457695
Connecting to 10.96.197.49:80 (10.96.197.49:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 10:43:03,102 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80457695': 1, 'ctest-pod-71205216': 3}
2025-03-29 10:43:05,152 - DEBUG - [Pod ctest-pod-18213189] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.755 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.307/0.755 ms
2025-03-29 10:43:05,152 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18213189 with expectation True passed
2025-03-29 10:43:07,215 - DEBUG - [Pod ctest-pod-13771373] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.403 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.529/1.403 ms
2025-03-29 10:43:07,215 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13771373 with expectation True passed
2025-03-29 10:43:09,275 - DEBUG - [Pod ctest-pod-51058575] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.893 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.357/0.893 ms
2025-03-29 10:43:09,275 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51058575 with expectation True passed
2025-03-29 10:43:09,336 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:43:09,336 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 10:43:09,336 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:43:09,336 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18213189 passed
2025-03-29 10:43:09,401 - DEBUG - [Pod ctest-pod-18213189] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:43:09,401 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 10:43:09,401 - DEBUG - [Pod Pod ctest-pod-18213189] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:43:09,401 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18213189 passed
2025-03-29 10:43:14,454 - DEBUG - [Pod ctest-pod-13771373] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 10:43:14,454 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 10:43:14,454 - DEBUG - [Pod Pod ctest-pod-13771373] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 10:43:14,454 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13771373 passed
2025-03-29 10:43:14,528 - DEBUG - [Pod ctest-pod-38245866] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:43:14,528 - DEBUG - [Pod Pod ctest-pod-38245866] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 10:43:14,528 - DEBUG - [Pod Pod ctest-pod-38245866] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 10:43:14,528 - INFO - wget check of of http://10.47.255.251 from ctest-pod-38245866 passed
2025-03-29 10:43:14,528 - INFO - Deleting Network Policy : ingress-on-service
2025-03-29 10:43:14,529 - INFO - Deleting service : ctest-nginx-svc-77983238
2025-03-29 10:43:14,737 - DEBUG - No XMPP flaps were noticed during the test
2025-03-29 10:43:14,737 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-29 10:43:14,737 - INFO - --------------------------------------------------------------------------------
2025-03-29 10:43:14,743 - INFO - Deleting pod ctest-new-default-53250646:ctest-pod-80457695
2025-03-29 10:43:14,743 - INFO - Deleting pod ctest-new-default-53250646:ctest-pod-71205216
2025-03-29 10:43:14,744 - INFO - Deleting pod ctest-non-default-45253667:ctest-pod-90054094
2025-03-29 10:43:14,744 - INFO - Deleting pod ctest-non-default-45253667:ctest-pod-00987150
2025-03-29 10:43:14,744 - INFO - Deleting pod ctest-new-default-53250646:ctest-pod-13771373
2025-03-29 10:43:14,745 - INFO - Deleting pod ctest-new-default-53250646:ctest-pod-18213189
2025-03-29 10:43:14,745 - INFO - Deleting pod ctest-non-default-45253667:ctest-pod-51058575
2025-03-29 10:43:14,745 - INFO - Deleting pod ctest-non-default-45253667:ctest-pod-38245866
2025-03-29 10:43:14,822 - WARNING - Pod uuid 1fb5dfca-974e-4ccb-9ebb-e9a4a8862a23 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,826 - WARNING - Pod uuid 2c85d485-dd37-4ae9-8bdf-623baed7e896 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,830 - WARNING - Pod uuid 2aa9a93b-1418-4e0d-bae6-5ebdc991ef5a is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,911 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,912 - WARNING - Pod uuid f02b34cc-82de-4fea-90f5-e08b3d55cb03 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,913 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,913 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:14,914 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:19,833 - DEBUG - Pod 1fb5dfca-974e-4ccb-9ebb-e9a4a8862a23 is not in agent 10.0.0.22 VM list
2025-03-29 10:43:19,847 - DEBUG - VMI 23b0a1b6-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:19,847 - INFO - Verified that pod ctest-pod-80457695 is removed in agent
2025-03-29 10:43:19,847 - DEBUG - Pod 2aa9a93b-1418-4e0d-bae6-5ebdc991ef5a is not in agent 10.0.0.22 VM list
2025-03-29 10:43:19,849 - DEBUG - Pod 2c85d485-dd37-4ae9-8bdf-623baed7e896 is not in agent 10.0.0.22 VM list
2025-03-29 10:43:19,858 - DEBUG - VMI 24e58c86-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:19,859 - INFO - Verified that pod ctest-pod-90054094 is removed in agent
2025-03-29 10:43:19,859 - DEBUG - VMI 243d1574-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:19,859 - INFO - Verified that pod ctest-pod-71205216 is removed in agent
2025-03-29 10:43:19,933 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:19,935 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:19,935 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:19,936 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:19,936 - DEBUG - Pod f02b34cc-82de-4fea-90f5-e08b3d55cb03 is not in agent 10.0.0.22 VM list
2025-03-29 10:43:19,942 - DEBUG - VMI 256e8ab8-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:19,943 - INFO - Verified that pod ctest-pod-00987150 is removed in agent
2025-03-29 10:43:24,952 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:24,954 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:24,954 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:24,955 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:29,978 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:29,981 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:29,981 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:29,982 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:34,997 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:34,999 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:35,000 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:35,000 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:40,023 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:40,023 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:40,024 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:40,025 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:45,055 - WARNING - Pod uuid 6dbd6591-4240-4eaf-b495-247c4fa52868 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:45,055 - WARNING - Pod uuid 15732940-5636-4f1c-94f9-e35428ca0b66 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:45,057 - WARNING - Pod uuid 8ed32cac-515c-4af6-899b-ad5c902fa44e is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:45,057 - WARNING - Pod uuid 524c2587-4542-45d3-89ca-b04c4f5ac639 is still seen in agent 10.0.0.22 VM list
2025-03-29 10:43:50,074 - DEBUG - Pod 6dbd6591-4240-4eaf-b495-247c4fa52868 is not in agent 10.0.0.22 VM list
2025-03-29 10:43:50,075 - DEBUG - Pod 15732940-5636-4f1c-94f9-e35428ca0b66 is not in agent 10.0.0.22 VM list
2025-03-29 10:43:50,079 - DEBUG - Pod 8ed32cac-515c-4af6-899b-ad5c902fa44e is not in agent 10.0.0.22 VM list
2025-03-29 10:43:50,080 - DEBUG - Pod 524c2587-4542-45d3-89ca-b04c4f5ac639 is not in agent 10.0.0.22 VM list
2025-03-29 10:43:50,093 - DEBUG - VMI 27820b68-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:50,093 - INFO - Verified that pod ctest-pod-38245866 is removed in agent
2025-03-29 10:43:50,095 - DEBUG - VMI 27040c2c-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:50,095 - INFO - Verified that pod ctest-pod-51058575 is removed in agent
2025-03-29 10:43:50,096 - DEBUG - VMI 268789a4-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:50,096 - INFO - Verified that pod ctest-pod-18213189 is removed in agent
2025-03-29 10:43:50,096 - DEBUG - VMI 26035e86-0c8a-11f0-8fcc-fa163ea61601 is removed from agent 10.0.0.22
2025-03-29 10:43:50,096 - INFO - Verified that pod ctest-pod-13771373 is removed in agent
2025-03-29 10:43:50,096 - INFO - Deleting namespace ctest-non-default-45253667
2025-03-29 10:43:50,106 - DEBUG - Namespace ctest-non-default-45253667 still in k8s
2025-03-29 10:43:52,111 - DEBUG - Namespace ctest-non-default-45253667 still in k8s
2025-03-29 10:43:54,117 - DEBUG - Namespace ctest-non-default-45253667 still in k8s
2025-03-29 10:43:56,120 - DEBUG - Namespace ctest-non-default-45253667 is not in k8s
2025-03-29 10:43:56,120 - DEBUG - No need to check project deletion in contrail-api
2025-03-29 10:43:56,120 - INFO - Deleting namespace ctest-new-default-53250646
2025-03-29 10:43:56,130 - DEBUG - Namespace ctest-new-default-53250646 still in k8s
2025-03-29 10:43:58,135 - DEBUG - Namespace ctest-new-default-53250646 still in k8s
2025-03-29 10:44:00,139 - DEBUG - Namespace ctest-new-default-53250646 still in k8s
2025-03-29 10:44:02,151 - DEBUG - Namespace ctest-new-default-53250646 is not in k8s
2025-03-29 10:44:02,151 - DEBUG - No need to check project deletion in contrail-api