2025-02-20 02:08:57,017 - INFO - Using existing project ['default-domain', 'k8s-default'](c222aa00-1894-4ba7-a010-6b48109859fe)
2025-02-20 02:08:57,047 - DEBUG - Namespace ctest-new-default-71482728 not present
2025-02-20 02:08:57,060 - INFO - Created namespace ctest-new-default-71482728
2025-02-20 02:09:00,066 - DEBUG - Namespace ctest-non-default-99227679 not present
2025-02-20 02:09:00,077 - INFO - Created namespace ctest-non-default-99227679
2025-02-20 02:09:03,103 - DEBUG - Pod ctest-pod-38502531 not present
2025-02-20 02:09:03,103 - INFO - Creating Pod ctest-pod-38502531
2025-02-20 02:09:03,139 - DEBUG - Pod : ctest-pod-38502531 UUID is 09f880bc-921f-494a-a6a4-b05f3c99414e
2025-02-20 02:09:03,146 - DEBUG - Pod ctest-pod-62218202 not present
2025-02-20 02:09:03,146 - INFO - Creating Pod ctest-pod-62218202
2025-02-20 02:09:03,188 - DEBUG - Pod : ctest-pod-62218202 UUID is 0308aa27-c4ba-4a06-96f4-e2b65f05921e
2025-02-20 02:09:03,191 - DEBUG - Pod ctest-pod-66658028 not present
2025-02-20 02:09:03,191 - INFO - Creating Pod ctest-pod-66658028
2025-02-20 02:09:03,245 - DEBUG - Pod : ctest-pod-66658028 UUID is 44a0702a-7823-4730-8a66-e46aabb020ef
2025-02-20 02:09:03,250 - DEBUG - Pod ctest-pod-02911973 not present
2025-02-20 02:09:03,251 - INFO - Creating Pod ctest-pod-02911973
2025-02-20 02:09:03,287 - DEBUG - Pod : ctest-pod-02911973 UUID is f3d05ecb-dffa-470f-bdb9-8897d5737cc1
2025-02-20 02:09:03,293 - DEBUG - Pod ctest-pod-73608803 not present
2025-02-20 02:09:03,293 - INFO - Creating Pod ctest-pod-73608803
2025-02-20 02:09:03,329 - DEBUG - Pod : ctest-pod-73608803 UUID is 28c6969d-78cd-4181-8951-4685ef9ba8e7
2025-02-20 02:09:03,332 - DEBUG - Pod ctest-pod-79278475 not present
2025-02-20 02:09:03,332 - INFO - Creating Pod ctest-pod-79278475
2025-02-20 02:09:03,358 - DEBUG - Pod : ctest-pod-79278475 UUID is 0abd439f-643a-46f5-850a-a26b9aba9b7b
2025-02-20 02:09:03,361 - DEBUG - Pod ctest-pod-31167288 not present
2025-02-20 02:09:03,361 - INFO - Creating Pod ctest-pod-31167288
2025-02-20 02:09:03,413 - DEBUG - Pod : ctest-pod-31167288 UUID is 9eb3aa51-a33c-4b34-9228-7081869cabd0
2025-02-20 02:09:03,415 - DEBUG - Pod ctest-pod-35293768 not present
2025-02-20 02:09:03,416 - INFO - Creating Pod ctest-pod-35293768
2025-02-20 02:09:03,439 - DEBUG - Pod : ctest-pod-35293768 UUID is db4fcba6-1bab-4ce0-b31d-706e8de9fe00
2025-02-20 02:09:03,706 - INFO - Project default-domain:k8s-ctest-new-default-71482728 for Namespace ctest-new-default-71482728 is seen in contrail-api
2025-02-20 02:09:03,707 - DEBUG - Project uuid in Contrail is 481a5d37-7fd0-4fd7-80d8-13ff6d2f3eda
2025-02-20 02:09:03,884 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=b8e9eb03-0f94-472e-97bc-dc4c75bb4192
2025-02-20 02:09:03,890 - INFO - Namespace ctest-new-default-71482728 with uuid b8e9eb03-0f94-472e-97bc-dc4c75bb4192 found in kube manager
2025-02-20 02:09:03,891 - INFO - Namespace ctest-new-default-71482728 verification passed
2025-02-20 02:09:04,127 - INFO - Project default-domain:k8s-ctest-non-default-99227679 for Namespace ctest-non-default-99227679 is seen in contrail-api
2025-02-20 02:09:04,127 - DEBUG - Project uuid in Contrail is d1d70e1a-9273-4aa7-9b51-6e049646fcfc
2025-02-20 02:09:04,127 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=07eaddc0-1d49-449e-aaa4-ef334efa9493
2025-02-20 02:09:04,133 - INFO - Namespace ctest-non-default-99227679 with uuid 07eaddc0-1d49-449e-aaa4-ef334efa9493 found in kube manager
2025-02-20 02:09:04,133 - INFO - Namespace ctest-non-default-99227679 verification passed
2025-02-20 02:09:04,139 - DEBUG - Pod ctest-pod-38502531 not in running state.Currently in Pending
2025-02-20 02:09:09,147 - DEBUG - Pod ctest-pod-38502531 not in running state.Currently in Pending
2025-02-20 02:09:14,153 - DEBUG - Pod ctest-pod-38502531 not in running state.Currently in Pending
2025-02-20 02:09:19,168 - INFO - Pod ctest-pod-38502531 is in running state.Got IP 10.47.255.251
2025-02-20 02:09:19,224 - DEBUG - Pod ctest-pod-38502531 has vmi a93f9bf2-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:19,225 - INFO - Verified pod ctest-pod-38502531 in contrail-api
2025-02-20 02:09:19,242 - DEBUG - VMI a93f9bf2-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:19,242 - INFO - Verified Pod ctest-pod-38502531 in agent 10.0.0.54
2025-02-20 02:09:19,242 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=09f880bc-921f-494a-a6a4-b05f3c99414e
2025-02-20 02:09:19,247 - INFO - Pod ctest-pod-38502531 with uuid 09f880bc-921f-494a-a6a4-b05f3c99414e found in kube manager
2025-02-20 02:09:19,247 - INFO - Pod ctest-pod-38502531 verification passed
2025-02-20 02:09:19,252 - INFO - Pod ctest-pod-62218202 is in running state.Got IP 10.47.255.250
2025-02-20 02:09:19,266 - DEBUG - Pod ctest-pod-62218202 has vmi a9c1c87a-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:19,267 - INFO - Verified pod ctest-pod-62218202 in contrail-api
2025-02-20 02:09:19,283 - DEBUG - VMI a9c1c87a-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:19,283 - INFO - Verified Pod ctest-pod-62218202 in agent 10.0.0.54
2025-02-20 02:09:19,283 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=0308aa27-c4ba-4a06-96f4-e2b65f05921e
2025-02-20 02:09:19,288 - INFO - Pod ctest-pod-62218202 with uuid 0308aa27-c4ba-4a06-96f4-e2b65f05921e found in kube manager
2025-02-20 02:09:19,288 - INFO - Pod ctest-pod-62218202 verification passed
2025-02-20 02:09:19,294 - INFO - Pod ctest-pod-66658028 is in running state.Got IP 10.47.255.249
2025-02-20 02:09:19,353 - DEBUG - Pod ctest-pod-66658028 has vmi aa7c6cf2-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:19,353 - INFO - Verified pod ctest-pod-66658028 in contrail-api
2025-02-20 02:09:19,370 - DEBUG - VMI aa7c6cf2-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:19,371 - INFO - Verified Pod ctest-pod-66658028 in agent 10.0.0.54
2025-02-20 02:09:19,371 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=44a0702a-7823-4730-8a66-e46aabb020ef
2025-02-20 02:09:19,376 - INFO - Pod ctest-pod-66658028 with uuid 44a0702a-7823-4730-8a66-e46aabb020ef found in kube manager
2025-02-20 02:09:19,376 - INFO - Pod ctest-pod-66658028 verification passed
2025-02-20 02:09:19,381 - INFO - Pod ctest-pod-02911973 is in running state.Got IP 10.47.255.248
2025-02-20 02:09:19,440 - DEBUG - Pod ctest-pod-02911973 has vmi ab25afba-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:19,440 - INFO - Verified pod ctest-pod-02911973 in contrail-api
2025-02-20 02:09:19,457 - DEBUG - VMI ab25afba-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:19,458 - INFO - Verified Pod ctest-pod-02911973 in agent 10.0.0.54
2025-02-20 02:09:19,458 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=f3d05ecb-dffa-470f-bdb9-8897d5737cc1
2025-02-20 02:09:19,463 - INFO - Pod ctest-pod-02911973 with uuid f3d05ecb-dffa-470f-bdb9-8897d5737cc1 found in kube manager
2025-02-20 02:09:19,463 - INFO - Pod ctest-pod-02911973 verification passed
2025-02-20 02:09:19,471 - DEBUG - Pod ctest-pod-73608803 not in running state.Currently in Pending
2025-02-20 02:09:24,478 - INFO - Pod ctest-pod-73608803 is in running state.Got IP 10.47.255.247
2025-02-20 02:09:24,495 - DEBUG - Pod ctest-pod-73608803 has vmi abc1cb8e-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:24,495 - INFO - Verified pod ctest-pod-73608803 in contrail-api
2025-02-20 02:09:24,510 - DEBUG - VMI abc1cb8e-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:24,510 - INFO - Verified Pod ctest-pod-73608803 in agent 10.0.0.54
2025-02-20 02:09:24,510 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=28c6969d-78cd-4181-8951-4685ef9ba8e7
2025-02-20 02:09:24,516 - INFO - Pod ctest-pod-73608803 with uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 found in kube manager
2025-02-20 02:09:24,516 - INFO - Pod ctest-pod-73608803 verification passed
2025-02-20 02:09:24,597 - INFO - Pod ctest-pod-31167288 is in running state.Got IP 10.47.255.245
2025-02-20 02:09:24,614 - DEBUG - Pod ctest-pod-31167288 has vmi acc1c0b6-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:24,614 - INFO - Verified pod ctest-pod-31167288 in contrail-api
2025-02-20 02:09:24,630 - DEBUG - VMI acc1c0b6-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:24,631 - INFO - Verified Pod ctest-pod-31167288 in agent 10.0.0.54
2025-02-20 02:09:24,631 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=9eb3aa51-a33c-4b34-9228-7081869cabd0
2025-02-20 02:09:24,636 - INFO - Pod ctest-pod-31167288 with uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 found in kube manager
2025-02-20 02:09:24,636 - INFO - Pod ctest-pod-31167288 verification passed
2025-02-20 02:09:24,642 - INFO - Pod ctest-pod-79278475 is in running state.Got IP 10.47.255.246
2025-02-20 02:09:24,701 - DEBUG - Pod ctest-pod-79278475 has vmi ac442660-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:24,701 - INFO - Verified pod ctest-pod-79278475 in contrail-api
2025-02-20 02:09:24,720 - DEBUG - VMI ac442660-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:24,721 - INFO - Verified Pod ctest-pod-79278475 in agent 10.0.0.54
2025-02-20 02:09:24,721 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=0abd439f-643a-46f5-850a-a26b9aba9b7b
2025-02-20 02:09:24,726 - INFO - Pod ctest-pod-79278475 with uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b found in kube manager
2025-02-20 02:09:24,726 - INFO - Pod ctest-pod-79278475 verification passed
2025-02-20 02:09:24,731 - INFO - Pod ctest-pod-35293768 is in running state.Got IP 10.47.255.244
2025-02-20 02:09:24,788 - DEBUG - Pod ctest-pod-35293768 has vmi ad44d17c-ef2f-11ef-847d-fa163e4a996b
2025-02-20 02:09:24,788 - INFO - Verified pod ctest-pod-35293768 in contrail-api
2025-02-20 02:09:24,804 - DEBUG - VMI ad44d17c-ef2f-11ef-847d-fa163e4a996b is active in agent 10.0.0.54
2025-02-20 02:09:24,804 - INFO - Verified Pod ctest-pod-35293768 in agent 10.0.0.54
2025-02-20 02:09:24,805 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=db4fcba6-1bab-4ce0-b31d-706e8de9fe00
2025-02-20 02:09:24,810 - INFO - Pod ctest-pod-35293768 with uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 found in kube manager
2025-02-20 02:09:24,810 - INFO - Pod ctest-pod-35293768 verification passed
2025-02-20 02:09:24,810 - INFO - ================================================================================
2025-02-20 02:09:24,810 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-02-20 02:09:24,810 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-02-20 02:09:25,085 - DEBUG - Nothing to compare xmpp stats {'10.0.0.54': {'10.0.0.45': '0'}} with
2025-02-20 02:09:25,085 - INFO - Initial checks done. Running the testcase now
2025-02-20 02:09:25,085 - INFO -
2025-02-20 02:09:25,168 - DEBUG - [Pod ctest-pod-38502531] Cmd: echo ctest-pod-38502531 > /usr/share/nginx/html/index.html, Output:
2025-02-20 02:09:25,272 - DEBUG - [Pod ctest-pod-62218202] Cmd: echo ctest-pod-62218202 > /usr/share/nginx/html/index.html, Output:
2025-02-20 02:09:25,364 - DEBUG - [Pod ctest-pod-66658028] Cmd: echo ctest-pod-66658028 > /usr/share/nginx/html/index.html, Output:
2025-02-20 02:09:25,434 - DEBUG - [Pod ctest-pod-02911973] Cmd: echo ctest-pod-02911973 > /usr/share/nginx/html/index.html, Output:
2025-02-20 02:09:25,437 - DEBUG - Service ctest-nginx-svc-85213488 not present
2025-02-20 02:09:25,437 - INFO - Creating service ctest-nginx-svc-85213488
2025-02-20 02:09:25,466 - INFO - Created Service ctest-nginx-svc-85213488
2025-02-20 02:09:25,487 - WARNING - Service UUID 98b28fc1-bd4a-4cf0-aabd-368d4e0ee602 not yet found in contrail-api
2025-02-20 02:09:26,512 - INFO - Validated that Service ctest-nginx-svc-85213488 is seen in contrail-api
2025-02-20 02:09:26,512 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_LoadbalancerDatabaseList?x=98b28fc1-bd4a-4cf0-aabd-368d4e0ee602
2025-02-20 02:09:26,541 - INFO - Service ctest-nginx-svc-85213488 with uuid 98b28fc1-bd4a-4cf0-aabd-368d4e0ee602 found in kube manager
2025-02-20 02:09:26,541 - INFO - Service ctest-nginx-svc-85213488 verification passed
2025-02-20 02:09:27,632 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
ctest-pod-38502531
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,632 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:09:27,632 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
ctest-pod-38502531
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,711 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,711 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:09:27,711 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,774 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62218202
2025-02-20 02:09:27,774 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:09:27,774 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-62218202
2025-02-20 02:09:27,774 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38502531': 2, 'ctest-pod-62218202': 1}
2025-02-20 02:09:27,855 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,855 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:09:27,855 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,922 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,922 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:09:27,922 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:09:27,922 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38502531': 1, 'ctest-pod-62218202': 1}
2025-02-20 02:09:27,925 - DEBUG - Network policy ingress-on-service not present
2025-02-20 02:09:27,926 - INFO - Creating Network Policy ingress-on-service
2025-02-20 02:09:27,945 - INFO - Network policy found in k8s
2025-02-20 02:09:27,946 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=80707400-1e54-466b-bba7-8b440206cf8f
2025-02-20 02:09:27,951 - INFO - Network Policy ingress-on-service with uuid 80707400-1e54-466b-bba7-8b440206cf8f found in kube manager
2025-02-20 02:09:27,993 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-02-20 02:09:27,993 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-02-20 02:09:27,993 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=80707400-1e54-466b-bba7-8b440206cf8f
2025-02-20 02:09:28,040 - WARNING - Network policy with name ingress-on-service not found in agent
2025-02-20 02:09:30,042 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=80707400-1e54-466b-bba7-8b440206cf8f
2025-02-20 02:09:30,076 - INFO - Network policy with name ingress-on-service found in agent
2025-02-20 02:09:30,076 - INFO - Network Policy ingress-on-service verification passed
2025-02-20 02:09:35,151 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:35,151 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:35,152 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:40,223 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:40,224 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:40,224 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:45,290 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:45,290 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:45,290 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:50,375 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:50,375 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:50,375 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:55,448 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:55,448 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:09:55,448 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:00,509 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:00,509 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:00,509 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:05,565 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:05,565 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:05,565 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:10,668 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:10,668 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:10,668 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:15,510 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-02-20 02:10:25,842 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:25,842 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:25,842 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:30,913 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:30,913 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:30,913 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:30,913 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38502531': 0, 'ctest-pod-62218202': 0}
2025-02-20 02:10:30,988 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:10:30,988 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:10:30,988 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:10:31,059 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:10:31,059 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:10:31,060 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:10:31,060 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38502531': 1, 'ctest-pod-62218202': 1}
2025-02-20 02:10:36,132 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:36,132 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:36,132 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:41,187 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:41,187 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:41,187 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:46,257 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:46,257 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:46,257 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:51,348 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:51,348 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:51,348 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:56,418 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:56,418 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:10:56,418 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:01,477 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:01,477 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:01,478 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:06,555 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:06,555 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:06,555 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:11,656 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:11,657 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:11,657 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:16,730 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:16,730 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:16,730 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:21,793 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:21,793 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:21,793 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:21,793 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38502531': 0, 'ctest-pod-62218202': 0}
2025-02-20 02:11:23,864 - DEBUG - [Pod ctest-pod-79278475] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.807 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.325/0.807 ms
2025-02-20 02:11:23,864 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79278475 with expectation True passed
2025-02-20 02:11:25,932 - DEBUG - [Pod ctest-pod-73608803] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.744 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.646/1.744 ms
2025-02-20 02:11:25,932 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73608803 with expectation True passed
2025-02-20 02:11:28,001 - DEBUG - [Pod ctest-pod-31167288] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.749 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.103 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.103/0.657/1.749 ms
2025-02-20 02:11:28,001 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-31167288 with expectation True passed
2025-02-20 02:11:28,084 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:11:28,084 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-20 02:11:28,084 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:11:28,084 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79278475 passed
2025-02-20 02:11:28,148 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:11:28,148 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-20 02:11:28,148 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:11:28,148 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79278475 passed
2025-02-20 02:11:33,209 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-20 02:11:33,209 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-20 02:11:33,209 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-20 02:11:33,209 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73608803 passed
2025-02-20 02:11:38,289 - DEBUG - [Pod ctest-pod-35293768] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-20 02:11:38,289 - DEBUG - [Pod Pod ctest-pod-35293768] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-20 02:11:38,289 - DEBUG - [Pod Pod ctest-pod-35293768] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-20 02:11:38,289 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35293768 passed
2025-02-20 02:11:38,298 - INFO - Updating Network Policy ingress-on-service
2025-02-20 02:11:43,393 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:43,394 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:43,394 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:48,473 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:48,473 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:48,473 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:53,532 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:53,532 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:53,532 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:58,589 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:58,589 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:11:58,589 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:03,671 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:03,671 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:03,671 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:08,739 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:08,739 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:08,739 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:13,822 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:13,822 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:13,822 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:18,903 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:18,903 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:18,903 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:23,962 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:23,962 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:23,962 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:29,032 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:29,032 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:29,032 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.96.201.82:80 (10.96.201.82:80)
wget: download timed out
2025-02-20 02:12:29,032 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38502531': 0, 'ctest-pod-62218202': 0}
2025-02-20 02:12:29,121 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,121 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:12:29,121 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,191 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,192 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:12:29,192 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,266 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,266 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:12:29,266 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,266 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38502531': 2, 'ctest-pod-62218202': 1}
2025-02-20 02:12:29,333 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,333 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:12:29,333 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,402 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,402 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:12:29,402 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: ctest-pod-38502531
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,458 - DEBUG - [Pod ctest-pod-31167288] Cmd: wget http://10.96.201.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,459 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd wget http://10.96.201.82:80/ -O - -T 5 -t 1 passed
2025-02-20 02:12:29,459 - DEBUG - [Pod Pod ctest-pod-31167288] Cmd output: ctest-pod-62218202
Connecting to 10.96.201.82:80 (10.96.201.82:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-20 02:12:29,459 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38502531': 2, 'ctest-pod-62218202': 1}
2025-02-20 02:12:31,538 - DEBUG - [Pod ctest-pod-79278475] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.629 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.119 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.274/0.629 ms
2025-02-20 02:12:31,538 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79278475 with expectation True passed
2025-02-20 02:12:33,644 - DEBUG - [Pod ctest-pod-73608803] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.361 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.509/1.361 ms
2025-02-20 02:12:33,645 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73608803 with expectation True passed
2025-02-20 02:12:35,713 - DEBUG - [Pod ctest-pod-31167288] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.428 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.107 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.208/0.428 ms
2025-02-20 02:12:35,713 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-31167288 with expectation True passed
2025-02-20 02:12:35,787 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:12:35,787 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-20 02:12:35,787 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:12:35,787 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79278475 passed
2025-02-20 02:12:35,852 - DEBUG - [Pod ctest-pod-79278475] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:12:35,852 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-20 02:12:35,852 - DEBUG - [Pod Pod ctest-pod-79278475] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:12:35,852 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79278475 passed
2025-02-20 02:12:40,930 - DEBUG - [Pod ctest-pod-73608803] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-20 02:12:40,930 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-20 02:12:40,930 - DEBUG - [Pod Pod ctest-pod-73608803] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-20 02:12:40,930 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73608803 passed
2025-02-20 02:12:41,000 - DEBUG - [Pod ctest-pod-35293768] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:12:41,001 - DEBUG - [Pod Pod ctest-pod-35293768] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-20 02:12:41,001 - DEBUG - [Pod Pod ctest-pod-35293768] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-20 02:12:41,001 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35293768 passed
2025-02-20 02:12:41,001 - INFO - Deleting Network Policy : ingress-on-service
2025-02-20 02:12:41,001 - INFO - Deleting service : ctest-nginx-svc-85213488
2025-02-20 02:12:41,212 - DEBUG - No XMPP flaps were noticed during the test
2025-02-20 02:12:41,213 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:17]
2025-02-20 02:12:41,213 - INFO - --------------------------------------------------------------------------------
2025-02-20 02:12:41,217 - INFO - Deleting pod ctest-new-default-71482728:ctest-pod-38502531
2025-02-20 02:12:41,218 - INFO - Deleting pod ctest-new-default-71482728:ctest-pod-62218202
2025-02-20 02:12:41,218 - INFO - Deleting pod ctest-non-default-99227679:ctest-pod-66658028
2025-02-20 02:12:41,218 - INFO - Deleting pod ctest-non-default-99227679:ctest-pod-02911973
2025-02-20 02:12:41,218 - INFO - Deleting pod ctest-new-default-71482728:ctest-pod-73608803
2025-02-20 02:12:41,219 - INFO - Deleting pod ctest-new-default-71482728:ctest-pod-79278475
2025-02-20 02:12:41,219 - INFO - Deleting pod ctest-non-default-99227679:ctest-pod-31167288
2025-02-20 02:12:41,219 - INFO - Deleting pod ctest-non-default-99227679:ctest-pod-35293768
2025-02-20 02:12:41,400 - WARNING - Pod uuid 09f880bc-921f-494a-a6a4-b05f3c99414e is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,400 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,402 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,403 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,403 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,404 - WARNING - Pod uuid 0308aa27-c4ba-4a06-96f4-e2b65f05921e is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,404 - WARNING - Pod uuid 44a0702a-7823-4730-8a66-e46aabb020ef is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:41,404 - WARNING - Pod uuid f3d05ecb-dffa-470f-bdb9-8897d5737cc1 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:46,431 - DEBUG - Pod 09f880bc-921f-494a-a6a4-b05f3c99414e is not in agent 10.0.0.54 VM list
2025-02-20 02:12:46,432 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:46,450 - DEBUG - Pod 44a0702a-7823-4730-8a66-e46aabb020ef is not in agent 10.0.0.54 VM list
2025-02-20 02:12:46,452 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:46,455 - DEBUG - VMI a93f9bf2-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:12:46,455 - INFO - Verified that pod ctest-pod-38502531 is removed in agent
2025-02-20 02:12:46,455 - DEBUG - Pod 0308aa27-c4ba-4a06-96f4-e2b65f05921e is not in agent 10.0.0.54 VM list
2025-02-20 02:12:46,457 - DEBUG - Pod f3d05ecb-dffa-470f-bdb9-8897d5737cc1 is not in agent 10.0.0.54 VM list
2025-02-20 02:12:46,458 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:46,458 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:46,475 - DEBUG - VMI a9c1c87a-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:12:46,475 - INFO - Verified that pod ctest-pod-62218202 is removed in agent
2025-02-20 02:12:46,476 - DEBUG - VMI ab25afba-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:12:46,476 - INFO - Verified that pod ctest-pod-02911973 is removed in agent
2025-02-20 02:12:46,476 - DEBUG - VMI aa7c6cf2-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:12:46,476 - INFO - Verified that pod ctest-pod-66658028 is removed in agent
2025-02-20 02:12:51,442 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:51,463 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:51,473 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:51,474 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:56,453 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:56,472 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:56,486 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:12:56,487 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:01,464 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:01,483 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:01,503 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:01,503 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:06,475 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:06,492 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:06,517 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:06,517 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:11,502 - WARNING - Pod uuid db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:11,504 - WARNING - Pod uuid 9eb3aa51-a33c-4b34-9228-7081869cabd0 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:11,531 - WARNING - Pod uuid 28c6969d-78cd-4181-8951-4685ef9ba8e7 is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:11,532 - WARNING - Pod uuid 0abd439f-643a-46f5-850a-a26b9aba9b7b is still seen in agent 10.0.0.54 VM list
2025-02-20 02:13:16,516 - DEBUG - Pod 9eb3aa51-a33c-4b34-9228-7081869cabd0 is not in agent 10.0.0.54 VM list
2025-02-20 02:13:16,518 - DEBUG - Pod db4fcba6-1bab-4ce0-b31d-706e8de9fe00 is not in agent 10.0.0.54 VM list
2025-02-20 02:13:16,530 - DEBUG - VMI acc1c0b6-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:13:16,530 - INFO - Verified that pod ctest-pod-31167288 is removed in agent
2025-02-20 02:13:16,534 - DEBUG - VMI ad44d17c-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:13:16,534 - INFO - Verified that pod ctest-pod-35293768 is removed in agent
2025-02-20 02:13:16,545 - DEBUG - Pod 28c6969d-78cd-4181-8951-4685ef9ba8e7 is not in agent 10.0.0.54 VM list
2025-02-20 02:13:16,548 - DEBUG - Pod 0abd439f-643a-46f5-850a-a26b9aba9b7b is not in agent 10.0.0.54 VM list
2025-02-20 02:13:16,559 - DEBUG - VMI ac442660-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:13:16,560 - INFO - Verified that pod ctest-pod-79278475 is removed in agent
2025-02-20 02:13:16,561 - DEBUG - VMI abc1cb8e-ef2f-11ef-847d-fa163e4a996b is removed from agent 10.0.0.54
2025-02-20 02:13:16,561 - INFO - Verified that pod ctest-pod-73608803 is removed in agent
2025-02-20 02:13:16,561 - INFO - Deleting namespace ctest-non-default-99227679
2025-02-20 02:13:16,577 - DEBUG - Namespace ctest-non-default-99227679 still in k8s
2025-02-20 02:13:18,583 - DEBUG - Namespace ctest-non-default-99227679 still in k8s
2025-02-20 02:13:20,588 - DEBUG - Namespace ctest-non-default-99227679 still in k8s
2025-02-20 02:13:22,591 - DEBUG - Namespace ctest-non-default-99227679 is not in k8s
2025-02-20 02:13:22,592 - DEBUG - No need to check project deletion in contrail-api
2025-02-20 02:13:22,592 - INFO - Deleting namespace ctest-new-default-71482728
2025-02-20 02:13:22,601 - DEBUG - Namespace ctest-new-default-71482728 still in k8s
2025-02-20 02:13:24,606 - DEBUG - Namespace ctest-new-default-71482728 still in k8s
2025-02-20 02:13:26,611 - DEBUG - Namespace ctest-new-default-71482728 still in k8s
2025-02-20 02:13:28,615 - DEBUG - Namespace ctest-new-default-71482728 is not in k8s
2025-02-20 02:13:28,615 - DEBUG - No need to check project deletion in contrail-api