2026-06-18 01:46:42,394 - INFO - Using existing project ['default-domain', 'k8s-default'](7a4c14ab-6c01-4c59-981d-35d4170868d5)
2026-06-18 01:46:42,409 - DEBUG - Namespace ctest-new-default-78395214 not present
2026-06-18 01:46:42,416 - INFO - Created namespace ctest-new-default-78395214
2026-06-18 01:46:45,419 - DEBUG - Namespace ctest-non-default-53678783 not present
2026-06-18 01:46:45,430 - INFO - Created namespace ctest-non-default-53678783
2026-06-18 01:46:48,472 - DEBUG - Pod ctest-pod-24059232 not present
2026-06-18 01:46:48,473 - INFO - Creating Pod ctest-pod-24059232
2026-06-18 01:46:48,525 - DEBUG - Pod : ctest-pod-24059232 UUID is 97da4e37-247d-41ce-93a0-a22ed06ba83d
2026-06-18 01:46:48,529 - DEBUG - Pod ctest-pod-29253352 not present
2026-06-18 01:46:48,530 - INFO - Creating Pod ctest-pod-29253352
2026-06-18 01:46:48,563 - DEBUG - Pod : ctest-pod-29253352 UUID is 10abbde8-d210-45c0-a16a-f99d0e538b6e
2026-06-18 01:46:48,567 - DEBUG - Pod ctest-pod-88570723 not present
2026-06-18 01:46:48,595 - INFO - Creating Pod ctest-pod-88570723
2026-06-18 01:46:48,632 - DEBUG - Pod : ctest-pod-88570723 UUID is bcaaf1e6-11cc-4513-8993-6b701aab5f6c
2026-06-18 01:46:48,635 - DEBUG - Pod ctest-pod-98226116 not present
2026-06-18 01:46:48,635 - INFO - Creating Pod ctest-pod-98226116
2026-06-18 01:46:48,660 - DEBUG - Pod : ctest-pod-98226116 UUID is 45bb7295-1dd6-4620-8035-f9d1e3cc7e57
2026-06-18 01:46:48,665 - DEBUG - Pod ctest-pod-90008044 not present
2026-06-18 01:46:48,666 - INFO - Creating Pod ctest-pod-90008044
2026-06-18 01:46:48,696 - DEBUG - Pod : ctest-pod-90008044 UUID is 76adcdf4-8e73-48ca-8b9c-bed92a05bf40
2026-06-18 01:46:48,705 - DEBUG - Pod ctest-pod-26434793 not present
2026-06-18 01:46:48,718 - INFO - Creating Pod ctest-pod-26434793
2026-06-18 01:46:48,750 - DEBUG - Pod : ctest-pod-26434793 UUID is 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a
2026-06-18 01:46:48,752 - DEBUG - Pod ctest-pod-13507904 not present
2026-06-18 01:46:48,752 - INFO - Creating Pod ctest-pod-13507904
2026-06-18 01:46:48,777 - DEBUG - Pod : ctest-pod-13507904 UUID is 57d1b009-c447-407e-932c-484e2d7bb84b
2026-06-18 01:46:48,779 - DEBUG - Pod ctest-pod-95562452 not present
2026-06-18 01:46:48,779 - INFO - Creating Pod ctest-pod-95562452
2026-06-18 01:46:48,804 - DEBUG - Pod : ctest-pod-95562452 UUID is cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce
2026-06-18 01:46:49,051 - INFO - Project default-domain:k8s-ctest-new-default-78395214 for Namespace ctest-new-default-78395214 is seen in contrail-api
2026-06-18 01:46:49,051 - DEBUG - Project uuid in Contrail is 41faf87f-22a2-4f76-b678-bbff1aec4c97
2026-06-18 01:46:49,190 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=70b3e7b4-12b0-4995-964e-a37bf0675836
2026-06-18 01:46:49,193 - INFO - Namespace ctest-new-default-78395214 with uuid 70b3e7b4-12b0-4995-964e-a37bf0675836 found in kube manager
2026-06-18 01:46:49,193 - INFO - Namespace ctest-new-default-78395214 verification passed
2026-06-18 01:46:49,412 - INFO - Project default-domain:k8s-ctest-non-default-53678783 for Namespace ctest-non-default-53678783 is seen in contrail-api
2026-06-18 01:46:49,413 - DEBUG - Project uuid in Contrail is 0c62d117-d1cc-44fb-a64a-cfb306d64f28
2026-06-18 01:46:49,413 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=5e2843de-1204-4b21-a5cd-fc2f0cd027c3
2026-06-18 01:46:49,417 - INFO - Namespace ctest-non-default-53678783 with uuid 5e2843de-1204-4b21-a5cd-fc2f0cd027c3 found in kube manager
2026-06-18 01:46:49,417 - INFO - Namespace ctest-non-default-53678783 verification passed
2026-06-18 01:46:49,424 - DEBUG - Pod ctest-pod-24059232 not in running state.Currently in Pending
2026-06-18 01:46:54,435 - DEBUG - Pod ctest-pod-24059232 not in running state.Currently in Pending
2026-06-18 01:46:59,443 - INFO - Pod ctest-pod-24059232 is in running state.Got IP 10.47.255.251
2026-06-18 01:46:59,494 - DEBUG - Pod ctest-pod-24059232 has vmi 92f90ad6-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:46:59,494 - INFO - Verified pod ctest-pod-24059232 in contrail-api
2026-06-18 01:46:59,505 - DEBUG - VMI 92f90ad6-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:46:59,505 - INFO - Verified Pod ctest-pod-24059232 in agent 10.0.0.242
2026-06-18 01:46:59,505 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=97da4e37-247d-41ce-93a0-a22ed06ba83d
2026-06-18 01:46:59,510 - INFO - Pod ctest-pod-24059232 with uuid 97da4e37-247d-41ce-93a0-a22ed06ba83d found in kube manager
2026-06-18 01:46:59,510 - INFO - Pod ctest-pod-24059232 verification passed
2026-06-18 01:46:59,516 - INFO - Pod ctest-pod-29253352 is in running state.Got IP 10.47.255.250
2026-06-18 01:46:59,529 - DEBUG - Pod ctest-pod-29253352 has vmi 93775102-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:46:59,529 - INFO - Verified pod ctest-pod-29253352 in contrail-api
2026-06-18 01:46:59,538 - DEBUG - VMI 93775102-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:46:59,538 - INFO - Verified Pod ctest-pod-29253352 in agent 10.0.0.242
2026-06-18 01:46:59,538 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=10abbde8-d210-45c0-a16a-f99d0e538b6e
2026-06-18 01:46:59,542 - INFO - Pod ctest-pod-29253352 with uuid 10abbde8-d210-45c0-a16a-f99d0e538b6e found in kube manager
2026-06-18 01:46:59,542 - INFO - Pod ctest-pod-29253352 verification passed
2026-06-18 01:46:59,548 - INFO - Pod ctest-pod-88570723 is in running state.Got IP 10.47.255.249
2026-06-18 01:46:59,559 - DEBUG - Pod ctest-pod-88570723 has vmi 940c3812-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:46:59,559 - INFO - Verified pod ctest-pod-88570723 in contrail-api
2026-06-18 01:46:59,569 - DEBUG - VMI 940c3812-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:46:59,569 - INFO - Verified Pod ctest-pod-88570723 in agent 10.0.0.242
2026-06-18 01:46:59,569 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=bcaaf1e6-11cc-4513-8993-6b701aab5f6c
2026-06-18 01:46:59,572 - INFO - Pod ctest-pod-88570723 with uuid bcaaf1e6-11cc-4513-8993-6b701aab5f6c found in kube manager
2026-06-18 01:46:59,572 - INFO - Pod ctest-pod-88570723 verification passed
2026-06-18 01:46:59,578 - DEBUG - Pod ctest-pod-98226116 not in running state.Currently in Pending
2026-06-18 01:47:04,584 - INFO - Pod ctest-pod-98226116 is in running state.Got IP 10.47.255.248
2026-06-18 01:47:04,638 - DEBUG - Pod ctest-pod-98226116 has vmi 947fecb2-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:47:04,638 - INFO - Verified pod ctest-pod-98226116 in contrail-api
2026-06-18 01:47:04,652 - DEBUG - VMI 947fecb2-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:47:04,652 - INFO - Verified Pod ctest-pod-98226116 in agent 10.0.0.242
2026-06-18 01:47:04,652 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=45bb7295-1dd6-4620-8035-f9d1e3cc7e57
2026-06-18 01:47:04,656 - INFO - Pod ctest-pod-98226116 with uuid 45bb7295-1dd6-4620-8035-f9d1e3cc7e57 found in kube manager
2026-06-18 01:47:04,656 - INFO - Pod ctest-pod-98226116 verification passed
2026-06-18 01:47:04,663 - DEBUG - Pod ctest-pod-90008044 not in running state.Currently in Pending
2026-06-18 01:47:09,671 - INFO - Pod ctest-pod-90008044 is in running state.Got IP 10.47.255.247
2026-06-18 01:47:09,682 - DEBUG - Pod ctest-pod-90008044 has vmi 94f5aae2-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:47:09,682 - INFO - Verified pod ctest-pod-90008044 in contrail-api
2026-06-18 01:47:09,700 - DEBUG - VMI 94f5aae2-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:47:09,700 - INFO - Verified Pod ctest-pod-90008044 in agent 10.0.0.242
2026-06-18 01:47:09,700 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=76adcdf4-8e73-48ca-8b9c-bed92a05bf40
2026-06-18 01:47:09,704 - INFO - Pod ctest-pod-90008044 with uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 found in kube manager
2026-06-18 01:47:09,704 - INFO - Pod ctest-pod-90008044 verification passed
2026-06-18 01:47:09,710 - INFO - Pod ctest-pod-13507904 is in running state.Got IP 10.47.255.245
2026-06-18 01:47:09,761 - DEBUG - Pod ctest-pod-13507904 has vmi 95ce1918-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:47:09,762 - INFO - Verified pod ctest-pod-13507904 in contrail-api
2026-06-18 01:47:09,773 - DEBUG - VMI 95ce1918-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:47:09,773 - INFO - Verified Pod ctest-pod-13507904 in agent 10.0.0.242
2026-06-18 01:47:09,773 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=57d1b009-c447-407e-932c-484e2d7bb84b
2026-06-18 01:47:09,777 - INFO - Pod ctest-pod-13507904 with uuid 57d1b009-c447-407e-932c-484e2d7bb84b found in kube manager
2026-06-18 01:47:09,777 - INFO - Pod ctest-pod-13507904 verification passed
2026-06-18 01:47:09,783 - INFO - Pod ctest-pod-26434793 is in running state.Got IP 10.47.255.246
2026-06-18 01:47:09,793 - DEBUG - Pod ctest-pod-26434793 has vmi 9566248e-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:47:09,793 - INFO - Verified pod ctest-pod-26434793 in contrail-api
2026-06-18 01:47:09,805 - DEBUG - VMI 9566248e-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:47:09,805 - INFO - Verified Pod ctest-pod-26434793 in agent 10.0.0.242
2026-06-18 01:47:09,805 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a
2026-06-18 01:47:09,809 - INFO - Pod ctest-pod-26434793 with uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a found in kube manager
2026-06-18 01:47:09,809 - INFO - Pod ctest-pod-26434793 verification passed
2026-06-18 01:47:09,815 - INFO - Pod ctest-pod-95562452 is in running state.Got IP 10.47.255.244
2026-06-18 01:47:09,867 - DEBUG - Pod ctest-pod-95562452 has vmi 96347b04-6ab7-11f1-a83a-fa163ea2f05b
2026-06-18 01:47:09,867 - INFO - Verified pod ctest-pod-95562452 in contrail-api
2026-06-18 01:47:09,879 - DEBUG - VMI 96347b04-6ab7-11f1-a83a-fa163ea2f05b is active in agent 10.0.0.242
2026-06-18 01:47:09,879 - INFO - Verified Pod ctest-pod-95562452 in agent 10.0.0.242
2026-06-18 01:47:09,879 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce
2026-06-18 01:47:09,883 - INFO - Pod ctest-pod-95562452 with uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce found in kube manager
2026-06-18 01:47:09,883 - INFO - Pod ctest-pod-95562452 verification passed
2026-06-18 01:47:09,883 - INFO - ================================================================================
2026-06-18 01:47:09,883 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2026-06-18 01:47:09,883 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2026-06-18 01:47:10,120 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.22': '0'}} with
2026-06-18 01:47:10,120 - INFO - Initial checks done. Running the testcase now
2026-06-18 01:47:10,120 - INFO -
2026-06-18 01:47:10,190 - DEBUG - [Pod ctest-pod-24059232] Cmd: echo ctest-pod-24059232 > /usr/share/nginx/html/index.html, Output:
2026-06-18 01:47:10,249 - DEBUG - [Pod ctest-pod-29253352] Cmd: echo ctest-pod-29253352 > /usr/share/nginx/html/index.html, Output:
2026-06-18 01:47:10,313 - DEBUG - [Pod ctest-pod-88570723] Cmd: echo ctest-pod-88570723 > /usr/share/nginx/html/index.html, Output:
2026-06-18 01:47:10,381 - DEBUG - [Pod ctest-pod-98226116] Cmd: echo ctest-pod-98226116 > /usr/share/nginx/html/index.html, Output:
2026-06-18 01:47:10,385 - DEBUG - Service ctest-nginx-svc-97721715 not present
2026-06-18 01:47:10,386 - INFO - Creating service ctest-nginx-svc-97721715
2026-06-18 01:47:10,402 - INFO - Created Service ctest-nginx-svc-97721715
2026-06-18 01:47:10,422 - WARNING - Service UUID b015c879-736b-4d6b-a73a-cbe67e7034e0 not yet found in contrail-api
2026-06-18 01:47:11,434 - INFO - Validated that Service ctest-nginx-svc-97721715 is seen in contrail-api
2026-06-18 01:47:11,434 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=b015c879-736b-4d6b-a73a-cbe67e7034e0
2026-06-18 01:47:11,441 - INFO - Service ctest-nginx-svc-97721715 with uuid b015c879-736b-4d6b-a73a-cbe67e7034e0 found in kube manager
2026-06-18 01:47:11,447 - INFO - Service ctest-nginx-svc-97721715 verification passed
2026-06-18 01:47:12,516 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
ctest-pod-24059232
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:47:12,517 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:47:12,517 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
ctest-pod-24059232
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:47:12,571 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:47:12,571 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:47:12,571 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:47:12,571 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24059232': 1, 'ctest-pod-29253352': 1}
2026-06-18 01:47:12,626 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:47:12,626 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:47:12,626 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:47:12,681 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:47:12,681 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:47:12,681 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:47:12,681 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24059232': 1, 'ctest-pod-29253352': 1}
2026-06-18 01:47:12,684 - DEBUG - Network policy ingress-on-service not present
2026-06-18 01:47:12,685 - INFO - Creating Network Policy ingress-on-service
2026-06-18 01:47:12,696 - INFO - Network policy found in k8s
2026-06-18 01:47:12,696 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=234c3005-76a1-48be-b3d8-dd9b7c1ad659
2026-06-18 01:47:12,706 - INFO - Network Policy ingress-on-service with uuid 234c3005-76a1-48be-b3d8-dd9b7c1ad659 found in kube manager
2026-06-18 01:47:12,736 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2026-06-18 01:47:12,736 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2026-06-18 01:47:12,736 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=234c3005-76a1-48be-b3d8-dd9b7c1ad659
2026-06-18 01:47:12,759 - WARNING - Network policy with name ingress-on-service not found in agent
2026-06-18 01:47:14,759 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=234c3005-76a1-48be-b3d8-dd9b7c1ad659
2026-06-18 01:47:14,784 - INFO - Network policy with name ingress-on-service found in agent
2026-06-18 01:47:14,785 - INFO - Network Policy ingress-on-service verification passed
2026-06-18 01:47:19,839 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:19,839 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:19,839 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:24,887 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:24,887 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:24,887 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:29,938 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:29,938 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:29,938 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:34,996 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:34,996 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:34,996 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:40,054 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:40,054 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:40,054 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:45,103 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:45,103 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:45,103 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:50,159 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:50,159 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:50,159 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:55,235 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:47:55,235 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:47:55,235 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:00,289 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:00,289 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:00,289 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:05,338 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:05,339 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:05,339 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:05,339 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24059232': 0, 'ctest-pod-29253352': 0}
2026-06-18 01:48:05,392 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-24059232
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:48:05,392 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:48:05,392 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-24059232
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:48:05,455 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:48:05,455 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:48:05,455 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:48:05,455 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24059232': 1, 'ctest-pod-29253352': 1}
2026-06-18 01:48:10,514 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:10,514 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:10,514 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:15,565 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:15,565 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:15,565 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:20,614 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:20,614 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:20,614 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:25,664 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:25,664 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:25,664 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:30,716 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:30,716 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:30,716 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:35,767 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:35,767 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:35,767 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:40,823 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:40,823 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:40,823 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:45,875 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:45,875 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:45,875 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:50,925 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:50,925 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:50,925 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:55,978 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:55,978 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:48:55,978 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:48:55,978 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24059232': 0, 'ctest-pod-29253352': 0}
2026-06-18 01:48:58,031 - DEBUG - [Pod ctest-pod-26434793] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.798 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.312/0.798 ms
2026-06-18 01:48:58,031 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26434793 with expectation True passed
2026-06-18 01:49:00,079 - DEBUG - [Pod ctest-pod-90008044] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.309 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.489/1.309 ms
2026-06-18 01:49:00,079 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90008044 with expectation True passed
2026-06-18 01:49:02,132 - DEBUG - [Pod ctest-pod-13507904] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.414 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.091/0.200/0.414 ms
2026-06-18 01:49:02,132 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13507904 with expectation True passed
2026-06-18 01:49:02,194 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-24059232
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:49:02,194 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-06-18 01:49:02,194 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-24059232
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:49:02,194 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26434793 passed
2026-06-18 01:49:02,244 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:49:02,244 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-06-18 01:49:02,244 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-29253352
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:49:02,244 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26434793 passed
2026-06-18 01:49:07,280 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-06-18 01:49:07,280 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-06-18 01:49:07,280 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-06-18 01:49:07,280 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90008044 passed
2026-06-18 01:49:12,335 - DEBUG - [Pod ctest-pod-95562452] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-06-18 01:49:12,335 - DEBUG - [Pod Pod ctest-pod-95562452] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed.
2026-06-18 01:49:12,335 - DEBUG - [Pod Pod ctest-pod-95562452] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-06-18 01:49:12,335 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95562452 passed
2026-06-18 01:49:12,344 - INFO - Updating Network Policy ingress-on-service
2026-06-18 01:49:17,406 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:17,406 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:17,406 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:22,455 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:22,455 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:22,455 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:25,779 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2026-06-18 01:49:36,010 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:36,010 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:36,010 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:41,089 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:41,089 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:41,089 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:46,147 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:46,147 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:46,147 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:51,203 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:51,204 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:51,204 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:56,254 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:49:56,254 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:49:56,254 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:01,311 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:01,311 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:50:01,311 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:06,359 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:06,359 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:50:06,359 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:11,412 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:11,412 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 failed.
2026-06-18 01:50:11,422 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
wget: download timed out
2026-06-18 01:50:11,422 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-24059232': 0, 'ctest-pod-29253352': 0}
2026-06-18 01:50:11,473 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-24059232
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:11,473 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:50:11,473 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-24059232
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:11,535 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:11,535 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:50:11,535 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:11,535 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24059232': 1, 'ctest-pod-29253352': 1}
2026-06-18 01:50:11,593 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:50:11,593 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:50:11,594 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:50:11,648 - DEBUG - [Pod ctest-pod-13507904] Cmd: wget http://10.111.124.150:80/ -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:11,648 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd wget http://10.111.124.150:80/ -O - -T 5 -t 1 passed
2026-06-18 01:50:11,648 - DEBUG - [Pod Pod ctest-pod-13507904] Cmd output: ctest-pod-29253352
Connecting to 10.111.124.150:80 (10.111.124.150:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:11,648 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-24059232': 1, 'ctest-pod-29253352': 1}
2026-06-18 01:50:13,699 - DEBUG - [Pod ctest-pod-26434793] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.970 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.126 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.388/0.970 ms
2026-06-18 01:50:13,699 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26434793 with expectation True passed
2026-06-18 01:50:15,751 - DEBUG - [Pod ctest-pod-90008044] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.380 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.172/0.380 ms
2026-06-18 01:50:15,751 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90008044 with expectation True passed
2026-06-18 01:50:17,810 - DEBUG - [Pod ctest-pod-13507904] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.897 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.358/0.897 ms
2026-06-18 01:50:17,811 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13507904 with expectation True passed
2026-06-18 01:50:17,876 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:50:17,876 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-06-18 01:50:17,876 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:50:17,876 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26434793 passed
2026-06-18 01:50:17,912 - DEBUG - [Pod ctest-pod-26434793] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-29253352
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:17,912 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-06-18 01:50:17,912 - DEBUG - [Pod Pod ctest-pod-26434793] Cmd output: ctest-pod-29253352
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-06-18 01:50:17,912 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26434793 passed
2026-06-18 01:50:22,966 - DEBUG - [Pod ctest-pod-90008044] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-06-18 01:50:22,966 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-06-18 01:50:22,966 - DEBUG - [Pod Pod ctest-pod-90008044] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-06-18 01:50:22,966 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90008044 passed
2026-06-18 01:50:23,036 - DEBUG - [Pod ctest-pod-95562452] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:50:23,036 - DEBUG - [Pod Pod ctest-pod-95562452] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-06-18 01:50:23,036 - DEBUG - [Pod Pod ctest-pod-95562452] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24059232
2026-06-18 01:50:23,036 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95562452 passed
2026-06-18 01:50:23,037 - INFO - Deleting Network Policy : ingress-on-service
2026-06-18 01:50:23,038 - INFO - Deleting service : ctest-nginx-svc-97721715
2026-06-18 01:50:23,299 - DEBUG - No XMPP flaps were noticed during the test
2026-06-18 01:50:23,299 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2026-06-18 01:50:23,299 - INFO - --------------------------------------------------------------------------------
2026-06-18 01:50:23,303 - INFO - Deleting pod ctest-new-default-78395214:ctest-pod-24059232
2026-06-18 01:50:23,304 - INFO - Deleting pod ctest-new-default-78395214:ctest-pod-29253352
2026-06-18 01:50:23,304 - INFO - Deleting pod ctest-non-default-53678783:ctest-pod-88570723
2026-06-18 01:50:23,304 - INFO - Deleting pod ctest-non-default-53678783:ctest-pod-98226116
2026-06-18 01:50:23,305 - INFO - Deleting pod ctest-new-default-78395214:ctest-pod-90008044
2026-06-18 01:50:23,305 - INFO - Deleting pod ctest-new-default-78395214:ctest-pod-26434793
2026-06-18 01:50:23,306 - INFO - Deleting pod ctest-non-default-53678783:ctest-pod-13507904
2026-06-18 01:50:23,306 - INFO - Deleting pod ctest-non-default-53678783:ctest-pod-95562452
2026-06-18 01:50:23,464 - WARNING - Pod uuid bcaaf1e6-11cc-4513-8993-6b701aab5f6c is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,465 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,491 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,492 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,492 - WARNING - Pod uuid 10abbde8-d210-45c0-a16a-f99d0e538b6e is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,492 - WARNING - Pod uuid 97da4e37-247d-41ce-93a0-a22ed06ba83d is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,493 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:23,494 - WARNING - Pod uuid 45bb7295-1dd6-4620-8035-f9d1e3cc7e57 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:28,476 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:28,476 - DEBUG - Pod bcaaf1e6-11cc-4513-8993-6b701aab5f6c is not in agent 10.0.0.242 VM list
2026-06-18 01:50:28,482 - DEBUG - VMI 940c3812-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:28,482 - INFO - Verified that pod ctest-pod-88570723 is removed in agent
2026-06-18 01:50:28,515 - DEBUG - Pod 10abbde8-d210-45c0-a16a-f99d0e538b6e is not in agent 10.0.0.242 VM list
2026-06-18 01:50:28,516 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:28,518 - DEBUG - Pod 45bb7295-1dd6-4620-8035-f9d1e3cc7e57 is not in agent 10.0.0.242 VM list
2026-06-18 01:50:28,520 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:28,520 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:28,521 - DEBUG - Pod 97da4e37-247d-41ce-93a0-a22ed06ba83d is not in agent 10.0.0.242 VM list
2026-06-18 01:50:28,527 - DEBUG - VMI 93775102-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:28,527 - INFO - Verified that pod ctest-pod-29253352 is removed in agent
2026-06-18 01:50:28,532 - DEBUG - VMI 947fecb2-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:28,532 - INFO - Verified that pod ctest-pod-98226116 is removed in agent
2026-06-18 01:50:28,533 - DEBUG - VMI 92f90ad6-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:28,533 - INFO - Verified that pod ctest-pod-24059232 is removed in agent
2026-06-18 01:50:33,484 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:33,525 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:33,537 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:33,537 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:38,490 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:38,532 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:38,544 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:38,554 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:43,501 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:43,540 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:43,550 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:43,560 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:48,507 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:48,547 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:48,556 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:48,567 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:53,529 - WARNING - Pod uuid 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:53,556 - WARNING - Pod uuid cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:53,562 - WARNING - Pod uuid 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:53,582 - WARNING - Pod uuid 57d1b009-c447-407e-932c-484e2d7bb84b is still seen in agent 10.0.0.242 VM list
2026-06-18 01:50:58,535 - DEBUG - Pod 894dd7bb-97d7-4a26-b9a4-0a2ae7c67f4a is not in agent 10.0.0.242 VM list
2026-06-18 01:50:58,541 - DEBUG - VMI 9566248e-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:58,541 - INFO - Verified that pod ctest-pod-26434793 is removed in agent
2026-06-18 01:50:58,564 - DEBUG - Pod cbdaa98a-fedc-4ba9-b4f8-9ff7cb2f64ce is not in agent 10.0.0.242 VM list
2026-06-18 01:50:58,572 - DEBUG - VMI 96347b04-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:58,572 - INFO - Verified that pod ctest-pod-95562452 is removed in agent
2026-06-18 01:50:58,573 - DEBUG - Pod 76adcdf4-8e73-48ca-8b9c-bed92a05bf40 is not in agent 10.0.0.242 VM list
2026-06-18 01:50:58,578 - DEBUG - VMI 94f5aae2-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:58,578 - INFO - Verified that pod ctest-pod-90008044 is removed in agent
2026-06-18 01:50:58,592 - DEBUG - Pod 57d1b009-c447-407e-932c-484e2d7bb84b is not in agent 10.0.0.242 VM list
2026-06-18 01:50:58,598 - DEBUG - VMI 95ce1918-6ab7-11f1-a83a-fa163ea2f05b is removed from agent 10.0.0.242
2026-06-18 01:50:58,598 - INFO - Verified that pod ctest-pod-13507904 is removed in agent
2026-06-18 01:50:58,598 - INFO - Deleting namespace ctest-non-default-53678783
2026-06-18 01:50:58,616 - DEBUG - Namespace ctest-non-default-53678783 still in k8s
2026-06-18 01:51:00,621 - DEBUG - Namespace ctest-non-default-53678783 still in k8s
2026-06-18 01:51:02,626 - DEBUG - Namespace ctest-non-default-53678783 still in k8s
2026-06-18 01:51:04,629 - DEBUG - Namespace ctest-non-default-53678783 is not in k8s
2026-06-18 01:51:04,629 - DEBUG - No need to check project deletion in contrail-api
2026-06-18 01:51:04,629 - INFO - Deleting namespace ctest-new-default-78395214
2026-06-18 01:51:04,638 - DEBUG - Namespace ctest-new-default-78395214 still in k8s
2026-06-18 01:51:06,642 - DEBUG - Namespace ctest-new-default-78395214 still in k8s
2026-06-18 01:51:08,647 - DEBUG - Namespace ctest-new-default-78395214 still in k8s
2026-06-18 01:51:10,651 - DEBUG - Namespace ctest-new-default-78395214 is not in k8s
2026-06-18 01:51:10,651 - DEBUG - No need to check project deletion in contrail-api