2026-03-23 22:57:21,667 - INFO - Using existing project ['default-domain', 'k8s-default'](22a831d9-9575-4b90-8fbf-c3e6a8a8d5a8)
2026-03-23 22:57:21,682 - DEBUG - Namespace ctest-new-default-66567989 not present
2026-03-23 22:57:21,689 - INFO - Created namespace ctest-new-default-66567989
2026-03-23 22:57:24,692 - DEBUG - Namespace ctest-non-default-12731695 not present
2026-03-23 22:57:24,699 - INFO - Created namespace ctest-non-default-12731695
2026-03-23 22:57:27,723 - DEBUG - Pod ctest-pod-76030114 not present
2026-03-23 22:57:27,724 - INFO - Creating Pod ctest-pod-76030114
2026-03-23 22:57:27,750 - DEBUG - Pod : ctest-pod-76030114 UUID is ab54b233-ead5-41a6-b64a-1d24ba750956
2026-03-23 22:57:27,759 - DEBUG - Pod ctest-pod-47613598 not present
2026-03-23 22:57:27,759 - INFO - Creating Pod ctest-pod-47613598
2026-03-23 22:57:27,801 - DEBUG - Pod : ctest-pod-47613598 UUID is 285b25a0-4304-4455-9bad-c9630f4600fe
2026-03-23 22:57:27,808 - DEBUG - Pod ctest-pod-31652849 not present
2026-03-23 22:57:27,808 - INFO - Creating Pod ctest-pod-31652849
2026-03-23 22:57:27,882 - DEBUG - Pod : ctest-pod-31652849 UUID is f31bfc3d-838b-45c5-a782-3beb789e7033
2026-03-23 22:57:27,885 - DEBUG - Pod ctest-pod-10056585 not present
2026-03-23 22:57:27,885 - INFO - Creating Pod ctest-pod-10056585
2026-03-23 22:57:28,023 - DEBUG - Pod : ctest-pod-10056585 UUID is f01ed3b4-93d1-4967-88e1-e8733bcdd5fb
2026-03-23 22:57:28,026 - DEBUG - Pod ctest-pod-39404987 not present
2026-03-23 22:57:28,026 - INFO - Creating Pod ctest-pod-39404987
2026-03-23 22:57:28,048 - DEBUG - Pod : ctest-pod-39404987 UUID is f31ab1ba-33f7-4c45-b73d-9b001b859901
2026-03-23 22:57:28,050 - DEBUG - Pod ctest-pod-34024985 not present
2026-03-23 22:57:28,050 - INFO - Creating Pod ctest-pod-34024985
2026-03-23 22:57:28,079 - DEBUG - Pod : ctest-pod-34024985 UUID is 7d2750dd-3fd3-4f94-9ec1-4d566648390f
2026-03-23 22:57:28,082 - DEBUG - Pod ctest-pod-94013029 not present
2026-03-23 22:57:28,082 - INFO - Creating Pod ctest-pod-94013029
2026-03-23 22:57:28,104 - DEBUG - Pod : ctest-pod-94013029 UUID is 8f4ad274-606a-4a47-ad07-7b8affc78c5d
2026-03-23 22:57:28,106 - DEBUG - Pod ctest-pod-27941585 not present
2026-03-23 22:57:28,106 - INFO - Creating Pod ctest-pod-27941585
2026-03-23 22:57:28,129 - DEBUG - Pod : ctest-pod-27941585 UUID is 6f506e5b-e9ae-4641-be18-44baca56fc66
2026-03-23 22:57:28,361 - INFO - Project default-domain:k8s-ctest-new-default-66567989 for Namespace ctest-new-default-66567989 is seen in contrail-api
2026-03-23 22:57:28,361 - DEBUG - Project uuid in Contrail is c5a4ee2c-29e0-4d52-afa9-e843c2bc9fde
2026-03-23 22:57:28,523 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=b77dee36-0caf-4f5a-a82c-fa00f8a17242
2026-03-23 22:57:28,526 - INFO - Namespace ctest-new-default-66567989 with uuid b77dee36-0caf-4f5a-a82c-fa00f8a17242 found in kube manager
2026-03-23 22:57:28,527 - INFO - Namespace ctest-new-default-66567989 verification passed
2026-03-23 22:57:28,798 - INFO - Project default-domain:k8s-ctest-non-default-12731695 for Namespace ctest-non-default-12731695 is seen in contrail-api
2026-03-23 22:57:28,798 - DEBUG - Project uuid in Contrail is 88d36538-b8f7-40d3-9b10-fb890f16aea4
2026-03-23 22:57:28,798 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=e31ea883-d1d2-43ae-a4a5-31a875622beb
2026-03-23 22:57:28,802 - INFO - Namespace ctest-non-default-12731695 with uuid e31ea883-d1d2-43ae-a4a5-31a875622beb found in kube manager
2026-03-23 22:57:28,802 - INFO - Namespace ctest-non-default-12731695 verification passed
2026-03-23 22:57:28,808 - DEBUG - Pod ctest-pod-76030114 not in running state.Currently in Pending
2026-03-23 22:57:33,817 - DEBUG - Pod ctest-pod-76030114 not in running state.Currently in Pending
2026-03-23 22:57:38,825 - DEBUG - Pod ctest-pod-76030114 not in running state.Currently in Pending
2026-03-23 22:57:43,833 - INFO - Pod ctest-pod-76030114 is in running state.Got IP 10.47.255.251
2026-03-23 22:57:43,846 - DEBUG - Pod ctest-pod-76030114 has vmi ab2ac4cc-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:43,846 - INFO - Verified pod ctest-pod-76030114 in contrail-api
2026-03-23 22:57:43,861 - DEBUG - VMI ab2ac4cc-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:43,861 - INFO - Verified Pod ctest-pod-76030114 in agent 10.0.0.242
2026-03-23 22:57:43,861 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ab54b233-ead5-41a6-b64a-1d24ba750956
2026-03-23 22:57:43,865 - INFO - Pod ctest-pod-76030114 with uuid ab54b233-ead5-41a6-b64a-1d24ba750956 found in kube manager
2026-03-23 22:57:43,865 - INFO - Pod ctest-pod-76030114 verification passed
2026-03-23 22:57:43,872 - INFO - Pod ctest-pod-47613598 is in running state.Got IP 10.47.255.250
2026-03-23 22:57:43,926 - DEBUG - Pod ctest-pod-47613598 has vmi abb47244-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:43,926 - INFO - Verified pod ctest-pod-47613598 in contrail-api
2026-03-23 22:57:43,936 - DEBUG - VMI abb47244-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:43,936 - INFO - Verified Pod ctest-pod-47613598 in agent 10.0.0.242
2026-03-23 22:57:43,936 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=285b25a0-4304-4455-9bad-c9630f4600fe
2026-03-23 22:57:43,939 - INFO - Pod ctest-pod-47613598 with uuid 285b25a0-4304-4455-9bad-c9630f4600fe found in kube manager
2026-03-23 22:57:43,939 - INFO - Pod ctest-pod-47613598 verification passed
2026-03-23 22:57:43,945 - INFO - Pod ctest-pod-31652849 is in running state.Got IP 10.47.255.249
2026-03-23 22:57:43,956 - DEBUG - Pod ctest-pod-31652849 has vmi ac5df062-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:43,956 - INFO - Verified pod ctest-pod-31652849 in contrail-api
2026-03-23 22:57:43,967 - DEBUG - VMI ac5df062-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:43,967 - INFO - Verified Pod ctest-pod-31652849 in agent 10.0.0.242
2026-03-23 22:57:43,968 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f31bfc3d-838b-45c5-a782-3beb789e7033
2026-03-23 22:57:43,971 - INFO - Pod ctest-pod-31652849 with uuid f31bfc3d-838b-45c5-a782-3beb789e7033 found in kube manager
2026-03-23 22:57:43,971 - INFO - Pod ctest-pod-31652849 verification passed
2026-03-23 22:57:43,979 - INFO - Pod ctest-pod-10056585 is in running state.Got IP 10.47.255.248
2026-03-23 22:57:44,032 - DEBUG - Pod ctest-pod-10056585 has vmi acf60032-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:44,033 - INFO - Verified pod ctest-pod-10056585 in contrail-api
2026-03-23 22:57:44,043 - DEBUG - VMI acf60032-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:44,043 - INFO - Verified Pod ctest-pod-10056585 in agent 10.0.0.242
2026-03-23 22:57:44,043 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f01ed3b4-93d1-4967-88e1-e8733bcdd5fb
2026-03-23 22:57:44,046 - INFO - Pod ctest-pod-10056585 with uuid f01ed3b4-93d1-4967-88e1-e8733bcdd5fb found in kube manager
2026-03-23 22:57:44,047 - INFO - Pod ctest-pod-10056585 verification passed
2026-03-23 22:57:44,052 - INFO - Pod ctest-pod-39404987 is in running state.Got IP 10.47.255.247
2026-03-23 22:57:44,063 - DEBUG - Pod ctest-pod-39404987 has vmi ad836602-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:44,064 - INFO - Verified pod ctest-pod-39404987 in contrail-api
2026-03-23 22:57:44,077 - DEBUG - VMI ad836602-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:44,078 - INFO - Verified Pod ctest-pod-39404987 in agent 10.0.0.242
2026-03-23 22:57:44,078 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=f31ab1ba-33f7-4c45-b73d-9b001b859901
2026-03-23 22:57:44,081 - INFO - Pod ctest-pod-39404987 with uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 found in kube manager
2026-03-23 22:57:44,081 - INFO - Pod ctest-pod-39404987 verification passed
2026-03-23 22:57:44,087 - DEBUG - Pod ctest-pod-94013029 not in running state.Currently in Pending
2026-03-23 22:57:49,097 - INFO - Pod ctest-pod-94013029 is in running state.Got IP 10.47.255.245
2026-03-23 22:57:49,150 - DEBUG - Pod ctest-pod-94013029 has vmi ae6c07ea-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:49,150 - INFO - Verified pod ctest-pod-94013029 in contrail-api
2026-03-23 22:57:49,161 - DEBUG - VMI ae6c07ea-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:49,161 - INFO - Verified Pod ctest-pod-94013029 in agent 10.0.0.242
2026-03-23 22:57:49,161 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8f4ad274-606a-4a47-ad07-7b8affc78c5d
2026-03-23 22:57:49,165 - INFO - Pod ctest-pod-94013029 with uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d found in kube manager
2026-03-23 22:57:49,165 - INFO - Pod ctest-pod-94013029 verification passed
2026-03-23 22:57:49,171 - INFO - Pod ctest-pod-34024985 is in running state.Got IP 10.47.255.246
2026-03-23 22:57:49,185 - DEBUG - Pod ctest-pod-34024985 has vmi adf9b852-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:49,186 - INFO - Verified pod ctest-pod-34024985 in contrail-api
2026-03-23 22:57:49,201 - DEBUG - VMI adf9b852-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:49,201 - INFO - Verified Pod ctest-pod-34024985 in agent 10.0.0.242
2026-03-23 22:57:49,201 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=7d2750dd-3fd3-4f94-9ec1-4d566648390f
2026-03-23 22:57:49,209 - INFO - Pod ctest-pod-34024985 with uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f found in kube manager
2026-03-23 22:57:49,209 - INFO - Pod ctest-pod-34024985 verification passed
2026-03-23 22:57:49,218 - INFO - Pod ctest-pod-27941585 is in running state.Got IP 10.47.255.244
2026-03-23 22:57:49,273 - DEBUG - Pod ctest-pod-27941585 has vmi aef57336-270b-11f1-be46-fa163eb562f7
2026-03-23 22:57:49,273 - INFO - Verified pod ctest-pod-27941585 in contrail-api
2026-03-23 22:57:49,285 - DEBUG - VMI aef57336-270b-11f1-be46-fa163eb562f7 is active in agent 10.0.0.242
2026-03-23 22:57:49,285 - INFO - Verified Pod ctest-pod-27941585 in agent 10.0.0.242
2026-03-23 22:57:49,285 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=6f506e5b-e9ae-4641-be18-44baca56fc66
2026-03-23 22:57:49,289 - INFO - Pod ctest-pod-27941585 with uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 found in kube manager
2026-03-23 22:57:49,289 - INFO - Pod ctest-pod-27941585 verification passed
2026-03-23 22:57:49,289 - INFO - ================================================================================
2026-03-23 22:57:49,289 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2026-03-23 22:57:49,289 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2026-03-23 22:57:49,539 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.22': '0'}} with
2026-03-23 22:57:49,539 - INFO - Initial checks done. Running the testcase now
2026-03-23 22:57:49,540 - INFO -
2026-03-23 22:57:49,590 - DEBUG - [Pod ctest-pod-76030114] Cmd: echo ctest-pod-76030114 > /usr/share/nginx/html/index.html, Output:
2026-03-23 22:57:49,663 - DEBUG - [Pod ctest-pod-47613598] Cmd: echo ctest-pod-47613598 > /usr/share/nginx/html/index.html, Output:
2026-03-23 22:57:49,729 - DEBUG - [Pod ctest-pod-31652849] Cmd: echo ctest-pod-31652849 > /usr/share/nginx/html/index.html, Output:
2026-03-23 22:57:49,766 - DEBUG - [Pod ctest-pod-10056585] Cmd: echo ctest-pod-10056585 > /usr/share/nginx/html/index.html, Output:
2026-03-23 22:57:49,769 - DEBUG - Service ctest-nginx-svc-51285902 not present
2026-03-23 22:57:49,770 - INFO - Creating service ctest-nginx-svc-51285902
2026-03-23 22:57:49,785 - INFO - Created Service ctest-nginx-svc-51285902
2026-03-23 22:57:49,791 - WARNING - Service UUID a093d3b5-5da6-4d35-a53c-44baa3506533 not yet found in contrail-api
2026-03-23 22:57:50,799 - INFO - Validated that Service ctest-nginx-svc-51285902 is seen in contrail-api
2026-03-23 22:57:50,800 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=a093d3b5-5da6-4d35-a53c-44baa3506533
2026-03-23 22:57:50,805 - INFO - Service ctest-nginx-svc-51285902 with uuid a093d3b5-5da6-4d35-a53c-44baa3506533 found in kube manager
2026-03-23 22:57:50,805 - INFO - Service ctest-nginx-svc-51285902 verification passed
2026-03-23 22:57:51,880 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-47613598
2026-03-23 22:57:51,880 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 22:57:51,880 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-47613598
2026-03-23 22:57:51,935 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:57:51,935 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 22:57:51,935 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:57:51,935 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76030114': 1, 'ctest-pod-47613598': 1}
2026-03-23 22:57:52,003 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:57:52,003 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 22:57:52,003 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:57:52,054 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:57:52,054 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 22:57:52,054 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:57:52,054 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76030114': 1, 'ctest-pod-47613598': 1}
2026-03-23 22:57:52,057 - DEBUG - Network policy ingress-on-service not present
2026-03-23 22:57:52,058 - INFO - Creating Network Policy ingress-on-service
2026-03-23 22:57:52,071 - INFO - Network policy found in k8s
2026-03-23 22:57:52,071 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30987038-012c-4dd8-9051-7810317fdbe2
2026-03-23 22:57:52,090 - INFO - Network Policy ingress-on-service with uuid 30987038-012c-4dd8-9051-7810317fdbe2 found in kube manager
2026-03-23 22:57:52,117 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2026-03-23 22:57:52,117 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2026-03-23 22:57:52,118 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30987038-012c-4dd8-9051-7810317fdbe2
2026-03-23 22:57:52,160 - WARNING - Network policy with name ingress-on-service not found in agent
2026-03-23 22:57:54,161 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30987038-012c-4dd8-9051-7810317fdbe2
2026-03-23 22:57:54,183 - INFO - Network policy with name ingress-on-service found in agent
2026-03-23 22:57:54,184 - INFO - Network Policy ingress-on-service verification passed
2026-03-23 22:57:59,228 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:57:59,228 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:57:59,228 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:04,279 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:04,280 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:04,280 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:09,344 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:09,344 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:09,344 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:14,396 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:14,396 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:14,396 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:19,448 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:19,448 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:19,448 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:24,500 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:24,500 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:24,500 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:29,547 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:29,547 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:29,547 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:34,597 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:34,597 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:34,597 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:39,661 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:39,662 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:39,662 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:44,716 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:44,716 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:44,716 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:44,716 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76030114': 0, 'ctest-pod-47613598': 0}
2026-03-23 22:58:44,765 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:58:44,765 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 22:58:44,765 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:58:44,824 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:58:44,824 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 22:58:44,824 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 22:58:44,824 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76030114': 1, 'ctest-pod-47613598': 1}
2026-03-23 22:58:49,860 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:49,860 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:49,860 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:54,912 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:54,912 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:54,912 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:59,960 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:58:59,960 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:58:59,960 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:05,012 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:05,012 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:05,012 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:10,064 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:10,064 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:10,064 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:15,115 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:15,115 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:15,116 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:20,168 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:20,168 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:20,168 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:25,216 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:25,216 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:25,216 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:30,268 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:30,268 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:30,268 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:35,321 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:35,321 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:35,321 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:35,321 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76030114': 0, 'ctest-pod-47613598': 0}
2026-03-23 22:59:37,374 - DEBUG - [Pod ctest-pod-34024985] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.812 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.326/0.812 ms
2026-03-23 22:59:37,374 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-34024985 with expectation True passed
2026-03-23 22:59:39,429 - DEBUG - [Pod ctest-pod-39404987] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.498 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.217/0.498 ms
2026-03-23 22:59:39,429 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39404987 with expectation True passed
2026-03-23 22:59:41,493 - DEBUG - [Pod ctest-pod-94013029] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.715 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.292/0.715 ms
2026-03-23 22:59:41,493 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94013029 with expectation True passed
2026-03-23 22:59:41,550 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76030114
2026-03-23 22:59:41,550 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-03-23 22:59:41,550 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76030114
2026-03-23 22:59:41,550 - INFO - wget check of of http://10.47.255.251 from ctest-pod-34024985 passed
2026-03-23 22:59:41,609 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-47613598
2026-03-23 22:59:41,609 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-03-23 22:59:41,609 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-47613598
2026-03-23 22:59:41,609 - INFO - wget check of of http://10.47.255.250 from ctest-pod-34024985 passed
2026-03-23 22:59:46,656 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 22:59:46,656 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-03-23 22:59:46,656 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 22:59:46,656 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39404987 passed
2026-03-23 22:59:51,705 - DEBUG - [Pod ctest-pod-27941585] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-03-23 22:59:51,705 - DEBUG - [Pod Pod ctest-pod-27941585] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed.
2026-03-23 22:59:51,705 - DEBUG - [Pod Pod ctest-pod-27941585] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2026-03-23 22:59:51,706 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27941585 passed
2026-03-23 22:59:51,713 - INFO - Updating Network Policy ingress-on-service
2026-03-23 22:59:56,784 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 22:59:56,784 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 22:59:56,784 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:01,832 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:01,832 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:01,832 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:06,885 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:06,885 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:06,885 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:11,938 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:11,938 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:11,938 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:16,985 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:16,985 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:16,985 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:22,052 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:22,052 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:22,052 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:24,969 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2026-03-23 23:00:35,026 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:35,026 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:35,026 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:40,080 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:40,080 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:40,080 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:45,131 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:45,132 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:45,132 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:50,186 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:50,186 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 failed.
2026-03-23 23:00:50,186 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
wget: download timed out
2026-03-23 23:00:50,186 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76030114': 0, 'ctest-pod-47613598': 0}
2026-03-23 23:00:50,240 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,240 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 23:00:50,240 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,276 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
ctest-pod-47613598
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,276 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 23:00:50,276 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: Connecting to 10.104.242.87:80 (10.104.242.87:80)
ctest-pod-47613598
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,276 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76030114': 1, 'ctest-pod-47613598': 1}
2026-03-23 23:00:50,325 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,326 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 23:00:50,326 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,376 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,376 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 23:00:50,377 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,426 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,426 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 23:00:50,426 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: ctest-pod-47613598
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,478 - DEBUG - [Pod ctest-pod-94013029] Cmd: wget http://10.104.242.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,478 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd wget http://10.104.242.87:80/ -O - -T 5 -t 1 passed
2026-03-23 23:00:50,478 - DEBUG - [Pod Pod ctest-pod-94013029] Cmd output: ctest-pod-76030114
Connecting to 10.104.242.87:80 (10.104.242.87:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:50,478 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76030114': 1, 'ctest-pod-47613598': 3}
2026-03-23 23:00:52,530 - DEBUG - [Pod ctest-pod-34024985] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.472 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.212/0.472 ms
2026-03-23 23:00:52,530 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-34024985 with expectation True passed
2026-03-23 23:00:54,580 - DEBUG - [Pod ctest-pod-39404987] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.751 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.101 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.314/0.751 ms
2026-03-23 23:00:54,580 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39404987 with expectation True passed
2026-03-23 23:00:56,637 - DEBUG - [Pod ctest-pod-94013029] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.616 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.213 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.303/0.616 ms
2026-03-23 23:00:56,637 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94013029 with expectation True passed
2026-03-23 23:00:56,694 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:56,694 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-03-23 23:00:56,694 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: ctest-pod-76030114
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:56,694 - INFO - wget check of of http://10.47.255.251 from ctest-pod-34024985 passed
2026-03-23 23:00:56,744 - DEBUG - [Pod ctest-pod-34024985] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-47613598
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:56,744 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed
2026-03-23 23:00:56,744 - DEBUG - [Pod Pod ctest-pod-34024985] Cmd output: ctest-pod-47613598
Connecting to 10.47.255.250 (10.47.255.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:00:56,744 - INFO - wget check of of http://10.47.255.250 from ctest-pod-34024985 passed
2026-03-23 23:01:01,797 - DEBUG - [Pod ctest-pod-39404987] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 23:01:01,797 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed.
2026-03-23 23:01:01,797 - DEBUG - [Pod Pod ctest-pod-39404987] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2026-03-23 23:01:01,797 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39404987 passed
2026-03-23 23:01:01,847 - DEBUG - [Pod ctest-pod-27941585] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-76030114
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:01:01,847 - DEBUG - [Pod Pod ctest-pod-27941585] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed
2026-03-23 23:01:01,847 - DEBUG - [Pod Pod ctest-pod-27941585] Cmd output: ctest-pod-76030114
Connecting to 10.47.255.251 (10.47.255.251:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2026-03-23 23:01:01,847 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27941585 passed
2026-03-23 23:01:01,848 - INFO - Deleting Network Policy : ingress-on-service
2026-03-23 23:01:01,848 - INFO - Deleting service : ctest-nginx-svc-51285902
2026-03-23 23:01:02,033 - DEBUG - No XMPP flaps were noticed during the test
2026-03-23 23:01:02,033 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2026-03-23 23:01:02,033 - INFO - --------------------------------------------------------------------------------
2026-03-23 23:01:02,036 - INFO - Deleting pod ctest-new-default-66567989:ctest-pod-76030114
2026-03-23 23:01:02,037 - INFO - Deleting pod ctest-new-default-66567989:ctest-pod-47613598
2026-03-23 23:01:02,037 - INFO - Deleting pod ctest-non-default-12731695:ctest-pod-31652849
2026-03-23 23:01:02,037 - INFO - Deleting pod ctest-non-default-12731695:ctest-pod-10056585
2026-03-23 23:01:02,038 - INFO - Deleting pod ctest-new-default-66567989:ctest-pod-39404987
2026-03-23 23:01:02,038 - INFO - Deleting pod ctest-new-default-66567989:ctest-pod-34024985
2026-03-23 23:01:02,038 - INFO - Deleting pod ctest-non-default-12731695:ctest-pod-94013029
2026-03-23 23:01:02,039 - INFO - Deleting pod ctest-non-default-12731695:ctest-pod-27941585
2026-03-23 23:01:02,067 - WARNING - Pod uuid ab54b233-ead5-41a6-b64a-1d24ba750956 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,132 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,198 - WARNING - Pod uuid 285b25a0-4304-4455-9bad-c9630f4600fe is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,199 - WARNING - Pod uuid f31bfc3d-838b-45c5-a782-3beb789e7033 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,199 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,199 - WARNING - Pod uuid f01ed3b4-93d1-4967-88e1-e8733bcdd5fb is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,199 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:02,200 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:07,075 - DEBUG - Pod ab54b233-ead5-41a6-b64a-1d24ba750956 is not in agent 10.0.0.242 VM list
2026-03-23 23:01:07,080 - DEBUG - VMI ab2ac4cc-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:07,080 - INFO - Verified that pod ctest-pod-76030114 is removed in agent
2026-03-23 23:01:07,143 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:07,220 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:07,221 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:07,221 - DEBUG - Pod f01ed3b4-93d1-4967-88e1-e8733bcdd5fb is not in agent 10.0.0.242 VM list
2026-03-23 23:01:07,222 - DEBUG - Pod 285b25a0-4304-4455-9bad-c9630f4600fe is not in agent 10.0.0.242 VM list
2026-03-23 23:01:07,225 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:07,225 - DEBUG - Pod f31bfc3d-838b-45c5-a782-3beb789e7033 is not in agent 10.0.0.242 VM list
2026-03-23 23:01:07,241 - DEBUG - VMI ac5df062-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:07,241 - INFO - Verified that pod ctest-pod-31652849 is removed in agent
2026-03-23 23:01:07,241 - DEBUG - VMI abb47244-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:07,241 - INFO - Verified that pod ctest-pod-47613598 is removed in agent
2026-03-23 23:01:07,242 - DEBUG - VMI acf60032-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:07,242 - INFO - Verified that pod ctest-pod-10056585 is removed in agent
2026-03-23 23:01:12,150 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:12,230 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:12,232 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:12,232 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:17,157 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:17,241 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:17,243 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:17,243 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:22,163 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:22,253 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:22,254 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:22,255 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:27,171 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:27,272 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:27,274 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:27,274 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:32,178 - WARNING - Pod uuid f31ab1ba-33f7-4c45-b73d-9b001b859901 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:32,316 - WARNING - Pod uuid 6f506e5b-e9ae-4641-be18-44baca56fc66 is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:32,317 - WARNING - Pod uuid 8f4ad274-606a-4a47-ad07-7b8affc78c5d is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:32,323 - WARNING - Pod uuid 7d2750dd-3fd3-4f94-9ec1-4d566648390f is still seen in agent 10.0.0.242 VM list
2026-03-23 23:01:37,184 - DEBUG - Pod f31ab1ba-33f7-4c45-b73d-9b001b859901 is not in agent 10.0.0.242 VM list
2026-03-23 23:01:37,189 - DEBUG - VMI ad836602-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:37,189 - INFO - Verified that pod ctest-pod-39404987 is removed in agent
2026-03-23 23:01:37,329 - DEBUG - Pod 8f4ad274-606a-4a47-ad07-7b8affc78c5d is not in agent 10.0.0.242 VM list
2026-03-23 23:01:37,330 - DEBUG - Pod 6f506e5b-e9ae-4641-be18-44baca56fc66 is not in agent 10.0.0.242 VM list
2026-03-23 23:01:37,332 - DEBUG - Pod 7d2750dd-3fd3-4f94-9ec1-4d566648390f is not in agent 10.0.0.242 VM list
2026-03-23 23:01:37,341 - DEBUG - VMI ae6c07ea-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:37,341 - INFO - Verified that pod ctest-pod-94013029 is removed in agent
2026-03-23 23:01:37,342 - DEBUG - VMI adf9b852-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:37,342 - INFO - Verified that pod ctest-pod-34024985 is removed in agent
2026-03-23 23:01:37,343 - DEBUG - VMI aef57336-270b-11f1-be46-fa163eb562f7 is removed from agent 10.0.0.242
2026-03-23 23:01:37,343 - INFO - Verified that pod ctest-pod-27941585 is removed in agent
2026-03-23 23:01:37,343 - INFO - Deleting namespace ctest-non-default-12731695
2026-03-23 23:01:37,363 - DEBUG - Namespace ctest-non-default-12731695 still in k8s
2026-03-23 23:01:39,367 - DEBUG - Namespace ctest-non-default-12731695 still in k8s
2026-03-23 23:01:41,372 - DEBUG - Namespace ctest-non-default-12731695 still in k8s
2026-03-23 23:01:43,376 - DEBUG - Namespace ctest-non-default-12731695 is not in k8s
2026-03-23 23:01:43,376 - DEBUG - No need to check project deletion in contrail-api
2026-03-23 23:01:43,376 - INFO - Deleting namespace ctest-new-default-66567989
2026-03-23 23:01:43,385 - DEBUG - Namespace ctest-new-default-66567989 still in k8s
2026-03-23 23:01:45,390 - DEBUG - Namespace ctest-new-default-66567989 still in k8s
2026-03-23 23:01:47,395 - DEBUG - Namespace ctest-new-default-66567989 still in k8s
2026-03-23 23:01:49,398 - DEBUG - Namespace ctest-new-default-66567989 is not in k8s
2026-03-23 23:01:49,398 - DEBUG - No need to check project deletion in contrail-api