2025-01-15 03:04:07,545 - INFO - Using existing project ['default-domain', 'k8s-default'](5606871a-d254-4d7e-aa55-087e7fdd2a78)
2025-01-15 03:04:07,564 - DEBUG - Namespace ctest-new-default-61442627 not present
2025-01-15 03:04:07,579 - INFO - Created namespace ctest-new-default-61442627
2025-01-15 03:04:10,583 - DEBUG - Namespace ctest-non-default-40991197 not present
2025-01-15 03:04:10,592 - INFO - Created namespace ctest-non-default-40991197
2025-01-15 03:04:13,616 - DEBUG - Pod ctest-pod-55765812 not present
2025-01-15 03:04:13,616 - INFO - Creating Pod ctest-pod-55765812
2025-01-15 03:04:13,648 - DEBUG - Pod : ctest-pod-55765812 UUID is bfd473f8-752e-4b71-8bbe-b7872b976b59
2025-01-15 03:04:13,651 - DEBUG - Pod ctest-pod-66238670 not present
2025-01-15 03:04:13,652 - INFO - Creating Pod ctest-pod-66238670
2025-01-15 03:04:13,688 - DEBUG - Pod : ctest-pod-66238670 UUID is 87cb386b-39ec-429b-88d5-2052020e2d20
2025-01-15 03:04:13,691 - DEBUG - Pod ctest-pod-30294508 not present
2025-01-15 03:04:13,691 - INFO - Creating Pod ctest-pod-30294508
2025-01-15 03:04:13,711 - DEBUG - Pod : ctest-pod-30294508 UUID is aa0f514e-99ec-417d-a58b-82db1749a39b
2025-01-15 03:04:13,714 - DEBUG - Pod ctest-pod-52045336 not present
2025-01-15 03:04:13,714 - INFO - Creating Pod ctest-pod-52045336
2025-01-15 03:04:13,756 - DEBUG - Pod : ctest-pod-52045336 UUID is 51e89a0c-2501-4e83-ad98-912dca61088e
2025-01-15 03:04:13,767 - DEBUG - Pod ctest-pod-96654372 not present
2025-01-15 03:04:13,767 - INFO - Creating Pod ctest-pod-96654372
2025-01-15 03:04:13,791 - DEBUG - Pod : ctest-pod-96654372 UUID is cfc7ff65-1c2b-406d-9cf6-87a67b5d1623
2025-01-15 03:04:13,793 - DEBUG - Pod ctest-pod-89903034 not present
2025-01-15 03:04:13,793 - INFO - Creating Pod ctest-pod-89903034
2025-01-15 03:04:13,810 - DEBUG - Pod : ctest-pod-89903034 UUID is 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a
2025-01-15 03:04:13,817 - DEBUG - Pod ctest-pod-73255232 not present
2025-01-15 03:04:13,817 - INFO - Creating Pod ctest-pod-73255232
2025-01-15 03:04:13,836 - DEBUG - Pod : ctest-pod-73255232 UUID is 6431b159-ddfd-49a6-b1b4-f5274a42d859
2025-01-15 03:04:13,841 - DEBUG - Pod ctest-pod-77258980 not present
2025-01-15 03:04:13,842 - INFO - Creating Pod ctest-pod-77258980
2025-01-15 03:04:13,858 - DEBUG - Pod : ctest-pod-77258980 UUID is 6baead3a-c7cb-4ff8-9411-ef7b0f916492
2025-01-15 03:04:14,021 - INFO - Project default-domain:k8s-ctest-new-default-61442627 for Namespace ctest-new-default-61442627 is seen in contrail-api
2025-01-15 03:04:14,021 - DEBUG - Project uuid in Contrail is b6ee7d8a-5f23-43c8-b1b4-aaa6ff44ebd7
2025-01-15 03:04:14,159 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=408e021e-f5aa-4ca5-b429-447141bc92d9
2025-01-15 03:04:14,181 - INFO - Namespace ctest-new-default-61442627 with uuid 408e021e-f5aa-4ca5-b429-447141bc92d9 found in kube manager
2025-01-15 03:04:14,181 - INFO - Namespace ctest-new-default-61442627 verification passed
2025-01-15 03:04:14,356 - INFO - Project default-domain:k8s-ctest-non-default-40991197 for Namespace ctest-non-default-40991197 is seen in contrail-api
2025-01-15 03:04:14,356 - DEBUG - Project uuid in Contrail is 72e4549e-628b-42c2-a1d7-e3b7bb168385
2025-01-15 03:04:14,356 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=0403133a-3d84-4de4-9a64-a7ed05caddd4
2025-01-15 03:04:14,361 - INFO - Namespace ctest-non-default-40991197 with uuid 0403133a-3d84-4de4-9a64-a7ed05caddd4 found in kube manager
2025-01-15 03:04:14,361 - INFO - Namespace ctest-non-default-40991197 verification passed
2025-01-15 03:04:14,366 - DEBUG - Pod ctest-pod-55765812 not in running state.Currently in Pending
2025-01-15 03:04:19,379 - DEBUG - Pod ctest-pod-55765812 not in running state.Currently in Pending
2025-01-15 03:04:24,385 - DEBUG - Pod ctest-pod-55765812 not in running state.Currently in Pending
2025-01-15 03:04:29,391 - INFO - Pod ctest-pod-55765812 is in running state.Got IP 10.47.255.251
2025-01-15 03:04:29,445 - DEBUG - Pod ctest-pod-55765812 has vmi 6776bb3c-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:29,445 - INFO - Verified pod ctest-pod-55765812 in contrail-api
2025-01-15 03:04:29,464 - DEBUG - VMI 6776bb3c-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:29,464 - INFO - Verified Pod ctest-pod-55765812 in agent 10.0.0.35
2025-01-15 03:04:29,464 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=bfd473f8-752e-4b71-8bbe-b7872b976b59
2025-01-15 03:04:29,469 - INFO - Pod ctest-pod-55765812 with uuid bfd473f8-752e-4b71-8bbe-b7872b976b59 found in kube manager
2025-01-15 03:04:29,469 - INFO - Pod ctest-pod-55765812 verification passed
2025-01-15 03:04:29,474 - INFO - Pod ctest-pod-66238670 is in running state.Got IP 10.47.255.250
2025-01-15 03:04:29,487 - DEBUG - Pod ctest-pod-66238670 has vmi 67faa280-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:29,487 - INFO - Verified pod ctest-pod-66238670 in contrail-api
2025-01-15 03:04:29,502 - DEBUG - VMI 67faa280-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:29,502 - INFO - Verified Pod ctest-pod-66238670 in agent 10.0.0.35
2025-01-15 03:04:29,502 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=87cb386b-39ec-429b-88d5-2052020e2d20
2025-01-15 03:04:29,507 - INFO - Pod ctest-pod-66238670 with uuid 87cb386b-39ec-429b-88d5-2052020e2d20 found in kube manager
2025-01-15 03:04:29,507 - INFO - Pod ctest-pod-66238670 verification passed
2025-01-15 03:04:29,513 - INFO - Pod ctest-pod-30294508 is in running state.Got IP 10.47.255.249
2025-01-15 03:04:29,571 - DEBUG - Pod ctest-pod-30294508 has vmi 68a3619a-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:29,571 - INFO - Verified pod ctest-pod-30294508 in contrail-api
2025-01-15 03:04:29,585 - DEBUG - VMI 68a3619a-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:29,585 - INFO - Verified Pod ctest-pod-30294508 in agent 10.0.0.35
2025-01-15 03:04:29,585 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=aa0f514e-99ec-417d-a58b-82db1749a39b
2025-01-15 03:04:29,590 - INFO - Pod ctest-pod-30294508 with uuid aa0f514e-99ec-417d-a58b-82db1749a39b found in kube manager
2025-01-15 03:04:29,590 - INFO - Pod ctest-pod-30294508 verification passed
2025-01-15 03:04:29,595 - INFO - Pod ctest-pod-52045336 is in running state.Got IP 10.47.255.248
2025-01-15 03:04:29,649 - DEBUG - Pod ctest-pod-52045336 has vmi 691cfeb0-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:29,649 - INFO - Verified pod ctest-pod-52045336 in contrail-api
2025-01-15 03:04:29,665 - DEBUG - VMI 691cfeb0-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:29,665 - INFO - Verified Pod ctest-pod-52045336 in agent 10.0.0.35
2025-01-15 03:04:29,665 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=51e89a0c-2501-4e83-ad98-912dca61088e
2025-01-15 03:04:29,670 - INFO - Pod ctest-pod-52045336 with uuid 51e89a0c-2501-4e83-ad98-912dca61088e found in kube manager
2025-01-15 03:04:29,670 - INFO - Pod ctest-pod-52045336 verification passed
2025-01-15 03:04:29,675 - INFO - Pod ctest-pod-96654372 is in running state.Got IP 10.47.255.247
2025-01-15 03:04:29,690 - DEBUG - Pod ctest-pod-96654372 has vmi 69a7272a-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:29,690 - INFO - Verified pod ctest-pod-96654372 in contrail-api
2025-01-15 03:04:29,706 - DEBUG - VMI 69a7272a-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:29,706 - INFO - Verified Pod ctest-pod-96654372 in agent 10.0.0.35
2025-01-15 03:04:29,706 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=cfc7ff65-1c2b-406d-9cf6-87a67b5d1623
2025-01-15 03:04:29,711 - INFO - Pod ctest-pod-96654372 with uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 found in kube manager
2025-01-15 03:04:29,711 - INFO - Pod ctest-pod-96654372 verification passed
2025-01-15 03:04:29,718 - DEBUG - Pod ctest-pod-73255232 not in running state.Currently in Pending
2025-01-15 03:04:34,725 - INFO - Pod ctest-pod-73255232 is in running state.Got IP 10.47.255.245
2025-01-15 03:04:34,738 - DEBUG - Pod ctest-pod-73255232 has vmi 6a984ea2-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:34,738 - INFO - Verified pod ctest-pod-73255232 in contrail-api
2025-01-15 03:04:34,753 - DEBUG - VMI 6a984ea2-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:34,753 - INFO - Verified Pod ctest-pod-73255232 in agent 10.0.0.35
2025-01-15 03:04:34,753 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=6431b159-ddfd-49a6-b1b4-f5274a42d859
2025-01-15 03:04:34,758 - INFO - Pod ctest-pod-73255232 with uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 found in kube manager
2025-01-15 03:04:34,758 - INFO - Pod ctest-pod-73255232 verification passed
2025-01-15 03:04:34,763 - INFO - Pod ctest-pod-89903034 is in running state.Got IP 10.47.255.246
2025-01-15 03:04:34,817 - DEBUG - Pod ctest-pod-89903034 has vmi 6a1bae9c-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:34,817 - INFO - Verified pod ctest-pod-89903034 in contrail-api
2025-01-15 03:04:34,840 - DEBUG - VMI 6a1bae9c-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:34,841 - INFO - Verified Pod ctest-pod-89903034 in agent 10.0.0.35
2025-01-15 03:04:34,841 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=90f6ee47-c8e2-41ca-8e0f-1b192875dc0a
2025-01-15 03:04:34,845 - INFO - Pod ctest-pod-89903034 with uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a found in kube manager
2025-01-15 03:04:34,846 - INFO - Pod ctest-pod-89903034 verification passed
2025-01-15 03:04:34,850 - INFO - Pod ctest-pod-77258980 is in running state.Got IP 10.47.255.244
2025-01-15 03:04:34,905 - DEBUG - Pod ctest-pod-77258980 has vmi 6b11e320-d2ed-11ef-915e-fa163eb6883f
2025-01-15 03:04:34,905 - INFO - Verified pod ctest-pod-77258980 in contrail-api
2025-01-15 03:04:34,920 - DEBUG - VMI 6b11e320-d2ed-11ef-915e-fa163eb6883f is active in agent 10.0.0.35
2025-01-15 03:04:34,920 - INFO - Verified Pod ctest-pod-77258980 in agent 10.0.0.35
2025-01-15 03:04:34,920 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=6baead3a-c7cb-4ff8-9411-ef7b0f916492
2025-01-15 03:04:34,925 - INFO - Pod ctest-pod-77258980 with uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 found in kube manager
2025-01-15 03:04:34,925 - INFO - Pod ctest-pod-77258980 verification passed
2025-01-15 03:04:34,925 - INFO - ================================================================================
2025-01-15 03:04:34,925 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-15 03:04:34,926 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-15 03:04:35,155 - DEBUG - Nothing to compare xmpp stats {'10.0.0.35': {'10.0.0.29': '0'}} with
2025-01-15 03:04:35,155 - INFO - Initial checks done. Running the testcase now
2025-01-15 03:04:35,155 - INFO -
2025-01-15 03:04:35,212 - DEBUG - [Pod ctest-pod-55765812] Cmd: echo ctest-pod-55765812 > /usr/share/nginx/html/index.html, Output:
2025-01-15 03:04:35,273 - DEBUG - [Pod ctest-pod-66238670] Cmd: echo ctest-pod-66238670 > /usr/share/nginx/html/index.html, Output:
2025-01-15 03:04:35,331 - DEBUG - [Pod ctest-pod-30294508] Cmd: echo ctest-pod-30294508 > /usr/share/nginx/html/index.html, Output:
2025-01-15 03:04:35,404 - DEBUG - [Pod ctest-pod-52045336] Cmd: echo ctest-pod-52045336 > /usr/share/nginx/html/index.html, Output:
2025-01-15 03:04:35,407 - DEBUG - Service ctest-nginx-svc-62996949 not present
2025-01-15 03:04:35,407 - INFO - Creating service ctest-nginx-svc-62996949
2025-01-15 03:04:35,429 - INFO - Created Service ctest-nginx-svc-62996949
2025-01-15 03:04:35,442 - WARNING - Service UUID 982c974d-d4ae-402d-83e0-762b6e42e682 not yet found in contrail-api
2025-01-15 03:04:36,449 - INFO - Validated that Service ctest-nginx-svc-62996949 is seen in contrail-api
2025-01-15 03:04:36,450 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=982c974d-d4ae-402d-83e0-762b6e42e682
2025-01-15 03:04:36,455 - INFO - Service ctest-nginx-svc-62996949 with uuid 982c974d-d4ae-402d-83e0-762b6e42e682 found in kube manager
2025-01-15 03:04:36,455 - INFO - Service ctest-nginx-svc-62996949 verification passed
2025-01-15 03:04:37,548 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:04:37,548 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,548 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:04:37,610 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,610 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,610 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,610 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55765812': 1, 'ctest-pod-66238670': 1}
2025-01-15 03:04:37,666 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:04:37,666 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,666 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:04:37,732 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,732 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,732 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,798 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:04:37,798 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,798 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:04:37,852 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,852 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,852 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,975 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,975 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:04:37,975 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:04:37,975 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55765812': 1, 'ctest-pod-66238670': 4}
2025-01-15 03:04:37,978 - DEBUG - Network policy ingress-on-service not present
2025-01-15 03:04:37,979 - INFO - Creating Network Policy ingress-on-service
2025-01-15 03:04:37,990 - INFO - Network policy found in k8s
2025-01-15 03:04:37,990 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3533618c-577b-4702-b364-0559ca6715a2
2025-01-15 03:04:37,994 - INFO - Network Policy ingress-on-service with uuid 3533618c-577b-4702-b364-0559ca6715a2 found in kube manager
2025-01-15 03:04:38,030 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-15 03:04:38,030 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-15 03:04:38,030 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3533618c-577b-4702-b364-0559ca6715a2
2025-01-15 03:04:38,061 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-15 03:04:40,062 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3533618c-577b-4702-b364-0559ca6715a2
2025-01-15 03:04:40,105 - INFO - Network policy with name ingress-on-service found in agent
2025-01-15 03:04:40,105 - INFO - Network Policy ingress-on-service verification passed
2025-01-15 03:04:45,197 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:45,197 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:45,197 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:50,271 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:50,271 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:50,271 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:55,350 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:55,350 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:04:55,350 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:00,406 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:00,406 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:00,406 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:05,473 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:05,473 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:05,473 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:10,538 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:10,539 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:10,539 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:15,606 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:15,606 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:15,606 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:20,690 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:20,690 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:20,690 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:25,768 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:25,768 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:25,768 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:30,825 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:30,825 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:30,825 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:30,825 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-55765812': 0, 'ctest-pod-66238670': 0}
2025-01-15 03:05:30,912 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-55765812
2025-01-15 03:05:30,912 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:05:30,912 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-55765812
2025-01-15 03:05:31,000 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-55765812
2025-01-15 03:05:31,001 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:05:31,001 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-55765812
2025-01-15 03:05:31,084 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-55765812
2025-01-15 03:05:31,085 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:05:31,085 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-55765812
2025-01-15 03:05:31,179 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:05:31,179 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:05:31,179 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:05:31,244 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:05:31,244 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:05:31,244 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:05:31,244 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55765812': 4, 'ctest-pod-66238670': 1}
2025-01-15 03:05:36,315 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:36,315 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:36,315 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:41,390 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:41,390 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:41,390 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:46,452 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:46,453 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:46,453 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:51,537 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:51,537 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:51,537 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:56,594 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:56,594 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:05:56,594 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:01,650 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:01,650 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:01,650 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:06,701 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:06,701 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:06,701 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:11,777 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:11,777 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:11,777 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:16,834 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:16,835 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:16,835 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:21,901 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:21,901 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:21,901 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:21,901 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-55765812': 0, 'ctest-pod-66238670': 0}
2025-01-15 03:06:23,990 - DEBUG - [Pod ctest-pod-89903034] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.937 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.110 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.379/0.937 ms
2025-01-15 03:06:23,990 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-89903034 with expectation True passed
2025-01-15 03:06:26,058 - DEBUG - [Pod ctest-pod-96654372] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.714 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.139 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.313/0.714 ms
2025-01-15 03:06:26,058 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96654372 with expectation True passed
2025-01-15 03:06:28,117 - DEBUG - [Pod ctest-pod-73255232] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.713 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.113 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.304/0.713 ms
2025-01-15 03:06:28,117 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73255232 with expectation True passed
2025-01-15 03:06:28,189 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:06:28,190 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 03:06:28,190 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:06:28,190 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89903034 passed
2025-01-15 03:06:28,282 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:06:28,282 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-15 03:06:28,283 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:06:28,283 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89903034 passed
2025-01-15 03:06:33,357 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 03:06:33,357 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 03:06:33,357 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 03:06:33,357 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96654372 passed
2025-01-15 03:06:37,973 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-01-15 03:06:48,037 - DEBUG - [Pod ctest-pod-77258980] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 03:06:48,037 - DEBUG - [Pod Pod ctest-pod-77258980] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 03:06:48,038 - DEBUG - [Pod Pod ctest-pod-77258980] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 03:06:48,038 - INFO - wget check of of http://10.47.255.251 from ctest-pod-77258980 passed
2025-01-15 03:06:48,074 - INFO - Updating Network Policy ingress-on-service
2025-01-15 03:06:53,229 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:53,229 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:53,229 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:58,298 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:58,298 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:06:58,298 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:03,359 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:03,359 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:03,359 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:08,426 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:08,426 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:08,426 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:13,492 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:13,492 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:13,492 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:18,553 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:18,553 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:18,553 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:23,620 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:23,620 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:23,620 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:28,681 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:28,681 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:28,681 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:33,746 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:33,746 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:33,746 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:38,811 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:38,812 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:38,812 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
wget: download timed out
2025-01-15 03:07:38,812 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-55765812': 0, 'ctest-pod-66238670': 0}
2025-01-15 03:07:38,879 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:07:38,879 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:07:38,879 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: ctest-pod-55765812
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:07:38,954 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:07:38,954 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:07:38,954 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-66238670
2025-01-15 03:07:38,954 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55765812': 1, 'ctest-pod-66238670': 1}
2025-01-15 03:07:39,020 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
ctest-pod-55765812
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:07:39,020 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:07:39,020 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: Connecting to 10.107.191.152:80 (10.107.191.152:80)
ctest-pod-55765812
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:07:39,091 - DEBUG - [Pod ctest-pod-73255232] Cmd: wget http://10.107.191.152:80/ -O - -T 5 -t 1 , Output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:07:39,091 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd wget http://10.107.191.152:80/ -O - -T 5 -t 1 passed
2025-01-15 03:07:39,091 - DEBUG - [Pod Pod ctest-pod-73255232] Cmd output: ctest-pod-66238670
Connecting to 10.107.191.152:80 (10.107.191.152:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 03:07:39,091 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-55765812': 1, 'ctest-pod-66238670': 1}
2025-01-15 03:07:41,149 - DEBUG - [Pod ctest-pod-89903034] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.048 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.089 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.089/0.411/1.048 ms
2025-01-15 03:07:41,149 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-89903034 with expectation True passed
2025-01-15 03:07:43,221 - DEBUG - [Pod ctest-pod-96654372] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.907 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.096 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/0.363/0.907 ms
2025-01-15 03:07:43,221 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96654372 with expectation True passed
2025-01-15 03:07:45,284 - DEBUG - [Pod ctest-pod-73255232] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.868 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.359/0.868 ms
2025-01-15 03:07:45,285 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73255232 with expectation True passed
2025-01-15 03:07:45,354 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:07:45,354 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 03:07:45,354 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:07:45,354 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89903034 passed
2025-01-15 03:07:45,419 - DEBUG - [Pod ctest-pod-89903034] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:07:45,419 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-15 03:07:45,419 - DEBUG - [Pod Pod ctest-pod-89903034] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:07:45,419 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89903034 passed
2025-01-15 03:07:50,485 - DEBUG - [Pod ctest-pod-96654372] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 03:07:50,485 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 03:07:50,485 - DEBUG - [Pod Pod ctest-pod-96654372] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 03:07:50,485 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96654372 passed
2025-01-15 03:07:50,537 - DEBUG - [Pod ctest-pod-77258980] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:07:50,537 - DEBUG - [Pod Pod ctest-pod-77258980] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 03:07:50,537 - DEBUG - [Pod Pod ctest-pod-77258980] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 03:07:50,537 - INFO - wget check of of http://10.47.255.251 from ctest-pod-77258980 passed
2025-01-15 03:07:50,537 - INFO - Deleting Network Policy : ingress-on-service
2025-01-15 03:07:50,537 - INFO - Deleting service : ctest-nginx-svc-62996949
2025-01-15 03:07:50,769 - DEBUG - No XMPP flaps were noticed during the test
2025-01-15 03:07:50,769 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:16]
2025-01-15 03:07:50,769 - INFO - --------------------------------------------------------------------------------
2025-01-15 03:07:50,774 - INFO - Deleting pod ctest-new-default-61442627:ctest-pod-55765812
2025-01-15 03:07:50,774 - INFO - Deleting pod ctest-new-default-61442627:ctest-pod-66238670
2025-01-15 03:07:50,774 - INFO - Deleting pod ctest-non-default-40991197:ctest-pod-30294508
2025-01-15 03:07:50,775 - INFO - Deleting pod ctest-non-default-40991197:ctest-pod-52045336
2025-01-15 03:07:50,775 - INFO - Deleting pod ctest-new-default-61442627:ctest-pod-96654372
2025-01-15 03:07:50,775 - INFO - Deleting pod ctest-new-default-61442627:ctest-pod-89903034
2025-01-15 03:07:50,776 - INFO - Deleting pod ctest-non-default-40991197:ctest-pod-73255232
2025-01-15 03:07:50,776 - INFO - Deleting pod ctest-non-default-40991197:ctest-pod-77258980
2025-01-15 03:07:50,876 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,897 - WARNING - Pod uuid aa0f514e-99ec-417d-a58b-82db1749a39b is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,898 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,898 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,899 - WARNING - Pod uuid bfd473f8-752e-4b71-8bbe-b7872b976b59 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,903 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,903 - WARNING - Pod uuid 87cb386b-39ec-429b-88d5-2052020e2d20 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:50,904 - WARNING - Pod uuid 51e89a0c-2501-4e83-ad98-912dca61088e is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:55,887 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:55,933 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:55,933 - DEBUG - Pod 51e89a0c-2501-4e83-ad98-912dca61088e is not in agent 10.0.0.35 VM list
2025-01-15 03:07:55,936 - DEBUG - Pod bfd473f8-752e-4b71-8bbe-b7872b976b59 is not in agent 10.0.0.35 VM list
2025-01-15 03:07:55,938 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:55,938 - DEBUG - Pod aa0f514e-99ec-417d-a58b-82db1749a39b is not in agent 10.0.0.35 VM list
2025-01-15 03:07:55,940 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:07:55,943 - DEBUG - Pod 87cb386b-39ec-429b-88d5-2052020e2d20 is not in agent 10.0.0.35 VM list
2025-01-15 03:07:55,959 - DEBUG - VMI 691cfeb0-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:07:55,959 - INFO - Verified that pod ctest-pod-52045336 is removed in agent
2025-01-15 03:07:55,962 - DEBUG - VMI 68a3619a-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:07:55,962 - INFO - Verified that pod ctest-pod-30294508 is removed in agent
2025-01-15 03:07:55,962 - DEBUG - VMI 67faa280-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:07:55,962 - INFO - Verified that pod ctest-pod-66238670 is removed in agent
2025-01-15 03:07:55,963 - DEBUG - VMI 6776bb3c-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:07:55,963 - INFO - Verified that pod ctest-pod-55765812 is removed in agent
2025-01-15 03:08:00,894 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:00,943 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:00,951 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:00,951 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:05,906 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:05,951 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:05,963 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:05,964 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:10,915 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:10,960 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:10,975 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:10,976 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:15,925 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:15,968 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:15,986 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:15,987 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:20,934 - WARNING - Pod uuid 6431b159-ddfd-49a6-b1b4-f5274a42d859 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:20,977 - WARNING - Pod uuid 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:21,016 - WARNING - Pod uuid 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:21,017 - WARNING - Pod uuid cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is still seen in agent 10.0.0.35 VM list
2025-01-15 03:08:25,943 - DEBUG - Pod 6431b159-ddfd-49a6-b1b4-f5274a42d859 is not in agent 10.0.0.35 VM list
2025-01-15 03:08:25,949 - DEBUG - VMI 6a984ea2-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:08:25,949 - INFO - Verified that pod ctest-pod-73255232 is removed in agent
2025-01-15 03:08:25,986 - DEBUG - Pod 6baead3a-c7cb-4ff8-9411-ef7b0f916492 is not in agent 10.0.0.35 VM list
2025-01-15 03:08:25,994 - DEBUG - VMI 6b11e320-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:08:25,994 - INFO - Verified that pod ctest-pod-77258980 is removed in agent
2025-01-15 03:08:26,028 - DEBUG - Pod 90f6ee47-c8e2-41ca-8e0f-1b192875dc0a is not in agent 10.0.0.35 VM list
2025-01-15 03:08:26,031 - DEBUG - Pod cfc7ff65-1c2b-406d-9cf6-87a67b5d1623 is not in agent 10.0.0.35 VM list
2025-01-15 03:08:26,040 - DEBUG - VMI 69a7272a-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:08:26,040 - INFO - Verified that pod ctest-pod-96654372 is removed in agent
2025-01-15 03:08:26,040 - DEBUG - VMI 6a1bae9c-d2ed-11ef-915e-fa163eb6883f is removed from agent 10.0.0.35
2025-01-15 03:08:26,040 - INFO - Verified that pod ctest-pod-89903034 is removed in agent
2025-01-15 03:08:26,041 - INFO - Deleting namespace ctest-non-default-40991197
2025-01-15 03:08:26,049 - DEBUG - Namespace ctest-non-default-40991197 still in k8s
2025-01-15 03:08:28,054 - DEBUG - Namespace ctest-non-default-40991197 still in k8s
2025-01-15 03:08:30,058 - DEBUG - Namespace ctest-non-default-40991197 still in k8s
2025-01-15 03:08:32,063 - DEBUG - Namespace ctest-non-default-40991197 is not in k8s
2025-01-15 03:08:32,063 - DEBUG - No need to check project deletion in contrail-api
2025-01-15 03:08:32,063 - INFO - Deleting namespace ctest-new-default-61442627
2025-01-15 03:08:32,071 - DEBUG - Namespace ctest-new-default-61442627 still in k8s
2025-01-15 03:08:34,074 - DEBUG - Namespace ctest-new-default-61442627 still in k8s
2025-01-15 03:08:36,086 - DEBUG - Namespace ctest-new-default-61442627 still in k8s
2025-01-15 03:08:38,093 - DEBUG - Namespace ctest-new-default-61442627 is not in k8s
2025-01-15 03:08:38,093 - DEBUG - No need to check project deletion in contrail-api