2024-09-11 09:40:47,612 - INFO - Using existing project ['default-domain', 'k8s-default'](d2c0dc38-1eaa-4989-882d-516d684a36f0) 2024-09-11 09:40:47,639 - DEBUG - Namespace ctest-new-default-12071026 not present 2024-09-11 09:40:47,656 - INFO - Created namespace ctest-new-default-12071026 2024-09-11 09:40:50,661 - DEBUG - Namespace ctest-non-default-69725342 not present 2024-09-11 09:40:50,670 - INFO - Created namespace ctest-non-default-69725342 2024-09-11 09:40:53,702 - DEBUG - Pod ctest-pod-12971566 not present 2024-09-11 09:40:53,702 - INFO - Creating Pod ctest-pod-12971566 2024-09-11 09:40:53,729 - DEBUG - Pod : ctest-pod-12971566 UUID is 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 2024-09-11 09:40:53,744 - DEBUG - Pod ctest-pod-99219559 not present 2024-09-11 09:40:53,744 - INFO - Creating Pod ctest-pod-99219559 2024-09-11 09:40:53,780 - DEBUG - Pod : ctest-pod-99219559 UUID is 48245692-afdf-4678-861f-54d5ec95b895 2024-09-11 09:40:53,783 - DEBUG - Pod ctest-pod-23302871 not present 2024-09-11 09:40:53,784 - INFO - Creating Pod ctest-pod-23302871 2024-09-11 09:40:53,844 - DEBUG - Pod : ctest-pod-23302871 UUID is 7c96a90d-9423-4c86-9941-1257454b8e7b 2024-09-11 09:40:53,854 - DEBUG - Pod ctest-pod-96115304 not present 2024-09-11 09:40:53,854 - INFO - Creating Pod ctest-pod-96115304 2024-09-11 09:40:53,883 - DEBUG - Pod : ctest-pod-96115304 UUID is 2309007f-c931-4a85-926e-322df844797c 2024-09-11 09:40:53,889 - DEBUG - Pod ctest-pod-20056534 not present 2024-09-11 09:40:53,889 - INFO - Creating Pod ctest-pod-20056534 2024-09-11 09:40:53,942 - DEBUG - Pod : ctest-pod-20056534 UUID is 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 2024-09-11 09:40:53,960 - DEBUG - Pod ctest-pod-15468789 not present 2024-09-11 09:40:53,961 - INFO - Creating Pod ctest-pod-15468789 2024-09-11 09:40:53,997 - DEBUG - Pod : ctest-pod-15468789 UUID is 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd 2024-09-11 09:40:54,005 - DEBUG - Pod ctest-pod-07514462 not present 2024-09-11 09:40:54,005 - INFO - Creating Pod ctest-pod-07514462 2024-09-11 09:40:54,033 - DEBUG - Pod : ctest-pod-07514462 UUID is 774d3d4c-cbcd-4a7e-aaf0-853599182b9f 2024-09-11 09:40:54,048 - DEBUG - Pod ctest-pod-66992918 not present 2024-09-11 09:40:54,048 - INFO - Creating Pod ctest-pod-66992918 2024-09-11 09:40:54,074 - DEBUG - Node for Pod ctest-pod-66992918 not yet populated 2024-09-11 09:40:57,082 - DEBUG - Pod : ctest-pod-66992918 UUID is 89776479-7a70-43b8-8ebb-cb02c559acf6 2024-09-11 09:40:57,376 - INFO - Project default-domain:k8s-ctest-new-default-12071026 for Namespace ctest-new-default-12071026 is seen in contrail-api 2024-09-11 09:40:57,376 - DEBUG - Project uuid in Contrail is cf2ccbf8-d200-4583-9771-b3a8ced31fba 2024-09-11 09:40:57,598 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=a2e4bbf3-1e7c-4c48-a52d-c38e736f953d 2024-09-11 09:40:57,605 - INFO - Namespace ctest-new-default-12071026 with uuid a2e4bbf3-1e7c-4c48-a52d-c38e736f953d found in kube manager 2024-09-11 09:40:57,605 - INFO - Namespace ctest-new-default-12071026 verification passed 2024-09-11 09:40:57,878 - INFO - Project default-domain:k8s-ctest-non-default-69725342 for Namespace ctest-non-default-69725342 is seen in contrail-api 2024-09-11 09:40:57,878 - DEBUG - Project uuid in Contrail is f9ea4876-a0ef-438a-baf5-ed5d774bc5bc 2024-09-11 09:40:57,878 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=06cefa5b-822a-4b75-a0de-81e7de51eafe 2024-09-11 09:40:57,885 - INFO - Namespace ctest-non-default-69725342 with uuid 06cefa5b-822a-4b75-a0de-81e7de51eafe found in kube manager 2024-09-11 09:40:57,885 - INFO - Namespace ctest-non-default-69725342 verification passed 2024-09-11 09:40:57,895 - DEBUG - Pod ctest-pod-12971566 not in running state.Currently in Pending 2024-09-11 09:41:02,903 - DEBUG - Pod ctest-pod-12971566 not in running state.Currently in Pending 2024-09-11 09:41:07,923 - INFO - Pod ctest-pod-12971566 is in running state.Got IP 10.47.255.251 2024-09-11 09:41:08,009 - DEBUG - Pod ctest-pod-12971566 has vmi f1283b6e-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:08,009 - INFO - Verified pod ctest-pod-12971566 in contrail-api 2024-09-11 09:41:08,026 - DEBUG - VMI f1283b6e-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:08,026 - INFO - Verified Pod ctest-pod-12971566 in agent 10.0.0.27 2024-09-11 09:41:08,026 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=7f52b1fc-b9c1-4659-96a8-73eac205c2f1 2024-09-11 09:41:08,034 - INFO - Pod ctest-pod-12971566 with uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 found in kube manager 2024-09-11 09:41:08,034 - INFO - Pod ctest-pod-12971566 verification passed 2024-09-11 09:41:08,043 - INFO - Pod ctest-pod-99219559 is in running state.Got IP 10.47.255.250 2024-09-11 09:41:08,061 - DEBUG - Pod ctest-pod-99219559 has vmi f1bb5aac-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:08,061 - INFO - Verified pod ctest-pod-99219559 in contrail-api 2024-09-11 09:41:08,082 - DEBUG - VMI f1bb5aac-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:08,082 - INFO - Verified Pod ctest-pod-99219559 in agent 10.0.0.27 2024-09-11 09:41:08,083 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=48245692-afdf-4678-861f-54d5ec95b895 2024-09-11 09:41:08,089 - INFO - Pod ctest-pod-99219559 with uuid 48245692-afdf-4678-861f-54d5ec95b895 found in kube manager 2024-09-11 09:41:08,089 - INFO - Pod ctest-pod-99219559 verification passed 2024-09-11 09:41:08,097 - DEBUG - Pod ctest-pod-23302871 not in running state.Currently in Pending 2024-09-11 09:41:13,115 - INFO - Pod ctest-pod-23302871 is in running state.Got IP 10.47.255.249 2024-09-11 09:41:13,181 - DEBUG - Pod ctest-pod-23302871 has vmi f2847e1e-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:13,181 - INFO - Verified pod ctest-pod-23302871 in contrail-api 2024-09-11 09:41:13,216 - DEBUG - VMI f2847e1e-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:13,217 - INFO - Verified Pod ctest-pod-23302871 in agent 10.0.0.27 2024-09-11 09:41:13,217 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=7c96a90d-9423-4c86-9941-1257454b8e7b 2024-09-11 09:41:13,231 - INFO - Pod ctest-pod-23302871 with uuid 7c96a90d-9423-4c86-9941-1257454b8e7b found in kube manager 2024-09-11 09:41:13,231 - INFO - Pod ctest-pod-23302871 verification passed 2024-09-11 09:41:13,246 - INFO - Pod ctest-pod-96115304 is in running state.Got IP 10.47.255.248 2024-09-11 09:41:13,281 - DEBUG - Pod ctest-pod-96115304 has vmi f3281c40-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:13,281 - INFO - Verified pod ctest-pod-96115304 in contrail-api 2024-09-11 09:41:13,307 - DEBUG - VMI f3281c40-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:13,308 - INFO - Verified Pod ctest-pod-96115304 in agent 10.0.0.27 2024-09-11 09:41:13,308 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=2309007f-c931-4a85-926e-322df844797c 2024-09-11 09:41:13,321 - INFO - Pod ctest-pod-96115304 with uuid 2309007f-c931-4a85-926e-322df844797c found in kube manager 2024-09-11 09:41:13,321 - INFO - Pod ctest-pod-96115304 verification passed 2024-09-11 09:41:13,337 - DEBUG - Pod ctest-pod-20056534 not in running state.Currently in Pending 2024-09-11 09:41:18,357 - INFO - Pod ctest-pod-20056534 is in running state.Got IP 10.47.255.247 2024-09-11 09:41:18,385 - DEBUG - Pod ctest-pod-20056534 has vmi f3c7a210-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:18,385 - INFO - Verified pod ctest-pod-20056534 in contrail-api 2024-09-11 09:41:18,418 - DEBUG - VMI f3c7a210-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:18,419 - INFO - Verified Pod ctest-pod-20056534 in agent 10.0.0.27 2024-09-11 09:41:18,419 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 2024-09-11 09:41:18,434 - INFO - Pod ctest-pod-20056534 with uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 found in kube manager 2024-09-11 09:41:18,435 - INFO - Pod ctest-pod-20056534 verification passed 2024-09-11 09:41:18,452 - INFO - Pod ctest-pod-07514462 is in running state.Got IP 10.47.255.245 2024-09-11 09:41:18,529 - DEBUG - Pod ctest-pod-07514462 has vmi f4d19fda-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:18,529 - INFO - Verified pod ctest-pod-07514462 in contrail-api 2024-09-11 09:41:18,551 - DEBUG - VMI f4d19fda-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:18,551 - INFO - Verified Pod ctest-pod-07514462 in agent 10.0.0.27 2024-09-11 09:41:18,551 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=774d3d4c-cbcd-4a7e-aaf0-853599182b9f 2024-09-11 09:41:18,560 - INFO - Pod ctest-pod-07514462 with uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f found in kube manager 2024-09-11 09:41:18,560 - INFO - Pod ctest-pod-07514462 verification passed 2024-09-11 09:41:18,567 - INFO - Pod ctest-pod-15468789 is in running state.Got IP 10.47.255.246 2024-09-11 09:41:18,588 - DEBUG - Pod ctest-pod-15468789 has vmi f44a7c08-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:18,588 - INFO - Verified pod ctest-pod-15468789 in contrail-api 2024-09-11 09:41:18,604 - DEBUG - VMI f44a7c08-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:18,604 - INFO - Verified Pod ctest-pod-15468789 in agent 10.0.0.27 2024-09-11 09:41:18,604 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=0ed3dfc9-efd3-47c1-9aa9-56974deda4bd 2024-09-11 09:41:18,612 - INFO - Pod ctest-pod-15468789 with uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd found in kube manager 2024-09-11 09:41:18,612 - INFO - Pod ctest-pod-15468789 verification passed 2024-09-11 09:41:18,619 - INFO - Pod ctest-pod-66992918 is in running state.Got IP 10.47.255.244 2024-09-11 09:41:18,680 - DEBUG - Pod ctest-pod-66992918 has vmi f54f6df2-7021-11ef-8987-fa163e103d53 2024-09-11 09:41:18,681 - INFO - Verified pod ctest-pod-66992918 in contrail-api 2024-09-11 09:41:18,706 - DEBUG - VMI f54f6df2-7021-11ef-8987-fa163e103d53 is active in agent 10.0.0.27 2024-09-11 09:41:18,706 - INFO - Verified Pod ctest-pod-66992918 in agent 10.0.0.27 2024-09-11 09:41:18,707 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=89776479-7a70-43b8-8ebb-cb02c559acf6 2024-09-11 09:41:18,720 - INFO - Pod ctest-pod-66992918 with uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 found in kube manager 2024-09-11 09:41:18,720 - INFO - Pod ctest-pod-66992918 verification passed 2024-09-11 09:41:18,721 - INFO - ================================================================================ 2024-09-11 09:41:18,721 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-11 09:41:18,721 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-11 09:41:19,094 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.49': '0'}} with 2024-09-11 09:41:19,094 - INFO - Initial checks done. Running the testcase now 2024-09-11 09:41:19,094 - INFO - 2024-09-11 09:41:19,175 - DEBUG - [Pod ctest-pod-12971566] Cmd: echo ctest-pod-12971566 > /usr/share/nginx/html/index.html, Output: 2024-09-11 09:41:19,261 - DEBUG - [Pod ctest-pod-99219559] Cmd: echo ctest-pod-99219559 > /usr/share/nginx/html/index.html, Output: 2024-09-11 09:41:19,344 - DEBUG - [Pod ctest-pod-23302871] Cmd: echo ctest-pod-23302871 > /usr/share/nginx/html/index.html, Output: 2024-09-11 09:41:19,444 - DEBUG - [Pod ctest-pod-96115304] Cmd: echo ctest-pod-96115304 > /usr/share/nginx/html/index.html, Output: 2024-09-11 09:41:19,450 - DEBUG - Service ctest-nginx-svc-32278329 not present 2024-09-11 09:41:19,451 - INFO - Creating service ctest-nginx-svc-32278329 2024-09-11 09:41:19,510 - INFO - Created Service ctest-nginx-svc-32278329 2024-09-11 09:41:19,522 - WARNING - Service UUID 3731e158-0f4c-4dd9-a6dd-3ca671cfcbad not yet found in contrail-api 2024-09-11 09:41:20,529 - INFO - Validated that Service ctest-nginx-svc-32278329 is seen in contrail-api 2024-09-11 09:41:20,529 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=3731e158-0f4c-4dd9-a6dd-3ca671cfcbad 2024-09-11 09:41:20,534 - INFO - Service ctest-nginx-svc-32278329 with uuid 3731e158-0f4c-4dd9-a6dd-3ca671cfcbad found in kube manager 2024-09-11 09:41:20,534 - INFO - Service ctest-nginx-svc-32278329 verification passed 2024-09-11 09:41:21,604 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) ctest-pod-99219559 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,605 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:41:21,605 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) ctest-pod-99219559 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,682 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,683 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:41:21,683 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,757 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12971566 2024-09-11 09:41:21,757 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:41:21,758 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12971566 2024-09-11 09:41:21,758 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12971566': 1, 'ctest-pod-99219559': 2} 2024-09-11 09:41:21,848 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12971566 2024-09-11 09:41:21,849 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:41:21,849 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12971566 2024-09-11 09:41:21,919 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-12971566 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,919 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:41:21,919 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: ctest-pod-12971566 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,981 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) ctest-pod-99219559 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,981 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:41:21,981 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) ctest-pod-99219559 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:41:21,981 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12971566': 2, 'ctest-pod-99219559': 1} 2024-09-11 09:41:21,997 - DEBUG - Network policy ingress-on-service not present 2024-09-11 09:41:22,005 - INFO - Creating Network Policy ingress-on-service 2024-09-11 09:41:22,045 - INFO - Network policy found in k8s 2024-09-11 09:41:22,046 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30db4f87-b7dd-4b32-8969-2408d4c426e2 2024-09-11 09:41:22,064 - INFO - Network Policy ingress-on-service with uuid 30db4f87-b7dd-4b32-8969-2408d4c426e2 found in kube manager 2024-09-11 09:41:22,126 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-11 09:41:22,126 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-11 09:41:22,126 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30db4f87-b7dd-4b32-8969-2408d4c426e2 2024-09-11 09:41:22,186 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-11 09:41:24,186 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30db4f87-b7dd-4b32-8969-2408d4c426e2 2024-09-11 09:41:24,268 - INFO - Network policy with name ingress-on-service found in agent 2024-09-11 09:41:24,269 - INFO - Network Policy ingress-on-service verification passed 2024-09-11 09:41:29,550 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:29,550 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:29,550 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:34,642 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:34,642 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:34,642 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:39,709 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:39,710 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:39,710 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:44,787 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:44,787 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:44,788 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:49,880 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:49,880 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:49,880 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:54,965 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:54,965 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:41:54,965 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:00,021 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:00,021 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:00,021 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:05,110 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:05,111 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:05,111 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:10,183 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:10,183 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:10,183 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:15,246 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:15,246 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:15,247 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:15,247 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-12971566': 0, 'ctest-pod-99219559': 0} 2024-09-11 09:42:15,325 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-12971566 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:42:15,325 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:42:15,325 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: ctest-pod-12971566 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:42:15,400 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:42:15,401 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:42:15,401 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:42:15,401 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12971566': 1, 'ctest-pod-99219559': 1} 2024-09-11 09:42:20,478 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:20,478 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:20,478 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:25,570 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:25,570 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:25,571 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:30,660 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:30,660 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:30,661 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:35,745 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:35,746 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:35,746 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:40,818 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:40,818 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:40,818 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:45,897 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:45,898 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:45,898 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:50,969 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:50,969 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:50,969 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:56,037 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:56,037 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:42:56,037 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:01,090 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:01,091 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:01,092 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:06,165 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:06,166 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:06,166 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:06,166 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-12971566': 0, 'ctest-pod-99219559': 0} 2024-09-11 09:43:08,238 - DEBUG - [Pod ctest-pod-15468789] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.704 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.282/0.704 ms 2024-09-11 09:43:08,239 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-15468789 with expectation True passed 2024-09-11 09:43:10,321 - DEBUG - [Pod ctest-pod-20056534] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.588 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.248/0.588 ms 2024-09-11 09:43:10,321 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20056534 with expectation True passed 2024-09-11 09:43:12,405 - DEBUG - [Pod ctest-pod-07514462] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.077 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.414/1.077 ms 2024-09-11 09:43:12,406 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07514462 with expectation True passed 2024-09-11 09:43:12,490 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:43:12,490 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-11 09:43:12,491 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:43:12,491 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15468789 passed 2024-09-11 09:43:12,549 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:43:12,550 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-11 09:43:12,550 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:43:12,550 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15468789 passed 2024-09-11 09:43:17,599 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-11 09:43:17,599 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-11 09:43:17,599 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-11 09:43:17,600 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20056534 passed 2024-09-11 09:43:22,702 - DEBUG - [Pod ctest-pod-66992918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-11 09:43:22,702 - DEBUG - [Pod Pod ctest-pod-66992918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-11 09:43:22,702 - DEBUG - [Pod Pod ctest-pod-66992918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-11 09:43:22,702 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66992918 passed 2024-09-11 09:43:22,717 - INFO - Updating Network Policy ingress-on-service 2024-09-11 09:43:27,806 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:27,806 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:27,806 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:32,877 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:32,877 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:32,877 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:37,981 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:37,981 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:37,982 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:43,056 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:43,056 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:43,056 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:48,241 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:48,241 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:48,242 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:53,318 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:53,318 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:53,318 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:58,372 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:58,373 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:43:58,373 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:05,943 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:05,944 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:05,944 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:11,009 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:11,009 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:11,010 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:16,092 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:16,092 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:16,092 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) wget: download timed out 2024-09-11 09:44:16,093 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-12971566': 0, 'ctest-pod-99219559': 0} 2024-09-11 09:44:16,177 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,178 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:44:16,178 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,258 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-12971566 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,258 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:44:16,259 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: ctest-pod-12971566 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,259 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12971566': 1, 'ctest-pod-99219559': 1} 2024-09-11 09:44:16,337 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,337 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:44:16,337 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,409 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,409 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:44:16,409 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,487 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,487 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:44:16,488 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: ctest-pod-99219559 Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-11 09:44:16,558 - DEBUG - [Pod ctest-pod-07514462] Cmd: wget http://10.102.206.22:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12971566 2024-09-11 09:44:16,559 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd wget http://10.102.206.22:80/ -O - -T 5 -t 1 passed 2024-09-11 09:44:16,559 - DEBUG - [Pod Pod ctest-pod-07514462] Cmd output: Connecting to 10.102.206.22:80 (10.102.206.22:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-12971566 2024-09-11 09:44:16,559 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-12971566': 1, 'ctest-pod-99219559': 3} 2024-09-11 09:44:18,625 - DEBUG - [Pod ctest-pod-15468789] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.601 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.249/0.601 ms 2024-09-11 09:44:18,626 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-15468789 with expectation True passed 2024-09-11 09:44:20,783 - DEBUG - [Pod ctest-pod-20056534] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.090 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.416/1.090 ms 2024-09-11 09:44:20,784 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20056534 with expectation True passed 2024-09-11 09:44:22,843 - DEBUG - [Pod ctest-pod-07514462] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.612 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.256/0.612 ms 2024-09-11 09:44:22,843 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07514462 with expectation True passed 2024-09-11 09:44:22,931 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:44:22,931 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-11 09:44:22,932 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:44:22,932 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15468789 passed 2024-09-11 09:44:23,014 - DEBUG - [Pod ctest-pod-15468789] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:44:23,015 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-11 09:44:23,015 - DEBUG - [Pod Pod ctest-pod-15468789] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:44:23,015 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15468789 passed 2024-09-11 09:44:28,071 - DEBUG - [Pod ctest-pod-20056534] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-11 09:44:28,071 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-11 09:44:28,072 - DEBUG - [Pod Pod ctest-pod-20056534] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-11 09:44:28,072 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20056534 passed 2024-09-11 09:44:28,143 - DEBUG - [Pod ctest-pod-66992918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:44:28,144 - DEBUG - [Pod Pod ctest-pod-66992918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-11 09:44:28,144 - DEBUG - [Pod Pod ctest-pod-66992918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-11 09:44:28,144 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66992918 passed 2024-09-11 09:44:28,144 - INFO - Deleting Network Policy : ingress-on-service 2024-09-11 09:44:28,147 - INFO - Deleting service : ctest-nginx-svc-32278329 2024-09-11 09:44:28,542 - DEBUG - No XMPP flaps were noticed during the test 2024-09-11 09:44:28,542 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2024-09-11 09:44:28,542 - INFO - -------------------------------------------------------------------------------- 2024-09-11 09:44:28,562 - INFO - Deleting pod ctest-new-default-12071026:ctest-pod-12971566 2024-09-11 09:44:28,564 - INFO - Deleting pod ctest-new-default-12071026:ctest-pod-99219559 2024-09-11 09:44:28,566 - INFO - Deleting pod ctest-non-default-69725342:ctest-pod-23302871 2024-09-11 09:44:28,567 - INFO - Deleting pod ctest-non-default-69725342:ctest-pod-96115304 2024-09-11 09:44:28,569 - INFO - Deleting pod ctest-new-default-12071026:ctest-pod-20056534 2024-09-11 09:44:28,570 - INFO - Deleting pod ctest-new-default-12071026:ctest-pod-15468789 2024-09-11 09:44:28,571 - INFO - Deleting pod ctest-non-default-69725342:ctest-pod-07514462 2024-09-11 09:44:28,572 - INFO - Deleting pod ctest-non-default-69725342:ctest-pod-66992918 2024-09-11 09:44:28,684 - WARNING - Pod uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:28,726 - WARNING - Pod uuid 48245692-afdf-4678-861f-54d5ec95b895 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:28,758 - WARNING - Pod uuid 2309007f-c931-4a85-926e-322df844797c is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:28,758 - WARNING - Pod uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:28,759 - WARNING - Pod uuid 7c96a90d-9423-4c86-9941-1257454b8e7b is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:28,760 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:28,760 - WARNING - Pod uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:29,738 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,700 - WARNING - Pod uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,736 - WARNING - Pod uuid 48245692-afdf-4678-861f-54d5ec95b895 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,787 - WARNING - Pod uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,787 - WARNING - Pod uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,788 - DEBUG - Pod 2309007f-c931-4a85-926e-322df844797c is not in agent 10.0.0.27 VM list 2024-09-11 09:44:33,790 - WARNING - Pod uuid 7c96a90d-9423-4c86-9941-1257454b8e7b is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,790 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:33,797 - DEBUG - VMI f3281c40-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:44:33,797 - INFO - Verified that pod ctest-pod-96115304 is removed in agent 2024-09-11 09:44:34,748 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:38,716 - WARNING - Pod uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:38,749 - DEBUG - Pod 48245692-afdf-4678-861f-54d5ec95b895 is not in agent 10.0.0.27 VM list 2024-09-11 09:44:38,763 - DEBUG - VMI f1bb5aac-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:44:38,763 - INFO - Verified that pod ctest-pod-99219559 is removed in agent 2024-09-11 09:44:38,830 - WARNING - Pod uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:38,836 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:38,837 - DEBUG - Pod 7c96a90d-9423-4c86-9941-1257454b8e7b is not in agent 10.0.0.27 VM list 2024-09-11 09:44:38,859 - DEBUG - VMI f2847e1e-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:44:38,860 - INFO - Verified that pod ctest-pod-23302871 is removed in agent 2024-09-11 09:44:39,766 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:41,494 - WARNING - Pod uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:43,735 - WARNING - Pod uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:43,856 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:43,860 - WARNING - Pod uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:44,780 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:46,508 - WARNING - Pod uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:48,755 - WARNING - Pod uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:48,881 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:48,882 - WARNING - Pod uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:49,795 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:51,521 - WARNING - Pod uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:55,872 - WARNING - Pod uuid 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:55,878 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:55,880 - WARNING - Pod uuid 89776479-7a70-43b8-8ebb-cb02c559acf6 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:55,885 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:44:56,529 - WARNING - Pod uuid 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is still seen in agent 10.0.0.27 VM list 2024-09-11 09:45:00,883 - DEBUG - Pod 7f52b1fc-b9c1-4659-96a8-73eac205c2f1 is not in agent 10.0.0.27 VM list 2024-09-11 09:45:00,899 - WARNING - Pod uuid 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is still seen in agent 10.0.0.27 VM list 2024-09-11 09:45:00,902 - DEBUG - Pod 89776479-7a70-43b8-8ebb-cb02c559acf6 is not in agent 10.0.0.27 VM list 2024-09-11 09:45:00,903 - DEBUG - VMI f1283b6e-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:45:00,903 - INFO - Verified that pod ctest-pod-12971566 is removed in agent 2024-09-11 09:45:00,905 - WARNING - Pod uuid 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is still seen in agent 10.0.0.27 VM list 2024-09-11 09:45:00,910 - DEBUG - VMI f54f6df2-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:45:00,910 - INFO - Verified that pod ctest-pod-66992918 is removed in agent 2024-09-11 09:45:01,538 - DEBUG - Pod 774d3d4c-cbcd-4a7e-aaf0-853599182b9f is not in agent 10.0.0.27 VM list 2024-09-11 09:45:01,546 - DEBUG - VMI f4d19fda-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:45:01,546 - INFO - Verified that pod ctest-pod-07514462 is removed in agent 2024-09-11 09:45:05,911 - DEBUG - Pod 0ed3dfc9-efd3-47c1-9aa9-56974deda4bd is not in agent 10.0.0.27 VM list 2024-09-11 09:45:05,915 - DEBUG - Pod 87ab56bd-f8c4-4d3a-a4dc-7b4844cde0a7 is not in agent 10.0.0.27 VM list 2024-09-11 09:45:05,924 - DEBUG - VMI f44a7c08-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:45:05,924 - INFO - Verified that pod ctest-pod-15468789 is removed in agent 2024-09-11 09:45:05,928 - DEBUG - VMI f3c7a210-7021-11ef-8987-fa163e103d53 is removed from agent 10.0.0.27 2024-09-11 09:45:05,928 - INFO - Verified that pod ctest-pod-20056534 is removed in agent 2024-09-11 09:45:05,928 - INFO - Deleting namespace ctest-non-default-69725342 2024-09-11 09:45:05,957 - DEBUG - Namespace ctest-non-default-69725342 still in k8s 2024-09-11 09:45:07,975 - DEBUG - Namespace ctest-non-default-69725342 still in k8s 2024-09-11 09:45:09,987 - DEBUG - Namespace ctest-non-default-69725342 still in k8s 2024-09-11 09:45:11,994 - DEBUG - Namespace ctest-non-default-69725342 is not in k8s 2024-09-11 09:45:11,994 - DEBUG - No need to check project deletion in contrail-api 2024-09-11 09:45:11,994 - INFO - Deleting namespace ctest-new-default-12071026 2024-09-11 09:45:12,005 - DEBUG - Namespace ctest-new-default-12071026 still in k8s 2024-09-11 09:45:14,017 - DEBUG - Namespace ctest-new-default-12071026 still in k8s 2024-09-11 09:45:16,027 - DEBUG - Namespace ctest-new-default-12071026 still in k8s 2024-09-11 09:45:18,031 - DEBUG - Namespace ctest-new-default-12071026 is not in k8s 2024-09-11 09:45:18,032 - DEBUG - No need to check project deletion in contrail-api