2024-11-06 18:43:07,409 - INFO - Using existing project ['default-domain', 'k8s-default'](59576c44-a686-4605-a04e-8e03e4e7e26f) 2024-11-06 18:43:07,431 - DEBUG - Namespace ctest-new-default-91467747 not present 2024-11-06 18:43:07,436 - INFO - Created namespace ctest-new-default-91467747 2024-11-06 18:43:10,440 - DEBUG - Namespace ctest-non-default-61266483 not present 2024-11-06 18:43:10,456 - INFO - Created namespace ctest-non-default-61266483 2024-11-06 18:43:13,477 - DEBUG - Pod ctest-pod-58828844 not present 2024-11-06 18:43:13,477 - INFO - Creating Pod ctest-pod-58828844 2024-11-06 18:43:13,498 - DEBUG - Pod : ctest-pod-58828844 UUID is 89603514-a599-4b06-9d4c-c3e05bec4a4e 2024-11-06 18:43:13,500 - DEBUG - Pod ctest-pod-35423047 not present 2024-11-06 18:43:13,500 - INFO - Creating Pod ctest-pod-35423047 2024-11-06 18:43:13,530 - DEBUG - Pod : ctest-pod-35423047 UUID is dc3301d6-fe6f-44b0-8a27-4ec52d9a2353 2024-11-06 18:43:13,537 - DEBUG - Pod ctest-pod-10373734 not present 2024-11-06 18:43:13,538 - INFO - Creating Pod ctest-pod-10373734 2024-11-06 18:43:13,565 - DEBUG - Pod : ctest-pod-10373734 UUID is 43811bfd-8585-424a-bbe6-6a7eaee59f89 2024-11-06 18:43:13,567 - DEBUG - Pod ctest-pod-18078012 not present 2024-11-06 18:43:13,567 - INFO - Creating Pod ctest-pod-18078012 2024-11-06 18:43:13,584 - DEBUG - Pod : ctest-pod-18078012 UUID is edb92c78-1626-4d19-8492-18dee8acf84b 2024-11-06 18:43:13,591 - DEBUG - Pod ctest-pod-80466368 not present 2024-11-06 18:43:13,591 - INFO - Creating Pod ctest-pod-80466368 2024-11-06 18:43:13,609 - DEBUG - Pod : ctest-pod-80466368 UUID is 6f5d1497-f7aa-4086-8429-2604d0af2518 2024-11-06 18:43:13,611 - DEBUG - Pod ctest-pod-89229506 not present 2024-11-06 18:43:13,611 - INFO - Creating Pod ctest-pod-89229506 2024-11-06 18:43:13,633 - DEBUG - Pod : ctest-pod-89229506 UUID is 733d4469-08ba-4a60-abe6-2af31ff685e6 2024-11-06 18:43:13,636 - DEBUG - Pod ctest-pod-36762820 not present 2024-11-06 18:43:13,636 - INFO - Creating Pod ctest-pod-36762820 2024-11-06 18:43:13,655 - DEBUG - Pod : ctest-pod-36762820 UUID is b311ae12-9f5c-475f-b8e7-0f8e2e190447 2024-11-06 18:43:13,657 - DEBUG - Pod ctest-pod-83026951 not present 2024-11-06 18:43:13,657 - INFO - Creating Pod ctest-pod-83026951 2024-11-06 18:43:13,677 - DEBUG - Pod : ctest-pod-83026951 UUID is 44500d55-5de9-458d-9b0f-3e1b1ab27ebb 2024-11-06 18:43:13,860 - INFO - Project default-domain:k8s-ctest-new-default-91467747 for Namespace ctest-new-default-91467747 is seen in contrail-api 2024-11-06 18:43:13,860 - DEBUG - Project uuid in Contrail is 093d0774-acfa-4500-a67f-6634c35cce22 2024-11-06 18:43:13,978 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NamespaceDatabaseList?namespace_uuid=1469da01-bc15-4549-93ec-15220e7a1fc6 2024-11-06 18:43:13,982 - INFO - Namespace ctest-new-default-91467747 with uuid 1469da01-bc15-4549-93ec-15220e7a1fc6 found in kube manager 2024-11-06 18:43:13,982 - INFO - Namespace ctest-new-default-91467747 verification passed 2024-11-06 18:43:14,261 - INFO - Project default-domain:k8s-ctest-non-default-61266483 for Namespace ctest-non-default-61266483 is seen in contrail-api 2024-11-06 18:43:14,261 - DEBUG - Project uuid in Contrail is 2802f166-1ad1-4d02-9f2b-86375e5c9f12 2024-11-06 18:43:14,261 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NamespaceDatabaseList?namespace_uuid=d7ad7462-6318-4413-943f-78a3ea745bb9 2024-11-06 18:43:14,265 - INFO - Namespace ctest-non-default-61266483 with uuid d7ad7462-6318-4413-943f-78a3ea745bb9 found in kube manager 2024-11-06 18:43:14,265 - INFO - Namespace ctest-non-default-61266483 verification passed 2024-11-06 18:43:14,272 - DEBUG - Pod ctest-pod-58828844 not in running state.Currently in Pending 2024-11-06 18:43:19,278 - DEBUG - Pod ctest-pod-58828844 not in running state.Currently in Pending 2024-11-06 18:43:24,285 - DEBUG - Pod ctest-pod-58828844 not in running state.Currently in Pending 2024-11-06 18:43:29,290 - INFO - Pod ctest-pod-58828844 is in running state.Got IP 10.47.255.251 2024-11-06 18:43:29,308 - DEBUG - Pod ctest-pod-58828844 has vmi fbae401e-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:29,308 - INFO - Verified pod ctest-pod-58828844 in contrail-api 2024-11-06 18:43:29,323 - DEBUG - VMI fbae401e-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:29,323 - INFO - Verified Pod ctest-pod-58828844 in agent 10.0.0.37 2024-11-06 18:43:29,323 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=89603514-a599-4b06-9d4c-c3e05bec4a4e 2024-11-06 18:43:29,328 - INFO - Pod ctest-pod-58828844 with uuid 89603514-a599-4b06-9d4c-c3e05bec4a4e found in kube manager 2024-11-06 18:43:29,328 - INFO - Pod ctest-pod-58828844 verification passed 2024-11-06 18:43:29,333 - INFO - Pod ctest-pod-35423047 is in running state.Got IP 10.47.255.250 2024-11-06 18:43:29,389 - DEBUG - Pod ctest-pod-35423047 has vmi fc240290-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:29,389 - INFO - Verified pod ctest-pod-35423047 in contrail-api 2024-11-06 18:43:29,403 - DEBUG - VMI fc240290-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:29,404 - INFO - Verified Pod ctest-pod-35423047 in agent 10.0.0.37 2024-11-06 18:43:29,404 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=dc3301d6-fe6f-44b0-8a27-4ec52d9a2353 2024-11-06 18:43:29,408 - INFO - Pod ctest-pod-35423047 with uuid dc3301d6-fe6f-44b0-8a27-4ec52d9a2353 found in kube manager 2024-11-06 18:43:29,408 - INFO - Pod ctest-pod-35423047 verification passed 2024-11-06 18:43:29,415 - INFO - Pod ctest-pod-10373734 is in running state.Got IP 10.47.255.249 2024-11-06 18:43:29,433 - DEBUG - Pod ctest-pod-10373734 has vmi fcd4841c-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:29,433 - INFO - Verified pod ctest-pod-10373734 in contrail-api 2024-11-06 18:43:29,447 - DEBUG - VMI fcd4841c-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:29,447 - INFO - Verified Pod ctest-pod-10373734 in agent 10.0.0.37 2024-11-06 18:43:29,447 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=43811bfd-8585-424a-bbe6-6a7eaee59f89 2024-11-06 18:43:29,451 - INFO - Pod ctest-pod-10373734 with uuid 43811bfd-8585-424a-bbe6-6a7eaee59f89 found in kube manager 2024-11-06 18:43:29,451 - INFO - Pod ctest-pod-10373734 verification passed 2024-11-06 18:43:29,457 - INFO - Pod ctest-pod-18078012 is in running state.Got IP 10.47.255.248 2024-11-06 18:43:29,518 - DEBUG - Pod ctest-pod-18078012 has vmi fd53805a-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:29,518 - INFO - Verified pod ctest-pod-18078012 in contrail-api 2024-11-06 18:43:29,534 - DEBUG - VMI fd53805a-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:29,534 - INFO - Verified Pod ctest-pod-18078012 in agent 10.0.0.37 2024-11-06 18:43:29,534 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=edb92c78-1626-4d19-8492-18dee8acf84b 2024-11-06 18:43:29,539 - INFO - Pod ctest-pod-18078012 with uuid edb92c78-1626-4d19-8492-18dee8acf84b found in kube manager 2024-11-06 18:43:29,540 - INFO - Pod ctest-pod-18078012 verification passed 2024-11-06 18:43:29,545 - DEBUG - Pod ctest-pod-80466368 not in running state.Currently in Pending 2024-11-06 18:43:34,552 - INFO - Pod ctest-pod-80466368 is in running state.Got IP 10.47.255.247 2024-11-06 18:43:34,576 - DEBUG - Pod ctest-pod-80466368 has vmi fde9bb4c-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:34,576 - INFO - Verified pod ctest-pod-80466368 in contrail-api 2024-11-06 18:43:34,590 - DEBUG - VMI fde9bb4c-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:34,590 - INFO - Verified Pod ctest-pod-80466368 in agent 10.0.0.37 2024-11-06 18:43:34,590 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=6f5d1497-f7aa-4086-8429-2604d0af2518 2024-11-06 18:43:34,595 - INFO - Pod ctest-pod-80466368 with uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 found in kube manager 2024-11-06 18:43:34,595 - INFO - Pod ctest-pod-80466368 verification passed 2024-11-06 18:43:34,601 - INFO - Pod ctest-pod-36762820 is in running state.Got IP 10.47.255.245 2024-11-06 18:43:34,664 - DEBUG - Pod ctest-pod-36762820 has vmi fee0b2e4-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:34,664 - INFO - Verified pod ctest-pod-36762820 in contrail-api 2024-11-06 18:43:34,683 - DEBUG - VMI fee0b2e4-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:34,683 - INFO - Verified Pod ctest-pod-36762820 in agent 10.0.0.37 2024-11-06 18:43:34,683 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=b311ae12-9f5c-475f-b8e7-0f8e2e190447 2024-11-06 18:43:34,688 - INFO - Pod ctest-pod-36762820 with uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 found in kube manager 2024-11-06 18:43:34,689 - INFO - Pod ctest-pod-36762820 verification passed 2024-11-06 18:43:34,694 - INFO - Pod ctest-pod-89229506 is in running state.Got IP 10.47.255.246 2024-11-06 18:43:34,753 - DEBUG - Pod ctest-pod-89229506 has vmi fe664144-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:34,753 - INFO - Verified pod ctest-pod-89229506 in contrail-api 2024-11-06 18:43:34,766 - DEBUG - VMI fe664144-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:34,767 - INFO - Verified Pod ctest-pod-89229506 in agent 10.0.0.37 2024-11-06 18:43:34,767 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=733d4469-08ba-4a60-abe6-2af31ff685e6 2024-11-06 18:43:34,772 - INFO - Pod ctest-pod-89229506 with uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 found in kube manager 2024-11-06 18:43:34,772 - INFO - Pod ctest-pod-89229506 verification passed 2024-11-06 18:43:34,777 - INFO - Pod ctest-pod-83026951 is in running state.Got IP 10.47.255.244 2024-11-06 18:43:34,795 - DEBUG - Pod ctest-pod-83026951 has vmi ff608b72-9c6e-11ef-abfe-fa163e60f13f 2024-11-06 18:43:34,795 - INFO - Verified pod ctest-pod-83026951 in contrail-api 2024-11-06 18:43:34,808 - DEBUG - VMI ff608b72-9c6e-11ef-abfe-fa163e60f13f is active in agent 10.0.0.37 2024-11-06 18:43:34,808 - INFO - Verified Pod ctest-pod-83026951 in agent 10.0.0.37 2024-11-06 18:43:34,808 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=44500d55-5de9-458d-9b0f-3e1b1ab27ebb 2024-11-06 18:43:34,812 - INFO - Pod ctest-pod-83026951 with uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb found in kube manager 2024-11-06 18:43:34,812 - INFO - Pod ctest-pod-83026951 verification passed 2024-11-06 18:43:34,812 - INFO - ================================================================================ 2024-11-06 18:43:34,812 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-06 18:43:34,813 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-06 18:43:35,042 - DEBUG - Nothing to compare xmpp stats {'10.0.0.37': {'10.0.0.36': '0'}} with 2024-11-06 18:43:35,042 - INFO - Initial checks done. Running the testcase now 2024-11-06 18:43:35,043 - INFO - 2024-11-06 18:43:35,112 - DEBUG - [Pod ctest-pod-58828844] Cmd: echo ctest-pod-58828844 > /usr/share/nginx/html/index.html, Output: 2024-11-06 18:43:35,167 - DEBUG - [Pod ctest-pod-35423047] Cmd: echo ctest-pod-35423047 > /usr/share/nginx/html/index.html, Output: 2024-11-06 18:43:35,223 - DEBUG - [Pod ctest-pod-10373734] Cmd: echo ctest-pod-10373734 > /usr/share/nginx/html/index.html, Output: 2024-11-06 18:43:35,276 - DEBUG - [Pod ctest-pod-18078012] Cmd: echo ctest-pod-18078012 > /usr/share/nginx/html/index.html, Output: 2024-11-06 18:43:35,279 - DEBUG - Service ctest-nginx-svc-90334740 not present 2024-11-06 18:43:35,279 - INFO - Creating service ctest-nginx-svc-90334740 2024-11-06 18:43:35,289 - INFO - Created Service ctest-nginx-svc-90334740 2024-11-06 18:43:35,300 - WARNING - Service UUID bfe728d1-110b-4d14-b144-4757f63b1784 not yet found in contrail-api 2024-11-06 18:43:36,316 - INFO - Validated that Service ctest-nginx-svc-90334740 is seen in contrail-api 2024-11-06 18:43:36,316 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_LoadbalancerDatabaseList?x=bfe728d1-110b-4d14-b144-4757f63b1784 2024-11-06 18:43:36,321 - INFO - Service ctest-nginx-svc-90334740 with uuid bfe728d1-110b-4d14-b144-4757f63b1784 found in kube manager 2024-11-06 18:43:36,321 - INFO - Service ctest-nginx-svc-90334740 verification passed 2024-11-06 18:43:37,384 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58828844 2024-11-06 18:43:37,385 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,385 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58828844 2024-11-06 18:43:37,444 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35423047 2024-11-06 18:43:37,444 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,444 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35423047 2024-11-06 18:43:37,444 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58828844': 1, 'ctest-pod-35423047': 1} 2024-11-06 18:43:37,522 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,522 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,522 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,594 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58828844 2024-11-06 18:43:37,594 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,594 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58828844 2024-11-06 18:43:37,660 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,660 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,660 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,723 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,723 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,723 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,790 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-35423047 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,790 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:43:37,790 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: ctest-pod-35423047 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:43:37,790 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58828844': 4, 'ctest-pod-35423047': 1} 2024-11-06 18:43:37,794 - DEBUG - Network policy ingress-on-service not present 2024-11-06 18:43:37,794 - INFO - Creating Network Policy ingress-on-service 2024-11-06 18:43:37,803 - INFO - Network policy found in k8s 2024-11-06 18:43:37,804 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0ff28c55-36fb-4852-aacd-0589c87c260c 2024-11-06 18:43:37,809 - INFO - Network Policy ingress-on-service with uuid 0ff28c55-36fb-4852-aacd-0589c87c260c found in kube manager 2024-11-06 18:43:37,861 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-06 18:43:37,861 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-06 18:43:37,861 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0ff28c55-36fb-4852-aacd-0589c87c260c 2024-11-06 18:43:37,894 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-06 18:43:39,895 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0ff28c55-36fb-4852-aacd-0589c87c260c 2024-11-06 18:43:39,929 - INFO - Network policy with name ingress-on-service found in agent 2024-11-06 18:43:39,930 - INFO - Network Policy ingress-on-service verification passed 2024-11-06 18:43:44,990 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:44,990 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:44,990 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:50,049 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:50,049 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:50,049 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:55,108 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:55,109 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:43:55,109 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:00,172 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:00,172 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:00,172 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:05,234 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:05,234 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:05,234 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:10,296 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:10,296 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:10,296 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:15,354 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:15,354 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:15,354 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:20,418 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:20,418 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:20,418 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:25,478 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:25,478 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:25,478 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:30,554 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:30,554 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:30,554 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:30,554 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58828844': 0, 'ctest-pod-35423047': 0} 2024-11-06 18:44:30,615 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35423047 2024-11-06 18:44:30,615 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:44:30,615 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35423047 2024-11-06 18:44:30,673 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:44:30,673 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:44:30,673 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:44:30,673 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58828844': 1, 'ctest-pod-35423047': 1} 2024-11-06 18:44:35,734 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:35,734 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:35,734 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:40,789 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:40,789 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:40,789 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:45,849 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:45,850 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:45,850 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:50,910 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:50,910 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:50,910 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:55,992 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:55,993 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:44:55,993 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:01,058 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:01,058 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:01,059 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:06,117 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:06,117 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:06,117 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:11,166 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:11,166 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:11,166 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:16,225 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:16,225 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:16,225 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:21,278 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:21,278 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:21,278 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:21,278 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58828844': 0, 'ctest-pod-35423047': 0} 2024-11-06 18:45:23,333 - DEBUG - [Pod ctest-pod-89229506] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.805 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.326/0.805 ms 2024-11-06 18:45:23,334 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-89229506 with expectation True passed 2024-11-06 18:45:25,401 - DEBUG - [Pod ctest-pod-80466368] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.487 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.215/0.487 ms 2024-11-06 18:45:25,401 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80466368 with expectation True passed 2024-11-06 18:45:27,453 - DEBUG - [Pod ctest-pod-36762820] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.355 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.166/0.355 ms 2024-11-06 18:45:27,453 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36762820 with expectation True passed 2024-11-06 18:45:27,533 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:45:27,533 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-06 18:45:27,533 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:45:27,534 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89229506 passed 2024-11-06 18:45:27,603 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:45:27,603 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-06 18:45:27,604 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:45:27,604 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89229506 passed 2024-11-06 18:45:32,665 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-06 18:45:32,665 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-06 18:45:32,665 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-06 18:45:32,665 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80466368 passed 2024-11-06 18:45:37,719 - DEBUG - [Pod ctest-pod-83026951] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-06 18:45:37,719 - DEBUG - [Pod Pod ctest-pod-83026951] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-06 18:45:37,719 - DEBUG - [Pod Pod ctest-pod-83026951] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-06 18:45:37,719 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83026951 passed 2024-11-06 18:45:37,727 - INFO - Updating Network Policy ingress-on-service 2024-11-06 18:45:42,805 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:42,823 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:42,823 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:47,882 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:47,883 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:47,883 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:52,933 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:52,934 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:52,934 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:58,002 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:58,002 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:45:58,002 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:03,074 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:03,074 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:03,074 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:08,145 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:08,145 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:08,145 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:13,217 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:13,217 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:13,217 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:18,280 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:18,280 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:18,280 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:23,338 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:23,338 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:23,338 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:28,394 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:28,394 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:28,394 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) wget: download timed out 2024-11-06 18:46:28,394 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58828844': 0, 'ctest-pod-35423047': 0} 2024-11-06 18:46:28,475 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58828844 2024-11-06 18:46:28,475 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:46:28,475 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58828844 2024-11-06 18:46:28,565 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-35423047 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:46:28,565 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:46:28,565 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: ctest-pod-35423047 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:46:28,565 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58828844': 1, 'ctest-pod-35423047': 1} 2024-11-06 18:46:28,629 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:46:28,630 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:46:28,630 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:46:28,691 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:46:28,691 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:46:28,691 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: ctest-pod-58828844 Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-06 18:46:28,745 - DEBUG - [Pod ctest-pod-36762820] Cmd: wget http://10.110.194.80:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35423047 2024-11-06 18:46:28,746 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd wget http://10.110.194.80:80/ -O - -T 5 -t 1 passed 2024-11-06 18:46:28,746 - DEBUG - [Pod Pod ctest-pod-36762820] Cmd output: Connecting to 10.110.194.80:80 (10.110.194.80:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35423047 2024-11-06 18:46:28,746 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58828844': 2, 'ctest-pod-35423047': 1} 2024-11-06 18:46:30,797 - DEBUG - [Pod ctest-pod-89229506] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.664 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.269/0.664 ms 2024-11-06 18:46:30,797 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-89229506 with expectation True passed 2024-11-06 18:46:32,859 - DEBUG - [Pod ctest-pod-80466368] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.630 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.266/0.630 ms 2024-11-06 18:46:32,859 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80466368 with expectation True passed 2024-11-06 18:46:34,905 - DEBUG - [Pod ctest-pod-36762820] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.252 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.470/1.252 ms 2024-11-06 18:46:34,906 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36762820 with expectation True passed 2024-11-06 18:46:34,958 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:46:34,958 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-06 18:46:34,958 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:46:34,958 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89229506 passed 2024-11-06 18:46:35,023 - DEBUG - [Pod ctest-pod-89229506] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:46:35,023 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-06 18:46:35,023 - DEBUG - [Pod Pod ctest-pod-89229506] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:46:35,023 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89229506 passed 2024-11-06 18:46:40,080 - DEBUG - [Pod ctest-pod-80466368] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-06 18:46:40,080 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-06 18:46:40,080 - DEBUG - [Pod Pod ctest-pod-80466368] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-06 18:46:40,080 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80466368 passed 2024-11-06 18:46:40,144 - DEBUG - [Pod ctest-pod-83026951] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:46:40,144 - DEBUG - [Pod Pod ctest-pod-83026951] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-06 18:46:40,144 - DEBUG - [Pod Pod ctest-pod-83026951] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-06 18:46:40,144 - INFO - wget check of of http://10.47.255.251 from ctest-pod-83026951 passed 2024-11-06 18:46:40,144 - INFO - Deleting Network Policy : ingress-on-service 2024-11-06 18:46:40,144 - INFO - Deleting service : ctest-nginx-svc-90334740 2024-11-06 18:46:40,405 - DEBUG - No XMPP flaps were noticed during the test 2024-11-06 18:46:40,405 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-11-06 18:46:40,405 - INFO - -------------------------------------------------------------------------------- 2024-11-06 18:46:40,410 - INFO - Deleting pod ctest-new-default-91467747:ctest-pod-58828844 2024-11-06 18:46:40,411 - INFO - Deleting pod ctest-new-default-91467747:ctest-pod-35423047 2024-11-06 18:46:40,411 - INFO - Deleting pod ctest-non-default-61266483:ctest-pod-10373734 2024-11-06 18:46:40,412 - INFO - Deleting pod ctest-non-default-61266483:ctest-pod-18078012 2024-11-06 18:46:40,412 - INFO - Deleting pod ctest-new-default-91467747:ctest-pod-80466368 2024-11-06 18:46:40,412 - INFO - Deleting pod ctest-new-default-91467747:ctest-pod-89229506 2024-11-06 18:46:40,413 - INFO - Deleting pod ctest-non-default-61266483:ctest-pod-36762820 2024-11-06 18:46:40,413 - INFO - Deleting pod ctest-non-default-61266483:ctest-pod-83026951 2024-11-06 18:46:40,459 - WARNING - Pod uuid 89603514-a599-4b06-9d4c-c3e05bec4a4e is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,626 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,627 - WARNING - Pod uuid dc3301d6-fe6f-44b0-8a27-4ec52d9a2353 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,629 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,630 - WARNING - Pod uuid 43811bfd-8585-424a-bbe6-6a7eaee59f89 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,630 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,631 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:40,631 - WARNING - Pod uuid edb92c78-1626-4d19-8492-18dee8acf84b is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:45,467 - DEBUG - Pod 89603514-a599-4b06-9d4c-c3e05bec4a4e is not in agent 10.0.0.37 VM list 2024-11-06 18:46:45,473 - DEBUG - VMI fbae401e-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:46:45,473 - INFO - Verified that pod ctest-pod-58828844 is removed in agent 2024-11-06 18:46:45,661 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:45,664 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:45,665 - DEBUG - Pod edb92c78-1626-4d19-8492-18dee8acf84b is not in agent 10.0.0.37 VM list 2024-11-06 18:46:45,666 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:45,666 - DEBUG - Pod dc3301d6-fe6f-44b0-8a27-4ec52d9a2353 is not in agent 10.0.0.37 VM list 2024-11-06 18:46:45,668 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:45,668 - DEBUG - Pod 43811bfd-8585-424a-bbe6-6a7eaee59f89 is not in agent 10.0.0.37 VM list 2024-11-06 18:46:45,682 - DEBUG - VMI fc240290-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:46:45,682 - INFO - Verified that pod ctest-pod-35423047 is removed in agent 2024-11-06 18:46:45,682 - DEBUG - VMI fcd4841c-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:46:45,682 - INFO - Verified that pod ctest-pod-10373734 is removed in agent 2024-11-06 18:46:45,683 - DEBUG - VMI fd53805a-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:46:45,683 - INFO - Verified that pod ctest-pod-18078012 is removed in agent 2024-11-06 18:46:50,673 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:50,684 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:50,687 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:50,688 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:55,680 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:55,692 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:55,698 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:46:55,699 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:00,689 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:00,697 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:00,742 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:00,745 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:05,696 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:05,704 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:05,757 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:05,758 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:10,764 - WARNING - Pod uuid 733d4469-08ba-4a60-abe6-2af31ff685e6 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:10,769 - WARNING - Pod uuid 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:10,770 - WARNING - Pod uuid b311ae12-9f5c-475f-b8e7-0f8e2e190447 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:10,771 - WARNING - Pod uuid 6f5d1497-f7aa-4086-8429-2604d0af2518 is still seen in agent 10.0.0.37 VM list 2024-11-06 18:47:15,775 - DEBUG - Pod 733d4469-08ba-4a60-abe6-2af31ff685e6 is not in agent 10.0.0.37 VM list 2024-11-06 18:47:15,787 - DEBUG - Pod 6f5d1497-f7aa-4086-8429-2604d0af2518 is not in agent 10.0.0.37 VM list 2024-11-06 18:47:15,790 - DEBUG - VMI fe664144-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:47:15,790 - INFO - Verified that pod ctest-pod-89229506 is removed in agent 2024-11-06 18:47:15,790 - DEBUG - Pod 44500d55-5de9-458d-9b0f-3e1b1ab27ebb is not in agent 10.0.0.37 VM list 2024-11-06 18:47:15,792 - DEBUG - Pod b311ae12-9f5c-475f-b8e7-0f8e2e190447 is not in agent 10.0.0.37 VM list 2024-11-06 18:47:15,801 - DEBUG - VMI fde9bb4c-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:47:15,801 - INFO - Verified that pod ctest-pod-80466368 is removed in agent 2024-11-06 18:47:15,803 - DEBUG - VMI ff608b72-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:47:15,803 - INFO - Verified that pod ctest-pod-83026951 is removed in agent 2024-11-06 18:47:15,803 - DEBUG - VMI fee0b2e4-9c6e-11ef-abfe-fa163e60f13f is removed from agent 10.0.0.37 2024-11-06 18:47:15,803 - INFO - Verified that pod ctest-pod-36762820 is removed in agent 2024-11-06 18:47:15,803 - INFO - Deleting namespace ctest-non-default-61266483 2024-11-06 18:47:15,820 - DEBUG - Namespace ctest-non-default-61266483 still in k8s 2024-11-06 18:47:17,824 - DEBUG - Namespace ctest-non-default-61266483 still in k8s 2024-11-06 18:47:19,828 - DEBUG - Namespace ctest-non-default-61266483 still in k8s 2024-11-06 18:47:21,833 - DEBUG - Namespace ctest-non-default-61266483 is not in k8s 2024-11-06 18:47:21,833 - DEBUG - No need to check project deletion in contrail-api 2024-11-06 18:47:21,833 - INFO - Deleting namespace ctest-new-default-91467747 2024-11-06 18:47:21,847 - DEBUG - Namespace ctest-new-default-91467747 still in k8s 2024-11-06 18:47:23,852 - DEBUG - Namespace ctest-new-default-91467747 still in k8s 2024-11-06 18:47:25,857 - DEBUG - Namespace ctest-new-default-91467747 still in k8s 2024-11-06 18:47:27,860 - DEBUG - Namespace ctest-new-default-91467747 is not in k8s 2024-11-06 18:47:27,860 - DEBUG - No need to check project deletion in contrail-api