2024-08-23 16:48:48,149 - INFO - Using existing project ['default-domain', 'k8s-default'](825c1af2-a299-471c-bfb2-3938be8e9b0d) 2024-08-23 16:48:48,173 - DEBUG - Namespace ctest-new-default-17961697 not present 2024-08-23 16:48:48,183 - INFO - Created namespace ctest-new-default-17961697 2024-08-23 16:48:51,188 - DEBUG - Namespace ctest-non-default-75388530 not present 2024-08-23 16:48:51,200 - INFO - Created namespace ctest-non-default-75388530 2024-08-23 16:48:54,217 - DEBUG - Pod ctest-pod-72078199 not present 2024-08-23 16:48:54,217 - INFO - Creating Pod ctest-pod-72078199 2024-08-23 16:48:54,247 - DEBUG - Pod : ctest-pod-72078199 UUID is dc7816f7-8ed8-44af-817d-acf148892662 2024-08-23 16:48:54,250 - DEBUG - Pod ctest-pod-20417257 not present 2024-08-23 16:48:54,250 - INFO - Creating Pod ctest-pod-20417257 2024-08-23 16:48:54,277 - DEBUG - Pod : ctest-pod-20417257 UUID is b825f0cd-734e-478f-9d61-b6e974d5d373 2024-08-23 16:48:54,281 - DEBUG - Pod ctest-pod-52370776 not present 2024-08-23 16:48:54,281 - INFO - Creating Pod ctest-pod-52370776 2024-08-23 16:48:54,309 - DEBUG - Pod : ctest-pod-52370776 UUID is 969c0e7a-b31c-4785-8819-36ab737cfe64 2024-08-23 16:48:54,313 - DEBUG - Pod ctest-pod-61259240 not present 2024-08-23 16:48:54,313 - INFO - Creating Pod ctest-pod-61259240 2024-08-23 16:48:54,338 - DEBUG - Pod : ctest-pod-61259240 UUID is d0257ee5-e173-4ff0-a079-09df67fa8eb1 2024-08-23 16:48:54,341 - DEBUG - Pod ctest-pod-66831321 not present 2024-08-23 16:48:54,341 - INFO - Creating Pod ctest-pod-66831321 2024-08-23 16:48:54,361 - DEBUG - Pod : ctest-pod-66831321 UUID is d5536cb3-5a24-484d-ad5c-ea2fd77a205c 2024-08-23 16:48:54,364 - DEBUG - Pod ctest-pod-51347534 not present 2024-08-23 16:48:54,364 - INFO - Creating Pod ctest-pod-51347534 2024-08-23 16:48:54,387 - DEBUG - Pod : ctest-pod-51347534 UUID is 5981c5bd-a1de-478e-b895-7bd1638eba39 2024-08-23 16:48:54,390 - DEBUG - Pod ctest-pod-14518409 not present 2024-08-23 16:48:54,390 - INFO - Creating Pod ctest-pod-14518409 2024-08-23 16:48:54,407 - DEBUG - Pod : ctest-pod-14518409 UUID is 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 2024-08-23 16:48:54,411 - DEBUG - Pod ctest-pod-79804076 not present 2024-08-23 16:48:54,412 - INFO - Creating Pod ctest-pod-79804076 2024-08-23 16:48:54,436 - DEBUG - Pod : ctest-pod-79804076 UUID is 9770b3a0-266a-444a-97b4-0569ad3f5d01 2024-08-23 16:48:54,745 - INFO - Project default-domain:k8s-ctest-new-default-17961697 for Namespace ctest-new-default-17961697 is seen in contrail-api 2024-08-23 16:48:54,745 - DEBUG - Project uuid in Contrail is 281d2888-c40f-4afd-b89b-e508dc88b991 2024-08-23 16:48:54,963 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=3e1c71bb-e8f5-4821-86a2-9842a5ee6afc 2024-08-23 16:48:54,968 - INFO - Namespace ctest-new-default-17961697 with uuid 3e1c71bb-e8f5-4821-86a2-9842a5ee6afc found in kube manager 2024-08-23 16:48:54,968 - INFO - Namespace ctest-new-default-17961697 verification passed 2024-08-23 16:48:55,243 - INFO - Project default-domain:k8s-ctest-non-default-75388530 for Namespace ctest-non-default-75388530 is seen in contrail-api 2024-08-23 16:48:55,244 - DEBUG - Project uuid in Contrail is 500bacd8-df57-47ea-a70c-e9d45a2f0597 2024-08-23 16:48:55,244 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=c41bf45b-78a3-4701-a57e-fe7bb7738839 2024-08-23 16:48:55,248 - INFO - Namespace ctest-non-default-75388530 with uuid c41bf45b-78a3-4701-a57e-fe7bb7738839 found in kube manager 2024-08-23 16:48:55,248 - INFO - Namespace ctest-non-default-75388530 verification passed 2024-08-23 16:48:55,254 - DEBUG - Pod ctest-pod-72078199 not in running state.Currently in Pending 2024-08-23 16:49:00,261 - DEBUG - Pod ctest-pod-72078199 not in running state.Currently in Pending 2024-08-23 16:49:05,267 - DEBUG - Pod ctest-pod-72078199 not in running state.Currently in Pending 2024-08-23 16:49:10,274 - INFO - Pod ctest-pod-72078199 is in running state.Got IP 10.47.255.248 2024-08-23 16:49:10,326 - DEBUG - Pod ctest-pod-72078199 has vmi 96bb8246-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:10,326 - INFO - Verified pod ctest-pod-72078199 in contrail-api 2024-08-23 16:49:10,338 - DEBUG - VMI 96bb8246-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:10,338 - INFO - Verified Pod ctest-pod-72078199 in agent 10.0.0.37 2024-08-23 16:49:10,338 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=dc7816f7-8ed8-44af-817d-acf148892662 2024-08-23 16:49:10,343 - INFO - Pod ctest-pod-72078199 with uuid dc7816f7-8ed8-44af-817d-acf148892662 found in kube manager 2024-08-23 16:49:10,343 - INFO - Pod ctest-pod-72078199 verification passed 2024-08-23 16:49:10,349 - INFO - Pod ctest-pod-20417257 is in running state.Got IP 10.47.255.247 2024-08-23 16:49:10,440 - DEBUG - Pod ctest-pod-20417257 has vmi 976a1e46-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:10,440 - INFO - Verified pod ctest-pod-20417257 in contrail-api 2024-08-23 16:49:10,451 - DEBUG - VMI 976a1e46-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:10,451 - INFO - Verified Pod ctest-pod-20417257 in agent 10.0.0.37 2024-08-23 16:49:10,451 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=b825f0cd-734e-478f-9d61-b6e974d5d373 2024-08-23 16:49:10,456 - INFO - Pod ctest-pod-20417257 with uuid b825f0cd-734e-478f-9d61-b6e974d5d373 found in kube manager 2024-08-23 16:49:10,456 - INFO - Pod ctest-pod-20417257 verification passed 2024-08-23 16:49:10,462 - DEBUG - Pod ctest-pod-52370776 not in running state.Currently in Pending 2024-08-23 16:49:15,469 - INFO - Pod ctest-pod-52370776 is in running state.Got IP 10.47.255.246 2024-08-23 16:49:15,519 - DEBUG - Pod ctest-pod-52370776 has vmi 985a7ad0-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:15,519 - INFO - Verified pod ctest-pod-52370776 in contrail-api 2024-08-23 16:49:15,531 - DEBUG - VMI 985a7ad0-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:15,532 - INFO - Verified Pod ctest-pod-52370776 in agent 10.0.0.37 2024-08-23 16:49:15,532 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=969c0e7a-b31c-4785-8819-36ab737cfe64 2024-08-23 16:49:15,537 - INFO - Pod ctest-pod-52370776 with uuid 969c0e7a-b31c-4785-8819-36ab737cfe64 found in kube manager 2024-08-23 16:49:15,537 - INFO - Pod ctest-pod-52370776 verification passed 2024-08-23 16:49:15,544 - INFO - Pod ctest-pod-61259240 is in running state.Got IP 10.47.255.245 2024-08-23 16:49:15,636 - DEBUG - Pod ctest-pod-61259240 has vmi 990eeac4-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:15,636 - INFO - Verified pod ctest-pod-61259240 in contrail-api 2024-08-23 16:49:15,650 - DEBUG - VMI 990eeac4-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:15,650 - INFO - Verified Pod ctest-pod-61259240 in agent 10.0.0.37 2024-08-23 16:49:15,650 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=d0257ee5-e173-4ff0-a079-09df67fa8eb1 2024-08-23 16:49:15,655 - INFO - Pod ctest-pod-61259240 with uuid d0257ee5-e173-4ff0-a079-09df67fa8eb1 found in kube manager 2024-08-23 16:49:15,655 - INFO - Pod ctest-pod-61259240 verification passed 2024-08-23 16:49:15,661 - INFO - Pod ctest-pod-66831321 is in running state.Got IP 10.47.255.244 2024-08-23 16:49:15,752 - DEBUG - Pod ctest-pod-66831321 has vmi 99e603d8-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:15,752 - INFO - Verified pod ctest-pod-66831321 in contrail-api 2024-08-23 16:49:15,772 - DEBUG - VMI 99e603d8-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:15,772 - INFO - Verified Pod ctest-pod-66831321 in agent 10.0.0.37 2024-08-23 16:49:15,772 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=d5536cb3-5a24-484d-ad5c-ea2fd77a205c 2024-08-23 16:49:15,779 - INFO - Pod ctest-pod-66831321 with uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c found in kube manager 2024-08-23 16:49:15,779 - INFO - Pod ctest-pod-66831321 verification passed 2024-08-23 16:49:15,785 - DEBUG - Pod ctest-pod-14518409 not in running state.Currently in Pending 2024-08-23 16:49:20,793 - INFO - Pod ctest-pod-14518409 is in running state.Got IP 10.47.255.242 2024-08-23 16:49:20,848 - DEBUG - Pod ctest-pod-14518409 has vmi 9b3640c2-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:20,848 - INFO - Verified pod ctest-pod-14518409 in contrail-api 2024-08-23 16:49:20,864 - DEBUG - VMI 9b3640c2-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:20,865 - INFO - Verified Pod ctest-pod-14518409 in agent 10.0.0.37 2024-08-23 16:49:20,865 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 2024-08-23 16:49:20,871 - INFO - Pod ctest-pod-14518409 with uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 found in kube manager 2024-08-23 16:49:20,871 - INFO - Pod ctest-pod-14518409 verification passed 2024-08-23 16:49:20,878 - INFO - Pod ctest-pod-51347534 is in running state.Got IP 10.47.255.243 2024-08-23 16:49:20,969 - DEBUG - Pod ctest-pod-51347534 has vmi 9a905e6e-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:20,969 - INFO - Verified pod ctest-pod-51347534 in contrail-api 2024-08-23 16:49:20,981 - DEBUG - VMI 9a905e6e-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:20,981 - INFO - Verified Pod ctest-pod-51347534 in agent 10.0.0.37 2024-08-23 16:49:20,982 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=5981c5bd-a1de-478e-b895-7bd1638eba39 2024-08-23 16:49:20,986 - INFO - Pod ctest-pod-51347534 with uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 found in kube manager 2024-08-23 16:49:20,986 - INFO - Pod ctest-pod-51347534 verification passed 2024-08-23 16:49:20,992 - INFO - Pod ctest-pod-79804076 is in running state.Got IP 10.47.255.241 2024-08-23 16:49:21,083 - DEBUG - Pod ctest-pod-79804076 has vmi 9bdf67ec-616f-11ef-93d8-fa163e943289 2024-08-23 16:49:21,083 - INFO - Verified pod ctest-pod-79804076 in contrail-api 2024-08-23 16:49:21,095 - DEBUG - VMI 9bdf67ec-616f-11ef-93d8-fa163e943289 is active in agent 10.0.0.37 2024-08-23 16:49:21,095 - INFO - Verified Pod ctest-pod-79804076 in agent 10.0.0.37 2024-08-23 16:49:21,095 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=9770b3a0-266a-444a-97b4-0569ad3f5d01 2024-08-23 16:49:21,099 - INFO - Pod ctest-pod-79804076 with uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 found in kube manager 2024-08-23 16:49:21,099 - INFO - Pod ctest-pod-79804076 verification passed 2024-08-23 16:49:21,099 - INFO - ================================================================================ 2024-08-23 16:49:21,100 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-23 16:49:21,100 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-23 16:49:21,337 - DEBUG - Nothing to compare xmpp stats {'10.0.0.37': {'10.0.0.37': '0'}} with 2024-08-23 16:49:21,337 - INFO - Initial checks done. Running the testcase now 2024-08-23 16:49:21,337 - INFO - 2024-08-23 16:49:21,383 - DEBUG - [Pod ctest-pod-72078199] Cmd: echo ctest-pod-72078199 > /usr/share/nginx/html/index.html, Output: 2024-08-23 16:49:21,425 - DEBUG - [Pod ctest-pod-20417257] Cmd: echo ctest-pod-20417257 > /usr/share/nginx/html/index.html, Output: 2024-08-23 16:49:21,472 - DEBUG - [Pod ctest-pod-52370776] Cmd: echo ctest-pod-52370776 > /usr/share/nginx/html/index.html, Output: 2024-08-23 16:49:21,518 - DEBUG - [Pod ctest-pod-61259240] Cmd: echo ctest-pod-61259240 > /usr/share/nginx/html/index.html, Output: 2024-08-23 16:49:21,522 - DEBUG - Service ctest-nginx-svc-39792509 not present 2024-08-23 16:49:21,522 - INFO - Creating service ctest-nginx-svc-39792509 2024-08-23 16:49:21,535 - INFO - Created Service ctest-nginx-svc-39792509 2024-08-23 16:49:21,546 - WARNING - Service UUID 18010edf-3c64-481b-94fe-98adc88a66fe not yet found in contrail-api 2024-08-23 16:49:22,552 - INFO - Validated that Service ctest-nginx-svc-39792509 is seen in contrail-api 2024-08-23 16:49:22,552 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_LoadbalancerDatabaseList?x=18010edf-3c64-481b-94fe-98adc88a66fe 2024-08-23 16:49:22,556 - INFO - Service ctest-nginx-svc-39792509 with uuid 18010edf-3c64-481b-94fe-98adc88a66fe found in kube manager 2024-08-23 16:49:22,556 - INFO - Service ctest-nginx-svc-39792509 verification passed 2024-08-23 16:49:23,608 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-20417257 2024-08-23 16:49:23,608 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,608 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-20417257 2024-08-23 16:49:23,666 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-20417257 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:49:23,666 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,666 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-20417257 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:49:23,732 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-20417257 2024-08-23 16:49:23,733 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,733 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-20417257 2024-08-23 16:49:23,774 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:49:23,774 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,774 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:49:23,774 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72078199': 1, 'ctest-pod-20417257': 3} 2024-08-23 16:49:23,817 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-20417257 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:49:23,817 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,817 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-20417257 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:49:23,861 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-20417257 2024-08-23 16:49:23,861 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,861 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-20417257 2024-08-23 16:49:23,910 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:49:23,910 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:49:23,911 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:49:23,911 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72078199': 1, 'ctest-pod-20417257': 2} 2024-08-23 16:49:23,916 - DEBUG - Network policy ingress-on-service not present 2024-08-23 16:49:23,916 - INFO - Creating Network Policy ingress-on-service 2024-08-23 16:49:23,930 - INFO - Network policy found in k8s 2024-08-23 16:49:23,930 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3e0bba78-fdd4-4263-a96d-84622c8f4a9b 2024-08-23 16:49:23,935 - INFO - Network Policy ingress-on-service with uuid 3e0bba78-fdd4-4263-a96d-84622c8f4a9b found in kube manager 2024-08-23 16:49:23,963 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-23 16:49:23,963 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-23 16:49:23,963 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3e0bba78-fdd4-4263-a96d-84622c8f4a9b 2024-08-23 16:49:23,990 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-23 16:49:25,992 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3e0bba78-fdd4-4263-a96d-84622c8f4a9b 2024-08-23 16:49:26,036 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-23 16:49:28,037 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3e0bba78-fdd4-4263-a96d-84622c8f4a9b 2024-08-23 16:49:28,065 - INFO - Network policy with name ingress-on-service found in agent 2024-08-23 16:49:28,065 - INFO - Network Policy ingress-on-service verification passed 2024-08-23 16:49:33,110 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:33,111 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:33,111 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:38,159 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:38,160 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:38,160 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:43,208 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:43,208 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:43,208 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:48,252 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:48,252 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:48,252 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:53,304 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:53,304 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:53,304 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:58,350 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:58,350 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:49:58,350 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:03,406 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:03,406 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:03,406 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:08,458 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:08,458 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:08,458 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:13,513 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:13,513 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:13,513 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:18,558 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:18,558 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:18,558 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:18,558 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72078199': 0, 'ctest-pod-20417257': 0} 2024-08-23 16:50:18,604 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:50:18,604 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:50:18,604 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:50:18,646 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: ctest-pod-20417257 Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:50:18,646 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:50:18,646 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: ctest-pod-20417257 Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:50:18,646 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72078199': 1, 'ctest-pod-20417257': 1} 2024-08-23 16:50:23,692 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:23,692 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:23,692 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:28,735 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:28,735 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:28,735 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:33,790 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:33,790 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:33,790 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:38,840 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:38,841 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:38,841 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:43,883 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:43,883 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:43,883 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:48,938 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:48,938 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:48,938 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:53,984 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:53,984 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:53,984 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:59,030 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:59,030 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:50:59,030 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:04,074 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:04,074 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:04,074 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:09,117 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:09,117 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:09,117 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:09,117 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72078199': 0, 'ctest-pod-20417257': 0} 2024-08-23 16:51:11,155 - DEBUG - [Pod ctest-pod-51347534] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.796 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.081 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.312/0.796 ms 2024-08-23 16:51:11,155 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-51347534 with expectation True passed 2024-08-23 16:51:13,202 - DEBUG - [Pod ctest-pod-66831321] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.461 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.092 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.063 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.205/0.461 ms 2024-08-23 16:51:13,202 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-66831321 with expectation True passed 2024-08-23 16:51:15,249 - DEBUG - [Pod ctest-pod-14518409] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.909 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.080 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.354/0.909 ms 2024-08-23 16:51:15,249 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-14518409 with expectation True passed 2024-08-23 16:51:15,295 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:51:15,295 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-23 16:51:15,295 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:51:15,295 - INFO - wget check of of http://10.47.255.248 from ctest-pod-51347534 passed 2024-08-23 16:51:15,346 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:51:15,346 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2024-08-23 16:51:15,346 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:51:15,346 - INFO - wget check of of http://10.47.255.247 from ctest-pod-51347534 passed 2024-08-23 16:51:20,392 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-23 16:51:20,392 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-23 16:51:20,392 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-23 16:51:20,392 - INFO - wget check of of http://10.47.255.247 from ctest-pod-66831321 passed 2024-08-23 16:51:25,435 - DEBUG - [Pod ctest-pod-79804076] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-23 16:51:25,435 - DEBUG - [Pod Pod ctest-pod-79804076] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-23 16:51:25,435 - DEBUG - [Pod Pod ctest-pod-79804076] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-23 16:51:25,435 - INFO - wget check of of http://10.47.255.248 from ctest-pod-79804076 passed 2024-08-23 16:51:25,445 - INFO - Updating Network Policy ingress-on-service 2024-08-23 16:51:30,500 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:30,500 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:30,500 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:35,545 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:35,545 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:35,545 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:40,589 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:40,590 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:40,590 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:45,631 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:45,631 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:45,631 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:50,677 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:50,677 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:50,677 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:55,731 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:55,731 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:51:55,731 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:00,774 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:00,774 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:00,774 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:05,827 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:05,827 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:05,827 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:10,889 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:10,889 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:10,889 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:15,936 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:15,936 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:15,936 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) wget: download timed out 2024-08-23 16:52:15,936 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72078199': 0, 'ctest-pod-20417257': 0} 2024-08-23 16:52:15,980 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-72078199 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:52:15,980 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:52:15,980 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-72078199 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:52:16,029 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: ctest-pod-20417257 Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:52:16,029 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:52:16,029 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: ctest-pod-20417257 Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:52:16,029 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72078199': 1, 'ctest-pod-20417257': 1} 2024-08-23 16:52:16,074 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:52:16,074 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:52:16,074 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72078199 2024-08-23 16:52:16,121 - DEBUG - [Pod ctest-pod-14518409] Cmd: wget http://10.104.151.7:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-20417257 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:52:16,121 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd wget http://10.104.151.7:80/ -O - -T 5 -t 1 passed 2024-08-23 16:52:16,121 - DEBUG - [Pod Pod ctest-pod-14518409] Cmd output: Connecting to 10.104.151.7:80 (10.104.151.7:80) ctest-pod-20417257 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 16:52:16,121 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72078199': 1, 'ctest-pod-20417257': 1} 2024-08-23 16:52:18,160 - DEBUG - [Pod ctest-pod-51347534] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=0.676 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.069 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.276/0.676 ms 2024-08-23 16:52:18,161 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-51347534 with expectation True passed 2024-08-23 16:52:20,218 - DEBUG - [Pod ctest-pod-66831321] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.460 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.089 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.208/0.460 ms 2024-08-23 16:52:20,218 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-66831321 with expectation True passed 2024-08-23 16:52:22,269 - DEBUG - [Pod ctest-pod-14518409] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=2.316 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.198 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.069 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.861/2.316 ms 2024-08-23 16:52:22,269 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-14518409 with expectation True passed 2024-08-23 16:52:22,321 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:52:22,321 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-23 16:52:22,321 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:52:22,321 - INFO - wget check of of http://10.47.255.248 from ctest-pod-51347534 passed 2024-08-23 16:52:22,369 - DEBUG - [Pod ctest-pod-51347534] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:52:22,369 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2024-08-23 16:52:22,369 - DEBUG - [Pod Pod ctest-pod-51347534] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:52:22,369 - INFO - wget check of of http://10.47.255.247 from ctest-pod-51347534 passed 2024-08-23 16:52:27,423 - DEBUG - [Pod ctest-pod-66831321] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-23 16:52:27,423 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-23 16:52:27,423 - DEBUG - [Pod Pod ctest-pod-66831321] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-23 16:52:27,423 - INFO - wget check of of http://10.47.255.247 from ctest-pod-66831321 passed 2024-08-23 16:52:27,473 - DEBUG - [Pod ctest-pod-79804076] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:52:27,473 - DEBUG - [Pod Pod ctest-pod-79804076] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-23 16:52:27,473 - DEBUG - [Pod Pod ctest-pod-79804076] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 16:52:27,473 - INFO - wget check of of http://10.47.255.248 from ctest-pod-79804076 passed 2024-08-23 16:52:27,473 - INFO - Deleting Network Policy : ingress-on-service 2024-08-23 16:52:27,473 - INFO - Deleting service : ctest-nginx-svc-39792509 2024-08-23 16:52:27,952 - DEBUG - No XMPP flaps were noticed during the test 2024-08-23 16:52:27,952 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-08-23 16:52:27,952 - INFO - -------------------------------------------------------------------------------- 2024-08-23 16:52:27,958 - INFO - Deleting pod ctest-new-default-17961697:ctest-pod-72078199 2024-08-23 16:52:27,959 - INFO - Deleting pod ctest-new-default-17961697:ctest-pod-20417257 2024-08-23 16:52:27,959 - INFO - Deleting pod ctest-non-default-75388530:ctest-pod-52370776 2024-08-23 16:52:27,960 - INFO - Deleting pod ctest-non-default-75388530:ctest-pod-61259240 2024-08-23 16:52:27,960 - INFO - Deleting pod ctest-new-default-17961697:ctest-pod-66831321 2024-08-23 16:52:27,960 - INFO - Deleting pod ctest-new-default-17961697:ctest-pod-51347534 2024-08-23 16:52:27,961 - INFO - Deleting pod ctest-non-default-75388530:ctest-pod-14518409 2024-08-23 16:52:27,961 - INFO - Deleting pod ctest-non-default-75388530:ctest-pod-79804076 2024-08-23 16:52:28,154 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,155 - WARNING - Pod uuid dc7816f7-8ed8-44af-817d-acf148892662 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,159 - WARNING - Pod uuid d0257ee5-e173-4ff0-a079-09df67fa8eb1 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,163 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,164 - WARNING - Pod uuid b825f0cd-734e-478f-9d61-b6e974d5d373 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,167 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,170 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:28,172 - WARNING - Pod uuid 969c0e7a-b31c-4785-8819-36ab737cfe64 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:33,163 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:33,186 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:33,187 - DEBUG - Pod 969c0e7a-b31c-4785-8819-36ab737cfe64 is not in agent 10.0.0.37 VM list 2024-08-23 16:52:33,188 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:33,189 - DEBUG - Pod b825f0cd-734e-478f-9d61-b6e974d5d373 is not in agent 10.0.0.37 VM list 2024-08-23 16:52:33,190 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:33,190 - DEBUG - Pod d0257ee5-e173-4ff0-a079-09df67fa8eb1 is not in agent 10.0.0.37 VM list 2024-08-23 16:52:33,192 - DEBUG - Pod dc7816f7-8ed8-44af-817d-acf148892662 is not in agent 10.0.0.37 VM list 2024-08-23 16:52:33,204 - DEBUG - VMI 976a1e46-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:52:33,204 - INFO - Verified that pod ctest-pod-20417257 is removed in agent 2024-08-23 16:52:33,206 - DEBUG - VMI 990eeac4-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:52:33,206 - INFO - Verified that pod ctest-pod-61259240 is removed in agent 2024-08-23 16:52:33,207 - DEBUG - VMI 985a7ad0-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:52:33,207 - INFO - Verified that pod ctest-pod-52370776 is removed in agent 2024-08-23 16:52:33,208 - DEBUG - VMI 96bb8246-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:52:33,208 - INFO - Verified that pod ctest-pod-72078199 is removed in agent 2024-08-23 16:52:38,170 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:38,201 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:38,201 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:38,202 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:43,178 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:43,216 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:43,216 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:43,217 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:48,185 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:48,230 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:48,232 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:48,233 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:53,192 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:53,245 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:53,246 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:53,246 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:58,200 - WARNING - Pod uuid 9770b3a0-266a-444a-97b4-0569ad3f5d01 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:58,281 - WARNING - Pod uuid 5981c5bd-a1de-478e-b895-7bd1638eba39 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:58,283 - WARNING - Pod uuid d5536cb3-5a24-484d-ad5c-ea2fd77a205c is still seen in agent 10.0.0.37 VM list 2024-08-23 16:52:58,284 - WARNING - Pod uuid 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is still seen in agent 10.0.0.37 VM list 2024-08-23 16:53:03,212 - DEBUG - Pod 9770b3a0-266a-444a-97b4-0569ad3f5d01 is not in agent 10.0.0.37 VM list 2024-08-23 16:53:03,217 - DEBUG - VMI 9bdf67ec-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:53:03,217 - INFO - Verified that pod ctest-pod-79804076 is removed in agent 2024-08-23 16:53:03,297 - DEBUG - Pod d5536cb3-5a24-484d-ad5c-ea2fd77a205c is not in agent 10.0.0.37 VM list 2024-08-23 16:53:03,302 - DEBUG - Pod 5981c5bd-a1de-478e-b895-7bd1638eba39 is not in agent 10.0.0.37 VM list 2024-08-23 16:53:03,303 - DEBUG - Pod 0ebf43c1-0345-4d0f-b8ad-3ca44c3eb7e5 is not in agent 10.0.0.37 VM list 2024-08-23 16:53:03,317 - DEBUG - VMI 99e603d8-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:53:03,317 - INFO - Verified that pod ctest-pod-66831321 is removed in agent 2024-08-23 16:53:03,319 - DEBUG - VMI 9a905e6e-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:53:03,319 - INFO - Verified that pod ctest-pod-51347534 is removed in agent 2024-08-23 16:53:03,320 - DEBUG - VMI 9b3640c2-616f-11ef-93d8-fa163e943289 is removed from agent 10.0.0.37 2024-08-23 16:53:03,320 - INFO - Verified that pod ctest-pod-14518409 is removed in agent 2024-08-23 16:53:03,320 - INFO - Deleting namespace ctest-non-default-75388530 2024-08-23 16:53:03,336 - DEBUG - Namespace ctest-non-default-75388530 still in k8s 2024-08-23 16:53:05,341 - DEBUG - Namespace ctest-non-default-75388530 still in k8s 2024-08-23 16:53:07,345 - DEBUG - Namespace ctest-non-default-75388530 still in k8s 2024-08-23 16:53:09,349 - DEBUG - Namespace ctest-non-default-75388530 is not in k8s 2024-08-23 16:53:09,349 - DEBUG - No need to check project deletion in contrail-api 2024-08-23 16:53:09,350 - INFO - Deleting namespace ctest-new-default-17961697 2024-08-23 16:53:09,359 - DEBUG - Namespace ctest-new-default-17961697 still in k8s 2024-08-23 16:53:11,364 - DEBUG - Namespace ctest-new-default-17961697 still in k8s 2024-08-23 16:53:13,370 - DEBUG - Namespace ctest-new-default-17961697 still in k8s 2024-08-23 16:53:15,374 - DEBUG - Namespace ctest-new-default-17961697 is not in k8s 2024-08-23 16:53:15,374 - DEBUG - No need to check project deletion in contrail-api