2024-09-14 02:48:37,707 - DEBUG - [10.0.0.27]: Running cmd : hostname 2024-09-14 02:48:38,019 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-663-1 2024-09-14 02:48:38,019 - DEBUG - [10.0.0.27]: Running cmd : hostname -f 2024-09-14 02:48:38,078 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-663-1 2024-09-14 02:48:38,078 - DEBUG - [10.0.0.27]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-09-14 02:48:38,232 - DEBUG - Output : NAMES contrail_test_jxidi1f18 contrail-kubernetes-master_kubemanager_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_alarm-gen_1 analytics_alarm_nodemgr_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 redis_redis_1 webui_web_1 webui_job_1 control_named_1 control_nodemgr_1 control_control_1 control_dns_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_nodemgr_1 config_database_cassandra_1 config_api_devicemgr_1 config_api_svcmonitor_1 config_api_api_1 config_api_schema_1 config_api_dnsmasq_1 config_api_nodemgr_1 2024-09-14 02:48:38,233 - DEBUG - [10.0.0.27]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-09-14 02:48:38,301 - DEBUG - Output : 10.0.0.27/24 172.17.0.1/16 2024-09-14 02:48:38,302 - DEBUG - [10.0.0.27]: Running cmd : getent hosts 10.0.0.27 | head -n 1 | awk '{print $2}' 2024-09-14 02:48:38,423 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-663-1 2024-09-14 02:48:38,576 - DEBUG - [10.0.0.23]: Running cmd : hostname 2024-09-14 02:48:38,788 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-663-1 2024-09-14 02:48:38,789 - DEBUG - [10.0.0.23]: Running cmd : hostname -f 2024-09-14 02:48:38,817 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-663-1 2024-09-14 02:48:38,818 - DEBUG - [10.0.0.23]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-09-14 02:48:38,864 - DEBUG - Output : NAMES vrouter_nodemgr_1 vrouter_vrouter-agent_1 2024-09-14 02:48:38,864 - DEBUG - [10.0.0.23]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-09-14 02:48:38,925 - DEBUG - Output : 10.0.0.23/24 2024-09-14 02:48:38,926 - DEBUG - [10.0.0.23]: Running cmd : getent hosts 10.0.0.23 | head -n 1 | awk '{print $2}' 2024-09-14 02:48:38,953 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-663-1 2024-09-14 02:48:39,168 - INFO - Using existing project ['default-domain', 'k8s-default'](e8fcd4a3-f346-4def-8421-6fbc846989e3) 2024-09-14 02:48:39,294 - INFO - Using existing project ['default-domain', 'k8s-default'](e8fcd4a3-f346-4def-8421-6fbc846989e3) 2024-09-14 02:48:39,439 - INFO - ================================================================================ 2024-09-14 02:48:39,440 - INFO - STARTING TEST : test_ingress_ip_assignment 2024-09-14 02:48:39,440 - INFO - TEST DESCRIPTION : Verify that Ingress gets a CLuster IP which is reachable to Pods in same namespace. Also verify that a Floating IP is assigned to the Ingress from the Public FIP poo. Steps: 1. Create a service with 2 pods running nginx 2. Create an ingress out of this service 3. From another Pod do a wget on the ingress Cluster ip Validate that Ingress get a IP from Public FIP pool which might/might not be accessible. Validate that service and its loadbalancing work 2024-09-14 02:48:39,717 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-14 02:48:39,733 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.27': '0'}} with 2024-09-14 02:48:39,733 - INFO - Initial checks done. Running the testcase now 2024-09-14 02:48:39,733 - INFO - 2024-09-14 02:48:39,744 - INFO - Namespace default already exists 2024-09-14 02:48:39,745 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-09-14 02:48:40,006 - DEBUG - Output : cluster_project={} 2024-09-14 02:48:40,092 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api 2024-09-14 02:48:40,093 - DEBUG - Project uuid in Contrail is e8fcd4a3-f346-4def-8421-6fbc846989e3 2024-09-14 02:48:40,093 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-09-14 02:48:40,222 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-09-14 02:48:40,222 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=3f14320a-7aca-44a1-ba78-ca29ef0e0e2b 2024-09-14 02:48:40,226 - INFO - Namespace default with uuid 3f14320a-7aca-44a1-ba78-ca29ef0e0e2b found in kube manager 2024-09-14 02:48:40,226 - INFO - Namespace default verification passed 2024-09-14 02:48:40,229 - DEBUG - Service ctest-nginx-svc-87838404 not present 2024-09-14 02:48:40,230 - INFO - Creating service ctest-nginx-svc-87838404 2024-09-14 02:48:40,246 - INFO - Created Service ctest-nginx-svc-87838404 2024-09-14 02:48:40,256 - DEBUG - Pod ctest-nginx-pod-19420206 not present 2024-09-14 02:48:40,257 - INFO - Creating Pod ctest-nginx-pod-19420206 2024-09-14 02:48:40,321 - DEBUG - Pod : ctest-nginx-pod-19420206 UUID is a77929fc-7b48-4d01-965d-0c5ce34fba95 2024-09-14 02:48:40,328 - DEBUG - Pod ctest-nginx-pod-52802606 not present 2024-09-14 02:48:40,329 - INFO - Creating Pod ctest-nginx-pod-52802606 2024-09-14 02:48:40,366 - DEBUG - Pod : ctest-nginx-pod-52802606 UUID is b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 2024-09-14 02:48:40,594 - INFO - Created VN __public__, UUID :8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:40,910 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-14 02:48:40,923 - DEBUG - Requesting: http://10.0.0.27:8082/domain/248825e0-eb0a-47fa-8f05-f7c958ac9ecd 2024-09-14 02:48:40,991 - DEBUG - Requesting: http://10.0.0.27:8082/project/e8fcd4a3-f346-4def-8421-6fbc846989e3 2024-09-14 02:48:41,148 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,166 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,191 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9bd60add-74af-4ec6-93f0-b805f33566f3 2024-09-14 02:48:41,216 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9bd60add-74af-4ec6-93f0-b805f33566f3 2024-09-14 02:48:41,239 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/479977d4-2fce-4c00-a12c-2ef1c3b71deb 2024-09-14 02:48:41,263 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-14 02:48:41,263 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,282 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9bd60add-74af-4ec6-93f0-b805f33566f3 2024-09-14 02:48:41,314 - INFO - Verified VN network id 13 for VN 8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,314 - INFO - Verifications in API Server for VN __public__ passed 2024-09-14 02:48:41,314 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,336 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9bd60add-74af-4ec6-93f0-b805f33566f3 2024-09-14 02:48:41,344 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9bd60add-74af-4ec6-93f0-b805f33566f3 2024-09-14 02:48:41,353 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/479977d4-2fce-4c00-a12c-2ef1c3b71deb 2024-09-14 02:48:41,371 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-09-14 02:48:41,380 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10149858134875654105', 'uuid-lslong': '12449333708938771692'}, 'enable': 'true', 'created': '2024-09-14T02:48:40', 'last-modified': '2024-09-14T02:48:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.576313'} 2024-09-14 02:48:41,380 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:48:41,387 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-14 02:48:41,387 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed 2024-09-14 02:48:41,388 - DEBUG - ====Verifying policy data for __public__ in API_Server ====== 2024-09-14 02:48:41,388 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-14 02:48:41,393 - DEBUG - Requesting: http://10.0.0.27:8082/domain/248825e0-eb0a-47fa-8f05-f7c958ac9ecd 2024-09-14 02:48:41,404 - DEBUG - Requesting: http://10.0.0.27:8082/project/e8fcd4a3-f346-4def-8421-6fbc846989e3 2024-09-14 02:48:41,470 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,485 - DEBUG - =>VN __public__ has no policy to be verified 2024-09-14 02:48:41,485 - DEBUG - Verifying the vn in opserver 2024-09-14 02:48:41,485 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.27 2024-09-14 02:48:41,489 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-09-14 02:48:41,507 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'} 2024-09-14 02:48:41,507 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver 2024-09-14 02:48:41,507 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:48:41,529 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:48:41,541 - DEBUG - Do not have enough data to verify VN in agent 2024-09-14 02:48:41,541 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:48:41,548 - DEBUG - VRF ids for VN __public__: {} 2024-09-14 02:48:41,682 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server 2024-09-14 02:48:41,819 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-14 02:48:41,825 - DEBUG - Requesting: http://10.0.0.27:8082/domain/248825e0-eb0a-47fa-8f05-f7c958ac9ecd 2024-09-14 02:48:41,834 - DEBUG - Requesting: http://10.0.0.27:8082/project/e8fcd4a3-f346-4def-8421-6fbc846989e3 2024-09-14 02:48:41,933 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:41,947 - DEBUG - Requesting: http://10.0.0.27:8082/floating-ip-pool/14cfd3f0-04ee-429c-9ee9-e1b5f4ca277f 2024-09-14 02:48:41,954 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-14 02:48:41,959 - DEBUG - Requesting: http://10.0.0.27:8082/domain/248825e0-eb0a-47fa-8f05-f7c958ac9ecd 2024-09-14 02:48:41,966 - DEBUG - Requesting: http://10.0.0.27:8082/project/e8fcd4a3-f346-4def-8421-6fbc846989e3 2024-09-14 02:48:42,043 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8cdb8a32-89df-47d9-acc4-eb0c83977cec 2024-09-14 02:48:42,057 - DEBUG - FIP Pool __fip_pool_public__ found in API Server 2024-09-14 02:48:42,057 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed 2024-09-14 02:48:42,070 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-09-14 02:48:42,076 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information 2024-09-14 02:48:42,076 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed 2024-09-14 02:48:42,079 - DEBUG - Ingress ctest-nginx-ingress-33031233 not present 2024-09-14 02:48:42,079 - INFO - Creating Ingress ctest-nginx-ingress-33031233 2024-09-14 02:48:42,086 - INFO - Created Ingress ctest-nginx-ingress-33031233 2024-09-14 02:48:42,089 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-33031233 2024-09-14 02:48:45,096 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-33031233 2024-09-14 02:48:48,100 - DEBUG - For Ingress ctest-nginx-ingress-33031233, Cluster IP: 10.47.255.249, External IPs ['186.67.238.60'] 2024-09-14 02:48:48,100 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-33031233 2024-09-14 02:48:48,101 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=03f96fb2-d6cf-4750-b91c-1dec68c63d31 2024-09-14 02:48:48,106 - INFO - Ingress ctest-nginx-ingress-33031233 with uuid 03f96fb2-d6cf-4750-b91c-1dec68c63d31 found in kube manager 2024-09-14 02:48:48,106 - INFO - Ingress ctest-nginx-ingress-33031233 verification passed 2024-09-14 02:48:48,109 - DEBUG - Pod ctest-busybox-pod-83417031 not present 2024-09-14 02:48:48,109 - INFO - Creating Pod ctest-busybox-pod-83417031 2024-09-14 02:48:48,264 - DEBUG - Pod : ctest-busybox-pod-83417031 UUID is e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:48:48,276 - DEBUG - Pod ctest-nginx-pod-19420206 not in running state.Currently in Pending 2024-09-14 02:48:53,284 - INFO - Pod ctest-nginx-pod-19420206 is in running state.Got IP 10.47.255.251 2024-09-14 02:48:53,323 - DEBUG - Pod ctest-nginx-pod-19420206 has vmi da534130-7243-11ef-8a23-fa163ed83b84 2024-09-14 02:48:53,323 - INFO - Verified pod ctest-nginx-pod-19420206 in contrail-api 2024-09-14 02:48:53,323 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:48:53,341 - DEBUG - VMI da534130-7243-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:48:53,341 - INFO - Verified Pod ctest-nginx-pod-19420206 in agent 10.0.0.23 2024-09-14 02:48:53,341 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=a77929fc-7b48-4d01-965d-0c5ce34fba95 2024-09-14 02:48:53,347 - INFO - Pod ctest-nginx-pod-19420206 with uuid a77929fc-7b48-4d01-965d-0c5ce34fba95 found in kube manager 2024-09-14 02:48:53,347 - INFO - Pod ctest-nginx-pod-19420206 verification passed 2024-09-14 02:48:53,430 - DEBUG - [Pod ctest-nginx-pod-19420206] Cmd: echo ctest-nginx-pod-19420206 > /usr/share/nginx/html/index.html, Output: 2024-09-14 02:48:53,436 - DEBUG - Pod ctest-nginx-pod-52802606 not in running state.Currently in Pending 2024-09-14 02:48:58,448 - INFO - Pod ctest-nginx-pod-52802606 is in running state.Got IP 10.47.255.250 2024-09-14 02:48:58,526 - DEBUG - Pod ctest-nginx-pod-52802606 has vmi dadc8044-7243-11ef-8a23-fa163ed83b84 2024-09-14 02:48:58,526 - INFO - Verified pod ctest-nginx-pod-52802606 in contrail-api 2024-09-14 02:48:58,526 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:48:58,540 - DEBUG - VMI dadc8044-7243-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:48:58,540 - INFO - Verified Pod ctest-nginx-pod-52802606 in agent 10.0.0.23 2024-09-14 02:48:58,540 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 2024-09-14 02:48:58,553 - INFO - Pod ctest-nginx-pod-52802606 with uuid b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 found in kube manager 2024-09-14 02:48:58,554 - INFO - Pod ctest-nginx-pod-52802606 verification passed 2024-09-14 02:48:58,624 - DEBUG - [Pod ctest-nginx-pod-52802606] Cmd: echo ctest-nginx-pod-52802606 > /usr/share/nginx/html/index.html, Output: 2024-09-14 02:48:58,629 - DEBUG - Pod ctest-busybox-pod-83417031 not in running state.Currently in Pending 2024-09-14 02:49:03,660 - INFO - Pod ctest-busybox-pod-83417031 is in running state.Got IP 10.47.255.248 2024-09-14 02:49:03,735 - DEBUG - Pod ctest-busybox-pod-83417031 has vmi de03ca0c-7243-11ef-8a23-fa163ed83b84 2024-09-14 02:49:03,735 - INFO - Verified pod ctest-busybox-pod-83417031 in contrail-api 2024-09-14 02:49:03,736 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:49:03,754 - DEBUG - VMI de03ca0c-7243-11ef-8a23-fa163ed83b84 is active in agent 10.0.0.23 2024-09-14 02:49:03,754 - INFO - Verified Pod ctest-busybox-pod-83417031 in agent 10.0.0.23 2024-09-14 02:49:03,755 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:03,767 - INFO - Pod ctest-busybox-pod-83417031 with uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e found in kube manager 2024-09-14 02:49:03,767 - INFO - Pod ctest-busybox-pod-83417031 verification passed 2024-09-14 02:49:03,845 - DEBUG - [Pod ctest-busybox-pod-83417031] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-52802606 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-14 02:49:03,845 - DEBUG - [Pod Pod ctest-busybox-pod-83417031] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2024-09-14 02:49:03,845 - DEBUG - [Pod Pod ctest-busybox-pod-83417031] Cmd output: ctest-nginx-pod-52802606 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-14 02:49:03,937 - DEBUG - [Pod ctest-busybox-pod-83417031] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-52802606 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-14 02:49:03,937 - DEBUG - [Pod Pod ctest-busybox-pod-83417031] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2024-09-14 02:49:03,937 - DEBUG - [Pod Pod ctest-busybox-pod-83417031] Cmd output: ctest-nginx-pod-52802606 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-14 02:49:04,006 - DEBUG - [Pod ctest-busybox-pod-83417031] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249:80 (10.47.255.249:80) ctest-nginx-pod-19420206 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-14 02:49:04,006 - DEBUG - [Pod Pod ctest-busybox-pod-83417031] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2024-09-14 02:49:04,006 - DEBUG - [Pod Pod ctest-busybox-pod-83417031] Cmd output: Connecting to 10.47.255.249:80 (10.47.255.249:80) ctest-nginx-pod-19420206 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-14 02:49:04,006 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-19420206': 1, 'ctest-nginx-pod-52802606': 2} 2024-09-14 02:49:04,007 - WARNING - Nothing to delete parallely 2024-09-14 02:49:04,007 - INFO - Deleting pod default:ctest-busybox-pod-83417031 2024-09-14 02:49:04,046 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:04,060 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:09,062 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:09,077 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:14,079 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:14,093 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:19,094 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:19,103 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:24,104 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:24,122 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:29,123 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:29,133 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:34,133 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:34,152 - WARNING - Pod uuid e6d996ec-07d9-4c91-be4b-c83b4fcc223e is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:39,153 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e6d996ec-07d9-4c91-be4b-c83b4fcc223e 2024-09-14 02:49:39,167 - DEBUG - Pod e6d996ec-07d9-4c91-be4b-c83b4fcc223e is not in agent 10.0.0.23 VM list 2024-09-14 02:49:39,168 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:de03ca0c-7243-11ef-8a23-fa163ed83b84 2024-09-14 02:49:39,180 - DEBUG - VMI de03ca0c-7243-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:49:39,181 - INFO - Verified that pod ctest-busybox-pod-83417031 is removed in agent 2024-09-14 02:49:39,181 - INFO - Deleting Ingress : ctest-nginx-ingress-33031233 2024-09-14 02:49:39,199 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=03f96fb2-d6cf-4750-b91c-1dec68c63d31 2024-09-14 02:49:39,222 - ERROR - Ingress ctest-nginx-ingress-33031233 with uuid 03f96fb2-d6cf-4750-b91c-1dec68c63d31 still found in kube manager 2024-09-14 02:49:40,223 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=03f96fb2-d6cf-4750-b91c-1dec68c63d31 2024-09-14 02:49:40,227 - INFO - Ingress ctest-nginx-ingress-33031233 with uuid 03f96fb2-d6cf-4750-b91c-1dec68c63d31 deleted successfully from kube manager 2024-09-14 02:49:40,227 - INFO - Verifications on Ingress %s cleanup passed 2024-09-14 02:49:40,227 - INFO - Deleting the FIP pool __fip_pool_public__ 2024-09-14 02:49:40,335 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-09-14 02:49:40,342 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information 2024-09-14 02:49:40,342 - INFO - Deleting VN __public__ 2024-09-14 02:49:40,615 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9bd60add-74af-4ec6-93f0-b805f33566f3 2024-09-14 02:49:40,633 - DEBUG - Response Code: 404 2024-09-14 02:49:40,634 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-14 02:49:40,652 - DEBUG - Requesting: http://10.0.0.27:8082/domain/248825e0-eb0a-47fa-8f05-f7c958ac9ecd 2024-09-14 02:49:40,663 - DEBUG - Requesting: http://10.0.0.27:8082/project/e8fcd4a3-f346-4def-8421-6fbc846989e3 2024-09-14 02:49:40,715 - INFO - Validated that VN __public__ is not found in API Server 2024-09-14 02:49:40,716 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__ 2024-09-14 02:49:40,727 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:49:40,743 - DEBUG - VN __public__ is not present in Agent 10.0.0.23 2024-09-14 02:49:40,743 - INFO - Validated that VN __public__ is not in any agent 2024-09-14 02:49:40,743 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:49:40,754 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-14 02:49:40,762 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-09-14 02:49:40,767 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info 2024-09-14 02:49:40,767 - INFO - Deleting pod default:ctest-nginx-pod-52802606 2024-09-14 02:49:40,784 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 2024-09-14 02:49:40,804 - WARNING - Pod uuid b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:45,806 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 2024-09-14 02:49:45,820 - DEBUG - Pod b32bf7c3-f7b2-45a5-b964-e0df8ee2ae19 is not in agent 10.0.0.23 VM list 2024-09-14 02:49:45,820 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dadc8044-7243-11ef-8a23-fa163ed83b84 2024-09-14 02:49:45,834 - DEBUG - VMI dadc8044-7243-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:49:45,834 - INFO - Verified that pod ctest-nginx-pod-52802606 is removed in agent 2024-09-14 02:49:45,835 - INFO - Deleting pod default:ctest-nginx-pod-19420206 2024-09-14 02:49:45,893 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=a77929fc-7b48-4d01-965d-0c5ce34fba95 2024-09-14 02:49:45,905 - WARNING - Pod uuid a77929fc-7b48-4d01-965d-0c5ce34fba95 is still seen in agent 10.0.0.23 VM list 2024-09-14 02:49:50,911 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=a77929fc-7b48-4d01-965d-0c5ce34fba95 2024-09-14 02:49:50,929 - DEBUG - Pod a77929fc-7b48-4d01-965d-0c5ce34fba95 is not in agent 10.0.0.23 VM list 2024-09-14 02:49:50,930 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:da534130-7243-11ef-8a23-fa163ed83b84 2024-09-14 02:49:50,944 - DEBUG - VMI da534130-7243-11ef-8a23-fa163ed83b84 is removed from agent 10.0.0.23 2024-09-14 02:49:50,945 - INFO - Verified that pod ctest-nginx-pod-19420206 is removed in agent 2024-09-14 02:49:50,945 - INFO - Deleting service : ctest-nginx-svc-87838404 2024-09-14 02:49:51,326 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-14 02:49:51,342 - DEBUG - No XMPP flaps were noticed during the test 2024-09-14 02:49:51,342 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:12] 2024-09-14 02:49:51,343 - INFO - -------------------------------------------------------------------------------- 2024-09-14 02:49:57,878 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-09-14 02:49:57,996 - DEBUG - Output : cluster_project={} 2024-09-14 02:49:58,066 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-09-14 02:49:58,237 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-09-14 02:49:58,251 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-09-14 02:49:58,429 - DEBUG - Output : cluster_project={} 2024-09-14 02:50:13,642 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:13,749 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:13,862 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:13,939 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:18,995 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:19,102 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:19,154 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:19,250 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-14 02:50:19,487 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-14 02:50:22,518 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_ApplicationPolicySetReq? 2024-09-14 02:50:22,537 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AclReq? 2024-09-14 02:50:22,613 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AclReq? 2024-09-14 02:50:24,653 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AclReq? 2024-09-14 02:53:26,170 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-14 02:53:26,256 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=66c3dcb4-c25a-4282-aa50-ccc06756411c 2024-09-14 02:53:26,309 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:26,328 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:26,337 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:53:26,346 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d4e7c547-a5b8-4028-abbf-a30e38e92ac4 2024-09-14 02:53:26,352 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b47ea763-eaba-4721-b2d5-ccd06df8cf91 2024-09-14 02:53:26,356 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:26,376 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=4d322c7e-ad1c-4d3b-9749-8ec01834744c 2024-09-14 02:53:31,290 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=66c3dcb4-c25a-4282-aa50-ccc06756411c 2024-09-14 02:53:31,307 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:08833b1e-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:53:31,462 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=4d322c7e-ad1c-4d3b-9749-8ec01834744c 2024-09-14 02:53:31,466 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:31,471 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:31,477 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d4e7c547-a5b8-4028-abbf-a30e38e92ac4 2024-09-14 02:53:31,486 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b47ea763-eaba-4721-b2d5-ccd06df8cf91 2024-09-14 02:53:31,489 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:31,492 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:53:31,521 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:09d4e49a-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:53:31,531 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:091e1b16-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:53:31,535 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0a704840-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:53:36,520 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:36,529 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:36,531 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:53:36,532 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:41,538 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:41,548 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:41,550 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:53:41,552 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:46,546 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:46,556 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:46,565 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:53:46,569 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:51,566 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:51,590 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:51,594 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:51,596 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:53:56,585 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:53:56,612 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:53:56,618 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:53:56,620 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:54:01,619 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=b92ac951-1451-41da-9fd9-c9dc01b74d3e 2024-09-14 02:54:01,626 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0b9480d8-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:54:01,633 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=682d2460-0565-4c11-91a6-16594539f2c5 2024-09-14 02:54:01,638 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=259e2391-0485-442d-b1fc-f281c7035630 2024-09-14 02:54:01,641 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=5af3c08b-7222-4bca-9b12-d129a6837d90 2024-09-14 02:54:01,650 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0c17556c-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:54:01,670 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0b119394-7244-11ef-8a23-fa163ed83b84 2024-09-14 02:54:01,682 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0ca0916a-7244-11ef-8a23-fa163ed83b84