2024-09-04 11:15:36,219 - DEBUG - [10.0.0.36]: Running cmd : hostname
2024-09-04 11:15:36,500 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-626-1
2024-09-04 11:15:36,500 - DEBUG - [10.0.0.36]: Running cmd : hostname -f
2024-09-04 11:15:36,534 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-626-1
2024-09-04 11:15:36,534 - DEBUG - [10.0.0.36]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-09-04 11:15:36,631 - DEBUG - Output : NAMES
contrail_test_Ffmoxa7NT
contrail-kubernetes-master_kubemanager_1
analytics_database_cassandra_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_snmp_snmp-collector_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_alarm_kafka_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_nodemgr_1
analytics_api_1
analytics_collector_1
redis_redis_1
webui_web_1
webui_job_1
control_named_1
control_control_1
control_nodemgr_1
control_dns_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
config_database_rabbitmq_1
config_api_devicemgr_1
config_api_svcmonitor_1
config_api_api_1
config_api_schema_1
config_api_nodemgr_1
config_api_dnsmasq_1
2024-09-04 11:15:36,631 - DEBUG - [10.0.0.36]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-09-04 11:15:36,713 - DEBUG - Output : 10.0.0.36/24
172.17.0.1/16
2024-09-04 11:15:36,713 - DEBUG - [10.0.0.36]: Running cmd : getent hosts 10.0.0.36 | head -n 1 | awk '{print $2}'
2024-09-04 11:15:36,747 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-626-1
2024-09-04 11:15:36,843 - DEBUG - [10.0.0.29]: Running cmd : hostname
2024-09-04 11:15:37,554 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-626-1
2024-09-04 11:15:37,554 - DEBUG - [10.0.0.29]: Running cmd : hostname -f
2024-09-04 11:15:37,578 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-626-1
2024-09-04 11:15:37,579 - DEBUG - [10.0.0.29]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-09-04 11:15:37,623 - DEBUG - Output : NAMES
vrouter_nodemgr_1
vrouter_vrouter-agent_1
2024-09-04 11:15:37,623 - DEBUG - [10.0.0.29]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-09-04 11:15:37,696 - DEBUG - Output : 10.0.0.29/24
2024-09-04 11:15:37,696 - DEBUG - [10.0.0.29]: Running cmd : getent hosts 10.0.0.29 | head -n 1 | awk '{print $2}'
2024-09-04 11:15:37,720 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-626-1
2024-09-04 11:15:37,794 - INFO - Using existing project ['default-domain', 'k8s-default'](6d8fdbe9-f602-4ef6-b721-002cede724a1)
2024-09-04 11:15:37,898 - INFO - Using existing project ['default-domain', 'k8s-default'](6d8fdbe9-f602-4ef6-b721-002cede724a1)
2024-09-04 11:15:38,065 - INFO - ================================================================================
2024-09-04 11:15:38,065 - INFO - STARTING TEST : test_ingress_ip_assignment
2024-09-04 11:15:38,066 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2024-09-04 11:15:38,266 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AgentXmppConnectionStatusReq?
2024-09-04 11:15:38,273 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.0.0.36': '0'}} with
2024-09-04 11:15:38,273 - INFO - Initial checks done. Running the testcase now
2024-09-04 11:15:38,273 - INFO -
2024-09-04 11:15:38,279 - INFO - Namespace default already exists
2024-09-04 11:15:38,279 - DEBUG - [10.0.0.36]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-09-04 11:15:38,411 - DEBUG - Output : cluster_project={}
2024-09-04 11:15:38,446 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2024-09-04 11:15:38,446 - DEBUG - Project uuid in Contrail is 6d8fdbe9-f602-4ef6-b721-002cede724a1
2024-09-04 11:15:38,446 - DEBUG - [10.0.0.36]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-09-04 11:15:38,588 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-09-04 11:15:38,588 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_NamespaceDatabaseList?namespace_uuid=71f5bbb6-cd48-417c-b61c-919ef320ff7a
2024-09-04 11:15:38,593 - INFO - Namespace default with uuid 71f5bbb6-cd48-417c-b61c-919ef320ff7a found in kube manager
2024-09-04 11:15:38,593 - INFO - Namespace default verification passed
2024-09-04 11:15:38,596 - DEBUG - Service ctest-nginx-svc-73392590 not present
2024-09-04 11:15:38,596 - INFO - Creating service ctest-nginx-svc-73392590
2024-09-04 11:15:38,611 - INFO - Created Service ctest-nginx-svc-73392590
2024-09-04 11:15:38,630 - DEBUG - Pod ctest-nginx-pod-28010203 not present
2024-09-04 11:15:38,630 - INFO - Creating Pod ctest-nginx-pod-28010203
2024-09-04 11:15:38,693 - DEBUG - Node for Pod ctest-nginx-pod-28010203 not yet populated
2024-09-04 11:15:41,700 - DEBUG - Pod : ctest-nginx-pod-28010203 UUID is 3b15bdac-a8fe-449a-9a05-4e8c86392a1d
2024-09-04 11:15:41,702 - DEBUG - Pod ctest-nginx-pod-53449890 not present
2024-09-04 11:15:41,702 - INFO - Creating Pod ctest-nginx-pod-53449890
2024-09-04 11:15:41,814 - DEBUG - Pod : ctest-nginx-pod-53449890 UUID is 95774187-7118-4773-9f00-0920cb4274c4
2024-09-04 11:15:42,032 - INFO - Created VN __public__, UUID :6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,261 - DEBUG - Requesting: http://10.0.0.36:8082/domains
2024-09-04 11:15:42,268 - DEBUG - Requesting: http://10.0.0.36:8082/domain/65bd2701-d5b7-4a96-af07-0ef1a58e1142
2024-09-04 11:15:42,290 - DEBUG - Requesting: http://10.0.0.36:8082/project/6d8fdbe9-f602-4ef6-b721-002cede724a1
2024-09-04 11:15:42,342 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,355 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,365 - DEBUG - Requesting: http://10.0.0.36:8082/routing-instance/63cc8577-453f-4aec-85e3-1d9c55198d30
2024-09-04 11:15:42,391 - DEBUG - Requesting: http://10.0.0.36:8082/routing-instance/63cc8577-453f-4aec-85e3-1d9c55198d30
2024-09-04 11:15:42,417 - DEBUG - Requesting: http://10.0.0.36:8082/route-target/200c341b-be95-45a8-a926-25bd21767457
2024-09-04 11:15:42,427 - DEBUG - Route Targets: ['target:64512:8000007']
2024-09-04 11:15:42,427 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,443 - DEBUG - Requesting: http://10.0.0.36:8082/routing-instance/63cc8577-453f-4aec-85e3-1d9c55198d30
2024-09-04 11:15:42,463 - INFO - Verified VN network id 13 for VN 6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,464 - INFO - Verifications in API Server for VN __public__ passed
2024-09-04 11:15:42,464 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,475 - DEBUG - Requesting: http://10.0.0.36:8082/routing-instance/63cc8577-453f-4aec-85e3-1d9c55198d30
2024-09-04 11:15:42,484 - DEBUG - Requesting: http://10.0.0.36:8082/routing-instance/63cc8577-453f-4aec-85e3-1d9c55198d30
2024-09-04 11:15:42,492 - DEBUG - Requesting: http://10.0.0.36:8082/route-target/200c341b-be95-45a8-a926-25bd21767457
2024-09-04 11:15:42,498 - DEBUG - Requesting: http://10.0.0.36:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-09-04 11:15:42,510 - DEBUG - Control-node 10.0.0.36 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7979965906916625333', 'uuid-lslong': '9642988133910712302'}, 'enable': 'true', 'created': '2024-09-04T11:15:41', 'last-modified': '2024-09-04T11:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.370090'}
2024-09-04 11:15:42,510 - DEBUG - Requesting: http://10.0.0.36:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:15:42,522 - DEBUG - Route Targets: ['target:64512:8000007']
2024-09-04 11:15:42,522 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2024-09-04 11:15:42,524 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2024-09-04 11:15:42,524 - DEBUG - Requesting: http://10.0.0.36:8082/domains
2024-09-04 11:15:42,532 - DEBUG - Requesting: http://10.0.0.36:8082/domain/65bd2701-d5b7-4a96-af07-0ef1a58e1142
2024-09-04 11:15:42,558 - DEBUG - Requesting: http://10.0.0.36:8082/project/6d8fdbe9-f602-4ef6-b721-002cede724a1
2024-09-04 11:15:42,606 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,615 - DEBUG - =>VN __public__ has no policy to be verified
2024-09-04 11:15:42,615 - DEBUG - Verifying the vn in opserver
2024-09-04 11:15:42,615 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.36
2024-09-04 11:15:42,615 - DEBUG - Requesting: http://10.0.0.36:8081/analytics/uves/virtual-networks
2024-09-04 11:15:42,625 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.36:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2024-09-04 11:15:42,625 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2024-09-04 11:15:42,625 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:15:42,635 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:15:42,642 - DEBUG - Do not have enough data to verify VN in agent
2024-09-04 11:15:42,642 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:15:42,649 - DEBUG - VRF ids for VN __public__: {}
2024-09-04 11:15:42,758 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2024-09-04 11:15:42,864 - DEBUG - Requesting: http://10.0.0.36:8082/domains
2024-09-04 11:15:42,869 - DEBUG - Requesting: http://10.0.0.36:8082/domain/65bd2701-d5b7-4a96-af07-0ef1a58e1142
2024-09-04 11:15:42,876 - DEBUG - Requesting: http://10.0.0.36:8082/project/6d8fdbe9-f602-4ef6-b721-002cede724a1
2024-09-04 11:15:42,906 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,918 - DEBUG - Requesting: http://10.0.0.36:8082/floating-ip-pool/d87adb9e-da3e-4fd4-ba23-e966daeffe84
2024-09-04 11:15:42,924 - DEBUG - Requesting: http://10.0.0.36:8082/domains
2024-09-04 11:15:42,929 - DEBUG - Requesting: http://10.0.0.36:8082/domain/65bd2701-d5b7-4a96-af07-0ef1a58e1142
2024-09-04 11:15:42,936 - DEBUG - Requesting: http://10.0.0.36:8082/project/6d8fdbe9-f602-4ef6-b721-002cede724a1
2024-09-04 11:15:42,979 - DEBUG - Requesting: http://10.0.0.36:8082/virtual-network/6ebe88b6-717e-4bb5-85d2-c69df70e0fee
2024-09-04 11:15:42,990 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2024-09-04 11:15:42,990 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2024-09-04 11:15:42,995 - DEBUG - Requesting: http://10.0.0.36:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-09-04 11:15:43,001 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2024-09-04 11:15:43,001 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2024-09-04 11:15:43,005 - DEBUG - Ingress ctest-nginx-ingress-27824847 not present
2024-09-04 11:15:43,005 - INFO - Creating Ingress ctest-nginx-ingress-27824847
2024-09-04 11:15:43,019 - INFO - Created Ingress ctest-nginx-ingress-27824847
2024-09-04 11:15:43,030 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-27824847
2024-09-04 11:15:46,035 - DEBUG - For Ingress ctest-nginx-ingress-27824847, Cluster IP: 10.47.255.249, External IPs ['204.166.32.124']
2024-09-04 11:15:46,035 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-27824847
2024-09-04 11:15:46,035 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_LoadbalancerDatabaseList?x=aeb238dc-be2f-4b79-a27e-fbe9216a9004
2024-09-04 11:15:46,042 - INFO - Ingress ctest-nginx-ingress-27824847 with uuid aeb238dc-be2f-4b79-a27e-fbe9216a9004 found in kube manager
2024-09-04 11:15:46,042 - INFO - Ingress ctest-nginx-ingress-27824847 verification passed
2024-09-04 11:15:46,044 - DEBUG - Pod ctest-busybox-pod-18714315 not present
2024-09-04 11:15:46,044 - INFO - Creating Pod ctest-busybox-pod-18714315
2024-09-04 11:15:46,071 - DEBUG - Pod : ctest-busybox-pod-18714315 UUID is 22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:15:46,077 - DEBUG - Pod ctest-nginx-pod-28010203 not in running state.Currently in Pending
2024-09-04 11:15:51,091 - DEBUG - Pod ctest-nginx-pod-28010203 not in running state.Currently in Pending
2024-09-04 11:15:56,098 - INFO - Pod ctest-nginx-pod-28010203 is in running state.Got IP 10.47.255.251
2024-09-04 11:15:56,115 - DEBUG - Pod ctest-nginx-pod-28010203 has vmi 04922c64-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:15:56,115 - INFO - Verified pod ctest-nginx-pod-28010203 in contrail-api
2024-09-04 11:15:56,115 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:15:56,130 - DEBUG - VMI 04922c64-6aaf-11ef-887b-fa163ea5246d is active in agent 10.0.0.29
2024-09-04 11:15:56,131 - INFO - Verified Pod ctest-nginx-pod-28010203 in agent 10.0.0.29
2024-09-04 11:15:56,131 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=3b15bdac-a8fe-449a-9a05-4e8c86392a1d
2024-09-04 11:15:56,136 - INFO - Pod ctest-nginx-pod-28010203 with uuid 3b15bdac-a8fe-449a-9a05-4e8c86392a1d found in kube manager
2024-09-04 11:15:56,136 - INFO - Pod ctest-nginx-pod-28010203 verification passed
2024-09-04 11:15:56,201 - DEBUG - [Pod ctest-nginx-pod-28010203] Cmd: echo ctest-nginx-pod-28010203 > /usr/share/nginx/html/index.html, Output:
2024-09-04 11:15:56,207 - INFO - Pod ctest-nginx-pod-53449890 is in running state.Got IP 10.47.255.250
2024-09-04 11:15:56,262 - DEBUG - Pod ctest-nginx-pod-53449890 has vmi 05c4e612-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:15:56,262 - INFO - Verified pod ctest-nginx-pod-53449890 in contrail-api
2024-09-04 11:15:56,263 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:15:56,275 - DEBUG - VMI 05c4e612-6aaf-11ef-887b-fa163ea5246d is active in agent 10.0.0.29
2024-09-04 11:15:56,275 - INFO - Verified Pod ctest-nginx-pod-53449890 in agent 10.0.0.29
2024-09-04 11:15:56,276 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=95774187-7118-4773-9f00-0920cb4274c4
2024-09-04 11:15:56,281 - INFO - Pod ctest-nginx-pod-53449890 with uuid 95774187-7118-4773-9f00-0920cb4274c4 found in kube manager
2024-09-04 11:15:56,281 - INFO - Pod ctest-nginx-pod-53449890 verification passed
2024-09-04 11:15:56,340 - DEBUG - [Pod ctest-nginx-pod-53449890] Cmd: echo ctest-nginx-pod-53449890 > /usr/share/nginx/html/index.html, Output:
2024-09-04 11:15:56,345 - DEBUG - Pod ctest-busybox-pod-18714315 not in running state.Currently in Pending
2024-09-04 11:16:01,353 - DEBUG - Pod ctest-busybox-pod-18714315 not in running state.Currently in Pending
2024-09-04 11:16:06,359 - INFO - Pod ctest-busybox-pod-18714315 is in running state.Got IP 10.47.255.248
2024-09-04 11:16:06,369 - DEBUG - Pod ctest-busybox-pod-18714315 has vmi 084d354c-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:16:06,369 - INFO - Verified pod ctest-busybox-pod-18714315 in contrail-api
2024-09-04 11:16:06,370 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:16:06,381 - DEBUG - VMI 084d354c-6aaf-11ef-887b-fa163ea5246d is active in agent 10.0.0.29
2024-09-04 11:16:06,381 - INFO - Verified Pod ctest-busybox-pod-18714315 in agent 10.0.0.29
2024-09-04 11:16:06,381 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_VirtualMachineDatabaseList?x=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:06,386 - INFO - Pod ctest-busybox-pod-18714315 with uuid 22861da9-3495-4893-bbbf-6ce457434685 found in kube manager
2024-09-04 11:16:06,386 - INFO - Pod ctest-busybox-pod-18714315 verification passed
2024-09-04 11:16:06,458 - DEBUG - [Pod ctest-busybox-pod-18714315] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-28010203
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-09-04 11:16:06,458 - DEBUG - [Pod Pod ctest-busybox-pod-18714315] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-09-04 11:16:06,458 - DEBUG - [Pod Pod ctest-busybox-pod-18714315] Cmd output: ctest-nginx-pod-28010203
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-09-04 11:16:06,509 - DEBUG - [Pod ctest-busybox-pod-18714315] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-28010203
2024-09-04 11:16:06,509 - DEBUG - [Pod Pod ctest-busybox-pod-18714315] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-09-04 11:16:06,509 - DEBUG - [Pod Pod ctest-busybox-pod-18714315] Cmd output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-28010203
2024-09-04 11:16:06,559 - DEBUG - [Pod ctest-busybox-pod-18714315] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-53449890
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-09-04 11:16:06,559 - DEBUG - [Pod Pod ctest-busybox-pod-18714315] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-09-04 11:16:06,559 - DEBUG - [Pod Pod ctest-busybox-pod-18714315] Cmd output: ctest-nginx-pod-53449890
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-09-04 11:16:06,560 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-28010203': 2, 'ctest-nginx-pod-53449890': 1}
2024-09-04 11:16:06,560 - WARNING - Nothing to delete parallely
2024-09-04 11:16:06,560 - INFO - Deleting pod default:ctest-busybox-pod-18714315
2024-09-04 11:16:06,577 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:06,588 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:11,589 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:11,597 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:16,598 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:16,607 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:21,608 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:21,615 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:26,615 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:26,667 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:31,668 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:31,678 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:36,679 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:36,688 - WARNING - Pod uuid 22861da9-3495-4893-bbbf-6ce457434685 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:41,689 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=22861da9-3495-4893-bbbf-6ce457434685
2024-09-04 11:16:41,696 - DEBUG - Pod 22861da9-3495-4893-bbbf-6ce457434685 is not in agent 10.0.0.29 VM list
2024-09-04 11:16:41,696 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:084d354c-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:16:41,703 - DEBUG - VMI 084d354c-6aaf-11ef-887b-fa163ea5246d is removed from agent 10.0.0.29
2024-09-04 11:16:41,704 - INFO - Verified that pod ctest-busybox-pod-18714315 is removed in agent
2024-09-04 11:16:41,704 - INFO - Deleting Ingress : ctest-nginx-ingress-27824847
2024-09-04 11:16:41,711 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_LoadbalancerDatabaseList?x=aeb238dc-be2f-4b79-a27e-fbe9216a9004
2024-09-04 11:16:41,717 - ERROR - Ingress ctest-nginx-ingress-27824847 with uuid aeb238dc-be2f-4b79-a27e-fbe9216a9004 still found in kube manager
2024-09-04 11:16:42,718 - DEBUG - Requesting: http://10.0.0.36:8108/Snh_LoadbalancerDatabaseList?x=aeb238dc-be2f-4b79-a27e-fbe9216a9004
2024-09-04 11:16:42,723 - INFO - Ingress ctest-nginx-ingress-27824847 with uuid aeb238dc-be2f-4b79-a27e-fbe9216a9004 deleted successfully from kube manager
2024-09-04 11:16:42,723 - INFO - Verifications on Ingress %s cleanup passed
2024-09-04 11:16:42,723 - INFO - Deleting the FIP pool __fip_pool_public__
2024-09-04 11:16:42,886 - DEBUG - Requesting: http://10.0.0.36:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-09-04 11:16:42,901 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2024-09-04 11:16:42,901 - INFO - Deleting VN __public__
2024-09-04 11:16:43,162 - DEBUG - Requesting: http://10.0.0.36:8082/routing-instance/63cc8577-453f-4aec-85e3-1d9c55198d30
2024-09-04 11:16:43,174 - DEBUG - Response Code: 404
2024-09-04 11:16:43,174 - DEBUG - Requesting: http://10.0.0.36:8082/domains
2024-09-04 11:16:43,179 - DEBUG - Requesting: http://10.0.0.36:8082/domain/65bd2701-d5b7-4a96-af07-0ef1a58e1142
2024-09-04 11:16:43,190 - DEBUG - Requesting: http://10.0.0.36:8082/project/6d8fdbe9-f602-4ef6-b721-002cede724a1
2024-09-04 11:16:43,247 - INFO - Validated that VN __public__ is not found in API Server
2024-09-04 11:16:43,247 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2024-09-04 11:16:43,256 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:16:43,266 - DEBUG - VN __public__ is not present in Agent 10.0.0.29
2024-09-04 11:16:43,266 - INFO - Validated that VN __public__ is not in any agent
2024-09-04 11:16:43,266 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:16:43,275 - DEBUG - Requesting: http://10.0.0.36:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-09-04 11:16:43,291 - DEBUG - Requesting: http://10.0.0.36:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-09-04 11:16:43,331 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2024-09-04 11:16:43,331 - INFO - Deleting pod default:ctest-nginx-pod-53449890
2024-09-04 11:16:43,343 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=95774187-7118-4773-9f00-0920cb4274c4
2024-09-04 11:16:43,373 - WARNING - Pod uuid 95774187-7118-4773-9f00-0920cb4274c4 is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:48,378 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=95774187-7118-4773-9f00-0920cb4274c4
2024-09-04 11:16:48,385 - DEBUG - Pod 95774187-7118-4773-9f00-0920cb4274c4 is not in agent 10.0.0.29 VM list
2024-09-04 11:16:48,385 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:05c4e612-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:16:48,394 - DEBUG - VMI 05c4e612-6aaf-11ef-887b-fa163ea5246d is removed from agent 10.0.0.29
2024-09-04 11:16:48,394 - INFO - Verified that pod ctest-nginx-pod-53449890 is removed in agent
2024-09-04 11:16:48,394 - INFO - Deleting pod default:ctest-nginx-pod-28010203
2024-09-04 11:16:48,405 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=3b15bdac-a8fe-449a-9a05-4e8c86392a1d
2024-09-04 11:16:48,417 - WARNING - Pod uuid 3b15bdac-a8fe-449a-9a05-4e8c86392a1d is still seen in agent 10.0.0.29 VM list
2024-09-04 11:16:53,418 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=3b15bdac-a8fe-449a-9a05-4e8c86392a1d
2024-09-04 11:16:53,425 - DEBUG - Pod 3b15bdac-a8fe-449a-9a05-4e8c86392a1d is not in agent 10.0.0.29 VM list
2024-09-04 11:16:53,425 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:04922c64-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:16:53,439 - DEBUG - VMI 04922c64-6aaf-11ef-887b-fa163ea5246d is removed from agent 10.0.0.29
2024-09-04 11:16:53,439 - INFO - Verified that pod ctest-nginx-pod-28010203 is removed in agent
2024-09-04 11:16:53,440 - INFO - Deleting service : ctest-nginx-svc-73392590
2024-09-04 11:16:53,597 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AgentXmppConnectionStatusReq?
2024-09-04 11:16:53,605 - DEBUG - No XMPP flaps were noticed during the test
2024-09-04 11:16:53,605 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:15]
2024-09-04 11:16:53,605 - INFO - --------------------------------------------------------------------------------
2024-09-04 11:16:59,976 - DEBUG - [10.0.0.36]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-09-04 11:17:00,077 - DEBUG - Output : cluster_project={}
2024-09-04 11:17:00,108 - DEBUG - [10.0.0.36]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-09-04 11:17:00,298 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-09-04 11:17:00,303 - DEBUG - [10.0.0.36]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-09-04 11:17:00,426 - DEBUG - Output : cluster_project={}
2024-09-04 11:17:15,507 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:15,547 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:15,622 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:15,661 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:15,762 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:20,819 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:20,852 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:20,975 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-09-04 11:17:21,165 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AgentXmppConnectionStatusReq?
2024-09-04 11:17:23,065 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_ApplicationPolicySetReq?
2024-09-04 11:17:23,073 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AclReq?
2024-09-04 11:17:23,104 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AclReq?
2024-09-04 11:17:25,134 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AclReq?
2024-09-04 11:20:26,123 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_AgentXmppConnectionStatusReq?
2024-09-04 11:20:26,166 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=0dc6a2c7-cafa-4bc0-b853-9d3f8abeb719
2024-09-04 11:20:26,189 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=5e0a1a3d-b283-4817-8927-fc3a911cd26d
2024-09-04 11:20:26,208 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=60778e60-3720-433a-ad3c-85136fcf0fde
2024-09-04 11:20:26,213 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:26,218 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:20:26,223 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:26,227 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:26,232 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=3fb0cf0c-0ec6-447f-8d78-4eeea9501a52
2024-09-04 11:20:31,287 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=3fb0cf0c-0ec6-447f-8d78-4eeea9501a52
2024-09-04 11:20:31,289 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=60778e60-3720-433a-ad3c-85136fcf0fde
2024-09-04 11:20:31,290 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=0dc6a2c7-cafa-4bc0-b853-9d3f8abeb719
2024-09-04 11:20:31,292 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=5e0a1a3d-b283-4817-8927-fc3a911cd26d
2024-09-04 11:20:31,293 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:31,294 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:31,295 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:20:31,296 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:31,316 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35f9157e-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:20:31,318 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3696e4ac-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:20:31,323 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:356aa014-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:20:31,552 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3712f57e-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:20:36,318 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:36,323 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:20:36,325 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:36,328 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:41,338 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:41,340 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:41,341 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:41,929 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:20:46,352 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:46,354 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:46,356 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:46,937 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:20:51,370 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:51,372 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:51,373 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:51,945 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:20:56,389 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:20:56,391 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:20:56,392 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:20:56,952 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:21:01,432 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=cb01adcb-e51c-4e75-85c6-2171aa22dfbb
2024-09-04 11:21:01,433 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=817d0bbb-02e5-4307-9b5d-1981885a47b6
2024-09-04 11:21:01,436 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=10bb53bf-2279-4be9-9e8a-2662f7ecc464
2024-09-04 11:21:01,451 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:388e7716-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:21:01,453 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:390f16f0-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:21:01,456 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:37a12844-6aaf-11ef-887b-fa163ea5246d
2024-09-04 11:21:01,960 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_VmListReq?uuid=40cd483f-76e2-4926-be96-12c86cce4932
2024-09-04 11:21:01,968 - DEBUG - Requesting: http://10.0.0.29:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:381d392a-6aaf-11ef-887b-fa163ea5246d