2025-09-29 01:22:38,113 - DEBUG - [10.0.0.48]: Running cmd : hostname
2025-09-29 01:22:38,370 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-256-1
2025-09-29 01:22:38,371 - DEBUG - [10.0.0.48]: Running cmd : hostname -f
2025-09-29 01:22:38,510 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-256-1.cluster.local
2025-09-29 01:22:38,511 - DEBUG - [10.0.0.48]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-09-29 01:22:38,681 - DEBUG - Output : NAMES
contrail_test_UTaOXb9Dl
k8s_autoscaler_dns-autoscaler-595558c478-6tpr4_kube-system_cedea1b8-7754-4c1e-9c38-0c90a8ac0470_0
k8s_coredns_coredns-77f7cc69db-5gdn9_kube-system_17246cf2-7709-428d-8f8a-bbf07e6db709_0
k8s_opensdn-controller-config-nodemgr_opensdn-controller-config-bdvgz_kube-system_a56a2ca4-87f3-4f92-a627-559505948a1d_0
k8s_opensdn-controller-config-svcmonitor_opensdn-controller-config-bdvgz_kube-system_a56a2ca4-87f3-4f92-a627-559505948a1d_0
k8s_opensdn-analytics-query-engine_opensdn-analyticsdb-ld9gw_kube-system_f4d73dc2-0727-407b-8b18-43693ecba470_0
k8s_opensdn-controller-nodemgr_opensdn-controller-control-8cmlj_kube-system_4cdae094-5114-47a9-9bdc-409b2f6dd342_0
k8s_opensdn-controller-control-named_opensdn-controller-control-8cmlj_kube-system_4cdae094-5114-47a9-9bdc-409b2f6dd342_0
k8s_opensdn-controller-config-schema_opensdn-controller-config-bdvgz_kube-system_a56a2ca4-87f3-4f92-a627-559505948a1d_0
k8s_opensdn-analyticsdb_opensdn-analyticsdb-ld9gw_kube-system_f4d73dc2-0727-407b-8b18-43693ecba470_0
k8s_opensdn-controller-control-dns_opensdn-controller-control-8cmlj_kube-system_4cdae094-5114-47a9-9bdc-409b2f6dd342_0
k8s_opensdn-analytics-nodemgr_opensdn-analytics-98pcm_kube-system_58078cd8-be15-43b1-92f8-9f7c63590c33_0
k8s_opensdn-analytics-collector_opensdn-analytics-98pcm_kube-system_58078cd8-be15-43b1-92f8-9f7c63590c33_0
k8s_opensdn-analytics-alarm-nodemgr_opensdn-analytics-alarm-8bqsq_kube-system_4c0ee595-6aa8-4e6b-ad44-ecfcf2f1dcf3_0
k8s_opensdn-analytics-alarm-gen_opensdn-analytics-alarm-8bqsq_kube-system_4c0ee595-6aa8-4e6b-ad44-ecfcf2f1dcf3_0
k8s_opensdn-controller-config-devicemgr_opensdn-controller-config-bdvgz_kube-system_a56a2ca4-87f3-4f92-a627-559505948a1d_0
k8s_opensdn-controller-webui-web_opensdn-controller-webui-l7x7p_kube-system_9ead0826-3446-44f3-b29e-52b5db1548e4_0
k8s_opensdn-analytics-snmp-nodemgr_opensdn-analytics-snmp-469bf_kube-system_bf44ed69-75e5-49c6-a9cc-ea0c4e683b72_0
k8s_opensdn-analytics-snmp-topology_opensdn-analytics-snmp-469bf_kube-system_bf44ed69-75e5-49c6-a9cc-ea0c4e683b72_0
k8s_opensdn-config-database-nodemgr_opensdn-configdb-wr6xv_kube-system_17e29b7b-81e6-4586-85bb-dfbc68e7d039_0
k8s_opensdn-analyticsdb-nodemgr_opensdn-analyticsdb-ld9gw_kube-system_f4d73dc2-0727-407b-8b18-43693ecba470_0
k8s_opensdn-controller-control_opensdn-controller-control-8cmlj_kube-system_4cdae094-5114-47a9-9bdc-409b2f6dd342_0
k8s_opensdn-analytics-api_opensdn-analytics-98pcm_kube-system_58078cd8-be15-43b1-92f8-9f7c63590c33_0
k8s_kafka_opensdn-analytics-alarm-8bqsq_kube-system_4c0ee595-6aa8-4e6b-ad44-ecfcf2f1dcf3_0
k8s_opensdn-controller-config-api_opensdn-controller-config-bdvgz_kube-system_a56a2ca4-87f3-4f92-a627-559505948a1d_0
k8s_opensdn-controller-webui-job_opensdn-controller-webui-l7x7p_kube-system_9ead0826-3446-44f3-b29e-52b5db1548e4_0
k8s_opensdn-analytics-snmp-collector_opensdn-analytics-snmp-469bf_kube-system_bf44ed69-75e5-49c6-a9cc-ea0c4e683b72_0
k8s_opensdn-agent-nodemgr_opensdn-agent-6zt45_kube-system_c078981f-0e07-419f-b898-bb23d1cf7fea_0
k8s_rabbitmq_rabbitmq-6zdnd_kube-system_a6759461-2e9f-44cd-977d-2ef35a440730_0
k8s_redis_redis-fcpd6_kube-system_8c6e23e2-92a8-4e0d-b0d5-5d9c20bdf88d_0
k8s_opensdn-configdb_opensdn-configdb-wr6xv_kube-system_17e29b7b-81e6-4586-85bb-dfbc68e7d039_0
k8s_config-zookeeper_config-zookeeper-fs998_kube-system_40026a3e-86f8-4160-90a5-c5a5af4c3fc1_0
k8s_opensdn-vrouter-agent_opensdn-agent-6zt45_kube-system_c078981f-0e07-419f-b898-bb23d1cf7fea_0
k8s_opensdn-kube-manager_opensdn-kube-manager-gr4lv_kube-system_e0274bf9-3837-4922-9d75-f8fcd37bda5b_0
k8s_kube-proxy_kube-proxy-srkwt_kube-system_54920c8a-aa40-4bd1-a943-16fc1a5f6f8c_0
k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-256-1_kube-system_da049b375a311b75a98a2e49810bfc72_1
k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-256-1_kube-system_62f66361a404098e8e60f98c648e690b_1
k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-256-1_kube-system_672ecfc96d69f5c97738c3dd8c85079c_0
2025-09-29 01:22:38,681 - DEBUG - [10.0.0.48]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-09-29 01:22:38,810 - DEBUG - Output : 127.0.0.1/8
172.17.0.1/16
10.96.0.3/32
10.96.0.1/32
10.0.0.48/24
2025-09-29 01:22:38,810 - DEBUG - [10.0.0.48]: Running cmd : getent hosts 10.0.0.48 | head -n 1 | awk '{print $2}'
2025-09-29 01:22:38,929 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-256-1.cluster.local
2025-09-29 01:22:38,929 - DEBUG - [10.0.0.48]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-09-29 01:22:39,062 - DEBUG - Output : 10.0.0.48/24
2025-09-29 01:22:39,420 - INFO - Using existing project ['default-domain', 'k8s-default'](6a32422f-6ebd-40f4-8a2f-979b8ed959f9)
2025-09-29 01:22:39,563 - INFO - Using existing project ['default-domain', 'k8s-default'](6a32422f-6ebd-40f4-8a2f-979b8ed959f9)
2025-09-29 01:22:39,702 - INFO - ================================================================================
2025-09-29 01:22:39,703 - INFO - STARTING TEST : test_ingress_ip_assignment
2025-09-29 01:22:39,703 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2025-09-29 01:22:40,005 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-09-29 01:22:40,015 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '1'}} with
2025-09-29 01:22:40,015 - INFO - Initial checks done. Running the testcase now
2025-09-29 01:22:40,015 - INFO -
2025-09-29 01:22:40,022 - INFO - Namespace default already exists
2025-09-29 01:22:40,023 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-gr4lv_kube-system_e0274bf9-3837-4922-9d75-f8fcd37bda5b_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-09-29 01:22:40,213 - DEBUG - Output : cluster_project={}
2025-09-29 01:22:40,292 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2025-09-29 01:22:40,292 - DEBUG - Project uuid in Contrail is 6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:22:40,292 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-gr4lv_kube-system_e0274bf9-3837-4922-9d75-f8fcd37bda5b_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-09-29 01:22:40,449 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-09-29 01:22:40,450 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=a9beb805-955f-43b8-aaba-e231684cee03
2025-09-29 01:22:40,454 - INFO - Namespace default with uuid a9beb805-955f-43b8-aaba-e231684cee03 found in kube manager
2025-09-29 01:22:40,454 - INFO - Namespace default verification passed
2025-09-29 01:22:40,457 - DEBUG - Service ctest-nginx-svc-45535623 not present
2025-09-29 01:22:40,457 - INFO - Creating service ctest-nginx-svc-45535623
2025-09-29 01:22:40,468 - INFO - Created Service ctest-nginx-svc-45535623
2025-09-29 01:22:40,472 - DEBUG - Pod ctest-nginx-pod-01951355 not present
2025-09-29 01:22:40,473 - INFO - Creating Pod ctest-nginx-pod-01951355
2025-09-29 01:22:40,509 - DEBUG - Pod : ctest-nginx-pod-01951355 UUID is a95d156a-4b89-43d9-9e44-76aaf5b92c85
2025-09-29 01:22:40,514 - DEBUG - Pod ctest-nginx-pod-97762028 not present
2025-09-29 01:22:40,515 - INFO - Creating Pod ctest-nginx-pod-97762028
2025-09-29 01:22:40,542 - DEBUG - Pod : ctest-nginx-pod-97762028 UUID is 2e32ae34-793a-465d-a6bc-4822e500d524
2025-09-29 01:22:41,048 - INFO - Created VN __public__, UUID :e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:41,328 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-09-29 01:22:41,333 - DEBUG - Requesting: http://10.0.0.48:8082/domain/378c81d7-f70f-43f6-a530-360cd8ae3b4f
2025-09-29 01:22:41,344 - DEBUG - Requesting: http://10.0.0.48:8082/project/6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:22:41,394 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:41,407 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:41,418 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:41,424 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:41,429 - DEBUG - Route Targets: []
2025-09-29 01:22:41,429 - DEBUG - RT names not yet present for VN __public__
2025-09-29 01:22:46,430 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-09-29 01:22:46,435 - DEBUG - Requesting: http://10.0.0.48:8082/domain/378c81d7-f70f-43f6-a530-360cd8ae3b4f
2025-09-29 01:22:46,443 - DEBUG - Requesting: http://10.0.0.48:8082/project/6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:22:46,487 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:46,494 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:46,504 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:46,510 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:46,516 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b19d6586-a516-4936-982e-bb0101b29ea9
2025-09-29 01:22:46,522 - DEBUG - Route Targets: ['target:64512:8000006']
2025-09-29 01:22:46,522 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:46,530 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:46,541 - INFO - Verified VN network id 11 for VN e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:46,541 - INFO - Verifications in API Server for VN __public__ passed
2025-09-29 01:22:46,541 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:46,548 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:46,553 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:22:46,558 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b19d6586-a516-4936-982e-bb0101b29ea9
2025-09-29 01:22:46,563 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-09-29 01:22:46,568 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16665629079474753059', 'uuid-lslong': '12698458552120100744'}, 'enable': 'true', 'created': '2025-09-29T01:22:40', 'last-modified': '2025-09-29T01:22:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.360251'}
2025-09-29 01:22:46,568 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:22:46,575 - DEBUG - Route Targets: ['target:64512:8000006']
2025-09-29 01:22:46,575 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2025-09-29 01:22:46,575 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2025-09-29 01:22:46,575 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-09-29 01:22:46,580 - DEBUG - Requesting: http://10.0.0.48:8082/domain/378c81d7-f70f-43f6-a530-360cd8ae3b4f
2025-09-29 01:22:46,586 - DEBUG - Requesting: http://10.0.0.48:8082/project/6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:22:46,617 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:46,625 - DEBUG - =>VN __public__ has no policy to be verified
2025-09-29 01:22:46,625 - DEBUG - Verifying the vn in opserver
2025-09-29 01:22:46,625 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.48
2025-09-29 01:22:46,625 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks
2025-09-29 01:22:46,630 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2025-09-29 01:22:46,630 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2025-09-29 01:22:46,630 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:22:46,636 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:22:46,640 - DEBUG - Do not have enough data to verify VN in agent
2025-09-29 01:22:46,640 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:22:46,645 - DEBUG - VRF ids for VN __public__: {}
2025-09-29 01:22:46,819 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2025-09-29 01:22:47,070 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-09-29 01:22:47,078 - DEBUG - Requesting: http://10.0.0.48:8082/domain/378c81d7-f70f-43f6-a530-360cd8ae3b4f
2025-09-29 01:22:47,086 - DEBUG - Requesting: http://10.0.0.48:8082/project/6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:22:47,125 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:47,138 - DEBUG - Requesting: http://10.0.0.48:8082/floating-ip-pool/7f6aa3e3-ba40-49b4-94a3-8dd56c2f215e
2025-09-29 01:22:47,145 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-09-29 01:22:47,149 - DEBUG - Requesting: http://10.0.0.48:8082/domain/378c81d7-f70f-43f6-a530-360cd8ae3b4f
2025-09-29 01:22:47,155 - DEBUG - Requesting: http://10.0.0.48:8082/project/6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:22:47,202 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/e7483559-7883-4e23-b039-fcc61a23c788
2025-09-29 01:22:47,212 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2025-09-29 01:22:47,212 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2025-09-29 01:22:47,221 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-09-29 01:22:47,226 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2025-09-29 01:22:47,226 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2025-09-29 01:22:47,230 - DEBUG - Ingress ctest-nginx-ingress-15634904 not present
2025-09-29 01:22:47,231 - INFO - Creating Ingress ctest-nginx-ingress-15634904
2025-09-29 01:22:47,240 - INFO - Created Ingress ctest-nginx-ingress-15634904
2025-09-29 01:22:47,244 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-15634904
2025-09-29 01:22:50,251 - DEBUG - For Ingress ctest-nginx-ingress-15634904, Cluster IP: 10.47.255.248, External IPs ['199.246.30.124']
2025-09-29 01:22:50,251 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-15634904
2025-09-29 01:22:50,251 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=ca9dc48f-3d42-443e-a469-08849aaec384
2025-09-29 01:22:50,255 - INFO - Ingress ctest-nginx-ingress-15634904 with uuid ca9dc48f-3d42-443e-a469-08849aaec384 found in kube manager
2025-09-29 01:22:50,256 - INFO - Ingress ctest-nginx-ingress-15634904 verification passed
2025-09-29 01:22:50,259 - DEBUG - Pod ctest-busybox-pod-17717561 not present
2025-09-29 01:22:50,259 - INFO - Creating Pod ctest-busybox-pod-17717561
2025-09-29 01:22:50,282 - DEBUG - Pod : ctest-busybox-pod-17717561 UUID is 6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:22:50,290 - DEBUG - Pod ctest-nginx-pod-01951355 not in running state.Currently in Pending
2025-09-29 01:22:55,298 - DEBUG - Pod ctest-nginx-pod-01951355 not in running state.Currently in Pending
2025-09-29 01:23:00,307 - INFO - Pod ctest-nginx-pod-01951355 is in running state.Got IP 10.47.255.250
2025-09-29 01:23:00,369 - DEBUG - Pod ctest-nginx-pod-01951355 has vmi cc33166a-9cd2-11f0-9f34-024253811e37
2025-09-29 01:23:00,369 - INFO - Verified pod ctest-nginx-pod-01951355 in contrail-api
2025-09-29 01:23:00,369 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:23:00,382 - DEBUG - VMI cc33166a-9cd2-11f0-9f34-024253811e37 is active in agent 10.0.0.48
2025-09-29 01:23:00,383 - INFO - Verified Pod ctest-nginx-pod-01951355 in agent 10.0.0.48
2025-09-29 01:23:00,383 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=a95d156a-4b89-43d9-9e44-76aaf5b92c85
2025-09-29 01:23:00,387 - INFO - Pod ctest-nginx-pod-01951355 with uuid a95d156a-4b89-43d9-9e44-76aaf5b92c85 found in kube manager
2025-09-29 01:23:00,387 - INFO - Pod ctest-nginx-pod-01951355 verification passed
2025-09-29 01:23:00,478 - DEBUG - [Pod ctest-nginx-pod-01951355] Cmd: echo ctest-nginx-pod-01951355 > /usr/share/nginx/html/index.html, Output:
2025-09-29 01:23:00,487 - INFO - Pod ctest-nginx-pod-97762028 is in running state.Got IP 10.47.255.249
2025-09-29 01:23:00,545 - DEBUG - Pod ctest-nginx-pod-97762028 has vmi cce1b1a2-9cd2-11f0-9f34-024253811e37
2025-09-29 01:23:00,545 - INFO - Verified pod ctest-nginx-pod-97762028 in contrail-api
2025-09-29 01:23:00,545 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:23:00,555 - DEBUG - VMI cce1b1a2-9cd2-11f0-9f34-024253811e37 is active in agent 10.0.0.48
2025-09-29 01:23:00,555 - INFO - Verified Pod ctest-nginx-pod-97762028 in agent 10.0.0.48
2025-09-29 01:23:00,555 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=2e32ae34-793a-465d-a6bc-4822e500d524
2025-09-29 01:23:00,559 - INFO - Pod ctest-nginx-pod-97762028 with uuid 2e32ae34-793a-465d-a6bc-4822e500d524 found in kube manager
2025-09-29 01:23:00,559 - INFO - Pod ctest-nginx-pod-97762028 verification passed
2025-09-29 01:23:00,647 - DEBUG - [Pod ctest-nginx-pod-97762028] Cmd: echo ctest-nginx-pod-97762028 > /usr/share/nginx/html/index.html, Output:
2025-09-29 01:23:00,656 - INFO - Pod ctest-busybox-pod-17717561 is in running state.Got IP 10.47.255.247
2025-09-29 01:23:00,708 - DEBUG - Pod ctest-busybox-pod-17717561 has vmi d1eba81a-9cd2-11f0-9f34-024253811e37
2025-09-29 01:23:00,708 - INFO - Verified pod ctest-busybox-pod-17717561 in contrail-api
2025-09-29 01:23:00,708 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:23:00,720 - DEBUG - VMI d1eba81a-9cd2-11f0-9f34-024253811e37 is active in agent 10.0.0.48
2025-09-29 01:23:00,720 - INFO - Verified Pod ctest-busybox-pod-17717561 in agent 10.0.0.48
2025-09-29 01:23:00,720 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:00,726 - INFO - Pod ctest-busybox-pod-17717561 with uuid 6d7ed156-8577-42c7-bbfc-841869da8ded found in kube manager
2025-09-29 01:23:00,726 - INFO - Pod ctest-busybox-pod-17717561 verification passed
2025-09-29 01:23:00,808 - DEBUG - [Pod ctest-busybox-pod-17717561] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-97762028
2025-09-29 01:23:00,808 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-09-29 01:23:00,808 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-97762028
2025-09-29 01:23:00,912 - DEBUG - [Pod ctest-busybox-pod-17717561] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-97762028
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-09-29 01:23:00,912 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-09-29 01:23:00,912 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-97762028
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-09-29 01:23:01,001 - DEBUG - [Pod ctest-busybox-pod-17717561] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-97762028
2025-09-29 01:23:01,001 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-09-29 01:23:01,001 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-97762028
2025-09-29 01:23:01,101 - DEBUG - [Pod ctest-busybox-pod-17717561] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-97762028
2025-09-29 01:23:01,101 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-09-29 01:23:01,101 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-97762028
2025-09-29 01:23:01,172 - DEBUG - [Pod ctest-busybox-pod-17717561] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-01951355
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-09-29 01:23:01,172 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-09-29 01:23:01,172 - DEBUG - [Pod Pod ctest-busybox-pod-17717561] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-01951355
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-09-29 01:23:01,172 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-01951355': 1, 'ctest-nginx-pod-97762028': 4}
2025-09-29 01:23:01,172 - WARNING - Nothing to delete parallely
2025-09-29 01:23:01,172 - INFO - Deleting pod default:ctest-busybox-pod-17717561
2025-09-29 01:23:01,190 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:01,197 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:06,198 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:06,204 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:11,205 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:11,210 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:16,211 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:16,219 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:21,220 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:21,225 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:26,226 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:26,232 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:31,234 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:31,239 - WARNING - Pod uuid 6d7ed156-8577-42c7-bbfc-841869da8ded is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:36,241 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6d7ed156-8577-42c7-bbfc-841869da8ded
2025-09-29 01:23:36,246 - DEBUG - Pod 6d7ed156-8577-42c7-bbfc-841869da8ded is not in agent 10.0.0.48 VM list
2025-09-29 01:23:36,246 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d1eba81a-9cd2-11f0-9f34-024253811e37
2025-09-29 01:23:36,252 - DEBUG - VMI d1eba81a-9cd2-11f0-9f34-024253811e37 is removed from agent 10.0.0.48
2025-09-29 01:23:36,252 - INFO - Verified that pod ctest-busybox-pod-17717561 is removed in agent
2025-09-29 01:23:36,252 - INFO - Deleting Ingress : ctest-nginx-ingress-15634904
2025-09-29 01:23:36,259 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=ca9dc48f-3d42-443e-a469-08849aaec384
2025-09-29 01:23:36,264 - ERROR - Ingress ctest-nginx-ingress-15634904 with uuid ca9dc48f-3d42-443e-a469-08849aaec384 still found in kube manager
2025-09-29 01:23:37,265 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=ca9dc48f-3d42-443e-a469-08849aaec384
2025-09-29 01:23:37,278 - ERROR - Ingress ctest-nginx-ingress-15634904 with uuid ca9dc48f-3d42-443e-a469-08849aaec384 still found in kube manager
2025-09-29 01:23:38,279 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=ca9dc48f-3d42-443e-a469-08849aaec384
2025-09-29 01:23:38,283 - INFO - Ingress ctest-nginx-ingress-15634904 with uuid ca9dc48f-3d42-443e-a469-08849aaec384 deleted successfully from kube manager
2025-09-29 01:23:38,283 - INFO - Verifications on Ingress %s cleanup passed
2025-09-29 01:23:38,283 - INFO - Deleting the FIP pool __fip_pool_public__
2025-09-29 01:23:38,406 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-09-29 01:23:38,414 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2025-09-29 01:23:38,414 - INFO - Deleting VN __public__
2025-09-29 01:23:38,553 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/c706c4e6-47f9-4f4b-8af9-e2a363cf0505
2025-09-29 01:23:38,561 - DEBUG - Response Code: 404
2025-09-29 01:23:38,561 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-09-29 01:23:38,569 - DEBUG - Requesting: http://10.0.0.48:8082/domain/378c81d7-f70f-43f6-a530-360cd8ae3b4f
2025-09-29 01:23:38,581 - DEBUG - Requesting: http://10.0.0.48:8082/project/6a32422f-6ebd-40f4-8a2f-979b8ed959f9
2025-09-29 01:23:38,619 - INFO - Validated that VN __public__ is not found in API Server
2025-09-29 01:23:38,619 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2025-09-29 01:23:38,625 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:23:38,629 - DEBUG - VN __public__ is not present in Agent 10.0.0.48
2025-09-29 01:23:38,629 - INFO - Validated that VN __public__ is not in any agent
2025-09-29 01:23:38,630 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:23:38,635 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-09-29 01:23:38,639 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-09-29 01:23:38,644 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2025-09-29 01:23:38,644 - INFO - Deleting pod default:ctest-nginx-pod-97762028
2025-09-29 01:23:38,657 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2e32ae34-793a-465d-a6bc-4822e500d524
2025-09-29 01:23:38,668 - WARNING - Pod uuid 2e32ae34-793a-465d-a6bc-4822e500d524 is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:43,669 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2e32ae34-793a-465d-a6bc-4822e500d524
2025-09-29 01:23:43,674 - DEBUG - Pod 2e32ae34-793a-465d-a6bc-4822e500d524 is not in agent 10.0.0.48 VM list
2025-09-29 01:23:43,674 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cce1b1a2-9cd2-11f0-9f34-024253811e37
2025-09-29 01:23:43,679 - DEBUG - VMI cce1b1a2-9cd2-11f0-9f34-024253811e37 is removed from agent 10.0.0.48
2025-09-29 01:23:43,679 - INFO - Verified that pod ctest-nginx-pod-97762028 is removed in agent
2025-09-29 01:23:43,680 - INFO - Deleting pod default:ctest-nginx-pod-01951355
2025-09-29 01:23:43,701 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a95d156a-4b89-43d9-9e44-76aaf5b92c85
2025-09-29 01:23:43,708 - WARNING - Pod uuid a95d156a-4b89-43d9-9e44-76aaf5b92c85 is still seen in agent 10.0.0.48 VM list
2025-09-29 01:23:48,709 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a95d156a-4b89-43d9-9e44-76aaf5b92c85
2025-09-29 01:23:48,714 - DEBUG - Pod a95d156a-4b89-43d9-9e44-76aaf5b92c85 is not in agent 10.0.0.48 VM list
2025-09-29 01:23:48,715 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cc33166a-9cd2-11f0-9f34-024253811e37
2025-09-29 01:23:48,720 - DEBUG - VMI cc33166a-9cd2-11f0-9f34-024253811e37 is removed from agent 10.0.0.48
2025-09-29 01:23:48,720 - INFO - Verified that pod ctest-nginx-pod-01951355 is removed in agent
2025-09-29 01:23:48,720 - INFO - Deleting service : ctest-nginx-svc-45535623
2025-09-29 01:23:49,278 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-09-29 01:23:49,284 - DEBUG - No XMPP flaps were noticed during the test
2025-09-29 01:23:49,284 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:10]
2025-09-29 01:23:49,284 - INFO - --------------------------------------------------------------------------------
2025-09-29 01:23:55,771 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-gr4lv_kube-system_e0274bf9-3837-4922-9d75-f8fcd37bda5b_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-09-29 01:23:55,956 - DEBUG - Output : cluster_project={}
2025-09-29 01:23:56,039 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-gr4lv_kube-system_e0274bf9-3837-4922-9d75-f8fcd37bda5b_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-09-29 01:23:56,191 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-09-29 01:23:56,196 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-gr4lv_kube-system_e0274bf9-3837-4922-9d75-f8fcd37bda5b_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-09-29 01:23:56,478 - DEBUG - Output : cluster_project={}
2025-09-29 01:24:06,672 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:11,757 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:11,870 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:16,952 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:17,072 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:17,192 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:17,311 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:17,434 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-09-29 01:24:17,758 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-09-29 01:24:21,061 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_ApplicationPolicySetReq?
2025-09-29 01:24:21,070 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-09-29 01:24:21,103 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-09-29 01:24:23,131 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-09-29 01:24:25,154 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-09-29 01:27:26,851 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-09-29 01:27:26,928 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=5623f529-4181-4e37-a489-7c512fd78c0b
2025-09-29 01:27:26,952 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:26,959 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=0978323e-5be7-4d03-863f-40abf842b4b7
2025-09-29 01:27:26,975 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:27:26,983 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=1904ff01-737e-4767-b7f2-2dd21af45808
2025-09-29 01:27:26,991 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=f4a76828-7f7f-4686-9013-b01b6c3b194a
2025-09-29 01:27:26,996 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:27,000 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:32,006 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=5623f529-4181-4e37-a489-7c512fd78c0b
2025-09-29 01:27:32,013 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f9344fe4-9cd2-11f0-9f34-024253811e37
2025-09-29 01:27:32,022 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:32,026 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=f4a76828-7f7f-4686-9013-b01b6c3b194a
2025-09-29 01:27:32,027 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:32,030 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:27:32,031 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=0978323e-5be7-4d03-863f-40abf842b4b7
2025-09-29 01:27:32,033 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=1904ff01-737e-4767-b7f2-2dd21af45808
2025-09-29 01:27:32,034 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:32,058 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fae2fe8a-9cd2-11f0-9f34-024253811e37
2025-09-29 01:27:32,059 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f9e5f9d8-9cd2-11f0-9f34-024253811e37
2025-09-29 01:27:32,060 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fb9d4a42-9cd2-11f0-9f34-024253811e37
2025-09-29 01:27:37,056 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:37,058 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:37,061 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:27:37,062 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:42,071 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:27:42,072 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:42,073 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:42,075 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:47,087 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:47,088 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:47,089 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:47,092 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:27:52,109 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:27:52,111 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:52,112 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:52,114 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:57,128 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:27:57,129 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:27:57,131 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:27:57,132 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:28:02,148 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e964b435-93eb-4048-a2fa-2443a4cba7cb
2025-09-29 01:28:02,150 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=da8b7e47-2eb8-408d-814e-1e21e2111265
2025-09-29 01:28:02,151 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=d3709681-030b-4b73-a395-bb8fa288f417
2025-09-29 01:28:02,152 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=801fcdb8-8565-4bfe-b211-3f88e6793858
2025-09-29 01:28:02,164 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fcad3492-9cd2-11f0-9f34-024253811e37
2025-09-29 01:28:02,169 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ff554fe0-9cd2-11f0-9f34-024253811e37
2025-09-29 01:28:02,170 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fe47d924-9cd2-11f0-9f34-024253811e37
2025-09-29 01:28:02,171 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fd77d3a0-9cd2-11f0-9f34-024253811e37