2025-04-14 15:22:07,927 - DEBUG - [10.0.0.65]: Running cmd : hostname
2025-04-14 15:22:08,241 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-k8s-324-1.novalocal
2025-04-14 15:22:08,242 - DEBUG - [10.0.0.65]: Running cmd : hostname -f
2025-04-14 15:22:08,397 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-k8s-324-1.novalocal
2025-04-14 15:22:08,398 - DEBUG - [10.0.0.65]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-04-14 15:22:08,589 - DEBUG - Output : NAMES
contrail_test_gwN7tXZMQ
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
kubemanager_k8s_kubemanager_1
analytics_snmp_snmp-collector_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_kafka_1
analytics_api_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_dns_1
control_control_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_nodemgr_1
config_api_1
config_schema_1
config_dnsmasq_1
config_database_rabbitmq_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
2025-04-14 15:22:08,590 - DEBUG - [10.0.0.65]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-04-14 15:22:08,747 - DEBUG - Output : 172.17.0.1/16
10.0.0.65/24
2025-04-14 15:22:08,747 - DEBUG - [10.0.0.65]: Running cmd : getent hosts 10.0.0.65 | head -n 1 | awk '{print $2}'
2025-04-14 15:22:08,886 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-k8s-324-1.novalocal
2025-04-14 15:22:08,886 - DEBUG - [10.0.0.65]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-04-14 15:22:09,032 - DEBUG - Output : 10.0.0.65/24
2025-04-14 15:22:09,306 - INFO - Using existing project ['default-domain', 'k8s-default'](0fc05407-d665-4205-923f-ae2ce7c6488c)
2025-04-14 15:22:09,386 - INFO - Using existing project ['default-domain', 'k8s-default'](0fc05407-d665-4205-923f-ae2ce7c6488c)
2025-04-14 15:22:09,546 - INFO - ================================================================================
2025-04-14 15:22:09,546 - INFO - STARTING TEST : test_ingress_ip_assignment
2025-04-14 15:22:09,547 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2025-04-14 15:22:09,791 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-14 15:22:09,799 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.65': '0'}} with
2025-04-14 15:22:09,799 - INFO - Initial checks done. Running the testcase now
2025-04-14 15:22:09,799 - INFO -
2025-04-14 15:22:09,803 - INFO - Namespace default already exists
2025-04-14 15:22:09,804 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-14 15:22:10,025 - DEBUG - Output : cluster_project={}
2025-04-14 15:22:10,081 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2025-04-14 15:22:10,081 - DEBUG - Project uuid in Contrail is 0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:22:10,081 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-04-14 15:22:10,293 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-04-14 15:22:10,293 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=05eec543-9d20-4161-a73c-2927d4f3498b
2025-04-14 15:22:10,298 - INFO - Namespace default with uuid 05eec543-9d20-4161-a73c-2927d4f3498b found in kube manager
2025-04-14 15:22:10,298 - INFO - Namespace default verification passed
2025-04-14 15:22:10,302 - DEBUG - Service ctest-nginx-svc-33235061 not present
2025-04-14 15:22:10,302 - INFO - Creating service ctest-nginx-svc-33235061
2025-04-14 15:22:10,329 - INFO - Created Service ctest-nginx-svc-33235061
2025-04-14 15:22:10,334 - DEBUG - Pod ctest-nginx-pod-15378554 not present
2025-04-14 15:22:10,334 - INFO - Creating Pod ctest-nginx-pod-15378554
2025-04-14 15:22:10,393 - DEBUG - Pod : ctest-nginx-pod-15378554 UUID is 8501696e-7347-48ed-bb25-dc5b3647d3bc
2025-04-14 15:22:10,408 - DEBUG - Pod ctest-nginx-pod-34310168 not present
2025-04-14 15:22:10,410 - INFO - Creating Pod ctest-nginx-pod-34310168
2025-04-14 15:22:10,445 - DEBUG - Pod : ctest-nginx-pod-34310168 UUID is ac36d951-b68a-4625-8717-00073398ea44
2025-04-14 15:22:10,621 - INFO - Created VN __public__, UUID :747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:10,759 - DEBUG - Requesting: http://10.0.0.65:8082/domains
2025-04-14 15:22:10,765 - DEBUG - Requesting: http://10.0.0.65:8082/domain/ca44f4ba-6c5d-4509-967f-9c579a8982b1
2025-04-14 15:22:10,783 - DEBUG - Requesting: http://10.0.0.65:8082/project/0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:22:10,847 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:10,859 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:10,872 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:10,878 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:10,884 - DEBUG - Route Targets: []
2025-04-14 15:22:10,884 - DEBUG - RT names not yet present for VN __public__
2025-04-14 15:22:15,885 - DEBUG - Requesting: http://10.0.0.65:8082/domains
2025-04-14 15:22:15,894 - DEBUG - Requesting: http://10.0.0.65:8082/domain/ca44f4ba-6c5d-4509-967f-9c579a8982b1
2025-04-14 15:22:15,908 - DEBUG - Requesting: http://10.0.0.65:8082/project/0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:22:15,955 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:15,967 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:15,977 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:15,988 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:15,995 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/ba44dba7-85da-4ba9-a31b-0296cbf61fe8
2025-04-14 15:22:16,003 - DEBUG - Route Targets: ['target:64512:8000007']
2025-04-14 15:22:16,003 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:16,015 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:16,033 - INFO - Verified VN network id 15 for VN 747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:16,034 - INFO - Verifications in API Server for VN __public__ passed
2025-04-14 15:22:16,034 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:16,044 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:16,053 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:22:16,065 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/ba44dba7-85da-4ba9-a31b-0296cbf61fe8
2025-04-14 15:22:16,074 - DEBUG - Requesting: http://10.0.0.65:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-04-14 15:22:16,082 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8394572117212284797', 'uuid-lslong': '9564964390905645182'}, 'enable': 'true', 'created': '2025-04-14T15:22:10', 'last-modified': '2025-04-14T15:22:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.389699'}
2025-04-14 15:22:16,082 - DEBUG - Requesting: http://10.0.0.65:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:22:16,093 - DEBUG - Route Targets: ['target:64512:8000007']
2025-04-14 15:22:16,094 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2025-04-14 15:22:16,095 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2025-04-14 15:22:16,095 - DEBUG - Requesting: http://10.0.0.65:8082/domains
2025-04-14 15:22:16,100 - DEBUG - Requesting: http://10.0.0.65:8082/domain/ca44f4ba-6c5d-4509-967f-9c579a8982b1
2025-04-14 15:22:16,107 - DEBUG - Requesting: http://10.0.0.65:8082/project/0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:22:16,161 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:16,173 - DEBUG - =>VN __public__ has no policy to be verified
2025-04-14 15:22:16,173 - DEBUG - Verifying the vn in opserver
2025-04-14 15:22:16,173 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.65
2025-04-14 15:22:16,173 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks
2025-04-14 15:22:16,179 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2025-04-14 15:22:16,179 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2025-04-14 15:22:16,179 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:22:16,185 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:22:16,191 - DEBUG - Do not have enough data to verify VN in agent
2025-04-14 15:22:16,191 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:22:16,198 - DEBUG - VRF ids for VN __public__: {}
2025-04-14 15:22:16,331 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2025-04-14 15:22:16,432 - DEBUG - Requesting: http://10.0.0.65:8082/domains
2025-04-14 15:22:16,439 - DEBUG - Requesting: http://10.0.0.65:8082/domain/ca44f4ba-6c5d-4509-967f-9c579a8982b1
2025-04-14 15:22:16,449 - DEBUG - Requesting: http://10.0.0.65:8082/project/0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:22:16,529 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:16,543 - DEBUG - Requesting: http://10.0.0.65:8082/floating-ip-pool/55f02999-b7ed-4fd5-9d6f-fbe5a12acbd5
2025-04-14 15:22:16,550 - DEBUG - Requesting: http://10.0.0.65:8082/domains
2025-04-14 15:22:16,556 - DEBUG - Requesting: http://10.0.0.65:8082/domain/ca44f4ba-6c5d-4509-967f-9c579a8982b1
2025-04-14 15:22:16,566 - DEBUG - Requesting: http://10.0.0.65:8082/project/0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:22:16,614 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/747f82dd-3fd6-477d-84bd-946fa931087e
2025-04-14 15:22:16,634 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2025-04-14 15:22:16,634 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2025-04-14 15:22:16,647 - DEBUG - Requesting: http://10.0.0.65:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-04-14 15:22:16,654 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2025-04-14 15:22:16,654 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2025-04-14 15:22:16,657 - DEBUG - Ingress ctest-nginx-ingress-99066947 not present
2025-04-14 15:22:16,658 - INFO - Creating Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:16,665 - INFO - Created Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:16,668 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:19,674 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:22,678 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:25,685 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:28,690 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:31,696 - DEBUG - For Ingress ctest-nginx-ingress-99066947, Cluster IP: 10.47.255.246, External IPs ['37.164.226.252']
2025-04-14 15:22:31,696 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-99066947
2025-04-14 15:22:31,697 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:22:31,708 - INFO - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 found in kube manager
2025-04-14 15:22:31,709 - INFO - Ingress ctest-nginx-ingress-99066947 verification passed
2025-04-14 15:22:31,715 - DEBUG - Pod ctest-busybox-pod-22369422 not present
2025-04-14 15:22:31,716 - INFO - Creating Pod ctest-busybox-pod-22369422
2025-04-14 15:22:31,782 - DEBUG - Pod : ctest-busybox-pod-22369422 UUID is 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:22:31,807 - DEBUG - Pod ctest-nginx-pod-15378554 not in running state.Currently in Pending
2025-04-14 15:22:36,817 - DEBUG - Pod ctest-nginx-pod-15378554 not in running state.Currently in Pending
2025-04-14 15:22:41,825 - INFO - Pod ctest-nginx-pod-15378554 is in running state.Got IP 10.47.255.248
2025-04-14 15:22:41,840 - DEBUG - Pod ctest-nginx-pod-15378554 has vmi 40441454-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:22:41,840 - INFO - Verified pod ctest-nginx-pod-15378554 in contrail-api
2025-04-14 15:22:41,840 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:22:41,851 - DEBUG - VMI 40441454-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65
2025-04-14 15:22:41,852 - INFO - Verified Pod ctest-nginx-pod-15378554 in agent 10.0.0.65
2025-04-14 15:22:41,852 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=8501696e-7347-48ed-bb25-dc5b3647d3bc
2025-04-14 15:22:41,857 - INFO - Pod ctest-nginx-pod-15378554 with uuid 8501696e-7347-48ed-bb25-dc5b3647d3bc found in kube manager
2025-04-14 15:22:41,857 - INFO - Pod ctest-nginx-pod-15378554 verification passed
2025-04-14 15:22:41,923 - DEBUG - [Pod ctest-nginx-pod-15378554] Cmd: echo ctest-nginx-pod-15378554 > /usr/share/nginx/html/index.html, Output:
2025-04-14 15:22:41,930 - INFO - Pod ctest-nginx-pod-34310168 is in running state.Got IP 10.47.255.247
2025-04-14 15:22:41,946 - DEBUG - Pod ctest-nginx-pod-34310168 has vmi 4303f8ee-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:22:41,946 - INFO - Verified pod ctest-nginx-pod-34310168 in contrail-api
2025-04-14 15:22:41,946 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:22:41,958 - DEBUG - VMI 4303f8ee-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65
2025-04-14 15:22:41,958 - INFO - Verified Pod ctest-nginx-pod-34310168 in agent 10.0.0.65
2025-04-14 15:22:41,958 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=ac36d951-b68a-4625-8717-00073398ea44
2025-04-14 15:22:41,964 - INFO - Pod ctest-nginx-pod-34310168 with uuid ac36d951-b68a-4625-8717-00073398ea44 found in kube manager
2025-04-14 15:22:41,964 - INFO - Pod ctest-nginx-pod-34310168 verification passed
2025-04-14 15:22:42,015 - DEBUG - [Pod ctest-nginx-pod-34310168] Cmd: echo ctest-nginx-pod-34310168 > /usr/share/nginx/html/index.html, Output:
2025-04-14 15:22:42,020 - DEBUG - Pod ctest-busybox-pod-22369422 not in running state.Currently in Pending
2025-04-14 15:22:47,030 - DEBUG - Pod ctest-busybox-pod-22369422 not in running state.Currently in Pending
2025-04-14 15:22:52,037 - DEBUG - Pod ctest-busybox-pod-22369422 not in running state.Currently in Pending
2025-04-14 15:22:57,045 - INFO - Pod ctest-busybox-pod-22369422 is in running state.Got IP 10.47.255.245
2025-04-14 15:22:57,064 - DEBUG - Pod ctest-busybox-pod-22369422 has vmi 4e39892c-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:22:57,065 - INFO - Verified pod ctest-busybox-pod-22369422 in contrail-api
2025-04-14 15:22:57,066 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:22:57,077 - DEBUG - VMI 4e39892c-1944-11f0-89f7-fa163ec8eaa3 is active in agent 10.0.0.65
2025-04-14 15:22:57,078 - INFO - Verified Pod ctest-busybox-pod-22369422 in agent 10.0.0.65
2025-04-14 15:22:57,078 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:22:57,082 - INFO - Pod ctest-busybox-pod-22369422 with uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad found in kube manager
2025-04-14 15:22:57,082 - INFO - Pod ctest-busybox-pod-22369422 verification passed
2025-04-14 15:22:57,132 - DEBUG - [Pod ctest-busybox-pod-22369422] Cmd: wget http://10.47.255.246:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.246:80 (10.47.255.246:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-15378554
2025-04-14 15:22:57,132 - DEBUG - [Pod Pod ctest-busybox-pod-22369422] Cmd wget http://10.47.255.246:80/ -O - -T 5 -t 1 passed
2025-04-14 15:22:57,133 - DEBUG - [Pod Pod ctest-busybox-pod-22369422] Cmd output: Connecting to 10.47.255.246:80 (10.47.255.246:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-15378554
2025-04-14 15:22:57,185 - DEBUG - [Pod ctest-busybox-pod-22369422] Cmd: wget http://10.47.255.246:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-34310168
Connecting to 10.47.255.246:80 (10.47.255.246:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-04-14 15:22:57,185 - DEBUG - [Pod Pod ctest-busybox-pod-22369422] Cmd wget http://10.47.255.246:80/ -O - -T 5 -t 1 passed
2025-04-14 15:22:57,185 - DEBUG - [Pod Pod ctest-busybox-pod-22369422] Cmd output: ctest-nginx-pod-34310168
Connecting to 10.47.255.246:80 (10.47.255.246:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-04-14 15:22:57,185 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-15378554': 1, 'ctest-nginx-pod-34310168': 1}
2025-04-14 15:22:57,186 - WARNING - Nothing to delete parallely
2025-04-14 15:22:57,186 - INFO - Deleting pod default:ctest-busybox-pod-22369422
2025-04-14 15:22:57,197 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:22:57,204 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:02,205 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:02,213 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:07,214 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:07,221 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:12,222 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:12,229 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:17,230 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:17,237 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:22,237 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:22,243 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:27,245 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:27,252 - WARNING - Pod uuid 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:32,253 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=75e3d744-27a8-4e97-b4c4-4d82c57aa0ad
2025-04-14 15:23:32,259 - DEBUG - Pod 75e3d744-27a8-4e97-b4c4-4d82c57aa0ad is not in agent 10.0.0.65 VM list
2025-04-14 15:23:32,259 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4e39892c-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:23:32,264 - DEBUG - VMI 4e39892c-1944-11f0-89f7-fa163ec8eaa3 is removed from agent 10.0.0.65
2025-04-14 15:23:32,264 - INFO - Verified that pod ctest-busybox-pod-22369422 is removed in agent
2025-04-14 15:23:32,265 - INFO - Deleting Ingress : ctest-nginx-ingress-99066947
2025-04-14 15:23:32,272 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:23:32,277 - ERROR - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 still found in kube manager
2025-04-14 15:23:33,279 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:23:33,285 - ERROR - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 still found in kube manager
2025-04-14 15:23:34,285 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:23:34,291 - ERROR - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 still found in kube manager
2025-04-14 15:23:35,292 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:23:35,298 - ERROR - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 still found in kube manager
2025-04-14 15:23:36,299 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:23:36,304 - ERROR - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 still found in kube manager
2025-04-14 15:23:37,304 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=18168be2-5b47-405d-801b-5512e6692af7
2025-04-14 15:23:37,309 - INFO - Ingress ctest-nginx-ingress-99066947 with uuid 18168be2-5b47-405d-801b-5512e6692af7 deleted successfully from kube manager
2025-04-14 15:23:37,309 - INFO - Verifications on Ingress %s cleanup passed
2025-04-14 15:23:37,309 - INFO - Deleting the FIP pool __fip_pool_public__
2025-04-14 15:23:37,378 - DEBUG - Requesting: http://10.0.0.65:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-04-14 15:23:37,384 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2025-04-14 15:23:37,384 - INFO - Deleting VN __public__
2025-04-14 15:23:37,532 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/525dbeb2-add5-457c-b6be-6effc13da542
2025-04-14 15:23:37,540 - DEBUG - Response Code: 404
2025-04-14 15:23:37,540 - DEBUG - Requesting: http://10.0.0.65:8082/domains
2025-04-14 15:23:37,549 - DEBUG - Requesting: http://10.0.0.65:8082/domain/ca44f4ba-6c5d-4509-967f-9c579a8982b1
2025-04-14 15:23:37,559 - DEBUG - Requesting: http://10.0.0.65:8082/project/0fc05407-d665-4205-923f-ae2ce7c6488c
2025-04-14 15:23:37,630 - INFO - Validated that VN __public__ is not found in API Server
2025-04-14 15:23:37,630 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2025-04-14 15:23:37,639 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:23:37,656 - DEBUG - VN __public__ is not present in Agent 10.0.0.65
2025-04-14 15:23:37,656 - INFO - Validated that VN __public__ is not in any agent
2025-04-14 15:23:37,656 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:23:37,665 - DEBUG - Requesting: http://10.0.0.65:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-04-14 15:23:37,673 - DEBUG - Requesting: http://10.0.0.65:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-04-14 15:23:37,680 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2025-04-14 15:23:37,681 - INFO - Deleting pod default:ctest-nginx-pod-34310168
2025-04-14 15:23:37,701 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=ac36d951-b68a-4625-8717-00073398ea44
2025-04-14 15:23:37,732 - WARNING - Pod uuid ac36d951-b68a-4625-8717-00073398ea44 is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:42,733 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=ac36d951-b68a-4625-8717-00073398ea44
2025-04-14 15:23:42,739 - DEBUG - Pod ac36d951-b68a-4625-8717-00073398ea44 is not in agent 10.0.0.65 VM list
2025-04-14 15:23:42,739 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4303f8ee-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:23:42,745 - DEBUG - VMI 4303f8ee-1944-11f0-89f7-fa163ec8eaa3 is removed from agent 10.0.0.65
2025-04-14 15:23:42,745 - INFO - Verified that pod ctest-nginx-pod-34310168 is removed in agent
2025-04-14 15:23:42,745 - INFO - Deleting pod default:ctest-nginx-pod-15378554
2025-04-14 15:23:42,756 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=8501696e-7347-48ed-bb25-dc5b3647d3bc
2025-04-14 15:23:42,778 - WARNING - Pod uuid 8501696e-7347-48ed-bb25-dc5b3647d3bc is still seen in agent 10.0.0.65 VM list
2025-04-14 15:23:47,779 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=8501696e-7347-48ed-bb25-dc5b3647d3bc
2025-04-14 15:23:47,785 - DEBUG - Pod 8501696e-7347-48ed-bb25-dc5b3647d3bc is not in agent 10.0.0.65 VM list
2025-04-14 15:23:47,785 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:40441454-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:23:47,791 - WARNING - VMI 40441454-1944-11f0-89f7-fa163ec8eaa3 of Pod ctest-nginx-pod-15378554 is still seen in agent 10.0.0.65
2025-04-14 15:23:47,791 - DEBUG - [{'index': '7', 'name': 'tapeth0-850169', 'uuid': '40441454-1944-11f0-89f7-fa163ec8eaa3', 'vrf_name': '--ERROR--', 'active': 'Inactive < vn-null vrf-null os-state-down ipv4_inactive ipv6_inactive l2_inactive >', 'ipv4_active': 'Ipv4 Inactive < vn-null vrf-null os-state-down l3-disabled >', 'l2_active': 'L2 Inactive < vn-null vrf-null os-state-down l2-disabled >', 'ip6_active': 'Ipv6 Inactive < vn-null vrf-null os-state-down l3-disabled no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '-1', 'l2_label': '-1', 'vxlan_id': '0', 'vn_name': None, 'vm_uuid': None, 'vm_name': None, 'ip_addr': '10.47.255.248', 'mac_addr': '02:40:44:14:54:19', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '18', 'fabric_port': 'FabricPort', 'alloc_linklocal_ip': 'LL-Disable', 'analyzer_name': None, 'config_name': None, 'sg_uuid_list': [], 'static_route_list': None, 'vm_project_uuid': '00000000-0000-0000-0000-000000000000', 'admin_state': 'Enabled', 'flow_key_idx': '0', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Invalid', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Inactive', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}]
2025-04-14 15:23:52,792 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=8501696e-7347-48ed-bb25-dc5b3647d3bc
2025-04-14 15:23:52,799 - DEBUG - Pod 8501696e-7347-48ed-bb25-dc5b3647d3bc is not in agent 10.0.0.65 VM list
2025-04-14 15:23:52,799 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:40441454-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:23:52,804 - DEBUG - VMI 40441454-1944-11f0-89f7-fa163ec8eaa3 is removed from agent 10.0.0.65
2025-04-14 15:23:52,804 - INFO - Verified that pod ctest-nginx-pod-15378554 is removed in agent
2025-04-14 15:23:52,805 - INFO - Deleting service : ctest-nginx-svc-33235061
2025-04-14 15:23:53,270 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-14 15:23:53,276 - DEBUG - No XMPP flaps were noticed during the test
2025-04-14 15:23:53,276 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:44]
2025-04-14 15:23:53,276 - INFO - --------------------------------------------------------------------------------
2025-04-14 15:23:59,642 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-14 15:23:59,895 - DEBUG - Output : cluster_project={}
2025-04-14 15:23:59,980 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-04-14 15:24:00,227 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-04-14 15:24:00,233 - DEBUG - [10.0.0.65]: Running cmd : docker exec --privileged -it kubemanager_k8s_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-04-14 15:24:00,475 - DEBUG - Output : cluster_project={}
2025-04-14 15:24:25,592 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:24:25,630 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:24:35,690 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:24:40,740 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:24:50,799 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:25:00,952 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:25:00,998 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:25:01,045 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-04-14 15:25:01,586 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-14 15:25:07,348 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_ApplicationPolicySetReq?
2025-04-14 15:25:07,354 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AclReq?
2025-04-14 15:25:07,382 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AclReq?
2025-04-14 15:25:09,412 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AclReq?
2025-04-14 15:25:11,447 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AclReq?
2025-04-14 15:25:13,479 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AclReq?
2025-04-14 15:25:15,512 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AclReq?
2025-04-14 15:28:15,575 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_AgentXmppConnectionStatusReq?
2025-04-14 15:28:15,655 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6bd415fe-e98e-48af-a2da-bdfa88bcc1d1
2025-04-14 15:28:15,670 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:15,674 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:15,684 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:15,693 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=e3669168-e797-4753-8ee2-8fc3c2ceb4eb
2025-04-14 15:28:15,704 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=c1049d1d-c993-4863-a2fe-6e6cdbc5efbf
2025-04-14 15:28:15,713 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b35a624-e217-48d7-8a15-24de6107c93a
2025-04-14 15:28:15,723 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:20,780 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6bd415fe-e98e-48af-a2da-bdfa88bcc1d1
2025-04-14 15:28:20,783 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:20,784 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:20,785 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=c1049d1d-c993-4863-a2fe-6e6cdbc5efbf
2025-04-14 15:28:20,786 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:20,789 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=e3669168-e797-4753-8ee2-8fc3c2ceb4eb
2025-04-14 15:28:20,790 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b35a624-e217-48d7-8a15-24de6107c93a
2025-04-14 15:28:20,791 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:20,817 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:82519f42-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:28:20,819 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:887ea9b4-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:28:25,816 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b35a624-e217-48d7-8a15-24de6107c93a
2025-04-14 15:28:25,818 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:25,820 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:25,821 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:25,822 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:25,824 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=e3669168-e797-4753-8ee2-8fc3c2ceb4eb
2025-04-14 15:28:25,844 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b3dae8e-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:28:25,850 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:84717478-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:28:30,844 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:30,848 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:30,849 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:30,851 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:35,866 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:35,867 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:35,869 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:35,870 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:40,884 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:40,886 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:40,887 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:40,889 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:45,902 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:45,904 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:45,906 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:45,907 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:50,918 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=0b374156-010b-47c8-b560-d5ab5e7dba3f
2025-04-14 15:28:50,925 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:50,927 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:50,928 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=a3055c58-8aa6-42c0-be29-f44e41ab9d5d
2025-04-14 15:28:50,934 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9762548a-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:28:50,968 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8f34d08a-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:28:55,962 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:28:55,964 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=5edfa4f7-3630-40b2-abc1-be6963f7a708
2025-04-14 15:28:55,976 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:91f60028-1944-11f0-89f7-fa163ec8eaa3
2025-04-14 15:29:00,980 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_VmListReq?uuid=6da8bfc9-4a24-4503-8bfd-6785bdebccf9
2025-04-14 15:29:00,986 - DEBUG - Requesting: http://10.0.0.65:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9545aefe-1944-11f0-89f7-fa163ec8eaa3