2025-08-14 01:39:54,974 - DEBUG - [10.0.0.33]: Running cmd : hostname
2025-08-14 01:39:55,239 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-236-1
2025-08-14 01:39:55,239 - DEBUG - [10.0.0.33]: Running cmd : hostname -f
2025-08-14 01:39:55,350 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-236-1.cluster.local
2025-08-14 01:39:55,350 - DEBUG - [10.0.0.33]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-08-14 01:39:55,528 - DEBUG - Output : NAMES
contrail_test_wDZ6ttYK7
k8s_autoscaler_dns-autoscaler-595558c478-tkp9z_kube-system_5baaffbd-5bff-425e-8f4f-d55c0d0b861c_0
k8s_coredns_coredns-77f7cc69db-gxwf9_kube-system_4d269e48-5e95-4d3e-9319-d263b62d9470_0
k8s_opensdn-controller-config-nodemgr_opensdn-controller-config-r7xzp_kube-system_e7076a25-9335-4690-8aae-d3ae38642d28_0
k8s_opensdn-controller-config-svcmonitor_opensdn-controller-config-r7xzp_kube-system_e7076a25-9335-4690-8aae-d3ae38642d28_0
k8s_opensdn-controller-nodemgr_opensdn-controller-control-b7kjw_kube-system_d0cf3afa-0c54-4727-a68e-d375a339254d_0
k8s_opensdn-controller-control-named_opensdn-controller-control-b7kjw_kube-system_d0cf3afa-0c54-4727-a68e-d375a339254d_0
k8s_opensdn-analytics-query-engine_opensdn-analyticsdb-xmdc7_kube-system_25f336e4-1915-4426-ba99-55ddd02c2a42_0
k8s_opensdn-controller-config-schema_opensdn-controller-config-r7xzp_kube-system_e7076a25-9335-4690-8aae-d3ae38642d28_0
k8s_opensdn-analytics-alarm-nodemgr_opensdn-analytics-alarm-t4vt2_kube-system_1629169d-3722-4fd5-af42-0259cdaed3dc_0
k8s_opensdn-analytics-alarm-gen_opensdn-analytics-alarm-t4vt2_kube-system_1629169d-3722-4fd5-af42-0259cdaed3dc_0
k8s_opensdn-controller-control-dns_opensdn-controller-control-b7kjw_kube-system_d0cf3afa-0c54-4727-a68e-d375a339254d_0
k8s_opensdn-analytics-snmp-nodemgr_opensdn-analytics-snmp-72jtk_kube-system_9342d155-889b-4662-a9b4-e84917578b38_0
k8s_opensdn-analytics-snmp-topology_opensdn-analytics-snmp-72jtk_kube-system_9342d155-889b-4662-a9b4-e84917578b38_0
k8s_opensdn-analyticsdb_opensdn-analyticsdb-xmdc7_kube-system_25f336e4-1915-4426-ba99-55ddd02c2a42_0
k8s_opensdn-controller-config-devicemgr_opensdn-controller-config-r7xzp_kube-system_e7076a25-9335-4690-8aae-d3ae38642d28_0
k8s_opensdn-controller-webui-web_opensdn-controller-webui-sr5sf_kube-system_6ab61add-e05b-4f7d-85ba-76562aa1da5d_0
k8s_opensdn-analytics-nodemgr_opensdn-analytics-4nmbz_kube-system_2c0e3812-5287-4366-bcec-53dc032a770a_0
k8s_opensdn-analytics-collector_opensdn-analytics-4nmbz_kube-system_2c0e3812-5287-4366-bcec-53dc032a770a_0
k8s_kafka_opensdn-analytics-alarm-t4vt2_kube-system_1629169d-3722-4fd5-af42-0259cdaed3dc_0
k8s_opensdn-controller-control_opensdn-controller-control-b7kjw_kube-system_d0cf3afa-0c54-4727-a68e-d375a339254d_0
k8s_opensdn-analytics-snmp-collector_opensdn-analytics-snmp-72jtk_kube-system_9342d155-889b-4662-a9b4-e84917578b38_0
k8s_opensdn-analyticsdb-nodemgr_opensdn-analyticsdb-xmdc7_kube-system_25f336e4-1915-4426-ba99-55ddd02c2a42_0
k8s_opensdn-controller-config-api_opensdn-controller-config-r7xzp_kube-system_e7076a25-9335-4690-8aae-d3ae38642d28_0
k8s_opensdn-controller-webui-job_opensdn-controller-webui-sr5sf_kube-system_6ab61add-e05b-4f7d-85ba-76562aa1da5d_0
k8s_opensdn-analytics-api_opensdn-analytics-4nmbz_kube-system_2c0e3812-5287-4366-bcec-53dc032a770a_0
k8s_config-zookeeper_config-zookeeper-4xnvj_kube-system_1860d436-9b0f-4e14-be38-91a706591ffa_0
k8s_redis_redis-q25rm_kube-system_20fbc9b6-076e-4303-8cd2-e6690f6985f8_0
k8s_opensdn-config-database-nodemgr_opensdn-configdb-xgsds_kube-system_123b6a93-768e-47d9-b23f-b2d0d49d64ea_0
k8s_opensdn-configdb_opensdn-configdb-xgsds_kube-system_123b6a93-768e-47d9-b23f-b2d0d49d64ea_0
k8s_rabbitmq_rabbitmq-nbq7q_kube-system_2460b363-d8c8-43f9-9431-e1bba1d4ea39_0
k8s_opensdn-agent-nodemgr_opensdn-agent-9hbcm_kube-system_f60d5ef9-3fe5-4540-889d-b8b2dcc5f3de_0
k8s_opensdn-vrouter-agent_opensdn-agent-9hbcm_kube-system_f60d5ef9-3fe5-4540-889d-b8b2dcc5f3de_0
k8s_opensdn-kube-manager_opensdn-kube-manager-w9g2t_kube-system_8544ef87-1f94-40d4-b488-1bbecd707a39_0
k8s_kube-proxy_kube-proxy-w47pp_kube-system_b230a874-cd9c-4e2e-b1ad-5dee443dcef7_0
k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-236-1_kube-system_736e7cc54be99c9c24b30ce734dd68f8_1
k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-236-1_kube-system_d1700c9043cc30872a7f47ee0eca24bd_1
k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-236-1_kube-system_9cb598f5ed2063836f5f684e1863d126_0
2025-08-14 01:39:55,529 - DEBUG - [10.0.0.33]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-08-14 01:39:55,637 - DEBUG - Output : 127.0.0.1/8
172.17.0.1/16
10.96.0.3/32
10.96.0.1/32
10.0.0.33/24
2025-08-14 01:39:55,637 - DEBUG - [10.0.0.33]: Running cmd : getent hosts 10.0.0.33 | head -n 1 | awk '{print $2}'
2025-08-14 01:39:55,747 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-236-1.cluster.local
2025-08-14 01:39:55,747 - DEBUG - [10.0.0.33]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-08-14 01:39:55,853 - DEBUG - Output : 10.0.0.33/24
2025-08-14 01:39:56,198 - INFO - Using existing project ['default-domain', 'k8s-default'](e445718a-6131-4ffc-b664-ad3d7a5704b5)
2025-08-14 01:39:56,334 - INFO - Using existing project ['default-domain', 'k8s-default'](e445718a-6131-4ffc-b664-ad3d7a5704b5)
2025-08-14 01:39:56,483 - INFO - ================================================================================
2025-08-14 01:39:56,483 - INFO - STARTING TEST : test_ingress_ip_assignment
2025-08-14 01:39:56,484 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2025-08-14 01:39:56,732 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-14 01:39:56,738 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.33': '2'}} with
2025-08-14 01:39:56,738 - INFO - Initial checks done. Running the testcase now
2025-08-14 01:39:56,738 - INFO -
2025-08-14 01:39:56,742 - INFO - Namespace default already exists
2025-08-14 01:39:56,742 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w9g2t_kube-system_8544ef87-1f94-40d4-b488-1bbecd707a39_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-08-14 01:39:56,909 - DEBUG - Output : cluster_project={}
2025-08-14 01:39:56,996 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2025-08-14 01:39:56,996 - DEBUG - Project uuid in Contrail is e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:39:56,996 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w9g2t_kube-system_8544ef87-1f94-40d4-b488-1bbecd707a39_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-08-14 01:39:57,122 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-08-14 01:39:57,122 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=88a11935-a6f1-46c4-8c9a-1ab8b0ab300e
2025-08-14 01:39:57,128 - INFO - Namespace default with uuid 88a11935-a6f1-46c4-8c9a-1ab8b0ab300e found in kube manager
2025-08-14 01:39:57,128 - INFO - Namespace default verification passed
2025-08-14 01:39:57,131 - DEBUG - Service ctest-nginx-svc-70209687 not present
2025-08-14 01:39:57,131 - INFO - Creating service ctest-nginx-svc-70209687
2025-08-14 01:39:57,145 - INFO - Created Service ctest-nginx-svc-70209687
2025-08-14 01:39:57,148 - DEBUG - Pod ctest-nginx-pod-82712715 not present
2025-08-14 01:39:57,149 - INFO - Creating Pod ctest-nginx-pod-82712715
2025-08-14 01:39:57,174 - DEBUG - Pod : ctest-nginx-pod-82712715 UUID is e1e72957-58a9-4b64-8817-25f8c8b7b5f9
2025-08-14 01:39:57,177 - DEBUG - Pod ctest-nginx-pod-65098987 not present
2025-08-14 01:39:57,177 - INFO - Creating Pod ctest-nginx-pod-65098987
2025-08-14 01:39:57,197 - DEBUG - Pod : ctest-nginx-pod-65098987 UUID is 981ce18d-d50b-40af-9a62-e1304e8544bc
2025-08-14 01:39:57,489 - INFO - Created VN __public__, UUID :55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:39:57,718 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-08-14 01:39:57,726 - DEBUG - Requesting: http://10.0.0.33:8082/domain/3268d52a-ba02-4d12-9a8c-d6d02cc3a244
2025-08-14 01:39:57,744 - DEBUG - Requesting: http://10.0.0.33:8082/project/e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:39:57,851 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:39:57,865 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:39:57,878 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:39:57,889 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:39:57,897 - DEBUG - Route Targets: []
2025-08-14 01:39:57,897 - DEBUG - RT names not yet present for VN __public__
2025-08-14 01:40:02,898 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-08-14 01:40:02,904 - DEBUG - Requesting: http://10.0.0.33:8082/domain/3268d52a-ba02-4d12-9a8c-d6d02cc3a244
2025-08-14 01:40:02,912 - DEBUG - Requesting: http://10.0.0.33:8082/project/e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:40:02,955 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:02,964 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:02,973 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:40:02,980 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:40:02,986 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/9b1573b8-2964-44ac-b7f0-046241e2ca29
2025-08-14 01:40:02,991 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 01:40:02,991 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:03,000 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:40:03,012 - INFO - Verified VN network id 12 for VN 55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:03,012 - INFO - Verifications in API Server for VN __public__ passed
2025-08-14 01:40:03,012 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:03,020 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:40:03,026 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:40:03,032 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/9b1573b8-2964-44ac-b7f0-046241e2ca29
2025-08-14 01:40:03,038 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-08-14 01:40:03,043 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6186546925496584205', 'uuid-lslong': '12430258625857239151'}, 'enable': 'true', 'created': '2025-08-14T01:39:57', 'last-modified': '2025-08-14T01:39:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.428518'}
2025-08-14 01:40:03,043 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:03,050 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-14 01:40:03,050 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2025-08-14 01:40:03,051 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2025-08-14 01:40:03,051 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-08-14 01:40:03,056 - DEBUG - Requesting: http://10.0.0.33:8082/domain/3268d52a-ba02-4d12-9a8c-d6d02cc3a244
2025-08-14 01:40:03,062 - DEBUG - Requesting: http://10.0.0.33:8082/project/e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:40:03,092 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:03,102 - DEBUG - =>VN __public__ has no policy to be verified
2025-08-14 01:40:03,102 - DEBUG - Verifying the vn in opserver
2025-08-14 01:40:03,102 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.33
2025-08-14 01:40:03,102 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2025-08-14 01:40:03,108 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2025-08-14 01:40:03,108 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2025-08-14 01:40:03,109 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:03,115 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:03,120 - DEBUG - Do not have enough data to verify VN in agent
2025-08-14 01:40:03,120 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:03,126 - DEBUG - VRF ids for VN __public__: {}
2025-08-14 01:40:03,330 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2025-08-14 01:40:03,543 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-08-14 01:40:03,549 - DEBUG - Requesting: http://10.0.0.33:8082/domain/3268d52a-ba02-4d12-9a8c-d6d02cc3a244
2025-08-14 01:40:03,556 - DEBUG - Requesting: http://10.0.0.33:8082/project/e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:40:03,590 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:03,624 - DEBUG - Requesting: http://10.0.0.33:8082/floating-ip-pool/d2cf67e3-bf9f-42a1-b365-3c0053544f99
2025-08-14 01:40:03,631 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-08-14 01:40:03,637 - DEBUG - Requesting: http://10.0.0.33:8082/domain/3268d52a-ba02-4d12-9a8c-d6d02cc3a244
2025-08-14 01:40:03,647 - DEBUG - Requesting: http://10.0.0.33:8082/project/e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:40:03,731 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/55db07a6-a882-480d-ac81-265ca474b86f
2025-08-14 01:40:03,745 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2025-08-14 01:40:03,745 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2025-08-14 01:40:03,753 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-08-14 01:40:03,765 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2025-08-14 01:40:03,765 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2025-08-14 01:40:03,770 - DEBUG - Ingress ctest-nginx-ingress-21072740 not present
2025-08-14 01:40:03,770 - INFO - Creating Ingress ctest-nginx-ingress-21072740
2025-08-14 01:40:03,779 - INFO - Created Ingress ctest-nginx-ingress-21072740
2025-08-14 01:40:03,783 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-21072740
2025-08-14 01:40:06,789 - DEBUG - For Ingress ctest-nginx-ingress-21072740, Cluster IP: 10.47.255.248, External IPs ['132.169.20.188']
2025-08-14 01:40:06,789 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-21072740
2025-08-14 01:40:06,789 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=889aba24-264c-4b76-af3c-d41367cfd388
2025-08-14 01:40:06,793 - INFO - Ingress ctest-nginx-ingress-21072740 with uuid 889aba24-264c-4b76-af3c-d41367cfd388 found in kube manager
2025-08-14 01:40:06,794 - INFO - Ingress ctest-nginx-ingress-21072740 verification passed
2025-08-14 01:40:06,797 - DEBUG - Pod ctest-busybox-pod-82329379 not present
2025-08-14 01:40:06,797 - INFO - Creating Pod ctest-busybox-pod-82329379
2025-08-14 01:40:06,836 - DEBUG - Pod : ctest-busybox-pod-82329379 UUID is ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:06,852 - DEBUG - Pod ctest-nginx-pod-82712715 not in running state.Currently in Pending
2025-08-14 01:40:11,858 - DEBUG - Pod ctest-nginx-pod-82712715 not in running state.Currently in Pending
2025-08-14 01:40:16,865 - INFO - Pod ctest-nginx-pod-82712715 is in running state.Got IP 10.47.255.250
2025-08-14 01:40:16,919 - DEBUG - Pod ctest-nginx-pod-82712715 has vmi 970e4fdc-78af-11f0-af56-0242d23e4658
2025-08-14 01:40:16,919 - INFO - Verified pod ctest-nginx-pod-82712715 in contrail-api
2025-08-14 01:40:16,919 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:40:16,931 - DEBUG - VMI 970e4fdc-78af-11f0-af56-0242d23e4658 is active in agent 10.0.0.33
2025-08-14 01:40:16,931 - INFO - Verified Pod ctest-nginx-pod-82712715 in agent 10.0.0.33
2025-08-14 01:40:16,931 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=e1e72957-58a9-4b64-8817-25f8c8b7b5f9
2025-08-14 01:40:16,937 - INFO - Pod ctest-nginx-pod-82712715 with uuid e1e72957-58a9-4b64-8817-25f8c8b7b5f9 found in kube manager
2025-08-14 01:40:16,937 - INFO - Pod ctest-nginx-pod-82712715 verification passed
2025-08-14 01:40:17,041 - DEBUG - [Pod ctest-nginx-pod-82712715] Cmd: echo ctest-nginx-pod-82712715 > /usr/share/nginx/html/index.html, Output:
2025-08-14 01:40:17,048 - INFO - Pod ctest-nginx-pod-65098987 is in running state.Got IP 10.47.255.249
2025-08-14 01:40:17,106 - DEBUG - Pod ctest-nginx-pod-65098987 has vmi 979d9660-78af-11f0-af56-0242d23e4658
2025-08-14 01:40:17,106 - INFO - Verified pod ctest-nginx-pod-65098987 in contrail-api
2025-08-14 01:40:17,106 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:40:17,116 - DEBUG - VMI 979d9660-78af-11f0-af56-0242d23e4658 is active in agent 10.0.0.33
2025-08-14 01:40:17,116 - INFO - Verified Pod ctest-nginx-pod-65098987 in agent 10.0.0.33
2025-08-14 01:40:17,116 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=981ce18d-d50b-40af-9a62-e1304e8544bc
2025-08-14 01:40:17,121 - INFO - Pod ctest-nginx-pod-65098987 with uuid 981ce18d-d50b-40af-9a62-e1304e8544bc found in kube manager
2025-08-14 01:40:17,121 - INFO - Pod ctest-nginx-pod-65098987 verification passed
2025-08-14 01:40:17,235 - DEBUG - [Pod ctest-nginx-pod-65098987] Cmd: echo ctest-nginx-pod-65098987 > /usr/share/nginx/html/index.html, Output:
2025-08-14 01:40:17,240 - DEBUG - Pod ctest-busybox-pod-82329379 not in running state.Currently in Pending
2025-08-14 01:40:22,248 - INFO - Pod ctest-busybox-pod-82329379 is in running state.Got IP 10.47.255.247
2025-08-14 01:40:22,302 - DEBUG - Pod ctest-busybox-pod-82329379 has vmi 9c4f7412-78af-11f0-af56-0242d23e4658
2025-08-14 01:40:22,302 - INFO - Verified pod ctest-busybox-pod-82329379 in contrail-api
2025-08-14 01:40:22,302 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:40:22,312 - DEBUG - VMI 9c4f7412-78af-11f0-af56-0242d23e4658 is active in agent 10.0.0.33
2025-08-14 01:40:22,313 - INFO - Verified Pod ctest-busybox-pod-82329379 in agent 10.0.0.33
2025-08-14 01:40:22,313 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:22,318 - INFO - Pod ctest-busybox-pod-82329379 with uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 found in kube manager
2025-08-14 01:40:22,318 - INFO - Pod ctest-busybox-pod-82329379 verification passed
2025-08-14 01:40:22,437 - DEBUG - [Pod ctest-busybox-pod-82329379] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-65098987
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-08-14 01:40:22,437 - DEBUG - [Pod Pod ctest-busybox-pod-82329379] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-08-14 01:40:22,437 - DEBUG - [Pod Pod ctest-busybox-pod-82329379] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-65098987
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-08-14 01:40:22,525 - DEBUG - [Pod ctest-busybox-pod-82329379] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-65098987
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-08-14 01:40:22,525 - DEBUG - [Pod Pod ctest-busybox-pod-82329379] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-08-14 01:40:22,525 - DEBUG - [Pod Pod ctest-busybox-pod-82329379] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-65098987
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-08-14 01:40:22,591 - DEBUG - [Pod ctest-busybox-pod-82329379] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-82712715
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-08-14 01:40:22,591 - DEBUG - [Pod Pod ctest-busybox-pod-82329379] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-08-14 01:40:22,591 - DEBUG - [Pod Pod ctest-busybox-pod-82329379] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-82712715
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-08-14 01:40:22,591 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-82712715': 1, 'ctest-nginx-pod-65098987': 2}
2025-08-14 01:40:22,591 - WARNING - Nothing to delete parallely
2025-08-14 01:40:22,591 - INFO - Deleting pod default:ctest-busybox-pod-82329379
2025-08-14 01:40:22,603 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:22,610 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:27,610 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:27,616 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:32,617 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:32,623 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:37,624 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:37,631 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:42,631 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:42,637 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:47,638 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:47,644 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:52,646 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:52,652 - WARNING - Pod uuid ea06d0e1-002f-4174-a1be-9a4cab94cd79 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:40:57,653 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ea06d0e1-002f-4174-a1be-9a4cab94cd79
2025-08-14 01:40:57,658 - DEBUG - Pod ea06d0e1-002f-4174-a1be-9a4cab94cd79 is not in agent 10.0.0.33 VM list
2025-08-14 01:40:57,658 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9c4f7412-78af-11f0-af56-0242d23e4658
2025-08-14 01:40:57,663 - DEBUG - VMI 9c4f7412-78af-11f0-af56-0242d23e4658 is removed from agent 10.0.0.33
2025-08-14 01:40:57,663 - INFO - Verified that pod ctest-busybox-pod-82329379 is removed in agent
2025-08-14 01:40:57,664 - INFO - Deleting Ingress : ctest-nginx-ingress-21072740
2025-08-14 01:40:57,669 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=889aba24-264c-4b76-af3c-d41367cfd388
2025-08-14 01:40:57,674 - ERROR - Ingress ctest-nginx-ingress-21072740 with uuid 889aba24-264c-4b76-af3c-d41367cfd388 still found in kube manager
2025-08-14 01:40:58,675 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=889aba24-264c-4b76-af3c-d41367cfd388
2025-08-14 01:40:58,679 - ERROR - Ingress ctest-nginx-ingress-21072740 with uuid 889aba24-264c-4b76-af3c-d41367cfd388 still found in kube manager
2025-08-14 01:40:59,680 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=889aba24-264c-4b76-af3c-d41367cfd388
2025-08-14 01:40:59,684 - INFO - Ingress ctest-nginx-ingress-21072740 with uuid 889aba24-264c-4b76-af3c-d41367cfd388 deleted successfully from kube manager
2025-08-14 01:40:59,684 - INFO - Verifications on Ingress %s cleanup passed
2025-08-14 01:40:59,684 - INFO - Deleting the FIP pool __fip_pool_public__
2025-08-14 01:40:59,794 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-08-14 01:40:59,803 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2025-08-14 01:40:59,804 - INFO - Deleting VN __public__
2025-08-14 01:40:59,899 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7ece1494-dbe8-4ead-9d50-2b4b3f868ec2
2025-08-14 01:40:59,904 - DEBUG - Response Code: 404
2025-08-14 01:40:59,904 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2025-08-14 01:40:59,910 - DEBUG - Requesting: http://10.0.0.33:8082/domain/3268d52a-ba02-4d12-9a8c-d6d02cc3a244
2025-08-14 01:40:59,918 - DEBUG - Requesting: http://10.0.0.33:8082/project/e445718a-6131-4ffc-b664-ad3d7a5704b5
2025-08-14 01:40:59,953 - INFO - Validated that VN __public__ is not found in API Server
2025-08-14 01:40:59,953 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2025-08-14 01:40:59,959 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:59,965 - DEBUG - VN __public__ is not present in Agent 10.0.0.33
2025-08-14 01:40:59,965 - INFO - Validated that VN __public__ is not in any agent
2025-08-14 01:40:59,965 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:59,971 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-08-14 01:40:59,977 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-08-14 01:40:59,982 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2025-08-14 01:40:59,982 - INFO - Deleting pod default:ctest-nginx-pod-65098987
2025-08-14 01:40:59,990 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=981ce18d-d50b-40af-9a62-e1304e8544bc
2025-08-14 01:41:00,004 - WARNING - Pod uuid 981ce18d-d50b-40af-9a62-e1304e8544bc is still seen in agent 10.0.0.33 VM list
2025-08-14 01:41:05,004 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=981ce18d-d50b-40af-9a62-e1304e8544bc
2025-08-14 01:41:05,011 - DEBUG - Pod 981ce18d-d50b-40af-9a62-e1304e8544bc is not in agent 10.0.0.33 VM list
2025-08-14 01:41:05,011 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:979d9660-78af-11f0-af56-0242d23e4658
2025-08-14 01:41:05,018 - DEBUG - VMI 979d9660-78af-11f0-af56-0242d23e4658 is removed from agent 10.0.0.33
2025-08-14 01:41:05,018 - INFO - Verified that pod ctest-nginx-pod-65098987 is removed in agent
2025-08-14 01:41:05,019 - INFO - Deleting pod default:ctest-nginx-pod-82712715
2025-08-14 01:41:05,033 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=e1e72957-58a9-4b64-8817-25f8c8b7b5f9
2025-08-14 01:41:05,047 - WARNING - Pod uuid e1e72957-58a9-4b64-8817-25f8c8b7b5f9 is still seen in agent 10.0.0.33 VM list
2025-08-14 01:41:10,049 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=e1e72957-58a9-4b64-8817-25f8c8b7b5f9
2025-08-14 01:41:10,056 - DEBUG - Pod e1e72957-58a9-4b64-8817-25f8c8b7b5f9 is not in agent 10.0.0.33 VM list
2025-08-14 01:41:10,056 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:970e4fdc-78af-11f0-af56-0242d23e4658
2025-08-14 01:41:10,063 - DEBUG - VMI 970e4fdc-78af-11f0-af56-0242d23e4658 is removed from agent 10.0.0.33
2025-08-14 01:41:10,063 - INFO - Verified that pod ctest-nginx-pod-82712715 is removed in agent
2025-08-14 01:41:10,063 - INFO - Deleting service : ctest-nginx-svc-70209687
2025-08-14 01:41:10,572 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-14 01:41:10,578 - DEBUG - No XMPP flaps were noticed during the test
2025-08-14 01:41:10,578 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:14]
2025-08-14 01:41:10,578 - INFO - --------------------------------------------------------------------------------
2025-08-14 01:41:16,995 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w9g2t_kube-system_8544ef87-1f94-40d4-b488-1bbecd707a39_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-08-14 01:41:17,206 - DEBUG - Output : cluster_project={}
2025-08-14 01:41:17,283 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w9g2t_kube-system_8544ef87-1f94-40d4-b488-1bbecd707a39_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-08-14 01:41:17,420 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-08-14 01:41:17,425 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w9g2t_kube-system_8544ef87-1f94-40d4-b488-1bbecd707a39_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-08-14 01:41:17,605 - DEBUG - Output : cluster_project={}
2025-08-14 01:41:32,778 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:32,898 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:33,018 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:38,121 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:38,213 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:43,301 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:43,422 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:43,552 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-08-14 01:41:43,865 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-14 01:41:47,260 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_ApplicationPolicySetReq?
2025-08-14 01:41:47,267 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AclReq?
2025-08-14 01:41:47,294 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AclReq?
2025-08-14 01:41:49,324 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AclReq?
2025-08-14 01:41:51,350 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AclReq?
2025-08-14 01:44:53,449 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2025-08-14 01:44:53,493 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=e7dee291-36d2-4697-b775-2be63bff2e91
2025-08-14 01:44:53,530 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:44:53,546 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:44:53,553 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:44:53,562 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=e4110ae5-d065-4fe7-a76b-7d0fd0000bb0
2025-08-14 01:44:53,569 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=fd1c5918-c163-49d1-af60-47ae2f04d50a
2025-08-14 01:44:53,572 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=acc0b7ef-f27c-4b19-8523-bb976e03346f
2025-08-14 01:44:53,579 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:44:58,592 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=e7dee291-36d2-4697-b775-2be63bff2e91
2025-08-14 01:44:58,597 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:44:58,599 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c6e85946-78af-11f0-af56-0242d23e4658
2025-08-14 01:44:58,613 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:44:58,615 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:44:58,616 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:44:58,622 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=acc0b7ef-f27c-4b19-8523-bb976e03346f
2025-08-14 01:44:58,624 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=e4110ae5-d065-4fe7-a76b-7d0fd0000bb0
2025-08-14 01:44:58,625 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=fd1c5918-c163-49d1-af60-47ae2f04d50a
2025-08-14 01:44:58,636 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c956c4b0-78af-11f0-af56-0242d23e4658
2025-08-14 01:44:58,637 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c799e4ae-78af-11f0-af56-0242d23e4658
2025-08-14 01:44:58,638 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c897144e-78af-11f0-af56-0242d23e4658
2025-08-14 01:45:03,607 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:45:03,628 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:45:03,630 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:45:03,631 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:45:08,613 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:45:08,641 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:45:08,643 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:45:08,644 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:45:13,621 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:45:13,659 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:45:13,661 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:45:13,662 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:45:18,629 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:45:18,673 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:45:18,675 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:45:18,676 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:45:23,635 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:45:23,686 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:45:23,688 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:45:23,690 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:45:28,642 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=27789f2b-951a-410a-a920-3085b703d415
2025-08-14 01:45:28,649 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ca311da4-78af-11f0-af56-0242d23e4658
2025-08-14 01:45:28,703 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=084a889e-ef28-4b60-82d0-c51fac2ed705
2025-08-14 01:45:28,705 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=b4a72db1-739c-4469-b821-09e89c17303e
2025-08-14 01:45:28,706 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VmListReq?uuid=ad563f09-b3de-40fd-ae5d-27226c1dbab9
2025-08-14 01:45:28,715 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cd0497b8-78af-11f0-af56-0242d23e4658
2025-08-14 01:45:28,718 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cbeea8a0-78af-11f0-af56-0242d23e4658
2025-08-14 01:45:28,719 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cb19d6e8-78af-11f0-af56-0242d23e4658