2026-05-18 03:23:10,300 - INFO - Domain Default found not creating 2026-05-18 03:23:10,480 - INFO - Project ctest-TestSvcHC-89508386 not found, creating it 2026-05-18 03:23:11,084 - INFO - Created Project:ctest-TestSvcHC-89508386, ID : 87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:12,849 - INFO - ================================================================================ 2026-05-18 03:23:12,849 - INFO - STARTING TEST : test_svc_hc_basic 2026-05-18 03:23:14,176 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '2'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '3'}} with 2026-05-18 03:23:14,176 - INFO - Initial checks done. Running the testcase now 2026-05-18 03:23:14,176 - INFO - 2026-05-18 03:23:14,904 - DEBUG - Response for create_network : {'network': {'id': 'b0a07802-9d72-461f-b22b-24cec69bb09c', 'name': 'ctest-mgmt_vn-11041831', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-mgmt_vn-11041831'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:15,180 - DEBUG - Response for create_subnet : {'subnet': {'id': '09392414-8683-4f29-bf62-04f06fb938a0', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': 'b0a07802-9d72-461f-b22b-24cec69bb09c', 'ip_version': 4, 'cidr': '80.46.199.64/26', 'allocation_pools': [{'start': '80.46.199.66', 'end': '80.46.199.126'}], 'gateway_ip': '80.46.199.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '80.46.199.66', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:15,213 - INFO - Created VN ctest-mgmt_vn-11041831 2026-05-18 03:23:15,224 - DEBUG - VN ctest-mgmt_vn-11041831 UUID is b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:15,306 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:15,653 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:15,687 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:15,706 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:15,838 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:15,852 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:15,862 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d72bce73-8327-47f8-b35c-4223226411f6 2026-05-18 03:23:15,873 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d72bce73-8327-47f8-b35c-4223226411f6 2026-05-18 03:23:15,882 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/0d008855-cdb9-4eda-91e6-f9a4e6460b21 2026-05-18 03:23:15,889 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:15,889 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:15,899 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d72bce73-8327-47f8-b35c-4223226411f6 2026-05-18 03:23:15,921 - INFO - Verified VN network id 13 for VN b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:15,921 - INFO - Verifications in API Server for VN ctest-mgmt_vn-11041831 passed 2026-05-18 03:23:15,922 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:15,936 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d72bce73-8327-47f8-b35c-4223226411f6 2026-05-18 03:23:15,948 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d72bce73-8327-47f8-b35c-4223226411f6 2026-05-18 03:23:15,959 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/0d008855-cdb9-4eda-91e6-f9a4e6460b21 2026-05-18 03:23:15,981 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12727304499575801375', 'uuid-lslong': '12838395633263685788'}, 'enable': 'true', 'created': '2026-05-18T03:23:14', 'last-modified': '2026-05-18T03:23:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.854561'} 2026-05-18 03:23:15,993 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:16,002 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12727304499575801375', 'uuid-lslong': '12838395633263685788'}, 'enable': 'true', 'created': '2026-05-18T03:23:14', 'last-modified': '2026-05-18T03:23:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.875815'} 2026-05-18 03:23:16,012 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:16,020 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12727304499575801375', 'uuid-lslong': '12838395633263685788'}, 'enable': 'true', 'created': '2026-05-18T03:23:14', 'last-modified': '2026-05-18T03:23:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.893009'} 2026-05-18 03:23:16,028 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:16,028 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-11041831 passed 2026-05-18 03:23:16,029 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-11041831 in API_Server ====== 2026-05-18 03:23:16,029 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:16,038 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:16,050 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:16,156 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b0a07802-9d72-461f-b22b-24cec69bb09c 2026-05-18 03:23:16,171 - DEBUG - =>VN ctest-mgmt_vn-11041831 has no policy to be verified 2026-05-18 03:23:16,171 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:16,171 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:16,171 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:16,491 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:16,563 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831?flat'} 2026-05-18 03:23:16,563 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:16,563 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:16,882 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:16,950 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831?flat'} 2026-05-18 03:23:16,950 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:16,950 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:17,264 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:17,339 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831?flat'} 2026-05-18 03:23:17,339 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-11041831 is found in opserver 2026-05-18 03:23:17,362 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:17,374 - DEBUG - VRF ids for VN ctest-mgmt_vn-11041831: {} 2026-05-18 03:23:17,686 - DEBUG - Response for create_network : {'network': {'id': 'd352e530-fff6-4d1f-9236-c52ec2b9b9d9', 'name': 'ctest-left_vn-17122559', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-left_vn-17122559'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:17,921 - DEBUG - Response for create_subnet : {'subnet': {'id': 'da04c9c2-0c79-4181-be7f-6517663e6559', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': 'd352e530-fff6-4d1f-9236-c52ec2b9b9d9', 'ip_version': 4, 'cidr': '99.83.161.192/26', 'allocation_pools': [{'start': '99.83.161.194', 'end': '99.83.161.254'}], 'gateway_ip': '99.83.161.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '99.83.161.194', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:17,946 - INFO - Created VN ctest-left_vn-17122559 2026-05-18 03:23:17,961 - DEBUG - VN ctest-left_vn-17122559 UUID is d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,035 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:18,042 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:18,055 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:18,171 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,187 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,201 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c8273561-2b8d-4c4b-b6fd-660db024796d 2026-05-18 03:23:18,213 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c8273561-2b8d-4c4b-b6fd-660db024796d 2026-05-18 03:23:18,225 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e3fe6249-2c5b-4582-8f64-2927acbcde20 2026-05-18 03:23:18,238 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:18,238 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,253 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c8273561-2b8d-4c4b-b6fd-660db024796d 2026-05-18 03:23:18,276 - INFO - Verified VN network id 14 for VN d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,277 - INFO - Verifications in API Server for VN ctest-left_vn-17122559 passed 2026-05-18 03:23:18,277 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,290 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c8273561-2b8d-4c4b-b6fd-660db024796d 2026-05-18 03:23:18,298 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c8273561-2b8d-4c4b-b6fd-660db024796d 2026-05-18 03:23:18,306 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e3fe6249-2c5b-4582-8f64-2927acbcde20 2026-05-18 03:23:18,322 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15227485288708590879', 'uuid-lslong': '10535825182905973209'}, 'enable': 'true', 'created': '2026-05-18T03:23:17', 'last-modified': '2026-05-18T03:23:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481950'} 2026-05-18 03:23:18,329 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:18,336 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15227485288708590879', 'uuid-lslong': '10535825182905973209'}, 'enable': 'true', 'created': '2026-05-18T03:23:17', 'last-modified': '2026-05-18T03:23:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487841'} 2026-05-18 03:23:18,349 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:18,355 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15227485288708590879', 'uuid-lslong': '10535825182905973209'}, 'enable': 'true', 'created': '2026-05-18T03:23:17', 'last-modified': '2026-05-18T03:23:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.508463'} 2026-05-18 03:23:18,360 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:18,361 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-17122559 passed 2026-05-18 03:23:18,361 - DEBUG - ====Verifying policy data for ctest-left_vn-17122559 in API_Server ====== 2026-05-18 03:23:18,361 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:18,370 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:18,389 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:18,497 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d352e530-fff6-4d1f-9236-c52ec2b9b9d9 2026-05-18 03:23:18,510 - DEBUG - =>VN ctest-left_vn-17122559 has no policy to be verified 2026-05-18 03:23:18,510 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:18,510 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:18,511 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:18,601 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559?flat'} 2026-05-18 03:23:18,601 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:18,601 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:18,695 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559?flat'} 2026-05-18 03:23:18,695 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:18,695 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:18,762 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559?flat'} 2026-05-18 03:23:18,762 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-17122559 is found in opserver 2026-05-18 03:23:18,786 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:18,801 - DEBUG - VRF ids for VN ctest-left_vn-17122559: {} 2026-05-18 03:23:19,081 - DEBUG - Response for create_network : {'network': {'id': '7f39330c-034a-44d7-9afb-ed4daad8afbf', 'name': 'ctest-right_vn-54178871', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-right_vn-54178871'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:19,314 - DEBUG - Response for create_subnet : {'subnet': {'id': '0aa065fa-f465-4ff9-b30d-1ac94e53cc58', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': '7f39330c-034a-44d7-9afb-ed4daad8afbf', 'ip_version': 4, 'cidr': '223.46.147.0/26', 'allocation_pools': [{'start': '223.46.147.2', 'end': '223.46.147.62'}], 'gateway_ip': '223.46.147.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '223.46.147.2', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:19,342 - INFO - Created VN ctest-right_vn-54178871 2026-05-18 03:23:19,357 - DEBUG - VN ctest-right_vn-54178871 UUID is 7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,446 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:19,455 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:19,470 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:19,576 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,590 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,603 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebc98e4d-66ca-4e8d-96b6-b2adcb569715 2026-05-18 03:23:19,611 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebc98e4d-66ca-4e8d-96b6-b2adcb569715 2026-05-18 03:23:19,619 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/98c8d5ce-5b73-444f-9b60-2e52e2f20c83 2026-05-18 03:23:19,627 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:19,627 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,636 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebc98e4d-66ca-4e8d-96b6-b2adcb569715 2026-05-18 03:23:19,656 - INFO - Verified VN network id 15 for VN 7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,656 - INFO - Verifications in API Server for VN ctest-right_vn-54178871 passed 2026-05-18 03:23:19,656 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,667 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebc98e4d-66ca-4e8d-96b6-b2adcb569715 2026-05-18 03:23:19,676 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebc98e4d-66ca-4e8d-96b6-b2adcb569715 2026-05-18 03:23:19,684 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/98c8d5ce-5b73-444f-9b60-2e52e2f20c83 2026-05-18 03:23:19,700 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9167414643177178327', 'uuid-lslong': '11167780618829868991'}, 'enable': 'true', 'created': '2026-05-18T03:23:19', 'last-modified': '2026-05-18T03:23:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434392'} 2026-05-18 03:23:19,707 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:19,712 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9167414643177178327', 'uuid-lslong': '11167780618829868991'}, 'enable': 'true', 'created': '2026-05-18T03:23:19', 'last-modified': '2026-05-18T03:23:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443214'} 2026-05-18 03:23:19,718 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:19,724 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9167414643177178327', 'uuid-lslong': '11167780618829868991'}, 'enable': 'true', 'created': '2026-05-18T03:23:19', 'last-modified': '2026-05-18T03:23:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.456901'} 2026-05-18 03:23:19,730 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:19,730 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-54178871 passed 2026-05-18 03:23:19,731 - DEBUG - ====Verifying policy data for ctest-right_vn-54178871 in API_Server ====== 2026-05-18 03:23:19,731 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:19,738 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:19,749 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:19,852 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7f39330c-034a-44d7-9afb-ed4daad8afbf 2026-05-18 03:23:19,866 - DEBUG - =>VN ctest-right_vn-54178871 has no policy to be verified 2026-05-18 03:23:19,866 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:19,867 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:19,867 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:19,953 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871?flat'} 2026-05-18 03:23:19,953 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:19,953 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:20,030 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871?flat'} 2026-05-18 03:23:20,030 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:20,030 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:20,102 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871?flat'} 2026-05-18 03:23:20,102 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-54178871 is found in opserver 2026-05-18 03:23:20,126 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:20,138 - DEBUG - VRF ids for VN ctest-right_vn-54178871: {} 2026-05-18 03:23:20,306 - DEBUG - Services list from nova: [, , , ] 2026-05-18 03:23:21,530 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 03:23:23,009 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1) 2026-05-18 03:23:23,009 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-20008532'] 2026-05-18 03:23:23,320 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-20008532'] created succesfully 2026-05-18 03:23:23,829 - DEBUG - Image by name tiny_nat_fw not found 2026-05-18 03:23:23,829 - DEBUG - Installing image tiny_nat_fw 2026-05-18 03:23:23,829 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-05-18 03:23:23,829 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-18 03:23:23,829 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-18 03:23:23,830 - DEBUG - Unzip image 2026-05-18 03:23:23,830 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-18 03:23:23,850 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-05-18 03:23:23,850 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-20008532'] 2026-05-18 03:23:23,984 - INFO - Service template: ['default-domain', 'ctest-service_template_1-20008532'] deleted successfully. 2026-05-18 03:23:23,984 - INFO - Skip interface_detach for VM ctest-right_vm-72576722 in state BUILD 2026-05-18 03:23:23,984 - INFO - Deleting VM ctest-right_vm-72576722 2026-05-18 03:23:24,022 - ERROR - VM ctest-right_vm-72576722 has failed to come up 2026-05-18 03:23:24,022 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:24,022 - ERROR - VM ctest-right_vm-72576722 has failed to come up 2026-05-18 03:23:24,022 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:24,099 - INFO - Skip interface_detach for VM ctest-left_vm-06452318 in state BUILD 2026-05-18 03:23:24,100 - INFO - Deleting VM ctest-left_vm-06452318 2026-05-18 03:23:24,100 - ERROR - VM ctest-left_vm-06452318 has failed to come up 2026-05-18 03:23:24,101 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:24,101 - ERROR - VM ctest-left_vm-06452318 has failed to come up 2026-05-18 03:23:24,102 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:24,174 - INFO - Deleting VN ctest-right_vn-54178871 2026-05-18 03:23:24,228 - DEBUG - VN 7f39330c-034a-44d7-9afb-ed4daad8afbf still in use: Unable to complete operation on network 7f39330c-034a-44d7-9afb-ed4daad8afbf. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1e9fbde7-9707-4093-b02a-6d1336ef014c'] 2026-05-18 03:23:24,228 - WARNING - Deleting VN ctest-right_vn-54178871 failed..Will retry 2026-05-18 03:23:26,421 - DEBUG - Response for deleting network () 2026-05-18 03:23:26,421 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ebc98e4d-66ca-4e8d-96b6-b2adcb569715 2026-05-18 03:23:26,427 - DEBUG - Response Code: 404 2026-05-18 03:23:26,428 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:26,446 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:26,463 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:26,588 - INFO - Validated that VN ctest-right_vn-54178871 is not found in API Server 2026-05-18 03:23:26,601 - DEBUG - VN ctest-right_vn-54178871 is not present in Agent 10.0.0.65 2026-05-18 03:23:26,611 - DEBUG - VN ctest-right_vn-54178871 is not present in Agent 10.0.0.130 2026-05-18 03:23:26,611 - INFO - Validated that VN ctest-right_vn-54178871 is not in any agent 2026-05-18 03:23:26,643 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-54178871 info 2026-05-18 03:23:26,644 - INFO - Deleting VN ctest-left_vn-17122559 2026-05-18 03:23:26,826 - DEBUG - Response for deleting network () 2026-05-18 03:23:26,826 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c8273561-2b8d-4c4b-b6fd-660db024796d 2026-05-18 03:23:26,834 - DEBUG - Response Code: 404 2026-05-18 03:23:26,834 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:26,840 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:26,852 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:26,969 - INFO - Validated that VN ctest-left_vn-17122559 is not found in API Server 2026-05-18 03:23:26,983 - DEBUG - VN ctest-left_vn-17122559 is not present in Agent 10.0.0.65 2026-05-18 03:23:26,994 - DEBUG - VN ctest-left_vn-17122559 is not present in Agent 10.0.0.130 2026-05-18 03:23:26,994 - INFO - Validated that VN ctest-left_vn-17122559 is not in any agent 2026-05-18 03:23:27,028 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-17122559 info 2026-05-18 03:23:27,028 - INFO - Deleting VN ctest-mgmt_vn-11041831 2026-05-18 03:23:27,246 - DEBUG - Response for deleting network () 2026-05-18 03:23:27,247 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d72bce73-8327-47f8-b35c-4223226411f6 2026-05-18 03:23:27,258 - DEBUG - Response Code: 404 2026-05-18 03:23:27,259 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:27,285 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:27,312 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:27,430 - INFO - Validated that VN ctest-mgmt_vn-11041831 is not found in API Server 2026-05-18 03:23:27,443 - DEBUG - VN ctest-mgmt_vn-11041831 is not present in Agent 10.0.0.65 2026-05-18 03:23:27,455 - DEBUG - VN ctest-mgmt_vn-11041831 is not present in Agent 10.0.0.130 2026-05-18 03:23:27,455 - INFO - Validated that VN ctest-mgmt_vn-11041831 is not in any agent 2026-05-18 03:23:27,493 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-11041831 info 2026-05-18 03:23:28,796 - DEBUG - No XMPP flaps were noticed during the test 2026-05-18 03:23:28,796 - INFO -
2026-05-18 03:23:28,796 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16]
2026-05-18 03:23:28,796 - INFO - -------------------------------------------------------------------------------- 2026-05-18 03:23:28,801 - INFO - ================================================================================ 2026-05-18 03:23:28,801 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-05-18 03:23:30,081 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '2'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '3'}} with 2026-05-18 03:23:30,081 - INFO - Initial checks done. Running the testcase now 2026-05-18 03:23:30,081 - INFO - 2026-05-18 03:23:30,380 - DEBUG - Response for create_network : {'network': {'id': '589b3e77-9089-4671-827d-d4f58f2bfe24', 'name': 'ctest-mgmt_vn-34302355', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-mgmt_vn-34302355'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:30,671 - DEBUG - Response for create_subnet : {'subnet': {'id': '1117ceb4-dacc-4fad-9158-16039a47819c', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': '589b3e77-9089-4671-827d-d4f58f2bfe24', 'ip_version': 4, 'cidr': '50.184.238.128/26', 'allocation_pools': [{'start': '50.184.238.130', 'end': '50.184.238.190'}], 'gateway_ip': '50.184.238.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '50.184.238.130', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:30,695 - INFO - Created VN ctest-mgmt_vn-34302355 2026-05-18 03:23:30,707 - DEBUG - VN ctest-mgmt_vn-34302355 UUID is 589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:30,809 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:30,816 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:30,829 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:30,934 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:30,947 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:30,956 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6d36f662-7f8c-4984-8cac-e1725b686b19 2026-05-18 03:23:30,966 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6d36f662-7f8c-4984-8cac-e1725b686b19 2026-05-18 03:23:30,973 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/98574af3-30bb-47e4-a5d6-1256136119de 2026-05-18 03:23:30,981 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:30,981 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:30,993 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6d36f662-7f8c-4984-8cac-e1725b686b19 2026-05-18 03:23:31,012 - INFO - Verified VN network id 13 for VN 589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:31,012 - INFO - Verifications in API Server for VN ctest-mgmt_vn-34302355 passed 2026-05-18 03:23:31,012 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:31,024 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6d36f662-7f8c-4984-8cac-e1725b686b19 2026-05-18 03:23:31,033 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6d36f662-7f8c-4984-8cac-e1725b686b19 2026-05-18 03:23:31,042 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/98574af3-30bb-47e4-a5d6-1256136119de 2026-05-18 03:23:31,055 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6384765579974755953', 'uuid-lslong': '9402905748153564708'}, 'enable': 'true', 'created': '2026-05-18T03:23:30', 'last-modified': '2026-05-18T03:23:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447036'} 2026-05-18 03:23:31,061 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:31,067 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6384765579974755953', 'uuid-lslong': '9402905748153564708'}, 'enable': 'true', 'created': '2026-05-18T03:23:30', 'last-modified': '2026-05-18T03:23:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451948'} 2026-05-18 03:23:31,074 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:31,081 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6384765579974755953', 'uuid-lslong': '9402905748153564708'}, 'enable': 'true', 'created': '2026-05-18T03:23:30', 'last-modified': '2026-05-18T03:23:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466504'} 2026-05-18 03:23:31,090 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:31,090 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-34302355 passed 2026-05-18 03:23:31,090 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-34302355 in API_Server ====== 2026-05-18 03:23:31,090 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:31,097 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:31,110 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:31,208 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/589b3e77-9089-4671-827d-d4f58f2bfe24 2026-05-18 03:23:31,218 - DEBUG - =>VN ctest-mgmt_vn-34302355 has no policy to be verified 2026-05-18 03:23:31,218 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:31,218 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:31,219 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:31,234 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355?flat'} 2026-05-18 03:23:31,234 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:31,234 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:31,248 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355?flat'} 2026-05-18 03:23:31,248 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:31,248 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:31,261 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355?flat'} 2026-05-18 03:23:31,261 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-mgmt_vn-34302355 is found in opserver 2026-05-18 03:23:31,282 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:31,293 - DEBUG - VRF ids for VN ctest-mgmt_vn-34302355: {} 2026-05-18 03:23:31,590 - DEBUG - Response for create_network : {'network': {'id': '3deee3bd-114e-487c-8f54-b9cb740c09fb', 'name': 'ctest-left_vn-50207446', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-left_vn-50207446'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:31,866 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd457218a-df63-41d6-aca3-8f3bcac1a67d', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': '3deee3bd-114e-487c-8f54-b9cb740c09fb', 'ip_version': 4, 'cidr': '141.226.21.128/26', 'allocation_pools': [{'start': '141.226.21.130', 'end': '141.226.21.190'}], 'gateway_ip': '141.226.21.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '141.226.21.130', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:31,889 - INFO - Created VN ctest-left_vn-50207446 2026-05-18 03:23:31,901 - DEBUG - VN ctest-left_vn-50207446 UUID is 3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:31,976 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:31,986 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:32,000 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:32,091 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:32,105 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:32,114 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8d292d65-b84b-4f21-a5cc-2c7ced30adda 2026-05-18 03:23:32,121 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8d292d65-b84b-4f21-a5cc-2c7ced30adda 2026-05-18 03:23:32,132 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/d353feb2-e091-4cf6-a943-8f5ab1cd9822 2026-05-18 03:23:32,139 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:32,139 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:32,149 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8d292d65-b84b-4f21-a5cc-2c7ced30adda 2026-05-18 03:23:32,164 - INFO - Verified VN network id 14 for VN 3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:32,164 - INFO - Verifications in API Server for VN ctest-left_vn-50207446 passed 2026-05-18 03:23:32,164 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:32,175 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8d292d65-b84b-4f21-a5cc-2c7ced30adda 2026-05-18 03:23:32,186 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8d292d65-b84b-4f21-a5cc-2c7ced30adda 2026-05-18 03:23:32,197 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/d353feb2-e091-4cf6-a943-8f5ab1cd9822 2026-05-18 03:23:32,209 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4462754681949407356', 'uuid-lslong': '10328084128943835643'}, 'enable': 'true', 'created': '2026-05-18T03:23:31', 'last-modified': '2026-05-18T03:23:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414078'} 2026-05-18 03:23:32,215 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:32,221 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4462754681949407356', 'uuid-lslong': '10328084128943835643'}, 'enable': 'true', 'created': '2026-05-18T03:23:31', 'last-modified': '2026-05-18T03:23:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421730'} 2026-05-18 03:23:32,227 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:32,233 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4462754681949407356', 'uuid-lslong': '10328084128943835643'}, 'enable': 'true', 'created': '2026-05-18T03:23:31', 'last-modified': '2026-05-18T03:23:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432505'} 2026-05-18 03:23:32,241 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:32,241 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-50207446 passed 2026-05-18 03:23:32,241 - DEBUG - ====Verifying policy data for ctest-left_vn-50207446 in API_Server ====== 2026-05-18 03:23:32,241 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:32,247 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:32,260 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:32,356 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3deee3bd-114e-487c-8f54-b9cb740c09fb 2026-05-18 03:23:32,366 - DEBUG - =>VN ctest-left_vn-50207446 has no policy to be verified 2026-05-18 03:23:32,366 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:32,366 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:32,366 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:32,379 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446?flat'} 2026-05-18 03:23:32,379 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:32,379 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:32,396 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446?flat'} 2026-05-18 03:23:32,396 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:32,396 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:32,411 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446?flat'} 2026-05-18 03:23:32,411 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-left_vn-50207446 is found in opserver 2026-05-18 03:23:32,436 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:32,446 - DEBUG - VRF ids for VN ctest-left_vn-50207446: {} 2026-05-18 03:23:32,725 - DEBUG - Response for create_network : {'network': {'id': '1f71e105-1716-4b99-adf9-4bb100b1d28a', 'name': 'ctest-right_vn-71451825', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-right_vn-71451825'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:32,961 - DEBUG - Response for create_subnet : {'subnet': {'id': '8b63b322-2cae-4efa-b967-7315eb886957', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': '1f71e105-1716-4b99-adf9-4bb100b1d28a', 'ip_version': 4, 'cidr': '43.202.183.64/26', 'allocation_pools': [{'start': '43.202.183.66', 'end': '43.202.183.126'}], 'gateway_ip': '43.202.183.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.202.183.66', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:32,985 - INFO - Created VN ctest-right_vn-71451825 2026-05-18 03:23:33,002 - DEBUG - VN ctest-right_vn-71451825 UUID is 1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,077 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:33,083 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:33,097 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:33,204 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,216 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,227 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2d03eed1-3ed2-4647-94ed-8eafeae1b8ac 2026-05-18 03:23:33,238 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2d03eed1-3ed2-4647-94ed-8eafeae1b8ac 2026-05-18 03:23:33,246 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4a856ae6-d19d-4332-b58f-ee73489889f7 2026-05-18 03:23:33,255 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:33,255 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,267 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2d03eed1-3ed2-4647-94ed-8eafeae1b8ac 2026-05-18 03:23:33,286 - INFO - Verified VN network id 15 for VN 1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,286 - INFO - Verifications in API Server for VN ctest-right_vn-71451825 passed 2026-05-18 03:23:33,286 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,301 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2d03eed1-3ed2-4647-94ed-8eafeae1b8ac 2026-05-18 03:23:33,309 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2d03eed1-3ed2-4647-94ed-8eafeae1b8ac 2026-05-18 03:23:33,316 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4a856ae6-d19d-4332-b58f-ee73489889f7 2026-05-18 03:23:33,329 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2265839499522493337', 'uuid-lslong': '12536134261355434634'}, 'enable': 'true', 'created': '2026-05-18T03:23:32', 'last-modified': '2026-05-18T03:23:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415690'} 2026-05-18 03:23:33,337 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:33,343 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2265839499522493337', 'uuid-lslong': '12536134261355434634'}, 'enable': 'true', 'created': '2026-05-18T03:23:32', 'last-modified': '2026-05-18T03:23:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437028'} 2026-05-18 03:23:33,351 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:33,358 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2265839499522493337', 'uuid-lslong': '12536134261355434634'}, 'enable': 'true', 'created': '2026-05-18T03:23:32', 'last-modified': '2026-05-18T03:23:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451328'} 2026-05-18 03:23:33,365 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:23:33,365 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-71451825 passed 2026-05-18 03:23:33,365 - DEBUG - ====Verifying policy data for ctest-right_vn-71451825 in API_Server ====== 2026-05-18 03:23:33,365 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:33,373 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:33,387 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:33,489 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1f71e105-1716-4b99-adf9-4bb100b1d28a 2026-05-18 03:23:33,504 - DEBUG - =>VN ctest-right_vn-71451825 has no policy to be verified 2026-05-18 03:23:33,504 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:33,504 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:33,504 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:33,522 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825?flat'} 2026-05-18 03:23:33,522 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:33,522 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:33,544 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825?flat'} 2026-05-18 03:23:33,544 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:33,544 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:33,558 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825?flat'} 2026-05-18 03:23:33,558 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-right_vn-71451825 is found in opserver 2026-05-18 03:23:33,581 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:33,591 - DEBUG - VRF ids for VN ctest-right_vn-71451825: {} 2026-05-18 03:23:33,886 - DEBUG - Response for create_network : {'network': {'id': '334cd8ce-fc97-4d4b-ba9f-a52124f3c82e', 'name': 'ctest-trans_left_vn-31796026', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-trans_left_vn-31796026'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:34,129 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a5aa808-9841-4416-858a-d113bc041207', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': '334cd8ce-fc97-4d4b-ba9f-a52124f3c82e', 'ip_version': 4, 'cidr': '212.248.110.192/26', 'allocation_pools': [{'start': '212.248.110.194', 'end': '212.248.110.254'}], 'gateway_ip': '212.248.110.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '212.248.110.194', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:34,156 - INFO - Created VN ctest-trans_left_vn-31796026 2026-05-18 03:23:34,168 - DEBUG - VN ctest-trans_left_vn-31796026 UUID is 334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,251 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:34,258 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:34,270 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:34,372 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,384 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,394 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/98d5d951-dd9e-425b-b76a-20d9173c1e59 2026-05-18 03:23:34,404 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/98d5d951-dd9e-425b-b76a-20d9173c1e59 2026-05-18 03:23:34,414 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/3f24f390-1dc9-4139-bce5-cfe06c6ce877 2026-05-18 03:23:34,425 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:23:34,425 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,438 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/98d5d951-dd9e-425b-b76a-20d9173c1e59 2026-05-18 03:23:34,458 - INFO - Verified VN network id 16 for VN 334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,458 - INFO - Verifications in API Server for VN ctest-trans_left_vn-31796026 passed 2026-05-18 03:23:34,458 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,469 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/98d5d951-dd9e-425b-b76a-20d9173c1e59 2026-05-18 03:23:34,478 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/98d5d951-dd9e-425b-b76a-20d9173c1e59 2026-05-18 03:23:34,485 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/3f24f390-1dc9-4139-bce5-cfe06c6ce877 2026-05-18 03:23:34,499 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3696567777676971339', 'uuid-lslong': '13447648574124050478'}, 'enable': 'true', 'created': '2026-05-18T03:23:33', 'last-modified': '2026-05-18T03:23:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437512'} 2026-05-18 03:23:34,507 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:23:34,513 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3696567777676971339', 'uuid-lslong': '13447648574124050478'}, 'enable': 'true', 'created': '2026-05-18T03:23:33', 'last-modified': '2026-05-18T03:23:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437612'} 2026-05-18 03:23:34,520 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:23:34,528 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3696567777676971339', 'uuid-lslong': '13447648574124050478'}, 'enable': 'true', 'created': '2026-05-18T03:23:33', 'last-modified': '2026-05-18T03:23:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465867'} 2026-05-18 03:23:34,535 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:23:34,535 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-31796026 passed 2026-05-18 03:23:34,535 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-31796026 in API_Server ====== 2026-05-18 03:23:34,535 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:34,542 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:34,553 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:34,650 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/334cd8ce-fc97-4d4b-ba9f-a52124f3c82e 2026-05-18 03:23:34,660 - DEBUG - =>VN ctest-trans_left_vn-31796026 has no policy to be verified 2026-05-18 03:23:34,660 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:34,660 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:34,660 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:34,674 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026?flat'} 2026-05-18 03:23:34,674 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:34,674 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:34,690 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026?flat'} 2026-05-18 03:23:34,691 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:34,691 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:34,706 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026?flat'} 2026-05-18 03:23:34,706 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-trans_left_vn-31796026 is found in opserver 2026-05-18 03:23:34,727 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:34,737 - DEBUG - VRF ids for VN ctest-trans_left_vn-31796026: {} 2026-05-18 03:23:35,034 - DEBUG - Response for create_network : {'network': {'id': 'd6d844e4-2f5c-477c-84fd-357c266f0ed3', 'name': 'ctest-trans_right_vn-50238011', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'project_id': '87a05d6624484dd7b0cddab1086856f9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-89508386', 'ctest-trans_right_vn-50238011'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:35,250 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c358eab3-da9c-4f81-8b1b-151da8328d16', 'name': '', 'tenant_id': '87a05d6624484dd7b0cddab1086856f9', 'network_id': 'd6d844e4-2f5c-477c-84fd-357c266f0ed3', 'ip_version': 4, 'cidr': '4.224.15.0/26', 'allocation_pools': [{'start': '4.224.15.2', 'end': '4.224.15.62'}], 'gateway_ip': '4.224.15.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.224.15.2', 'tags': [], 'project_id': '87a05d6624484dd7b0cddab1086856f9'}} 2026-05-18 03:23:35,272 - INFO - Created VN ctest-trans_right_vn-50238011 2026-05-18 03:23:35,285 - DEBUG - VN ctest-trans_right_vn-50238011 UUID is d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,371 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:35,377 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:35,391 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:35,485 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,498 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,508 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/211fbbc7-dac7-4acb-8682-99047b85b1cc 2026-05-18 03:23:35,516 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/211fbbc7-dac7-4acb-8682-99047b85b1cc 2026-05-18 03:23:35,524 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/a896e4c6-64ec-4e96-8d8f-87e72da0b6cb 2026-05-18 03:23:35,531 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:23:35,531 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,541 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/211fbbc7-dac7-4acb-8682-99047b85b1cc 2026-05-18 03:23:35,557 - INFO - Verified VN network id 17 for VN d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,557 - INFO - Verifications in API Server for VN ctest-trans_right_vn-50238011 passed 2026-05-18 03:23:35,557 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,567 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/211fbbc7-dac7-4acb-8682-99047b85b1cc 2026-05-18 03:23:35,574 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/211fbbc7-dac7-4acb-8682-99047b85b1cc 2026-05-18 03:23:35,582 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/a896e4c6-64ec-4e96-8d8f-87e72da0b6cb 2026-05-18 03:23:35,593 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15481199465923889020', 'uuid-lslong': '9582874389451312851'}, 'enable': 'true', 'created': '2026-05-18T03:23:34', 'last-modified': '2026-05-18T03:23:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403628'} 2026-05-18 03:23:35,599 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:23:35,606 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15481199465923889020', 'uuid-lslong': '9582874389451312851'}, 'enable': 'true', 'created': '2026-05-18T03:23:34', 'last-modified': '2026-05-18T03:23:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418001'} 2026-05-18 03:23:35,612 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:23:35,618 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-89508386', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15481199465923889020', 'uuid-lslong': '9582874389451312851'}, 'enable': 'true', 'created': '2026-05-18T03:23:34', 'last-modified': '2026-05-18T03:23:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426278'} 2026-05-18 03:23:35,631 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:23:35,631 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-50238011 passed 2026-05-18 03:23:35,631 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-50238011 in API_Server ====== 2026-05-18 03:23:35,631 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:35,638 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:35,654 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:35,752 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d6d844e4-2f5c-477c-84fd-357c266f0ed3 2026-05-18 03:23:35,762 - DEBUG - =>VN ctest-trans_right_vn-50238011 has no policy to be verified 2026-05-18 03:23:35,762 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:35,762 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:35,762 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:35,776 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011?flat'} 2026-05-18 03:23:35,776 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:35,776 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:35,793 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011?flat'} 2026-05-18 03:23:35,793 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:35,793 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:35,807 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011?flat'} 2026-05-18 03:23:35,807 - INFO - Validated that VN default-domain:ctest-TestSvcHC-89508386:ctest-trans_right_vn-50238011 is found in opserver 2026-05-18 03:23:35,829 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:35,839 - DEBUG - VRF ids for VN ctest-trans_right_vn-50238011: {} 2026-05-18 03:23:37,113 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1) 2026-05-18 03:23:38,524 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 03:23:38,524 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-83094299'] 2026-05-18 03:23:38,840 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-83094299'] created succesfully 2026-05-18 03:23:39,326 - DEBUG - Image by name tiny_trans_fw not found 2026-05-18 03:23:39,326 - DEBUG - Installing image tiny_trans_fw 2026-05-18 03:23:39,326 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-05-18 03:23:39,327 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-18 03:23:39,327 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-18 03:23:39,327 - DEBUG - Unzip image 2026-05-18 03:23:39,327 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-18 03:23:39,348 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-05-18 03:23:39,356 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-83094299'] 2026-05-18 03:23:39,488 - INFO - Service template: ['default-domain', 'ctest-service_template_1-83094299'] deleted successfully. 2026-05-18 03:23:39,488 - INFO - Skip interface_detach for VM ctest-right_vm-54897721 in state BUILD 2026-05-18 03:23:39,488 - INFO - Deleting VM ctest-right_vm-54897721 2026-05-18 03:23:39,488 - ERROR - VM ctest-right_vm-54897721 has failed to come up 2026-05-18 03:23:39,488 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:39,488 - ERROR - VM ctest-right_vm-54897721 has failed to come up 2026-05-18 03:23:39,488 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:39,572 - INFO - Skip interface_detach for VM ctest-left_vm-32299071 in state BUILD 2026-05-18 03:23:39,573 - INFO - Deleting VM ctest-left_vm-32299071 2026-05-18 03:23:39,573 - ERROR - VM ctest-left_vm-32299071 has failed to come up 2026-05-18 03:23:39,573 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:39,573 - ERROR - VM ctest-left_vm-32299071 has failed to come up 2026-05-18 03:23:39,573 - ERROR - Nova failed to get host of the VM 2026-05-18 03:23:39,652 - INFO - Deleting VN ctest-trans_right_vn-50238011 2026-05-18 03:23:39,844 - DEBUG - Response for deleting network () 2026-05-18 03:23:39,845 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/211fbbc7-dac7-4acb-8682-99047b85b1cc 2026-05-18 03:23:39,852 - DEBUG - Response Code: 404 2026-05-18 03:23:39,853 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:39,861 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:39,886 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:39,979 - INFO - Validated that VN ctest-trans_right_vn-50238011 is not found in API Server 2026-05-18 03:23:39,994 - DEBUG - VN ctest-trans_right_vn-50238011 is not present in Agent 10.0.0.65 2026-05-18 03:23:40,006 - DEBUG - VN ctest-trans_right_vn-50238011 is not present in Agent 10.0.0.130 2026-05-18 03:23:40,006 - INFO - Validated that VN ctest-trans_right_vn-50238011 is not in any agent 2026-05-18 03:23:40,045 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-50238011 info 2026-05-18 03:23:40,045 - INFO - Deleting VN ctest-trans_left_vn-31796026 2026-05-18 03:23:40,224 - DEBUG - Response for deleting network () 2026-05-18 03:23:40,224 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/98d5d951-dd9e-425b-b76a-20d9173c1e59 2026-05-18 03:23:40,231 - DEBUG - Response Code: 404 2026-05-18 03:23:40,231 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:40,246 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:40,276 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:40,402 - INFO - Validated that VN ctest-trans_left_vn-31796026 is not found in API Server 2026-05-18 03:23:40,415 - DEBUG - VN ctest-trans_left_vn-31796026 is not present in Agent 10.0.0.65 2026-05-18 03:23:40,462 - DEBUG - VN ctest-trans_left_vn-31796026 is not present in Agent 10.0.0.130 2026-05-18 03:23:40,462 - INFO - Validated that VN ctest-trans_left_vn-31796026 is not in any agent 2026-05-18 03:23:40,512 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-31796026 info 2026-05-18 03:23:40,512 - INFO - Deleting VN ctest-right_vn-71451825 2026-05-18 03:23:40,577 - DEBUG - VN 1f71e105-1716-4b99-adf9-4bb100b1d28a still in use: Unable to complete operation on network 1f71e105-1716-4b99-adf9-4bb100b1d28a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d9991d5e-4244-4b24-82e0-e27f8e2cb987'] 2026-05-18 03:23:40,577 - WARNING - Deleting VN ctest-right_vn-71451825 failed..Will retry 2026-05-18 03:23:42,764 - DEBUG - Response for deleting network () 2026-05-18 03:23:42,764 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2d03eed1-3ed2-4647-94ed-8eafeae1b8ac 2026-05-18 03:23:42,770 - DEBUG - Response Code: 404 2026-05-18 03:23:42,771 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:42,788 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:42,850 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:42,965 - INFO - Validated that VN ctest-right_vn-71451825 is not found in API Server 2026-05-18 03:23:42,976 - DEBUG - VN ctest-right_vn-71451825 is not present in Agent 10.0.0.65 2026-05-18 03:23:42,995 - DEBUG - VN ctest-right_vn-71451825 is not present in Agent 10.0.0.130 2026-05-18 03:23:42,995 - INFO - Validated that VN ctest-right_vn-71451825 is not in any agent 2026-05-18 03:23:43,037 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-71451825 info 2026-05-18 03:23:43,037 - INFO - Deleting VN ctest-left_vn-50207446 2026-05-18 03:23:43,229 - DEBUG - Response for deleting network () 2026-05-18 03:23:43,229 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8d292d65-b84b-4f21-a5cc-2c7ced30adda 2026-05-18 03:23:43,238 - DEBUG - Response Code: 404 2026-05-18 03:23:43,238 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:43,256 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:43,267 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:43,365 - INFO - Validated that VN ctest-left_vn-50207446 is not found in API Server 2026-05-18 03:23:43,384 - DEBUG - VN ctest-left_vn-50207446 is not present in Agent 10.0.0.65 2026-05-18 03:23:43,397 - DEBUG - VN ctest-left_vn-50207446 is not present in Agent 10.0.0.130 2026-05-18 03:23:43,397 - INFO - Validated that VN ctest-left_vn-50207446 is not in any agent 2026-05-18 03:23:43,448 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-50207446 info 2026-05-18 03:23:43,448 - INFO - Deleting VN ctest-mgmt_vn-34302355 2026-05-18 03:23:43,634 - DEBUG - Response for deleting network () 2026-05-18 03:23:43,634 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6d36f662-7f8c-4984-8cac-e1725b686b19 2026-05-18 03:23:43,640 - DEBUG - Response Code: 404 2026-05-18 03:23:43,640 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:43,647 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:43,710 - DEBUG - Requesting: http://10.0.0.23:8082/project/87a05d66-2448-4dd7-b0cd-dab1086856f9 2026-05-18 03:23:43,806 - INFO - Validated that VN ctest-mgmt_vn-34302355 is not found in API Server 2026-05-18 03:23:43,818 - DEBUG - VN ctest-mgmt_vn-34302355 is not present in Agent 10.0.0.65 2026-05-18 03:23:43,829 - DEBUG - VN ctest-mgmt_vn-34302355 is not present in Agent 10.0.0.130 2026-05-18 03:23:43,829 - INFO - Validated that VN ctest-mgmt_vn-34302355 is not in any agent 2026-05-18 03:23:43,864 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-34302355 info 2026-05-18 03:23:45,164 - DEBUG - No XMPP flaps were noticed during the test 2026-05-18 03:23:45,164 - INFO -
2026-05-18 03:23:45,164 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17]
2026-05-18 03:23:45,164 - INFO - -------------------------------------------------------------------------------- 2026-05-18 03:23:45,942 - INFO - Deleted project: ctest-TestSvcHC-89508386, ID : 87a05d66-2448-4dd7-b0cd-dab1086856f9