2026-03-26 03:18:06,383 - INFO - Domain Default found not creating 2026-03-26 03:18:06,583 - INFO - Project ctest-TestSvcHC-14284305 not found, creating it 2026-03-26 03:18:07,113 - INFO - Created Project:ctest-TestSvcHC-14284305, ID : a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:08,842 - INFO - ================================================================================ 2026-03-26 03:18:08,842 - INFO - STARTING TEST : test_svc_hc_basic 2026-03-26 03:18:10,135 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.18': '0', '10.20.0.14': '0'}, '10.0.0.23': {'10.20.0.254': '0', '10.20.0.18': '0'}} with 2026-03-26 03:18:10,135 - INFO - Initial checks done. Running the testcase now 2026-03-26 03:18:10,135 - INFO - 2026-03-26 03:18:10,894 - DEBUG - Response for create_network : {'network': {'id': '88912b06-bf62-4747-9c9b-5a06702dc2bc', 'name': 'ctest-mgmt_vn-93860660', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-mgmt_vn-93860660'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:11,174 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b31c272e-b20b-452c-be97-86490a5a4597', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': '88912b06-bf62-4747-9c9b-5a06702dc2bc', 'ip_version': 4, 'cidr': '56.84.43.192/26', 'allocation_pools': [{'start': '56.84.43.194', 'end': '56.84.43.254'}], 'gateway_ip': '56.84.43.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.84.43.194', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:11,201 - INFO - Created VN ctest-mgmt_vn-93860660 2026-03-26 03:18:11,213 - DEBUG - VN ctest-mgmt_vn-93860660 UUID is 88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:11,294 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:11,643 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:11,675 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:11,698 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:11,824 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:11,838 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:11,848 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/abff1da3-f25e-4fd2-a29a-f0e769614cdd 2026-03-26 03:18:11,857 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/abff1da3-f25e-4fd2-a29a-f0e769614cdd 2026-03-26 03:18:11,867 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/38bf5fb2-fa03-4d2d-b4e3-17ea423ed6ce 2026-03-26 03:18:11,876 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:11,876 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:11,887 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/abff1da3-f25e-4fd2-a29a-f0e769614cdd 2026-03-26 03:18:11,908 - INFO - Verified VN network id 18 for VN 88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:11,908 - INFO - Verifications in API Server for VN ctest-mgmt_vn-93860660 passed 2026-03-26 03:18:11,909 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:11,920 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/abff1da3-f25e-4fd2-a29a-f0e769614cdd 2026-03-26 03:18:11,928 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/abff1da3-f25e-4fd2-a29a-f0e769614cdd 2026-03-26 03:18:11,936 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/38bf5fb2-fa03-4d2d-b4e3-17ea423ed6ce 2026-03-26 03:18:11,949 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9840693968761931591', 'uuid-lslong': '11284712275005260476'}, 'enable': 'true', 'created': '2026-03-26T03:18:10', 'last-modified': '2026-03-26T03:18:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.834115'} 2026-03-26 03:18:11,955 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:11,961 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9840693968761931591', 'uuid-lslong': '11284712275005260476'}, 'enable': 'true', 'created': '2026-03-26T03:18:10', 'last-modified': '2026-03-26T03:18:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.848404'} 2026-03-26 03:18:11,966 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:11,971 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9840693968761931591', 'uuid-lslong': '11284712275005260476'}, 'enable': 'true', 'created': '2026-03-26T03:18:10', 'last-modified': '2026-03-26T03:18:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.858470'} 2026-03-26 03:18:11,976 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:11,977 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-93860660 passed 2026-03-26 03:18:11,977 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-93860660 in API_Server ====== 2026-03-26 03:18:11,977 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:11,984 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:11,996 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:12,081 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/88912b06-bf62-4747-9c9b-5a06702dc2bc 2026-03-26 03:18:12,091 - DEBUG - =>VN ctest-mgmt_vn-93860660 has no policy to be verified 2026-03-26 03:18:12,091 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:12,091 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:12,091 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:12,443 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:12,538 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660?flat'} 2026-03-26 03:18:12,538 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:12,538 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:12,919 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:12,988 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660?flat'} 2026-03-26 03:18:12,988 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:12,988 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:13,336 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:13,407 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660?flat'} 2026-03-26 03:18:13,407 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-93860660 is found in opserver 2026-03-26 03:18:13,433 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:13,443 - DEBUG - VRF ids for VN ctest-mgmt_vn-93860660: {} 2026-03-26 03:18:13,716 - DEBUG - Response for create_network : {'network': {'id': 'd7372eed-cdb6-4ffe-b344-84317a89556e', 'name': 'ctest-left_vn-75891455', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-left_vn-75891455'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:13,958 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cf2e00ce-0e34-4a9b-b29b-7b86c930c5db', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': 'd7372eed-cdb6-4ffe-b344-84317a89556e', 'ip_version': 4, 'cidr': '136.254.141.128/26', 'allocation_pools': [{'start': '136.254.141.130', 'end': '136.254.141.190'}], 'gateway_ip': '136.254.141.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.254.141.130', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:13,979 - INFO - Created VN ctest-left_vn-75891455 2026-03-26 03:18:13,991 - DEBUG - VN ctest-left_vn-75891455 UUID is d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,065 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:14,071 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:14,083 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:14,179 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,193 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,203 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/b52473de-50b6-40a2-a40e-89a10f77dbc8 2026-03-26 03:18:14,212 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/b52473de-50b6-40a2-a40e-89a10f77dbc8 2026-03-26 03:18:14,219 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/f5f21644-b420-4f44-b5ca-1b0466933e3a 2026-03-26 03:18:14,225 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:14,226 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,234 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/b52473de-50b6-40a2-a40e-89a10f77dbc8 2026-03-26 03:18:14,249 - INFO - Verified VN network id 19 for VN d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,249 - INFO - Verifications in API Server for VN ctest-left_vn-75891455 passed 2026-03-26 03:18:14,249 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,259 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/b52473de-50b6-40a2-a40e-89a10f77dbc8 2026-03-26 03:18:14,268 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/b52473de-50b6-40a2-a40e-89a10f77dbc8 2026-03-26 03:18:14,274 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/f5f21644-b420-4f44-b5ca-1b0466933e3a 2026-03-26 03:18:14,287 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15507915440766996478', 'uuid-lslong': '12917594979249509742'}, 'enable': 'true', 'created': '2026-03-26T03:18:13', 'last-modified': '2026-03-26T03:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406112'} 2026-03-26 03:18:14,292 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:14,298 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15507915440766996478', 'uuid-lslong': '12917594979249509742'}, 'enable': 'true', 'created': '2026-03-26T03:18:13', 'last-modified': '2026-03-26T03:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417783'} 2026-03-26 03:18:14,304 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:14,309 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15507915440766996478', 'uuid-lslong': '12917594979249509742'}, 'enable': 'true', 'created': '2026-03-26T03:18:13', 'last-modified': '2026-03-26T03:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429646'} 2026-03-26 03:18:14,315 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:14,315 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-75891455 passed 2026-03-26 03:18:14,315 - DEBUG - ====Verifying policy data for ctest-left_vn-75891455 in API_Server ====== 2026-03-26 03:18:14,315 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:14,321 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:14,332 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:14,423 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d7372eed-cdb6-4ffe-b344-84317a89556e 2026-03-26 03:18:14,435 - DEBUG - =>VN ctest-left_vn-75891455 has no policy to be verified 2026-03-26 03:18:14,435 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:14,435 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:14,435 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:14,500 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455?flat'} 2026-03-26 03:18:14,500 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:14,500 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:14,563 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455?flat'} 2026-03-26 03:18:14,563 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:14,563 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:14,624 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455?flat'} 2026-03-26 03:18:14,624 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-75891455 is found in opserver 2026-03-26 03:18:14,645 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:14,656 - DEBUG - VRF ids for VN ctest-left_vn-75891455: {} 2026-03-26 03:18:14,924 - DEBUG - Response for create_network : {'network': {'id': '07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c', 'name': 'ctest-right_vn-16467605', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-right_vn-16467605'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:15,202 - DEBUG - Response for create_subnet : {'subnet': {'id': '805fc74c-a22b-4b9c-800c-865b4099e939', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': '07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c', 'ip_version': 4, 'cidr': '50.225.115.192/26', 'allocation_pools': [{'start': '50.225.115.194', 'end': '50.225.115.254'}], 'gateway_ip': '50.225.115.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '50.225.115.194', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:15,233 - INFO - Created VN ctest-right_vn-16467605 2026-03-26 03:18:15,248 - DEBUG - VN ctest-right_vn-16467605 UUID is 07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,332 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:15,344 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:15,359 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:15,476 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,491 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,503 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/3948b04a-2b6d-4cf9-8b30-af4a6398c798 2026-03-26 03:18:15,511 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/3948b04a-2b6d-4cf9-8b30-af4a6398c798 2026-03-26 03:18:15,520 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/545ebea1-9c5f-442f-a912-9aa361ced8da 2026-03-26 03:18:15,530 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:15,530 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,548 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/3948b04a-2b6d-4cf9-8b30-af4a6398c798 2026-03-26 03:18:15,570 - INFO - Verified VN network id 20 for VN 07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,570 - INFO - Verifications in API Server for VN ctest-right_vn-16467605 passed 2026-03-26 03:18:15,570 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,580 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/3948b04a-2b6d-4cf9-8b30-af4a6398c798 2026-03-26 03:18:15,587 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/3948b04a-2b6d-4cf9-8b30-af4a6398c798 2026-03-26 03:18:15,595 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/545ebea1-9c5f-442f-a912-9aa361ced8da 2026-03-26 03:18:15,606 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '568922130980488877', 'uuid-lslong': '10272270732756811340'}, 'enable': 'true', 'created': '2026-03-26T03:18:14', 'last-modified': '2026-03-26T03:18:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487190'} 2026-03-26 03:18:15,612 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:15,617 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '568922130980488877', 'uuid-lslong': '10272270732756811340'}, 'enable': 'true', 'created': '2026-03-26T03:18:14', 'last-modified': '2026-03-26T03:18:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495816'} 2026-03-26 03:18:15,623 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:15,628 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '568922130980488877', 'uuid-lslong': '10272270732756811340'}, 'enable': 'true', 'created': '2026-03-26T03:18:14', 'last-modified': '2026-03-26T03:18:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.505823'} 2026-03-26 03:18:15,634 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:15,634 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-16467605 passed 2026-03-26 03:18:15,635 - DEBUG - ====Verifying policy data for ctest-right_vn-16467605 in API_Server ====== 2026-03-26 03:18:15,635 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:15,641 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:15,652 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:15,745 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c 2026-03-26 03:18:15,758 - DEBUG - =>VN ctest-right_vn-16467605 has no policy to be verified 2026-03-26 03:18:15,758 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:15,758 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:15,758 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:15,832 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605?flat'} 2026-03-26 03:18:15,832 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:15,832 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:15,894 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605?flat'} 2026-03-26 03:18:15,894 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:15,894 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:15,959 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605?flat'} 2026-03-26 03:18:15,959 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-16467605 is found in opserver 2026-03-26 03:18:15,984 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:15,994 - DEBUG - VRF ids for VN ctest-right_vn-16467605: {} 2026-03-26 03:18:16,143 - DEBUG - Services list from nova: [, , , ] 2026-03-26 03:18:17,439 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5545-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5545-2) 2026-03-26 03:18:19,202 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5545-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5545-1) 2026-03-26 03:18:19,202 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-22084598'] 2026-03-26 03:18:19,515 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-22084598'] created succesfully 2026-03-26 03:18:19,953 - DEBUG - Image by name tiny_nat_fw not found 2026-03-26 03:18:19,953 - DEBUG - Installing image tiny_nat_fw 2026-03-26 03:18:19,953 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-03-26 03:18:19,953 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-26 03:18:19,954 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-26 03:18:19,954 - DEBUG - Unzip image 2026-03-26 03:18:19,954 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-26 03:18:19,973 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-03-26 03:18:19,973 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-22084598'] 2026-03-26 03:18:20,095 - INFO - Service template: ['default-domain', 'ctest-service_template_1-22084598'] deleted successfully. 2026-03-26 03:18:20,095 - INFO - Skip interface_detach for VM ctest-right_vm-47881167 in state BUILD 2026-03-26 03:18:20,095 - INFO - Deleting VM ctest-right_vm-47881167 2026-03-26 03:18:20,142 - ERROR - VM ctest-right_vm-47881167 has failed to come up 2026-03-26 03:18:20,142 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:20,142 - ERROR - VM ctest-right_vm-47881167 has failed to come up 2026-03-26 03:18:20,142 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:20,235 - INFO - Skip interface_detach for VM ctest-left_vm-56928238 in state BUILD 2026-03-26 03:18:20,236 - INFO - Deleting VM ctest-left_vm-56928238 2026-03-26 03:18:20,236 - ERROR - VM ctest-left_vm-56928238 has failed to come up 2026-03-26 03:18:20,236 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:20,236 - ERROR - VM ctest-left_vm-56928238 has failed to come up 2026-03-26 03:18:20,236 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:20,314 - INFO - Deleting VN ctest-right_vn-16467605 2026-03-26 03:18:20,365 - DEBUG - VN 07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c still in use: Unable to complete operation on network 07e537a9-f1f3-46ad-8e8e-6fce7e9c7e4c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a1bf9a63-e969-476c-ab27-9d82d5acbdd4'] 2026-03-26 03:18:20,365 - WARNING - Deleting VN ctest-right_vn-16467605 failed..Will retry 2026-03-26 03:18:22,523 - DEBUG - Response for deleting network () 2026-03-26 03:18:22,523 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/3948b04a-2b6d-4cf9-8b30-af4a6398c798 2026-03-26 03:18:22,529 - DEBUG - Response Code: 404 2026-03-26 03:18:22,529 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:22,546 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:22,560 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:22,664 - INFO - Validated that VN ctest-right_vn-16467605 is not found in API Server 2026-03-26 03:18:22,674 - DEBUG - VN ctest-right_vn-16467605 is not present in Agent 10.0.0.38 2026-03-26 03:18:22,684 - DEBUG - VN ctest-right_vn-16467605 is not present in Agent 10.0.0.23 2026-03-26 03:18:22,684 - INFO - Validated that VN ctest-right_vn-16467605 is not in any agent 2026-03-26 03:18:22,711 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-16467605 info 2026-03-26 03:18:22,711 - INFO - Deleting VN ctest-left_vn-75891455 2026-03-26 03:18:22,853 - DEBUG - Response for deleting network () 2026-03-26 03:18:22,853 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/b52473de-50b6-40a2-a40e-89a10f77dbc8 2026-03-26 03:18:22,860 - DEBUG - Response Code: 404 2026-03-26 03:18:22,860 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:22,866 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:22,876 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:22,982 - INFO - Validated that VN ctest-left_vn-75891455 is not found in API Server 2026-03-26 03:18:22,992 - DEBUG - VN ctest-left_vn-75891455 is not present in Agent 10.0.0.38 2026-03-26 03:18:23,002 - DEBUG - VN ctest-left_vn-75891455 is not present in Agent 10.0.0.23 2026-03-26 03:18:23,002 - INFO - Validated that VN ctest-left_vn-75891455 is not in any agent 2026-03-26 03:18:23,037 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-75891455 info 2026-03-26 03:18:23,037 - INFO - Deleting VN ctest-mgmt_vn-93860660 2026-03-26 03:18:23,192 - DEBUG - Response for deleting network () 2026-03-26 03:18:23,192 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/abff1da3-f25e-4fd2-a29a-f0e769614cdd 2026-03-26 03:18:23,197 - DEBUG - Response Code: 404 2026-03-26 03:18:23,197 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:23,206 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:23,264 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:23,356 - INFO - Validated that VN ctest-mgmt_vn-93860660 is not found in API Server 2026-03-26 03:18:23,366 - DEBUG - VN ctest-mgmt_vn-93860660 is not present in Agent 10.0.0.38 2026-03-26 03:18:23,376 - DEBUG - VN ctest-mgmt_vn-93860660 is not present in Agent 10.0.0.23 2026-03-26 03:18:23,376 - INFO - Validated that VN ctest-mgmt_vn-93860660 is not in any agent 2026-03-26 03:18:23,409 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-93860660 info 2026-03-26 03:18:24,695 - DEBUG - No XMPP flaps were noticed during the test 2026-03-26 03:18:24,695 - INFO -
2026-03-26 03:18:24,696 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16]
2026-03-26 03:18:24,696 - INFO - -------------------------------------------------------------------------------- 2026-03-26 03:18:24,699 - INFO - ================================================================================ 2026-03-26 03:18:24,699 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-03-26 03:18:25,958 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.18': '0', '10.20.0.14': '0'}, '10.0.0.23': {'10.20.0.254': '0', '10.20.0.18': '0'}} with 2026-03-26 03:18:25,958 - INFO - Initial checks done. Running the testcase now 2026-03-26 03:18:25,959 - INFO - 2026-03-26 03:18:26,252 - DEBUG - Response for create_network : {'network': {'id': 'aa258791-ade5-4e94-9265-a41d607c2290', 'name': 'ctest-mgmt_vn-30100478', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-mgmt_vn-30100478'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:26,522 - DEBUG - Response for create_subnet : {'subnet': {'id': '096a51c0-92b1-4841-9ad6-91d7159ef321', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': 'aa258791-ade5-4e94-9265-a41d607c2290', 'ip_version': 4, 'cidr': '168.59.106.192/26', 'allocation_pools': [{'start': '168.59.106.194', 'end': '168.59.106.254'}], 'gateway_ip': '168.59.106.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '168.59.106.194', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:26,549 - INFO - Created VN ctest-mgmt_vn-30100478 2026-03-26 03:18:26,563 - DEBUG - VN ctest-mgmt_vn-30100478 UUID is aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:26,643 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:26,650 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:26,662 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:26,755 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:26,767 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:26,780 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/1950b16c-16bb-4ae4-a547-a1c0302b7deb 2026-03-26 03:18:26,788 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/1950b16c-16bb-4ae4-a547-a1c0302b7deb 2026-03-26 03:18:26,795 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/b23b9a8a-52f9-481e-9adc-6d27cfeaee22 2026-03-26 03:18:26,802 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:26,802 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:26,811 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/1950b16c-16bb-4ae4-a547-a1c0302b7deb 2026-03-26 03:18:26,829 - INFO - Verified VN network id 18 for VN aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:26,829 - INFO - Verifications in API Server for VN ctest-mgmt_vn-30100478 passed 2026-03-26 03:18:26,829 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:26,839 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/1950b16c-16bb-4ae4-a547-a1c0302b7deb 2026-03-26 03:18:26,848 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/1950b16c-16bb-4ae4-a547-a1c0302b7deb 2026-03-26 03:18:26,857 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/b23b9a8a-52f9-481e-9adc-6d27cfeaee22 2026-03-26 03:18:26,872 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12260354620343537300', 'uuid-lslong': '10549018148265009808'}, 'enable': 'true', 'created': '2026-03-26T03:18:26', 'last-modified': '2026-03-26T03:18:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411933'} 2026-03-26 03:18:26,878 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:26,883 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12260354620343537300', 'uuid-lslong': '10549018148265009808'}, 'enable': 'true', 'created': '2026-03-26T03:18:26', 'last-modified': '2026-03-26T03:18:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422289'} 2026-03-26 03:18:26,892 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:26,897 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12260354620343537300', 'uuid-lslong': '10549018148265009808'}, 'enable': 'true', 'created': '2026-03-26T03:18:26', 'last-modified': '2026-03-26T03:18:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438777'} 2026-03-26 03:18:26,903 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-26 03:18:26,903 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-30100478 passed 2026-03-26 03:18:26,904 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-30100478 in API_Server ====== 2026-03-26 03:18:26,904 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:26,911 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:26,929 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:27,030 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/aa258791-ade5-4e94-9265-a41d607c2290 2026-03-26 03:18:27,043 - DEBUG - =>VN ctest-mgmt_vn-30100478 has no policy to be verified 2026-03-26 03:18:27,043 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:27,043 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:27,043 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:27,057 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478?flat'} 2026-03-26 03:18:27,057 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:27,057 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:27,071 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478?flat'} 2026-03-26 03:18:27,071 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:27,071 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:27,085 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478?flat'} 2026-03-26 03:18:27,085 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-mgmt_vn-30100478 is found in opserver 2026-03-26 03:18:27,111 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:27,124 - DEBUG - VRF ids for VN ctest-mgmt_vn-30100478: {} 2026-03-26 03:18:27,402 - DEBUG - Response for create_network : {'network': {'id': '337807e5-683d-4fe2-a396-95a5e16a8a70', 'name': 'ctest-left_vn-35193990', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-left_vn-35193990'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:27,667 - DEBUG - Response for create_subnet : {'subnet': {'id': 'beb91618-e833-4f93-8830-f88188dca78f', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': '337807e5-683d-4fe2-a396-95a5e16a8a70', 'ip_version': 4, 'cidr': '198.137.203.128/26', 'allocation_pools': [{'start': '198.137.203.130', 'end': '198.137.203.190'}], 'gateway_ip': '198.137.203.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.137.203.130', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:27,697 - INFO - Created VN ctest-left_vn-35193990 2026-03-26 03:18:27,712 - DEBUG - VN ctest-left_vn-35193990 UUID is 337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:27,934 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:27,942 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:27,956 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:28,052 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:28,071 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:28,082 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6db7f2ab-f383-4126-a31f-15b0624c2673 2026-03-26 03:18:28,093 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6db7f2ab-f383-4126-a31f-15b0624c2673 2026-03-26 03:18:28,103 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/b3eec286-918d-4f74-b67e-281f4359d47b 2026-03-26 03:18:28,110 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:28,111 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:28,123 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6db7f2ab-f383-4126-a31f-15b0624c2673 2026-03-26 03:18:28,141 - INFO - Verified VN network id 19 for VN 337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:28,141 - INFO - Verifications in API Server for VN ctest-left_vn-35193990 passed 2026-03-26 03:18:28,141 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:28,154 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6db7f2ab-f383-4126-a31f-15b0624c2673 2026-03-26 03:18:28,161 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6db7f2ab-f383-4126-a31f-15b0624c2673 2026-03-26 03:18:28,169 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/b3eec286-918d-4f74-b67e-281f4359d47b 2026-03-26 03:18:28,183 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3708722975017357282', 'uuid-lslong': '11787773614372850288'}, 'enable': 'true', 'created': '2026-03-26T03:18:27', 'last-modified': '2026-03-26T03:18:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.575413'} 2026-03-26 03:18:28,189 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:28,194 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3708722975017357282', 'uuid-lslong': '11787773614372850288'}, 'enable': 'true', 'created': '2026-03-26T03:18:27', 'last-modified': '2026-03-26T03:18:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.588447'} 2026-03-26 03:18:28,201 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:28,209 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3708722975017357282', 'uuid-lslong': '11787773614372850288'}, 'enable': 'true', 'created': '2026-03-26T03:18:27', 'last-modified': '2026-03-26T03:18:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.598781'} 2026-03-26 03:18:28,217 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-26 03:18:28,217 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-35193990 passed 2026-03-26 03:18:28,217 - DEBUG - ====Verifying policy data for ctest-left_vn-35193990 in API_Server ====== 2026-03-26 03:18:28,217 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:28,225 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:28,238 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:28,332 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/337807e5-683d-4fe2-a396-95a5e16a8a70 2026-03-26 03:18:28,344 - DEBUG - =>VN ctest-left_vn-35193990 has no policy to be verified 2026-03-26 03:18:28,344 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:28,344 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:28,344 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:28,360 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990?flat'} 2026-03-26 03:18:28,360 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:28,360 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:28,377 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990?flat'} 2026-03-26 03:18:28,377 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:28,377 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:28,390 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990?flat'} 2026-03-26 03:18:28,390 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-left_vn-35193990 is found in opserver 2026-03-26 03:18:28,410 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:28,421 - DEBUG - VRF ids for VN ctest-left_vn-35193990: {} 2026-03-26 03:18:28,695 - DEBUG - Response for create_network : {'network': {'id': 'f9eb1efc-e14f-4914-a706-b99912ea89a8', 'name': 'ctest-right_vn-25658226', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-right_vn-25658226'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:28,974 - DEBUG - Response for create_subnet : {'subnet': {'id': '80d9d0f0-44b5-43fb-bc47-2935eb51480e', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': 'f9eb1efc-e14f-4914-a706-b99912ea89a8', 'ip_version': 4, 'cidr': '92.120.123.0/26', 'allocation_pools': [{'start': '92.120.123.2', 'end': '92.120.123.62'}], 'gateway_ip': '92.120.123.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '92.120.123.2', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:28,999 - INFO - Created VN ctest-right_vn-25658226 2026-03-26 03:18:29,018 - DEBUG - VN ctest-right_vn-25658226 UUID is f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,093 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:29,099 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:29,111 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:29,203 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,219 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,232 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6b4bcd07-5bc3-4a62-b03b-09b8ef665900 2026-03-26 03:18:29,242 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6b4bcd07-5bc3-4a62-b03b-09b8ef665900 2026-03-26 03:18:29,249 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/50a873ff-cfac-41c2-ab4b-314fa193aff3 2026-03-26 03:18:29,257 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:29,257 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,266 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6b4bcd07-5bc3-4a62-b03b-09b8ef665900 2026-03-26 03:18:29,288 - INFO - Verified VN network id 20 for VN f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,288 - INFO - Verifications in API Server for VN ctest-right_vn-25658226 passed 2026-03-26 03:18:29,288 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,299 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6b4bcd07-5bc3-4a62-b03b-09b8ef665900 2026-03-26 03:18:29,306 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6b4bcd07-5bc3-4a62-b03b-09b8ef665900 2026-03-26 03:18:29,313 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/50a873ff-cfac-41c2-ab4b-314fa193aff3 2026-03-26 03:18:29,326 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18008521606431721748', 'uuid-lslong': '12035511121292724648'}, 'enable': 'true', 'created': '2026-03-26T03:18:28', 'last-modified': '2026-03-26T03:18:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424710'} 2026-03-26 03:18:29,333 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:29,339 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18008521606431721748', 'uuid-lslong': '12035511121292724648'}, 'enable': 'true', 'created': '2026-03-26T03:18:28', 'last-modified': '2026-03-26T03:18:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436551'} 2026-03-26 03:18:29,344 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:29,349 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18008521606431721748', 'uuid-lslong': '12035511121292724648'}, 'enable': 'true', 'created': '2026-03-26T03:18:28', 'last-modified': '2026-03-26T03:18:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443369'} 2026-03-26 03:18:29,355 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-26 03:18:29,355 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-25658226 passed 2026-03-26 03:18:29,355 - DEBUG - ====Verifying policy data for ctest-right_vn-25658226 in API_Server ====== 2026-03-26 03:18:29,355 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:29,360 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:29,373 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:29,474 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/f9eb1efc-e14f-4914-a706-b99912ea89a8 2026-03-26 03:18:29,491 - DEBUG - =>VN ctest-right_vn-25658226 has no policy to be verified 2026-03-26 03:18:29,491 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:29,491 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:29,491 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:29,503 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226?flat'} 2026-03-26 03:18:29,503 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:29,503 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:29,515 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226?flat'} 2026-03-26 03:18:29,515 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:29,515 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:29,527 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226?flat'} 2026-03-26 03:18:29,527 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-right_vn-25658226 is found in opserver 2026-03-26 03:18:29,549 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:29,560 - DEBUG - VRF ids for VN ctest-right_vn-25658226: {} 2026-03-26 03:18:29,819 - DEBUG - Response for create_network : {'network': {'id': '8c5af1d7-838f-4b52-8a8c-a5b58cb1e156', 'name': 'ctest-trans_left_vn-27544773', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-trans_left_vn-27544773'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:30,046 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c7375b36-76c6-41cf-b6fb-23a40140c0f8', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': '8c5af1d7-838f-4b52-8a8c-a5b58cb1e156', 'ip_version': 4, 'cidr': '13.6.40.64/26', 'allocation_pools': [{'start': '13.6.40.66', 'end': '13.6.40.126'}], 'gateway_ip': '13.6.40.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.6.40.66', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:30,075 - INFO - Created VN ctest-trans_left_vn-27544773 2026-03-26 03:18:30,089 - DEBUG - VN ctest-trans_left_vn-27544773 UUID is 8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,164 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:30,171 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:30,182 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:30,275 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,294 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,307 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/df34f5e2-cbac-4f90-bca2-545fb06e0eb2 2026-03-26 03:18:30,316 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/df34f5e2-cbac-4f90-bca2-545fb06e0eb2 2026-03-26 03:18:30,325 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/4faaa632-4a16-4988-96b4-54729c44252c 2026-03-26 03:18:30,334 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-03-26 03:18:30,334 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,346 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/df34f5e2-cbac-4f90-bca2-545fb06e0eb2 2026-03-26 03:18:30,362 - INFO - Verified VN network id 21 for VN 8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,362 - INFO - Verifications in API Server for VN ctest-trans_left_vn-27544773 passed 2026-03-26 03:18:30,362 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,373 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/df34f5e2-cbac-4f90-bca2-545fb06e0eb2 2026-03-26 03:18:30,381 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/df34f5e2-cbac-4f90-bca2-545fb06e0eb2 2026-03-26 03:18:30,388 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/4faaa632-4a16-4988-96b4-54729c44252c 2026-03-26 03:18:30,400 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10113661821141338962', 'uuid-lslong': '9983536673141678422'}, 'enable': 'true', 'created': '2026-03-26T03:18:29', 'last-modified': '2026-03-26T03:18:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417608'} 2026-03-26 03:18:30,406 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-03-26 03:18:30,412 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10113661821141338962', 'uuid-lslong': '9983536673141678422'}, 'enable': 'true', 'created': '2026-03-26T03:18:29', 'last-modified': '2026-03-26T03:18:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428818'} 2026-03-26 03:18:30,418 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-03-26 03:18:30,424 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10113661821141338962', 'uuid-lslong': '9983536673141678422'}, 'enable': 'true', 'created': '2026-03-26T03:18:29', 'last-modified': '2026-03-26T03:18:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442241'} 2026-03-26 03:18:30,430 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-03-26 03:18:30,430 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-27544773 passed 2026-03-26 03:18:30,430 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-27544773 in API_Server ====== 2026-03-26 03:18:30,430 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:30,436 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:30,448 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:30,539 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/8c5af1d7-838f-4b52-8a8c-a5b58cb1e156 2026-03-26 03:18:30,548 - DEBUG - =>VN ctest-trans_left_vn-27544773 has no policy to be verified 2026-03-26 03:18:30,548 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:30,548 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:30,548 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:30,560 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773?flat'} 2026-03-26 03:18:30,561 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:30,561 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:30,573 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773?flat'} 2026-03-26 03:18:30,574 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:30,574 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:30,586 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773?flat'} 2026-03-26 03:18:30,586 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-trans_left_vn-27544773 is found in opserver 2026-03-26 03:18:30,608 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:30,620 - DEBUG - VRF ids for VN ctest-trans_left_vn-27544773: {} 2026-03-26 03:18:30,890 - DEBUG - Response for create_network : {'network': {'id': 'd296dfe8-e26a-4048-bedf-579cf5046c77', 'name': 'ctest-trans_right_vn-97085515', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'project_id': 'a53dd520bcbc45058b950438b79dcb21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-14284305', 'ctest-trans_right_vn-97085515'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 03:18:31,143 - DEBUG - Response for create_subnet : {'subnet': {'id': '91e95f73-1e88-4f8f-a252-839e9ecd1017', 'name': '', 'tenant_id': 'a53dd520bcbc45058b950438b79dcb21', 'network_id': 'd296dfe8-e26a-4048-bedf-579cf5046c77', 'ip_version': 4, 'cidr': '84.204.214.128/26', 'allocation_pools': [{'start': '84.204.214.130', 'end': '84.204.214.190'}], 'gateway_ip': '84.204.214.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '84.204.214.130', 'tags': [], 'project_id': 'a53dd520bcbc45058b950438b79dcb21'}} 2026-03-26 03:18:31,167 - INFO - Created VN ctest-trans_right_vn-97085515 2026-03-26 03:18:31,178 - DEBUG - VN ctest-trans_right_vn-97085515 UUID is d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,250 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:31,256 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:31,268 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:31,379 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,394 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,405 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/587ef969-0877-473e-b581-60e9163e4e33 2026-03-26 03:18:31,414 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/587ef969-0877-473e-b581-60e9163e4e33 2026-03-26 03:18:31,422 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/b64f0bfe-1f7b-42c5-b583-d347a9d9e5f6 2026-03-26 03:18:31,430 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-03-26 03:18:31,430 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,443 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/587ef969-0877-473e-b581-60e9163e4e33 2026-03-26 03:18:31,459 - INFO - Verified VN network id 22 for VN d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,459 - INFO - Verifications in API Server for VN ctest-trans_right_vn-97085515 passed 2026-03-26 03:18:31,459 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,470 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/587ef969-0877-473e-b581-60e9163e4e33 2026-03-26 03:18:31,479 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/587ef969-0877-473e-b581-60e9163e4e33 2026-03-26 03:18:31,487 - DEBUG - Requesting: http://10.0.0.240:8082/route-target/b64f0bfe-1f7b-42c5-b583-d347a9d9e5f6 2026-03-26 03:18:31,501 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15174562185795485768', 'uuid-lslong': '13753808118650006647'}, 'enable': 'true', 'created': '2026-03-26T03:18:30', 'last-modified': '2026-03-26T03:18:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.397327'} 2026-03-26 03:18:31,508 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-03-26 03:18:31,514 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15174562185795485768', 'uuid-lslong': '13753808118650006647'}, 'enable': 'true', 'created': '2026-03-26T03:18:30', 'last-modified': '2026-03-26T03:18:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410860'} 2026-03-26 03:18:31,522 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-03-26 03:18:31,527 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-14284305', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15174562185795485768', 'uuid-lslong': '13753808118650006647'}, 'enable': 'true', 'created': '2026-03-26T03:18:30', 'last-modified': '2026-03-26T03:18:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426302'} 2026-03-26 03:18:31,534 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-03-26 03:18:31,534 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-97085515 passed 2026-03-26 03:18:31,534 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-97085515 in API_Server ====== 2026-03-26 03:18:31,534 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:31,540 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:31,552 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:31,649 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-network/d296dfe8-e26a-4048-bedf-579cf5046c77 2026-03-26 03:18:31,664 - DEBUG - =>VN ctest-trans_right_vn-97085515 has no policy to be verified 2026-03-26 03:18:31,664 - DEBUG - Verifying the vn in opserver 2026-03-26 03:18:31,664 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515 virtual network link through opserver 10.0.0.240 2026-03-26 03:18:31,664 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-03-26 03:18:31,683 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515?flat'} 2026-03-26 03:18:31,683 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515 virtual network link through opserver 10.0.0.22 2026-03-26 03:18:31,683 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-26 03:18:31,696 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515?flat'} 2026-03-26 03:18:31,696 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515 virtual network link through opserver 10.0.0.65 2026-03-26 03:18:31,696 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2026-03-26 03:18:31,709 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515?flat'} 2026-03-26 03:18:31,709 - INFO - Validated that VN default-domain:ctest-TestSvcHC-14284305:ctest-trans_right_vn-97085515 is found in opserver 2026-03-26 03:18:31,731 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 03:18:31,742 - DEBUG - VRF ids for VN ctest-trans_right_vn-97085515: {} 2026-03-26 03:18:33,075 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5545-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5545-1) 2026-03-26 03:18:34,597 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5545-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5545-2) 2026-03-26 03:18:34,597 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-88889285'] 2026-03-26 03:18:34,914 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-88889285'] created succesfully 2026-03-26 03:18:35,365 - DEBUG - Image by name tiny_trans_fw not found 2026-03-26 03:18:35,365 - DEBUG - Installing image tiny_trans_fw 2026-03-26 03:18:35,365 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-03-26 03:18:35,366 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-26 03:18:35,366 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-26 03:18:35,366 - DEBUG - Unzip image 2026-03-26 03:18:35,366 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-26 03:18:35,385 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-03-26 03:18:35,386 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-88889285'] 2026-03-26 03:18:35,491 - INFO - Service template: ['default-domain', 'ctest-service_template_1-88889285'] deleted successfully. 2026-03-26 03:18:35,491 - INFO - Skip interface_detach for VM ctest-right_vm-16615855 in state BUILD 2026-03-26 03:18:35,492 - INFO - Deleting VM ctest-right_vm-16615855 2026-03-26 03:18:35,492 - ERROR - VM ctest-right_vm-16615855 has failed to come up 2026-03-26 03:18:35,492 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:35,492 - ERROR - VM ctest-right_vm-16615855 has failed to come up 2026-03-26 03:18:35,493 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:35,640 - INFO - Skip interface_detach for VM ctest-left_vm-48799101 in state BUILD 2026-03-26 03:18:35,641 - INFO - Deleting VM ctest-left_vm-48799101 2026-03-26 03:18:35,641 - ERROR - VM ctest-left_vm-48799101 has failed to come up 2026-03-26 03:18:35,641 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:35,641 - ERROR - VM ctest-left_vm-48799101 has failed to come up 2026-03-26 03:18:35,641 - ERROR - Nova failed to get host of the VM 2026-03-26 03:18:35,732 - INFO - Deleting VN ctest-trans_right_vn-97085515 2026-03-26 03:18:35,922 - DEBUG - Response for deleting network () 2026-03-26 03:18:35,923 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/587ef969-0877-473e-b581-60e9163e4e33 2026-03-26 03:18:35,932 - DEBUG - Response Code: 404 2026-03-26 03:18:35,932 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:35,944 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:36,003 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:36,101 - INFO - Validated that VN ctest-trans_right_vn-97085515 is not found in API Server 2026-03-26 03:18:36,111 - DEBUG - VN ctest-trans_right_vn-97085515 is not present in Agent 10.0.0.38 2026-03-26 03:18:36,123 - DEBUG - VN ctest-trans_right_vn-97085515 is not present in Agent 10.0.0.23 2026-03-26 03:18:36,123 - INFO - Validated that VN ctest-trans_right_vn-97085515 is not in any agent 2026-03-26 03:18:36,162 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-97085515 info 2026-03-26 03:18:36,162 - INFO - Deleting VN ctest-trans_left_vn-27544773 2026-03-26 03:18:36,396 - DEBUG - Response for deleting network () 2026-03-26 03:18:36,396 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/df34f5e2-cbac-4f90-bca2-545fb06e0eb2 2026-03-26 03:18:36,406 - DEBUG - Response Code: 404 2026-03-26 03:18:36,407 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:36,428 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:36,455 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:36,569 - INFO - Validated that VN ctest-trans_left_vn-27544773 is not found in API Server 2026-03-26 03:18:36,582 - DEBUG - VN ctest-trans_left_vn-27544773 is not present in Agent 10.0.0.38 2026-03-26 03:18:36,616 - DEBUG - VN ctest-trans_left_vn-27544773 is not present in Agent 10.0.0.23 2026-03-26 03:18:36,616 - INFO - Validated that VN ctest-trans_left_vn-27544773 is not in any agent 2026-03-26 03:18:36,660 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-27544773 info 2026-03-26 03:18:36,660 - INFO - Deleting VN ctest-right_vn-25658226 2026-03-26 03:18:36,714 - DEBUG - VN f9eb1efc-e14f-4914-a706-b99912ea89a8 still in use: Unable to complete operation on network f9eb1efc-e14f-4914-a706-b99912ea89a8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-92c9702e-e17d-45e7-8453-69e1dc7bd1a9'] 2026-03-26 03:18:36,714 - WARNING - Deleting VN ctest-right_vn-25658226 failed..Will retry 2026-03-26 03:18:38,881 - DEBUG - Response for deleting network () 2026-03-26 03:18:38,881 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6b4bcd07-5bc3-4a62-b03b-09b8ef665900 2026-03-26 03:18:38,887 - DEBUG - Response Code: 404 2026-03-26 03:18:38,888 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:38,895 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:38,906 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:39,005 - INFO - Validated that VN ctest-right_vn-25658226 is not found in API Server 2026-03-26 03:18:39,017 - DEBUG - VN ctest-right_vn-25658226 is not present in Agent 10.0.0.38 2026-03-26 03:18:39,027 - DEBUG - VN ctest-right_vn-25658226 is not present in Agent 10.0.0.23 2026-03-26 03:18:39,027 - INFO - Validated that VN ctest-right_vn-25658226 is not in any agent 2026-03-26 03:18:39,060 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-25658226 info 2026-03-26 03:18:39,060 - INFO - Deleting VN ctest-left_vn-35193990 2026-03-26 03:18:39,232 - DEBUG - Response for deleting network () 2026-03-26 03:18:39,232 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/6db7f2ab-f383-4126-a31f-15b0624c2673 2026-03-26 03:18:39,244 - DEBUG - Response Code: 404 2026-03-26 03:18:39,244 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:39,250 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:39,272 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:39,363 - INFO - Validated that VN ctest-left_vn-35193990 is not found in API Server 2026-03-26 03:18:39,373 - DEBUG - VN ctest-left_vn-35193990 is not present in Agent 10.0.0.38 2026-03-26 03:18:39,383 - DEBUG - VN ctest-left_vn-35193990 is not present in Agent 10.0.0.23 2026-03-26 03:18:39,384 - INFO - Validated that VN ctest-left_vn-35193990 is not in any agent 2026-03-26 03:18:39,414 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-35193990 info 2026-03-26 03:18:39,414 - INFO - Deleting VN ctest-mgmt_vn-30100478 2026-03-26 03:18:39,562 - DEBUG - Response for deleting network () 2026-03-26 03:18:39,562 - DEBUG - Requesting: http://10.0.0.240:8082/routing-instance/1950b16c-16bb-4ae4-a547-a1c0302b7deb 2026-03-26 03:18:39,569 - DEBUG - Response Code: 404 2026-03-26 03:18:39,569 - DEBUG - Requesting: http://10.0.0.240:8082/domains 2026-03-26 03:18:39,574 - DEBUG - Requesting: http://10.0.0.240:8082/domain/b07ef41d-f358-4169-a694-2c6c20158c87 2026-03-26 03:18:39,636 - DEBUG - Requesting: http://10.0.0.240:8082/project/a53dd520-bcbc-4505-8b95-0438b79dcb21 2026-03-26 03:18:39,739 - INFO - Validated that VN ctest-mgmt_vn-30100478 is not found in API Server 2026-03-26 03:18:39,752 - DEBUG - VN ctest-mgmt_vn-30100478 is not present in Agent 10.0.0.38 2026-03-26 03:18:39,762 - DEBUG - VN ctest-mgmt_vn-30100478 is not present in Agent 10.0.0.23 2026-03-26 03:18:39,762 - INFO - Validated that VN ctest-mgmt_vn-30100478 is not in any agent 2026-03-26 03:18:39,794 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-30100478 info 2026-03-26 03:18:41,098 - DEBUG - No XMPP flaps were noticed during the test 2026-03-26 03:18:41,098 - INFO -
2026-03-26 03:18:41,098 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17]
2026-03-26 03:18:41,098 - INFO - -------------------------------------------------------------------------------- 2026-03-26 03:18:41,947 - INFO - Deleted project: ctest-TestSvcHC-14284305, ID : a53dd520-bcbc-4505-8b95-0438b79dcb21