2026-03-23 03:18:32,130 - INFO - Domain Default found not creating 2026-03-23 03:18:32,387 - INFO - Project ctest-TestSvcHC-31774004 not found, creating it 2026-03-23 03:18:33,022 - INFO - Created Project:ctest-TestSvcHC-31774004, ID : 20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:34,843 - INFO - ================================================================================ 2026-03-23 03:18:34,843 - INFO - STARTING TEST : test_svc_hc_basic 2026-03-23 03:18:36,140 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.18': '0', '10.20.0.14': '0'}, '10.0.0.65': {'10.20.0.18': '0', '10.20.0.14': '0'}} with 2026-03-23 03:18:36,140 - INFO - Initial checks done. Running the testcase now 2026-03-23 03:18:36,140 - INFO - 2026-03-23 03:18:36,834 - DEBUG - Response for create_network : {'network': {'id': '6eacd07d-5650-4f90-b21f-cd8ce05be9b1', 'name': 'ctest-mgmt_vn-75553692', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-mgmt_vn-75553692'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:37,179 - DEBUG - Response for create_subnet : {'subnet': {'id': '35509c5f-497c-4379-99eb-10166db70936', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': '6eacd07d-5650-4f90-b21f-cd8ce05be9b1', 'ip_version': 4, 'cidr': '60.84.171.64/26', 'allocation_pools': [{'start': '60.84.171.66', 'end': '60.84.171.126'}], 'gateway_ip': '60.84.171.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '60.84.171.66', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:37,203 - INFO - Created VN ctest-mgmt_vn-75553692 2026-03-23 03:18:37,216 - DEBUG - VN ctest-mgmt_vn-75553692 UUID is 6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:37,290 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:37,603 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:37,640 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:37,658 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:37,763 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:37,779 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:37,790 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9595cc16-8b3d-411e-8c4d-604e5e4df31e 2026-03-23 03:18:37,798 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9595cc16-8b3d-411e-8c4d-604e5e4df31e 2026-03-23 03:18:37,805 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7feb5402-7bab-4b20-b358-ac910871875e 2026-03-23 03:18:37,813 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:37,813 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:37,825 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9595cc16-8b3d-411e-8c4d-604e5e4df31e 2026-03-23 03:18:37,842 - INFO - Verified VN network id 15 for VN 6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:37,842 - INFO - Verifications in API Server for VN ctest-mgmt_vn-75553692 passed 2026-03-23 03:18:37,842 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:37,854 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9595cc16-8b3d-411e-8c4d-604e5e4df31e 2026-03-23 03:18:37,862 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9595cc16-8b3d-411e-8c4d-604e5e4df31e 2026-03-23 03:18:37,870 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/7feb5402-7bab-4b20-b358-ac910871875e 2026-03-23 03:18:37,883 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7974978276903899024', 'uuid-lslong': '12835203467972438449'}, 'enable': 'true', 'created': '2026-03-23T03:18:36', 'last-modified': '2026-03-23T03:18:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.757617'} 2026-03-23 03:18:37,889 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:37,895 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7974978276903899024', 'uuid-lslong': '12835203467972438449'}, 'enable': 'true', 'created': '2026-03-23T03:18:36', 'last-modified': '2026-03-23T03:18:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.769897'} 2026-03-23 03:18:37,901 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:37,907 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7974978276903899024', 'uuid-lslong': '12835203467972438449'}, 'enable': 'true', 'created': '2026-03-23T03:18:36', 'last-modified': '2026-03-23T03:18:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.775286'} 2026-03-23 03:18:37,914 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:37,914 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-75553692 passed 2026-03-23 03:18:37,915 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-75553692 in API_Server ====== 2026-03-23 03:18:37,915 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:37,922 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:37,938 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:38,057 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6eacd07d-5650-4f90-b21f-cd8ce05be9b1 2026-03-23 03:18:38,081 - DEBUG - =>VN ctest-mgmt_vn-75553692 has no policy to be verified 2026-03-23 03:18:38,081 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:38,081 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:38,081 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:38,424 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:38,494 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692?flat'} 2026-03-23 03:18:38,494 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:38,494 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:38,819 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:38,893 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692?flat'} 2026-03-23 03:18:38,893 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:38,893 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:39,198 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:39,279 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692?flat'} 2026-03-23 03:18:39,279 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-75553692 is found in opserver 2026-03-23 03:18:39,305 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:39,317 - DEBUG - VRF ids for VN ctest-mgmt_vn-75553692: {} 2026-03-23 03:18:39,622 - DEBUG - Response for create_network : {'network': {'id': '5cad3ec9-6397-4540-9cdf-171c0cdc4557', 'name': 'ctest-left_vn-30998102', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-left_vn-30998102'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:39,829 - DEBUG - Response for create_subnet : {'subnet': {'id': '38aae9a3-fed5-472e-8a19-173df91f844c', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': '5cad3ec9-6397-4540-9cdf-171c0cdc4557', 'ip_version': 4, 'cidr': '49.184.50.192/26', 'allocation_pools': [{'start': '49.184.50.194', 'end': '49.184.50.254'}], 'gateway_ip': '49.184.50.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '49.184.50.194', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:39,860 - INFO - Created VN ctest-left_vn-30998102 2026-03-23 03:18:39,872 - DEBUG - VN ctest-left_vn-30998102 UUID is 5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:39,952 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:39,959 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:39,970 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:40,064 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:40,077 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:40,091 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e18124eb-99bb-42ac-8179-a7ae48f828e7 2026-03-23 03:18:40,101 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e18124eb-99bb-42ac-8179-a7ae48f828e7 2026-03-23 03:18:40,109 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a182bc8a-0796-47f2-8a10-13fc6fa6b3d2 2026-03-23 03:18:40,117 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:40,117 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:40,130 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e18124eb-99bb-42ac-8179-a7ae48f828e7 2026-03-23 03:18:40,147 - INFO - Verified VN network id 16 for VN 5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:40,147 - INFO - Verifications in API Server for VN ctest-left_vn-30998102 passed 2026-03-23 03:18:40,147 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:40,157 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e18124eb-99bb-42ac-8179-a7ae48f828e7 2026-03-23 03:18:40,166 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e18124eb-99bb-42ac-8179-a7ae48f828e7 2026-03-23 03:18:40,175 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a182bc8a-0796-47f2-8a10-13fc6fa6b3d2 2026-03-23 03:18:40,191 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6678062857140520256', 'uuid-lslong': '11303778998965519703'}, 'enable': 'true', 'created': '2026-03-23T03:18:39', 'last-modified': '2026-03-23T03:18:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421396'} 2026-03-23 03:18:40,196 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:40,201 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6678062857140520256', 'uuid-lslong': '11303778998965519703'}, 'enable': 'true', 'created': '2026-03-23T03:18:39', 'last-modified': '2026-03-23T03:18:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435497'} 2026-03-23 03:18:40,208 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:40,213 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6678062857140520256', 'uuid-lslong': '11303778998965519703'}, 'enable': 'true', 'created': '2026-03-23T03:18:39', 'last-modified': '2026-03-23T03:18:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442563'} 2026-03-23 03:18:40,220 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:40,220 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-30998102 passed 2026-03-23 03:18:40,220 - DEBUG - ====Verifying policy data for ctest-left_vn-30998102 in API_Server ====== 2026-03-23 03:18:40,220 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:40,227 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:40,247 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:40,343 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5cad3ec9-6397-4540-9cdf-171c0cdc4557 2026-03-23 03:18:40,354 - DEBUG - =>VN ctest-left_vn-30998102 has no policy to be verified 2026-03-23 03:18:40,354 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:40,354 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:40,354 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:40,432 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102?flat'} 2026-03-23 03:18:40,432 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:40,432 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:40,504 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102?flat'} 2026-03-23 03:18:40,504 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:40,504 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:40,577 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102?flat'} 2026-03-23 03:18:40,577 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-30998102 is found in opserver 2026-03-23 03:18:40,605 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:40,620 - DEBUG - VRF ids for VN ctest-left_vn-30998102: {} 2026-03-23 03:18:40,895 - DEBUG - Response for create_network : {'network': {'id': 'c95492f0-3b99-4a5f-a409-84dd8ae4c9c0', 'name': 'ctest-right_vn-71731909', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-right_vn-71731909'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:41,123 - DEBUG - Response for create_subnet : {'subnet': {'id': '38634d21-eb72-43aa-af80-d346434b70f6', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': 'c95492f0-3b99-4a5f-a409-84dd8ae4c9c0', 'ip_version': 4, 'cidr': '30.38.18.128/26', 'allocation_pools': [{'start': '30.38.18.130', 'end': '30.38.18.190'}], 'gateway_ip': '30.38.18.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.38.18.130', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:41,149 - INFO - Created VN ctest-right_vn-71731909 2026-03-23 03:18:41,161 - DEBUG - VN ctest-right_vn-71731909 UUID is c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,243 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:41,249 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:41,260 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:41,375 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,392 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,405 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/65204625-8f90-4450-8a12-b21cfb62c7af 2026-03-23 03:18:41,417 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/65204625-8f90-4450-8a12-b21cfb62c7af 2026-03-23 03:18:41,426 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/0bffe42a-a30f-44fb-9d79-6c1e2984a0a4 2026-03-23 03:18:41,434 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:41,434 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,446 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/65204625-8f90-4450-8a12-b21cfb62c7af 2026-03-23 03:18:41,463 - INFO - Verified VN network id 17 for VN c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,463 - INFO - Verifications in API Server for VN ctest-right_vn-71731909 passed 2026-03-23 03:18:41,463 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,473 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/65204625-8f90-4450-8a12-b21cfb62c7af 2026-03-23 03:18:41,482 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/65204625-8f90-4450-8a12-b21cfb62c7af 2026-03-23 03:18:41,490 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/0bffe42a-a30f-44fb-9d79-6c1e2984a0a4 2026-03-23 03:18:41,507 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14507381860156918367', 'uuid-lslong': '11820124784063465920'}, 'enable': 'true', 'created': '2026-03-23T03:18:40', 'last-modified': '2026-03-23T03:18:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437749'} 2026-03-23 03:18:41,513 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:41,518 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14507381860156918367', 'uuid-lslong': '11820124784063465920'}, 'enable': 'true', 'created': '2026-03-23T03:18:40', 'last-modified': '2026-03-23T03:18:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446852'} 2026-03-23 03:18:41,525 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:41,530 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14507381860156918367', 'uuid-lslong': '11820124784063465920'}, 'enable': 'true', 'created': '2026-03-23T03:18:40', 'last-modified': '2026-03-23T03:18:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461717'} 2026-03-23 03:18:41,536 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:41,537 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-71731909 passed 2026-03-23 03:18:41,537 - DEBUG - ====Verifying policy data for ctest-right_vn-71731909 in API_Server ====== 2026-03-23 03:18:41,537 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:41,544 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:41,557 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:41,653 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 2026-03-23 03:18:41,666 - DEBUG - =>VN ctest-right_vn-71731909 has no policy to be verified 2026-03-23 03:18:41,667 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:41,667 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:41,667 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:41,776 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909?flat'} 2026-03-23 03:18:41,776 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:41,776 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:41,858 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909?flat'} 2026-03-23 03:18:41,858 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:41,858 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:41,931 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909?flat'} 2026-03-23 03:18:41,931 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-71731909 is found in opserver 2026-03-23 03:18:41,970 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:41,983 - DEBUG - VRF ids for VN ctest-right_vn-71731909: {} 2026-03-23 03:18:42,064 - DEBUG - Services list from nova: [, , , ] 2026-03-23 03:18:43,273 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5514-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5514-2) 2026-03-23 03:18:44,780 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5514-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5514-1) 2026-03-23 03:18:44,781 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-16165458'] 2026-03-23 03:18:45,097 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-16165458'] created succesfully 2026-03-23 03:18:45,536 - DEBUG - Image by name tiny_nat_fw not found 2026-03-23 03:18:45,536 - DEBUG - Installing image tiny_nat_fw 2026-03-23 03:18:45,536 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-03-23 03:18:45,537 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-23 03:18:45,537 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-23 03:18:45,537 - DEBUG - Unzip image 2026-03-23 03:18:45,537 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-23 03:18:45,567 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-03-23 03:18:45,568 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-16165458'] 2026-03-23 03:18:45,675 - INFO - Service template: ['default-domain', 'ctest-service_template_1-16165458'] deleted successfully. 2026-03-23 03:18:45,675 - INFO - Skip interface_detach for VM ctest-right_vm-73921589 in state BUILD 2026-03-23 03:18:45,675 - INFO - Deleting VM ctest-right_vm-73921589 2026-03-23 03:18:45,766 - ERROR - VM ctest-right_vm-73921589 has failed to come up 2026-03-23 03:18:45,767 - ERROR - Nova failed to get host of the VM 2026-03-23 03:18:45,767 - ERROR - VM ctest-right_vm-73921589 has failed to come up 2026-03-23 03:18:45,767 - ERROR - Nova failed to get host of the VM 2026-03-23 03:18:45,860 - INFO - Skip interface_detach for VM ctest-left_vm-93210208 in state BUILD 2026-03-23 03:18:45,861 - INFO - Deleting VM ctest-left_vm-93210208 2026-03-23 03:18:45,861 - ERROR - VM ctest-left_vm-93210208 has failed to come up 2026-03-23 03:18:45,861 - ERROR - Nova failed to get host of the VM 2026-03-23 03:18:45,861 - ERROR - VM ctest-left_vm-93210208 has failed to come up 2026-03-23 03:18:45,861 - ERROR - Nova failed to get host of the VM 2026-03-23 03:18:45,955 - INFO - Deleting VN ctest-right_vn-71731909 2026-03-23 03:18:46,015 - DEBUG - VN c95492f0-3b99-4a5f-a409-84dd8ae4c9c0 still in use: Unable to complete operation on network c95492f0-3b99-4a5f-a409-84dd8ae4c9c0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0641939f-6d1e-4d4b-aceb-343a6ec74a28'] 2026-03-23 03:18:46,015 - WARNING - Deleting VN ctest-right_vn-71731909 failed..Will retry 2026-03-23 03:18:48,218 - DEBUG - Response for deleting network () 2026-03-23 03:18:48,218 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/65204625-8f90-4450-8a12-b21cfb62c7af 2026-03-23 03:18:48,235 - DEBUG - Response Code: 404 2026-03-23 03:18:48,235 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:48,245 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:48,265 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:48,393 - INFO - Validated that VN ctest-right_vn-71731909 is not found in API Server 2026-03-23 03:18:48,405 - DEBUG - VN ctest-right_vn-71731909 is not present in Agent 10.0.0.249 2026-03-23 03:18:48,418 - DEBUG - VN ctest-right_vn-71731909 is not present in Agent 10.0.0.65 2026-03-23 03:18:48,419 - INFO - Validated that VN ctest-right_vn-71731909 is not in any agent 2026-03-23 03:18:48,457 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-71731909 info 2026-03-23 03:18:48,458 - INFO - Deleting VN ctest-left_vn-30998102 2026-03-23 03:18:48,653 - DEBUG - Response for deleting network () 2026-03-23 03:18:48,654 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e18124eb-99bb-42ac-8179-a7ae48f828e7 2026-03-23 03:18:48,663 - DEBUG - Response Code: 404 2026-03-23 03:18:48,663 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:48,670 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:48,688 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:48,806 - INFO - Validated that VN ctest-left_vn-30998102 is not found in API Server 2026-03-23 03:18:48,821 - DEBUG - VN ctest-left_vn-30998102 is not present in Agent 10.0.0.249 2026-03-23 03:18:48,835 - DEBUG - VN ctest-left_vn-30998102 is not present in Agent 10.0.0.65 2026-03-23 03:18:48,835 - INFO - Validated that VN ctest-left_vn-30998102 is not in any agent 2026-03-23 03:18:48,872 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-30998102 info 2026-03-23 03:18:48,872 - INFO - Deleting VN ctest-mgmt_vn-75553692 2026-03-23 03:18:49,013 - DEBUG - Response for deleting network () 2026-03-23 03:18:49,013 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9595cc16-8b3d-411e-8c4d-604e5e4df31e 2026-03-23 03:18:49,020 - DEBUG - Response Code: 404 2026-03-23 03:18:49,020 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:49,027 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:49,049 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:49,152 - INFO - Validated that VN ctest-mgmt_vn-75553692 is not found in API Server 2026-03-23 03:18:49,163 - DEBUG - VN ctest-mgmt_vn-75553692 is not present in Agent 10.0.0.249 2026-03-23 03:18:49,176 - DEBUG - VN ctest-mgmt_vn-75553692 is not present in Agent 10.0.0.65 2026-03-23 03:18:49,176 - INFO - Validated that VN ctest-mgmt_vn-75553692 is not in any agent 2026-03-23 03:18:49,209 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-75553692 info 2026-03-23 03:18:50,497 - DEBUG - No XMPP flaps were noticed during the test 2026-03-23 03:18:50,497 - INFO - 2026-03-23 03:18:50,497 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16] 2026-03-23 03:18:50,497 - INFO - -------------------------------------------------------------------------------- 2026-03-23 03:18:50,501 - INFO - ================================================================================ 2026-03-23 03:18:50,501 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-03-23 03:18:51,781 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.18': '0', '10.20.0.14': '0'}, '10.0.0.65': {'10.20.0.18': '0', '10.20.0.14': '0'}} with 2026-03-23 03:18:51,781 - INFO - Initial checks done. Running the testcase now 2026-03-23 03:18:51,781 - INFO - 2026-03-23 03:18:52,042 - DEBUG - Response for create_network : {'network': {'id': 'ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5', 'name': 'ctest-mgmt_vn-00118819', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-mgmt_vn-00118819'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:52,255 - DEBUG - Response for create_subnet : {'subnet': {'id': '30768dde-a6d9-424e-99a6-0de91da26b9d', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': 'ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5', 'ip_version': 4, 'cidr': '18.170.250.128/26', 'allocation_pools': [{'start': '18.170.250.130', 'end': '18.170.250.190'}], 'gateway_ip': '18.170.250.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '18.170.250.130', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:52,280 - INFO - Created VN ctest-mgmt_vn-00118819 2026-03-23 03:18:52,292 - DEBUG - VN ctest-mgmt_vn-00118819 UUID is ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,375 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:52,382 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:52,394 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:52,499 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,512 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,522 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/59b5c9d3-c3ff-4f8f-9807-97e6ab725fb2 2026-03-23 03:18:52,530 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/59b5c9d3-c3ff-4f8f-9807-97e6ab725fb2 2026-03-23 03:18:52,538 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a53dc89d-273e-4f63-b35e-441ec7868b8e 2026-03-23 03:18:52,547 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:52,547 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,556 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/59b5c9d3-c3ff-4f8f-9807-97e6ab725fb2 2026-03-23 03:18:52,572 - INFO - Verified VN network id 15 for VN ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,572 - INFO - Verifications in API Server for VN ctest-mgmt_vn-00118819 passed 2026-03-23 03:18:52,572 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,582 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/59b5c9d3-c3ff-4f8f-9807-97e6ab725fb2 2026-03-23 03:18:52,592 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/59b5c9d3-c3ff-4f8f-9807-97e6ab725fb2 2026-03-23 03:18:52,602 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a53dc89d-273e-4f63-b35e-441ec7868b8e 2026-03-23 03:18:52,616 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17150096876840568821', 'uuid-lslong': '13422271972281340917'}, 'enable': 'true', 'created': '2026-03-23T03:18:51', 'last-modified': '2026-03-23T03:18:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400408'} 2026-03-23 03:18:52,622 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:52,628 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17150096876840568821', 'uuid-lslong': '13422271972281340917'}, 'enable': 'true', 'created': '2026-03-23T03:18:51', 'last-modified': '2026-03-23T03:18:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.409238'} 2026-03-23 03:18:52,635 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:52,642 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17150096876840568821', 'uuid-lslong': '13422271972281340917'}, 'enable': 'true', 'created': '2026-03-23T03:18:51', 'last-modified': '2026-03-23T03:18:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425985'} 2026-03-23 03:18:52,648 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-23 03:18:52,648 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-00118819 passed 2026-03-23 03:18:52,649 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-00118819 in API_Server ====== 2026-03-23 03:18:52,649 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:52,656 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:52,670 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:52,771 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ee01623e-8f9e-47f5-ba45-7d3e9a82d3f5 2026-03-23 03:18:52,784 - DEBUG - =>VN ctest-mgmt_vn-00118819 has no policy to be verified 2026-03-23 03:18:52,784 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:52,784 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:52,784 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:52,798 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819?flat'} 2026-03-23 03:18:52,798 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:52,798 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:52,811 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819?flat'} 2026-03-23 03:18:52,811 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:52,811 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:52,826 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819?flat'} 2026-03-23 03:18:52,826 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-mgmt_vn-00118819 is found in opserver 2026-03-23 03:18:52,850 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:52,860 - DEBUG - VRF ids for VN ctest-mgmt_vn-00118819: {} 2026-03-23 03:18:53,121 - DEBUG - Response for create_network : {'network': {'id': '8762b4c5-565a-48a0-84c9-064576f5a11d', 'name': 'ctest-left_vn-09037779', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-left_vn-09037779'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:53,375 - DEBUG - Response for create_subnet : {'subnet': {'id': '89441bb4-e9c4-4e65-bbd8-c9be67759d30', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': '8762b4c5-565a-48a0-84c9-064576f5a11d', 'ip_version': 4, 'cidr': '190.26.114.192/26', 'allocation_pools': [{'start': '190.26.114.194', 'end': '190.26.114.254'}], 'gateway_ip': '190.26.114.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.26.114.194', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:53,403 - INFO - Created VN ctest-left_vn-09037779 2026-03-23 03:18:53,416 - DEBUG - VN ctest-left_vn-09037779 UUID is 8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,500 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:53,508 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:53,520 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:53,615 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,629 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,641 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/97a7fecc-b71d-4a24-ad7e-4b2ce8d52643 2026-03-23 03:18:53,649 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/97a7fecc-b71d-4a24-ad7e-4b2ce8d52643 2026-03-23 03:18:53,658 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/59f0ba7f-73ae-4b98-8246-6c3c9164cd1a 2026-03-23 03:18:53,666 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:53,666 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,676 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/97a7fecc-b71d-4a24-ad7e-4b2ce8d52643 2026-03-23 03:18:53,692 - INFO - Verified VN network id 16 for VN 8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,693 - INFO - Verifications in API Server for VN ctest-left_vn-09037779 passed 2026-03-23 03:18:53,693 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,704 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/97a7fecc-b71d-4a24-ad7e-4b2ce8d52643 2026-03-23 03:18:53,714 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/97a7fecc-b71d-4a24-ad7e-4b2ce8d52643 2026-03-23 03:18:53,723 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/59f0ba7f-73ae-4b98-8246-6c3c9164cd1a 2026-03-23 03:18:53,737 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9755558502488230048', 'uuid-lslong': '9568185778743648541'}, 'enable': 'true', 'created': '2026-03-23T03:18:53', 'last-modified': '2026-03-23T03:18:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420789'} 2026-03-23 03:18:53,744 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:53,750 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9755558502488230048', 'uuid-lslong': '9568185778743648541'}, 'enable': 'true', 'created': '2026-03-23T03:18:53', 'last-modified': '2026-03-23T03:18:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444293'} 2026-03-23 03:18:53,757 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:53,763 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9755558502488230048', 'uuid-lslong': '9568185778743648541'}, 'enable': 'true', 'created': '2026-03-23T03:18:53', 'last-modified': '2026-03-23T03:18:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455657'} 2026-03-23 03:18:53,769 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-23 03:18:53,769 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-09037779 passed 2026-03-23 03:18:53,769 - DEBUG - ====Verifying policy data for ctest-left_vn-09037779 in API_Server ====== 2026-03-23 03:18:53,769 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:53,776 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:53,790 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:53,885 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/8762b4c5-565a-48a0-84c9-064576f5a11d 2026-03-23 03:18:53,895 - DEBUG - =>VN ctest-left_vn-09037779 has no policy to be verified 2026-03-23 03:18:53,895 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:53,895 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:53,895 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:53,908 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779?flat'} 2026-03-23 03:18:53,909 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:53,909 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:53,921 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779?flat'} 2026-03-23 03:18:53,922 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:53,922 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:53,934 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779?flat'} 2026-03-23 03:18:53,934 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-left_vn-09037779 is found in opserver 2026-03-23 03:18:53,957 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:53,968 - DEBUG - VRF ids for VN ctest-left_vn-09037779: {} 2026-03-23 03:18:54,242 - DEBUG - Response for create_network : {'network': {'id': '69bc9b45-3ed2-4687-bfcc-275892bac319', 'name': 'ctest-right_vn-55099389', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-right_vn-55099389'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:54,516 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c1119984-aece-4a51-a67e-4b430da90e74', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': '69bc9b45-3ed2-4687-bfcc-275892bac319', 'ip_version': 4, 'cidr': '103.230.60.192/26', 'allocation_pools': [{'start': '103.230.60.194', 'end': '103.230.60.254'}], 'gateway_ip': '103.230.60.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.230.60.194', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:54,540 - INFO - Created VN ctest-right_vn-55099389 2026-03-23 03:18:54,552 - DEBUG - VN ctest-right_vn-55099389 UUID is 69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:54,630 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:54,637 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:54,651 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:54,752 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:54,764 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:54,775 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3295c3a0-fac4-4eb3-8347-8dd2e7cd915a 2026-03-23 03:18:54,786 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3295c3a0-fac4-4eb3-8347-8dd2e7cd915a 2026-03-23 03:18:54,796 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/91d18f36-5d1b-4cda-a1ed-e274d1ebb9e4 2026-03-23 03:18:54,802 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:54,802 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:54,811 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3295c3a0-fac4-4eb3-8347-8dd2e7cd915a 2026-03-23 03:18:54,827 - INFO - Verified VN network id 17 for VN 69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:54,827 - INFO - Verifications in API Server for VN ctest-right_vn-55099389 passed 2026-03-23 03:18:54,827 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:54,842 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3295c3a0-fac4-4eb3-8347-8dd2e7cd915a 2026-03-23 03:18:54,852 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3295c3a0-fac4-4eb3-8347-8dd2e7cd915a 2026-03-23 03:18:54,860 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/91d18f36-5d1b-4cda-a1ed-e274d1ebb9e4 2026-03-23 03:18:54,873 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7619135391313053319', 'uuid-lslong': '13820464617865528089'}, 'enable': 'true', 'created': '2026-03-23T03:18:54', 'last-modified': '2026-03-23T03:18:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423815'} 2026-03-23 03:18:54,881 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:54,887 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7619135391313053319', 'uuid-lslong': '13820464617865528089'}, 'enable': 'true', 'created': '2026-03-23T03:18:54', 'last-modified': '2026-03-23T03:18:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435940'} 2026-03-23 03:18:54,893 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:54,899 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7619135391313053319', 'uuid-lslong': '13820464617865528089'}, 'enable': 'true', 'created': '2026-03-23T03:18:54', 'last-modified': '2026-03-23T03:18:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.439721'} 2026-03-23 03:18:54,906 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-23 03:18:54,906 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-55099389 passed 2026-03-23 03:18:54,907 - DEBUG - ====Verifying policy data for ctest-right_vn-55099389 in API_Server ====== 2026-03-23 03:18:54,907 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:54,915 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:54,930 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:55,041 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/69bc9b45-3ed2-4687-bfcc-275892bac319 2026-03-23 03:18:55,051 - DEBUG - =>VN ctest-right_vn-55099389 has no policy to be verified 2026-03-23 03:18:55,051 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:55,051 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:55,051 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:55,066 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389?flat'} 2026-03-23 03:18:55,066 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:55,066 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:55,081 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389?flat'} 2026-03-23 03:18:55,081 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:55,081 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:55,094 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389?flat'} 2026-03-23 03:18:55,094 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-right_vn-55099389 is found in opserver 2026-03-23 03:18:55,123 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:55,133 - DEBUG - VRF ids for VN ctest-right_vn-55099389: {} 2026-03-23 03:18:55,407 - DEBUG - Response for create_network : {'network': {'id': '1601e1ed-a872-46ce-b76a-8efa154c7880', 'name': 'ctest-trans_left_vn-62365447', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-trans_left_vn-62365447'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:55,697 - DEBUG - Response for create_subnet : {'subnet': {'id': '0e85dbb2-4fff-4adf-a398-16b45cd9d012', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': '1601e1ed-a872-46ce-b76a-8efa154c7880', 'ip_version': 4, 'cidr': '67.56.28.128/26', 'allocation_pools': [{'start': '67.56.28.130', 'end': '67.56.28.190'}], 'gateway_ip': '67.56.28.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.56.28.130', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:55,722 - INFO - Created VN ctest-trans_left_vn-62365447 2026-03-23 03:18:55,732 - DEBUG - VN ctest-trans_left_vn-62365447 UUID is 1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:55,809 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:55,816 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:55,828 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:55,930 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:55,942 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:55,951 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/0466ed4c-3cae-4ec4-afa7-9b7c9aa9c65a 2026-03-23 03:18:55,959 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/0466ed4c-3cae-4ec4-afa7-9b7c9aa9c65a 2026-03-23 03:18:55,967 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/9ae599cc-4248-4944-b8b3-1342364f62a8 2026-03-23 03:18:55,974 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-23 03:18:55,974 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:55,983 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/0466ed4c-3cae-4ec4-afa7-9b7c9aa9c65a 2026-03-23 03:18:56,002 - INFO - Verified VN network id 18 for VN 1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:56,002 - INFO - Verifications in API Server for VN ctest-trans_left_vn-62365447 passed 2026-03-23 03:18:56,002 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:56,014 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/0466ed4c-3cae-4ec4-afa7-9b7c9aa9c65a 2026-03-23 03:18:56,027 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/0466ed4c-3cae-4ec4-afa7-9b7c9aa9c65a 2026-03-23 03:18:56,035 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/9ae599cc-4248-4944-b8b3-1342364f62a8 2026-03-23 03:18:56,049 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1585796954660685518', 'uuid-lslong': '13216533261222443136'}, 'enable': 'true', 'created': '2026-03-23T03:18:55', 'last-modified': '2026-03-23T03:18:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406818'} 2026-03-23 03:18:56,055 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-23 03:18:56,063 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1585796954660685518', 'uuid-lslong': '13216533261222443136'}, 'enable': 'true', 'created': '2026-03-23T03:18:55', 'last-modified': '2026-03-23T03:18:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434976'} 2026-03-23 03:18:56,071 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-23 03:18:56,077 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1585796954660685518', 'uuid-lslong': '13216533261222443136'}, 'enable': 'true', 'created': '2026-03-23T03:18:55', 'last-modified': '2026-03-23T03:18:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433000'} 2026-03-23 03:18:56,083 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-23 03:18:56,083 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-62365447 passed 2026-03-23 03:18:56,084 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-62365447 in API_Server ====== 2026-03-23 03:18:56,084 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:56,091 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:56,110 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:56,214 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1601e1ed-a872-46ce-b76a-8efa154c7880 2026-03-23 03:18:56,225 - DEBUG - =>VN ctest-trans_left_vn-62365447 has no policy to be verified 2026-03-23 03:18:56,225 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:56,225 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:56,225 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:56,238 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447?flat'} 2026-03-23 03:18:56,238 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:56,238 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:56,249 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447?flat'} 2026-03-23 03:18:56,249 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:56,249 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:56,263 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447?flat'} 2026-03-23 03:18:56,263 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-trans_left_vn-62365447 is found in opserver 2026-03-23 03:18:56,287 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:56,299 - DEBUG - VRF ids for VN ctest-trans_left_vn-62365447: {} 2026-03-23 03:18:56,559 - DEBUG - Response for create_network : {'network': {'id': '9a65da0d-1de4-4944-a6de-349937c5418d', 'name': 'ctest-trans_right_vn-52761069', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-31774004', 'ctest-trans_right_vn-52761069'], 'port_security_enabled': True, 'description': ''}} 2026-03-23 03:18:56,787 - DEBUG - Response for create_subnet : {'subnet': {'id': '4033be75-4c58-4739-9d72-f13709475288', 'name': '', 'tenant_id': '20ee8ecf2e3e452ea39ee8b14211fcad', 'network_id': '9a65da0d-1de4-4944-a6de-349937c5418d', 'ip_version': 4, 'cidr': '220.108.241.192/26', 'allocation_pools': [{'start': '220.108.241.194', 'end': '220.108.241.254'}], 'gateway_ip': '220.108.241.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.108.241.194', 'tags': [], 'project_id': '20ee8ecf2e3e452ea39ee8b14211fcad'}} 2026-03-23 03:18:56,811 - INFO - Created VN ctest-trans_right_vn-52761069 2026-03-23 03:18:56,826 - DEBUG - VN ctest-trans_right_vn-52761069 UUID is 9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:56,896 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:56,903 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:56,915 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:57,005 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:57,041 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:57,055 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afad4631-00da-42a8-8b43-e8e8f373c44a 2026-03-23 03:18:57,064 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afad4631-00da-42a8-8b43-e8e8f373c44a 2026-03-23 03:18:57,072 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/4ae120b6-dec9-4029-ab1e-cd1ae8d6e50b 2026-03-23 03:18:57,081 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-23 03:18:57,081 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:57,093 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afad4631-00da-42a8-8b43-e8e8f373c44a 2026-03-23 03:18:57,111 - INFO - Verified VN network id 19 for VN 9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:57,111 - INFO - Verifications in API Server for VN ctest-trans_right_vn-52761069 passed 2026-03-23 03:18:57,111 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:57,121 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afad4631-00da-42a8-8b43-e8e8f373c44a 2026-03-23 03:18:57,129 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afad4631-00da-42a8-8b43-e8e8f373c44a 2026-03-23 03:18:57,137 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/4ae120b6-dec9-4029-ab1e-cd1ae8d6e50b 2026-03-23 03:18:57,150 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11125538204359608644', 'uuid-lslong': '12024105887796117901'}, 'enable': 'true', 'created': '2026-03-23T03:18:56', 'last-modified': '2026-03-23T03:18:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422760'} 2026-03-23 03:18:57,156 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-23 03:18:57,162 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11125538204359608644', 'uuid-lslong': '12024105887796117901'}, 'enable': 'true', 'created': '2026-03-23T03:18:56', 'last-modified': '2026-03-23T03:18:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435219'} 2026-03-23 03:18:57,169 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-23 03:18:57,175 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-31774004', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11125538204359608644', 'uuid-lslong': '12024105887796117901'}, 'enable': 'true', 'created': '2026-03-23T03:18:56', 'last-modified': '2026-03-23T03:18:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443857'} 2026-03-23 03:18:57,185 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-03-23 03:18:57,185 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-52761069 passed 2026-03-23 03:18:57,185 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-52761069 in API_Server ====== 2026-03-23 03:18:57,185 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:18:57,198 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:18:57,212 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:18:57,312 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9a65da0d-1de4-4944-a6de-349937c5418d 2026-03-23 03:18:57,320 - DEBUG - =>VN ctest-trans_right_vn-52761069 has no policy to be verified 2026-03-23 03:18:57,320 - DEBUG - Verifying the vn in opserver 2026-03-23 03:18:57,320 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069 virtual network link through opserver 10.0.0.27 2026-03-23 03:18:57,320 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-23 03:18:57,332 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069?flat'} 2026-03-23 03:18:57,332 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069 virtual network link through opserver 10.0.0.50 2026-03-23 03:18:57,333 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-03-23 03:18:57,344 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069?flat'} 2026-03-23 03:18:57,344 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069 virtual network link through opserver 10.0.0.23 2026-03-23 03:18:57,344 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-23 03:18:57,356 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069?flat'} 2026-03-23 03:18:57,356 - INFO - Validated that VN default-domain:ctest-TestSvcHC-31774004:ctest-trans_right_vn-52761069 is found in opserver 2026-03-23 03:18:57,377 - DEBUG - Do not have enough data to verify VN in agent 2026-03-23 03:18:57,389 - DEBUG - VRF ids for VN ctest-trans_right_vn-52761069: {} 2026-03-23 03:18:58,548 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5514-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5514-1) 2026-03-23 03:18:59,932 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5514-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5514-2) 2026-03-23 03:18:59,932 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-51160350'] 2026-03-23 03:19:00,235 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-51160350'] created succesfully 2026-03-23 03:19:00,643 - DEBUG - Image by name tiny_trans_fw not found 2026-03-23 03:19:00,643 - DEBUG - Installing image tiny_trans_fw 2026-03-23 03:19:00,643 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-03-23 03:19:00,644 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-23 03:19:00,644 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-23 03:19:00,645 - DEBUG - Unzip image 2026-03-23 03:19:00,645 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-23 03:19:00,677 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-03-23 03:19:00,678 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-51160350'] 2026-03-23 03:19:00,809 - INFO - Service template: ['default-domain', 'ctest-service_template_1-51160350'] deleted successfully. 2026-03-23 03:19:00,809 - INFO - Skip interface_detach for VM ctest-right_vm-23727406 in state BUILD 2026-03-23 03:19:00,809 - INFO - Deleting VM ctest-right_vm-23727406 2026-03-23 03:19:00,809 - ERROR - VM ctest-right_vm-23727406 has failed to come up 2026-03-23 03:19:00,809 - ERROR - Nova failed to get host of the VM 2026-03-23 03:19:00,809 - ERROR - VM ctest-right_vm-23727406 has failed to come up 2026-03-23 03:19:00,809 - ERROR - Nova failed to get host of the VM 2026-03-23 03:19:00,951 - INFO - Skip interface_detach for VM ctest-left_vm-75002701 in state BUILD 2026-03-23 03:19:00,951 - INFO - Deleting VM ctest-left_vm-75002701 2026-03-23 03:19:00,951 - ERROR - VM ctest-left_vm-75002701 has failed to come up 2026-03-23 03:19:00,951 - ERROR - Nova failed to get host of the VM 2026-03-23 03:19:00,952 - ERROR - VM ctest-left_vm-75002701 has failed to come up 2026-03-23 03:19:00,952 - ERROR - Nova failed to get host of the VM 2026-03-23 03:19:01,055 - INFO - Deleting VN ctest-trans_right_vn-52761069 2026-03-23 03:19:01,306 - DEBUG - Response for deleting network () 2026-03-23 03:19:01,306 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/afad4631-00da-42a8-8b43-e8e8f373c44a 2026-03-23 03:19:01,315 - DEBUG - Response Code: 404 2026-03-23 03:19:01,315 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:19:01,332 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:19:01,392 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:19:01,489 - INFO - Validated that VN ctest-trans_right_vn-52761069 is not found in API Server 2026-03-23 03:19:01,507 - DEBUG - VN ctest-trans_right_vn-52761069 is not present in Agent 10.0.0.249 2026-03-23 03:19:01,558 - DEBUG - VN ctest-trans_right_vn-52761069 is not present in Agent 10.0.0.65 2026-03-23 03:19:01,558 - INFO - Validated that VN ctest-trans_right_vn-52761069 is not in any agent 2026-03-23 03:19:01,597 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-52761069 info 2026-03-23 03:19:01,597 - INFO - Deleting VN ctest-trans_left_vn-62365447 2026-03-23 03:19:01,780 - DEBUG - Response for deleting network () 2026-03-23 03:19:01,780 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/0466ed4c-3cae-4ec4-afa7-9b7c9aa9c65a 2026-03-23 03:19:01,788 - DEBUG - Response Code: 404 2026-03-23 03:19:01,788 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:19:01,810 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:19:01,845 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:19:01,967 - INFO - Validated that VN ctest-trans_left_vn-62365447 is not found in API Server 2026-03-23 03:19:01,980 - DEBUG - VN ctest-trans_left_vn-62365447 is not present in Agent 10.0.0.249 2026-03-23 03:19:02,001 - DEBUG - VN ctest-trans_left_vn-62365447 is not present in Agent 10.0.0.65 2026-03-23 03:19:02,001 - INFO - Validated that VN ctest-trans_left_vn-62365447 is not in any agent 2026-03-23 03:19:02,052 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-62365447 info 2026-03-23 03:19:02,052 - INFO - Deleting VN ctest-right_vn-55099389 2026-03-23 03:19:02,102 - DEBUG - VN 69bc9b45-3ed2-4687-bfcc-275892bac319 still in use: Unable to complete operation on network 69bc9b45-3ed2-4687-bfcc-275892bac319. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e20f435b-f2df-4a18-abd4-a239faca1b54'] 2026-03-23 03:19:02,102 - WARNING - Deleting VN ctest-right_vn-55099389 failed..Will retry 2026-03-23 03:19:04,371 - DEBUG - Response for deleting network () 2026-03-23 03:19:04,371 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3295c3a0-fac4-4eb3-8347-8dd2e7cd915a 2026-03-23 03:19:04,387 - DEBUG - Response Code: 404 2026-03-23 03:19:04,387 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:19:04,398 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:19:04,460 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:19:04,582 - INFO - Validated that VN ctest-right_vn-55099389 is not found in API Server 2026-03-23 03:19:04,595 - DEBUG - VN ctest-right_vn-55099389 is not present in Agent 10.0.0.249 2026-03-23 03:19:04,606 - DEBUG - VN ctest-right_vn-55099389 is not present in Agent 10.0.0.65 2026-03-23 03:19:04,606 - INFO - Validated that VN ctest-right_vn-55099389 is not in any agent 2026-03-23 03:19:04,650 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-55099389 info 2026-03-23 03:19:04,650 - INFO - Deleting VN ctest-left_vn-09037779 2026-03-23 03:19:04,869 - DEBUG - Response for deleting network () 2026-03-23 03:19:04,869 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/97a7fecc-b71d-4a24-ad7e-4b2ce8d52643 2026-03-23 03:19:04,877 - DEBUG - Response Code: 404 2026-03-23 03:19:04,877 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:19:04,892 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:19:04,905 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:19:05,032 - INFO - Validated that VN ctest-left_vn-09037779 is not found in API Server 2026-03-23 03:19:05,047 - DEBUG - VN ctest-left_vn-09037779 is not present in Agent 10.0.0.249 2026-03-23 03:19:05,060 - DEBUG - VN ctest-left_vn-09037779 is not present in Agent 10.0.0.65 2026-03-23 03:19:05,060 - INFO - Validated that VN ctest-left_vn-09037779 is not in any agent 2026-03-23 03:19:05,102 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-09037779 info 2026-03-23 03:19:05,102 - INFO - Deleting VN ctest-mgmt_vn-00118819 2026-03-23 03:19:05,256 - DEBUG - Response for deleting network () 2026-03-23 03:19:05,256 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/59b5c9d3-c3ff-4f8f-9807-97e6ab725fb2 2026-03-23 03:19:05,264 - DEBUG - Response Code: 404 2026-03-23 03:19:05,264 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-03-23 03:19:05,271 - DEBUG - Requesting: http://10.0.0.27:8082/domain/54adab80-1c58-45eb-8fc6-565ee3803789 2026-03-23 03:19:05,299 - DEBUG - Requesting: http://10.0.0.27:8082/project/20ee8ecf-2e3e-452e-a39e-e8b14211fcad 2026-03-23 03:19:05,402 - INFO - Validated that VN ctest-mgmt_vn-00118819 is not found in API Server 2026-03-23 03:19:05,414 - DEBUG - VN ctest-mgmt_vn-00118819 is not present in Agent 10.0.0.249 2026-03-23 03:19:05,426 - DEBUG - VN ctest-mgmt_vn-00118819 is not present in Agent 10.0.0.65 2026-03-23 03:19:05,426 - INFO - Validated that VN ctest-mgmt_vn-00118819 is not in any agent 2026-03-23 03:19:05,463 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-00118819 info 2026-03-23 03:19:06,775 - DEBUG - No XMPP flaps were noticed during the test 2026-03-23 03:19:06,776 - INFO - 2026-03-23 03:19:06,776 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2026-03-23 03:19:06,776 - INFO - -------------------------------------------------------------------------------- 2026-03-23 03:19:07,581 - INFO - Deleted project: ctest-TestSvcHC-31774004, ID : 20ee8ecf-2e3e-452e-a39e-e8b14211fcad