2026-03-09 02:59:53,799 - INFO - Domain Default found not creating 2026-03-09 02:59:53,981 - INFO - Project ctest-TestSvcHC-13479483 not found, creating it 2026-03-09 02:59:54,469 - INFO - Created Project:ctest-TestSvcHC-13479483, ID : 88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 02:59:55,993 - INFO - ================================================================================ 2026-03-09 02:59:55,994 - INFO - STARTING TEST : test_svc_hc_basic 2026-03-09 02:59:57,262 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.27': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2026-03-09 02:59:57,262 - INFO - Initial checks done. Running the testcase now 2026-03-09 02:59:57,262 - INFO - 2026-03-09 02:59:57,925 - DEBUG - Response for create_network : {'network': {'id': '46a3952a-b02d-4567-ba2f-c9ccc8be83f3', 'name': 'ctest-mgmt_vn-06499101', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-mgmt_vn-06499101'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 02:59:58,186 - DEBUG - Response for create_subnet : {'subnet': {'id': '82f39c07-a919-4592-9bea-5118918e814e', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': '46a3952a-b02d-4567-ba2f-c9ccc8be83f3', 'ip_version': 4, 'cidr': '15.238.70.64/26', 'allocation_pools': [{'start': '15.238.70.66', 'end': '15.238.70.126'}], 'gateway_ip': '15.238.70.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.238.70.66', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 02:59:58,215 - INFO - Created VN ctest-mgmt_vn-06499101 2026-03-09 02:59:58,228 - DEBUG - VN ctest-mgmt_vn-06499101 UUID is 46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:58,319 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 02:59:58,615 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 02:59:58,652 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 02:59:58,667 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 02:59:58,762 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:58,773 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:58,783 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c38249e6-8f07-4aa7-a014-b1f10c371e34 2026-03-09 02:59:58,791 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c38249e6-8f07-4aa7-a014-b1f10c371e34 2026-03-09 02:59:58,798 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/aa452221-a16c-4543-90c9-fe7e84c9abc3 2026-03-09 02:59:58,805 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 02:59:58,805 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:58,815 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c38249e6-8f07-4aa7-a014-b1f10c371e34 2026-03-09 02:59:58,830 - INFO - Verified VN network id 10 for VN 46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:58,830 - INFO - Verifications in API Server for VN ctest-mgmt_vn-06499101 passed 2026-03-09 02:59:58,830 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:58,841 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c38249e6-8f07-4aa7-a014-b1f10c371e34 2026-03-09 02:59:58,850 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c38249e6-8f07-4aa7-a014-b1f10c371e34 2026-03-09 02:59:58,857 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/aa452221-a16c-4543-90c9-fe7e84c9abc3 2026-03-09 02:59:58,870 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090076014435714407', 'uuid-lslong': '13416163696338437107'}, 'enable': 'true', 'created': '2026-03-09T02:59:57', 'last-modified': '2026-03-09T02:59:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.730644'} 2026-03-09 02:59:58,876 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 02:59:58,881 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090076014435714407', 'uuid-lslong': '13416163696338437107'}, 'enable': 'true', 'created': '2026-03-09T02:59:57', 'last-modified': '2026-03-09T02:59:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.752966'} 2026-03-09 02:59:58,887 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 02:59:58,893 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5090076014435714407', 'uuid-lslong': '13416163696338437107'}, 'enable': 'true', 'created': '2026-03-09T02:59:57', 'last-modified': '2026-03-09T02:59:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.772658'} 2026-03-09 02:59:58,899 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 02:59:58,899 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-06499101 passed 2026-03-09 02:59:58,900 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-06499101 in API_Server ====== 2026-03-09 02:59:58,900 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 02:59:58,906 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 02:59:58,919 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 02:59:59,008 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/46a3952a-b02d-4567-ba2f-c9ccc8be83f3 2026-03-09 02:59:59,019 - DEBUG - =>VN ctest-mgmt_vn-06499101 has no policy to be verified 2026-03-09 02:59:59,019 - DEBUG - Verifying the vn in opserver 2026-03-09 02:59:59,019 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101 virtual network link through opserver 10.0.0.22 2026-03-09 02:59:59,019 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 02:59:59,314 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 02:59:59,387 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101?flat'} 2026-03-09 02:59:59,387 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101 virtual network link through opserver 10.0.0.249 2026-03-09 02:59:59,387 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 02:59:59,681 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 02:59:59,739 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101?flat'} 2026-03-09 02:59:59,739 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101 virtual network link through opserver 10.0.0.23 2026-03-09 02:59:59,739 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:00,038 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:00,111 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101?flat'} 2026-03-09 03:00:00,111 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-06499101 is found in opserver 2026-03-09 03:00:00,131 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:00,142 - DEBUG - VRF ids for VN ctest-mgmt_vn-06499101: {} 2026-03-09 03:00:00,392 - DEBUG - Response for create_network : {'network': {'id': 'b50d207d-67a3-475f-a9b0-a7059fb9341f', 'name': 'ctest-left_vn-66535808', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-left_vn-66535808'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:00,604 - DEBUG - Response for create_subnet : {'subnet': {'id': '15695d36-54ae-42f3-95d4-1b168979fa2f', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': 'b50d207d-67a3-475f-a9b0-a7059fb9341f', 'ip_version': 4, 'cidr': '73.213.156.0/26', 'allocation_pools': [{'start': '73.213.156.2', 'end': '73.213.156.62'}], 'gateway_ip': '73.213.156.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.213.156.2', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:00,628 - INFO - Created VN ctest-left_vn-66535808 2026-03-09 03:00:00,641 - DEBUG - VN ctest-left_vn-66535808 UUID is b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:00,712 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:00,719 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:00,731 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:00,828 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:00,844 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:00,857 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/065437ab-8a25-48c2-a0a1-09d81fd3c8f0 2026-03-09 03:00:00,866 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/065437ab-8a25-48c2-a0a1-09d81fd3c8f0 2026-03-09 03:00:00,875 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/65dd6f20-4b1a-4af4-a0f6-e2882a401161 2026-03-09 03:00:00,884 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:00,884 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:00,898 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/065437ab-8a25-48c2-a0a1-09d81fd3c8f0 2026-03-09 03:00:00,916 - INFO - Verified VN network id 11 for VN b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:00,916 - INFO - Verifications in API Server for VN ctest-left_vn-66535808 passed 2026-03-09 03:00:00,916 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:00,930 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/065437ab-8a25-48c2-a0a1-09d81fd3c8f0 2026-03-09 03:00:00,939 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/065437ab-8a25-48c2-a0a1-09d81fd3c8f0 2026-03-09 03:00:00,946 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/65dd6f20-4b1a-4af4-a0f6-e2882a401161 2026-03-09 03:00:00,960 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13046119418543949663', 'uuid-lslong': '12227456630907286559'}, 'enable': 'true', 'created': '2026-03-09T03:00:00', 'last-modified': '2026-03-09T03:00:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410627'} 2026-03-09 03:00:00,967 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:00,981 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13046119418543949663', 'uuid-lslong': '12227456630907286559'}, 'enable': 'true', 'created': '2026-03-09T03:00:00', 'last-modified': '2026-03-09T03:00:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432007'} 2026-03-09 03:00:00,988 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:00,994 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13046119418543949663', 'uuid-lslong': '12227456630907286559'}, 'enable': 'true', 'created': '2026-03-09T03:00:00', 'last-modified': '2026-03-09T03:00:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440845'} 2026-03-09 03:00:01,002 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:01,002 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-66535808 passed 2026-03-09 03:00:01,003 - DEBUG - ====Verifying policy data for ctest-left_vn-66535808 in API_Server ====== 2026-03-09 03:00:01,003 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:01,009 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:01,020 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:01,120 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b50d207d-67a3-475f-a9b0-a7059fb9341f 2026-03-09 03:00:01,132 - DEBUG - =>VN ctest-left_vn-66535808 has no policy to be verified 2026-03-09 03:00:01,132 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:01,132 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:01,132 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:01,226 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808?flat'} 2026-03-09 03:00:01,226 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:01,226 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:01,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808?flat'} 2026-03-09 03:00:01,594 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:01,594 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:01,679 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808?flat'} 2026-03-09 03:00:01,679 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-66535808 is found in opserver 2026-03-09 03:00:01,704 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:01,716 - DEBUG - VRF ids for VN ctest-left_vn-66535808: {} 2026-03-09 03:00:01,989 - DEBUG - Response for create_network : {'network': {'id': '607c2dfb-641f-4bc1-94e8-caa8c7d4a899', 'name': 'ctest-right_vn-04728580', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-right_vn-04728580'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:02,231 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c9396308-950b-4f64-a1ee-e5c1c8c7203b', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': '607c2dfb-641f-4bc1-94e8-caa8c7d4a899', 'ip_version': 4, 'cidr': '5.138.253.192/26', 'allocation_pools': [{'start': '5.138.253.194', 'end': '5.138.253.254'}], 'gateway_ip': '5.138.253.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.138.253.194', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:02,253 - INFO - Created VN ctest-right_vn-04728580 2026-03-09 03:00:02,262 - DEBUG - VN ctest-right_vn-04728580 UUID is 607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,333 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:02,339 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:02,350 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:02,434 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,447 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,465 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cb52a90e-2623-47a6-b39d-dadd0f9c4f37 2026-03-09 03:00:02,474 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cb52a90e-2623-47a6-b39d-dadd0f9c4f37 2026-03-09 03:00:02,482 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f4fdc05b-51fe-4b3e-a842-0fa07568527f 2026-03-09 03:00:02,490 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:02,490 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,499 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cb52a90e-2623-47a6-b39d-dadd0f9c4f37 2026-03-09 03:00:02,516 - INFO - Verified VN network id 12 for VN 607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,516 - INFO - Verifications in API Server for VN ctest-right_vn-04728580 passed 2026-03-09 03:00:02,517 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,526 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cb52a90e-2623-47a6-b39d-dadd0f9c4f37 2026-03-09 03:00:02,537 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cb52a90e-2623-47a6-b39d-dadd0f9c4f37 2026-03-09 03:00:02,545 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f4fdc05b-51fe-4b3e-a842-0fa07568527f 2026-03-09 03:00:02,560 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6952482482493017025', 'uuid-lslong': '10730048938466125977'}, 'enable': 'true', 'created': '2026-03-09T03:00:01', 'last-modified': '2026-03-09T03:00:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.373914'} 2026-03-09 03:00:02,571 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:02,576 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6952482482493017025', 'uuid-lslong': '10730048938466125977'}, 'enable': 'true', 'created': '2026-03-09T03:00:01', 'last-modified': '2026-03-09T03:00:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.389548'} 2026-03-09 03:00:02,582 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:02,588 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6952482482493017025', 'uuid-lslong': '10730048938466125977'}, 'enable': 'true', 'created': '2026-03-09T03:00:01', 'last-modified': '2026-03-09T03:00:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393596'} 2026-03-09 03:00:02,595 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:02,595 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-04728580 passed 2026-03-09 03:00:02,595 - DEBUG - ====Verifying policy data for ctest-right_vn-04728580 in API_Server ====== 2026-03-09 03:00:02,595 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:02,605 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:02,621 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:02,723 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/607c2dfb-641f-4bc1-94e8-caa8c7d4a899 2026-03-09 03:00:02,733 - DEBUG - =>VN ctest-right_vn-04728580 has no policy to be verified 2026-03-09 03:00:02,733 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:02,733 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:02,733 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:02,803 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580?flat'} 2026-03-09 03:00:02,803 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:02,803 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:02,816 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580?flat'} 2026-03-09 03:00:02,816 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:02,816 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:02,828 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580?flat'} 2026-03-09 03:00:02,828 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-04728580 is found in opserver 2026-03-09 03:00:02,851 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:02,864 - DEBUG - VRF ids for VN ctest-right_vn-04728580: {} 2026-03-09 03:00:02,926 - DEBUG - Services list from nova: [, , , ] 2026-03-09 03:00:04,083 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5454-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5454-1) 2026-03-09 03:00:05,550 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5454-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5454-2) 2026-03-09 03:00:05,551 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-61085082'] 2026-03-09 03:00:05,874 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-61085082'] created succesfully 2026-03-09 03:00:06,244 - DEBUG - Image by name tiny_nat_fw not found 2026-03-09 03:00:06,244 - DEBUG - Installing image tiny_nat_fw 2026-03-09 03:00:06,244 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-03-09 03:00:06,245 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-09 03:00:06,245 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-09 03:00:06,245 - DEBUG - Unzip image 2026-03-09 03:00:06,245 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-09 03:00:06,262 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-03-09 03:00:06,262 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-61085082'] 2026-03-09 03:00:06,380 - INFO - Service template: ['default-domain', 'ctest-service_template_1-61085082'] deleted successfully. 2026-03-09 03:00:06,380 - INFO - Skip interface_detach for VM ctest-right_vm-63381760 in state BUILD 2026-03-09 03:00:06,380 - INFO - Deleting VM ctest-right_vm-63381760 2026-03-09 03:00:06,433 - ERROR - VM ctest-right_vm-63381760 has failed to come up 2026-03-09 03:00:06,433 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:06,433 - ERROR - VM ctest-right_vm-63381760 has failed to come up 2026-03-09 03:00:06,434 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:06,570 - INFO - Skip interface_detach for VM ctest-left_vm-86399707 in state BUILD 2026-03-09 03:00:06,571 - INFO - Deleting VM ctest-left_vm-86399707 2026-03-09 03:00:06,571 - ERROR - VM ctest-left_vm-86399707 has failed to come up 2026-03-09 03:00:06,572 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:06,572 - ERROR - VM ctest-left_vm-86399707 has failed to come up 2026-03-09 03:00:06,572 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:06,663 - INFO - Deleting VN ctest-right_vn-04728580 2026-03-09 03:00:06,710 - DEBUG - VN 607c2dfb-641f-4bc1-94e8-caa8c7d4a899 still in use: Unable to complete operation on network 607c2dfb-641f-4bc1-94e8-caa8c7d4a899. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3c8b5a1d-40db-45cb-a9b9-2eadd312d4d5'] 2026-03-09 03:00:06,710 - WARNING - Deleting VN ctest-right_vn-04728580 failed..Will retry 2026-03-09 03:00:08,866 - DEBUG - Response for deleting network () 2026-03-09 03:00:08,866 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cb52a90e-2623-47a6-b39d-dadd0f9c4f37 2026-03-09 03:00:08,873 - DEBUG - Response Code: 404 2026-03-09 03:00:08,874 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:08,884 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:08,917 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:09,020 - INFO - Validated that VN ctest-right_vn-04728580 is not found in API Server 2026-03-09 03:00:09,031 - DEBUG - VN ctest-right_vn-04728580 is not present in Agent 10.0.0.41 2026-03-09 03:00:09,042 - DEBUG - VN ctest-right_vn-04728580 is not present in Agent 10.0.0.27 2026-03-09 03:00:09,042 - INFO - Validated that VN ctest-right_vn-04728580 is not in any agent 2026-03-09 03:00:09,071 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-04728580 info 2026-03-09 03:00:09,071 - INFO - Deleting VN ctest-left_vn-66535808 2026-03-09 03:00:09,220 - DEBUG - Response for deleting network () 2026-03-09 03:00:09,220 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/065437ab-8a25-48c2-a0a1-09d81fd3c8f0 2026-03-09 03:00:09,225 - DEBUG - Response Code: 404 2026-03-09 03:00:09,225 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:09,236 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:09,249 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:09,336 - INFO - Validated that VN ctest-left_vn-66535808 is not found in API Server 2026-03-09 03:00:09,353 - DEBUG - VN ctest-left_vn-66535808 is not present in Agent 10.0.0.41 2026-03-09 03:00:09,367 - DEBUG - VN ctest-left_vn-66535808 is not present in Agent 10.0.0.27 2026-03-09 03:00:09,367 - INFO - Validated that VN ctest-left_vn-66535808 is not in any agent 2026-03-09 03:00:09,406 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-66535808 info 2026-03-09 03:00:09,407 - INFO - Deleting VN ctest-mgmt_vn-06499101 2026-03-09 03:00:09,561 - DEBUG - Response for deleting network () 2026-03-09 03:00:09,561 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c38249e6-8f07-4aa7-a014-b1f10c371e34 2026-03-09 03:00:09,567 - DEBUG - Response Code: 404 2026-03-09 03:00:09,567 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:09,572 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:09,590 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:09,674 - INFO - Validated that VN ctest-mgmt_vn-06499101 is not found in API Server 2026-03-09 03:00:09,685 - DEBUG - VN ctest-mgmt_vn-06499101 is not present in Agent 10.0.0.41 2026-03-09 03:00:09,697 - DEBUG - VN ctest-mgmt_vn-06499101 is not present in Agent 10.0.0.27 2026-03-09 03:00:09,697 - INFO - Validated that VN ctest-mgmt_vn-06499101 is not in any agent 2026-03-09 03:00:09,740 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-06499101 info 2026-03-09 03:00:11,030 - DEBUG - No XMPP flaps were noticed during the test 2026-03-09 03:00:11,030 - INFO -

2026-03-09 03:00:11,030 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16]

2026-03-09 03:00:11,030 - INFO - -------------------------------------------------------------------------------- 2026-03-09 03:00:11,034 - INFO - ================================================================================ 2026-03-09 03:00:11,034 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-03-09 03:00:12,307 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.27': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2026-03-09 03:00:12,307 - INFO - Initial checks done. Running the testcase now 2026-03-09 03:00:12,307 - INFO - 2026-03-09 03:00:12,597 - DEBUG - Response for create_network : {'network': {'id': '034fc2ba-9777-4768-ad6b-69455b8258ca', 'name': 'ctest-mgmt_vn-59111290', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-mgmt_vn-59111290'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:12,797 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cf05cc84-f9a7-42ca-8ebd-305ac7b63940', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': '034fc2ba-9777-4768-ad6b-69455b8258ca', 'ip_version': 4, 'cidr': '4.112.13.192/26', 'allocation_pools': [{'start': '4.112.13.194', 'end': '4.112.13.254'}], 'gateway_ip': '4.112.13.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.112.13.194', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:12,822 - INFO - Created VN ctest-mgmt_vn-59111290 2026-03-09 03:00:12,832 - DEBUG - VN ctest-mgmt_vn-59111290 UUID is 034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:12,911 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:12,917 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:12,930 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:13,036 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:13,061 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:13,073 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/3edade59-623c-438e-ada7-cf66510135b0 2026-03-09 03:00:13,081 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/3edade59-623c-438e-ada7-cf66510135b0 2026-03-09 03:00:13,089 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/29a16212-c23e-4349-986d-f5e85b866cdb 2026-03-09 03:00:13,097 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:00:13,097 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:13,106 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/3edade59-623c-438e-ada7-cf66510135b0 2026-03-09 03:00:13,123 - INFO - Verified VN network id 10 for VN 034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:13,123 - INFO - Verifications in API Server for VN ctest-mgmt_vn-59111290 passed 2026-03-09 03:00:13,123 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:13,134 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/3edade59-623c-438e-ada7-cf66510135b0 2026-03-09 03:00:13,142 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/3edade59-623c-438e-ada7-cf66510135b0 2026-03-09 03:00:13,149 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/29a16212-c23e-4349-986d-f5e85b866cdb 2026-03-09 03:00:13,163 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '238623411934807912', 'uuid-lslong': '12496197337678502090'}, 'enable': 'true', 'created': '2026-03-09T03:00:12', 'last-modified': '2026-03-09T03:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412023'} 2026-03-09 03:00:13,168 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:00:13,174 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '238623411934807912', 'uuid-lslong': '12496197337678502090'}, 'enable': 'true', 'created': '2026-03-09T03:00:12', 'last-modified': '2026-03-09T03:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423212'} 2026-03-09 03:00:13,181 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:00:13,188 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '238623411934807912', 'uuid-lslong': '12496197337678502090'}, 'enable': 'true', 'created': '2026-03-09T03:00:12', 'last-modified': '2026-03-09T03:00:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436880'} 2026-03-09 03:00:13,195 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-09 03:00:13,195 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-59111290 passed 2026-03-09 03:00:13,196 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-59111290 in API_Server ====== 2026-03-09 03:00:13,196 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:13,202 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:13,214 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:13,311 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/034fc2ba-9777-4768-ad6b-69455b8258ca 2026-03-09 03:00:13,320 - DEBUG - =>VN ctest-mgmt_vn-59111290 has no policy to be verified 2026-03-09 03:00:13,320 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:13,320 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:13,320 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:13,335 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290?flat'} 2026-03-09 03:00:13,335 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:13,335 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:13,405 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290?flat'} 2026-03-09 03:00:13,405 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:13,405 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:13,462 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290?flat'} 2026-03-09 03:00:13,462 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-mgmt_vn-59111290 is found in opserver 2026-03-09 03:00:13,484 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:13,493 - DEBUG - VRF ids for VN ctest-mgmt_vn-59111290: {} 2026-03-09 03:00:13,729 - DEBUG - Response for create_network : {'network': {'id': '952192e7-7f76-4785-a9f5-f0dfa93534b6', 'name': 'ctest-left_vn-67313579', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-left_vn-67313579'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:13,925 - DEBUG - Response for create_subnet : {'subnet': {'id': '97344e87-a18a-4931-a0fb-a0b768bc64b1', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': '952192e7-7f76-4785-a9f5-f0dfa93534b6', 'ip_version': 4, 'cidr': '78.204.96.128/26', 'allocation_pools': [{'start': '78.204.96.130', 'end': '78.204.96.190'}], 'gateway_ip': '78.204.96.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '78.204.96.130', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:13,950 - INFO - Created VN ctest-left_vn-67313579 2026-03-09 03:00:13,966 - DEBUG - VN ctest-left_vn-67313579 UUID is 952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,042 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:14,053 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:14,064 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:14,153 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,164 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,175 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/19919ae4-bcfc-420e-9aa4-e5c7999a1b7f 2026-03-09 03:00:14,184 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/19919ae4-bcfc-420e-9aa4-e5c7999a1b7f 2026-03-09 03:00:14,191 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/d04eaebe-27e0-4d67-a4a3-e7ba96271a3f 2026-03-09 03:00:14,198 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:14,198 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,208 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/19919ae4-bcfc-420e-9aa4-e5c7999a1b7f 2026-03-09 03:00:14,224 - INFO - Verified VN network id 11 for VN 952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,224 - INFO - Verifications in API Server for VN ctest-left_vn-67313579 passed 2026-03-09 03:00:14,224 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,238 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/19919ae4-bcfc-420e-9aa4-e5c7999a1b7f 2026-03-09 03:00:14,247 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/19919ae4-bcfc-420e-9aa4-e5c7999a1b7f 2026-03-09 03:00:14,255 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/d04eaebe-27e0-4d67-a4a3-e7ba96271a3f 2026-03-09 03:00:14,266 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10746031708856272773', 'uuid-lslong': '12246959605111141558'}, 'enable': 'true', 'created': '2026-03-09T03:00:13', 'last-modified': '2026-03-09T03:00:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384533'} 2026-03-09 03:00:14,273 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:14,279 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10746031708856272773', 'uuid-lslong': '12246959605111141558'}, 'enable': 'true', 'created': '2026-03-09T03:00:13', 'last-modified': '2026-03-09T03:00:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400067'} 2026-03-09 03:00:14,285 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:14,290 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10746031708856272773', 'uuid-lslong': '12246959605111141558'}, 'enable': 'true', 'created': '2026-03-09T03:00:13', 'last-modified': '2026-03-09T03:00:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414937'} 2026-03-09 03:00:14,296 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-09 03:00:14,297 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-67313579 passed 2026-03-09 03:00:14,297 - DEBUG - ====Verifying policy data for ctest-left_vn-67313579 in API_Server ====== 2026-03-09 03:00:14,297 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:14,303 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:14,315 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:14,418 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/952192e7-7f76-4785-a9f5-f0dfa93534b6 2026-03-09 03:00:14,433 - DEBUG - =>VN ctest-left_vn-67313579 has no policy to be verified 2026-03-09 03:00:14,433 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:14,433 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:14,434 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:14,447 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579?flat'} 2026-03-09 03:00:14,447 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:14,447 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:14,468 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579?flat'} 2026-03-09 03:00:14,468 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:14,468 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:14,482 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579?flat'} 2026-03-09 03:00:14,483 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-left_vn-67313579 is found in opserver 2026-03-09 03:00:14,506 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:14,517 - DEBUG - VRF ids for VN ctest-left_vn-67313579: {} 2026-03-09 03:00:14,760 - DEBUG - Response for create_network : {'network': {'id': 'e5d632c7-277c-4eef-a32f-f06eec725bee', 'name': 'ctest-right_vn-11915016', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-right_vn-11915016'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:15,049 - DEBUG - Response for create_subnet : {'subnet': {'id': '4e281559-454e-4325-9c70-5190ac05da4b', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': 'e5d632c7-277c-4eef-a32f-f06eec725bee', 'ip_version': 4, 'cidr': '186.32.83.192/26', 'allocation_pools': [{'start': '186.32.83.194', 'end': '186.32.83.254'}], 'gateway_ip': '186.32.83.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.32.83.194', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:15,072 - INFO - Created VN ctest-right_vn-11915016 2026-03-09 03:00:15,088 - DEBUG - VN ctest-right_vn-11915016 UUID is e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,159 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:15,165 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:15,175 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:15,275 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,287 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,298 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/8426325f-8aa1-4505-ba29-5fcf539d2621 2026-03-09 03:00:15,305 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/8426325f-8aa1-4505-ba29-5fcf539d2621 2026-03-09 03:00:15,312 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/874a9147-addf-4398-8a0a-6752af0f833f 2026-03-09 03:00:15,320 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:15,321 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,329 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/8426325f-8aa1-4505-ba29-5fcf539d2621 2026-03-09 03:00:15,344 - INFO - Verified VN network id 12 for VN e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,344 - INFO - Verifications in API Server for VN ctest-right_vn-11915016 passed 2026-03-09 03:00:15,344 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,353 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/8426325f-8aa1-4505-ba29-5fcf539d2621 2026-03-09 03:00:15,360 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/8426325f-8aa1-4505-ba29-5fcf539d2621 2026-03-09 03:00:15,367 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/874a9147-addf-4398-8a0a-6752af0f833f 2026-03-09 03:00:15,379 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16561480510643916527', 'uuid-lslong': '11758881511291640814'}, 'enable': 'true', 'created': '2026-03-09T03:00:14', 'last-modified': '2026-03-09T03:00:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402818'} 2026-03-09 03:00:15,385 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:15,392 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16561480510643916527', 'uuid-lslong': '11758881511291640814'}, 'enable': 'true', 'created': '2026-03-09T03:00:14', 'last-modified': '2026-03-09T03:00:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413805'} 2026-03-09 03:00:15,398 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:15,404 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16561480510643916527', 'uuid-lslong': '11758881511291640814'}, 'enable': 'true', 'created': '2026-03-09T03:00:14', 'last-modified': '2026-03-09T03:00:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429100'} 2026-03-09 03:00:15,409 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-09 03:00:15,409 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-11915016 passed 2026-03-09 03:00:15,410 - DEBUG - ====Verifying policy data for ctest-right_vn-11915016 in API_Server ====== 2026-03-09 03:00:15,410 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:15,415 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:15,426 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:15,514 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/e5d632c7-277c-4eef-a32f-f06eec725bee 2026-03-09 03:00:15,524 - DEBUG - =>VN ctest-right_vn-11915016 has no policy to be verified 2026-03-09 03:00:15,524 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:15,524 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:15,524 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:15,536 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016?flat'} 2026-03-09 03:00:15,536 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:15,536 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:15,547 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016?flat'} 2026-03-09 03:00:15,547 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:15,547 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:15,559 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016?flat'} 2026-03-09 03:00:15,559 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-right_vn-11915016 is found in opserver 2026-03-09 03:00:15,580 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:15,590 - DEBUG - VRF ids for VN ctest-right_vn-11915016: {} 2026-03-09 03:00:15,845 - DEBUG - Response for create_network : {'network': {'id': '33b0c449-7cf2-4de9-8a33-98885dcf739b', 'name': 'ctest-trans_left_vn-70301853', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-trans_left_vn-70301853'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:16,068 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e040d0cf-9bb2-485f-981f-8ef9cfbb3a87', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': '33b0c449-7cf2-4de9-8a33-98885dcf739b', 'ip_version': 4, 'cidr': '13.255.167.64/26', 'allocation_pools': [{'start': '13.255.167.66', 'end': '13.255.167.126'}], 'gateway_ip': '13.255.167.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.255.167.66', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:16,090 - INFO - Created VN ctest-trans_left_vn-70301853 2026-03-09 03:00:16,100 - DEBUG - VN ctest-trans_left_vn-70301853 UUID is 33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,171 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:16,178 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:16,189 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:16,284 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,299 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,309 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b221520e-9d6c-4a9e-8a6d-e8ae3712b8e4 2026-03-09 03:00:16,317 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b221520e-9d6c-4a9e-8a6d-e8ae3712b8e4 2026-03-09 03:00:16,327 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f857d14e-e400-4eea-ad23-dbe0cbceb6e9 2026-03-09 03:00:16,337 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-09 03:00:16,337 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,349 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b221520e-9d6c-4a9e-8a6d-e8ae3712b8e4 2026-03-09 03:00:16,380 - INFO - Verified VN network id 13 for VN 33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,380 - INFO - Verifications in API Server for VN ctest-trans_left_vn-70301853 passed 2026-03-09 03:00:16,381 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,395 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b221520e-9d6c-4a9e-8a6d-e8ae3712b8e4 2026-03-09 03:00:16,403 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b221520e-9d6c-4a9e-8a6d-e8ae3712b8e4 2026-03-09 03:00:16,414 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f857d14e-e400-4eea-ad23-dbe0cbceb6e9 2026-03-09 03:00:16,428 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3724692711743311337', 'uuid-lslong': '9958470912503149467'}, 'enable': 'true', 'created': '2026-03-09T03:00:15', 'last-modified': '2026-03-09T03:00:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412821'} 2026-03-09 03:00:16,436 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-09 03:00:16,442 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3724692711743311337', 'uuid-lslong': '9958470912503149467'}, 'enable': 'true', 'created': '2026-03-09T03:00:15', 'last-modified': '2026-03-09T03:00:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425974'} 2026-03-09 03:00:16,448 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-09 03:00:16,455 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3724692711743311337', 'uuid-lslong': '9958470912503149467'}, 'enable': 'true', 'created': '2026-03-09T03:00:15', 'last-modified': '2026-03-09T03:00:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.439931'} 2026-03-09 03:00:16,462 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-09 03:00:16,462 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-70301853 passed 2026-03-09 03:00:16,462 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-70301853 in API_Server ====== 2026-03-09 03:00:16,462 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:16,469 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:16,479 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:16,568 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/33b0c449-7cf2-4de9-8a33-98885dcf739b 2026-03-09 03:00:16,578 - DEBUG - =>VN ctest-trans_left_vn-70301853 has no policy to be verified 2026-03-09 03:00:16,578 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:16,578 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:16,578 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:16,590 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853?flat'} 2026-03-09 03:00:16,590 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:16,590 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:16,603 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853?flat'} 2026-03-09 03:00:16,603 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:16,603 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:16,617 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853?flat'} 2026-03-09 03:00:16,617 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-trans_left_vn-70301853 is found in opserver 2026-03-09 03:00:16,646 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:16,660 - DEBUG - VRF ids for VN ctest-trans_left_vn-70301853: {} 2026-03-09 03:00:16,915 - DEBUG - Response for create_network : {'network': {'id': '6f74e722-31c9-439e-ad21-cf5bb08a07cf', 'name': 'ctest-trans_right_vn-25963161', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-13479483', 'ctest-trans_right_vn-25963161'], 'port_security_enabled': True, 'description': ''}} 2026-03-09 03:00:17,139 - DEBUG - Response for create_subnet : {'subnet': {'id': '9f1bcbe0-d2ab-45ad-896f-2806a180a196', 'name': '', 'tenant_id': '88cf84caf0fd4f3fb15459308a62ec6a', 'network_id': '6f74e722-31c9-439e-ad21-cf5bb08a07cf', 'ip_version': 4, 'cidr': '4.22.3.192/26', 'allocation_pools': [{'start': '4.22.3.194', 'end': '4.22.3.254'}], 'gateway_ip': '4.22.3.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.22.3.194', 'tags': [], 'project_id': '88cf84caf0fd4f3fb15459308a62ec6a'}} 2026-03-09 03:00:17,162 - INFO - Created VN ctest-trans_right_vn-25963161 2026-03-09 03:00:17,173 - DEBUG - VN ctest-trans_right_vn-25963161 UUID is 6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,256 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:17,263 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:17,274 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:17,372 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,388 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,397 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b18d2d51-705f-49d4-bec8-9ac09738daaf 2026-03-09 03:00:17,406 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b18d2d51-705f-49d4-bec8-9ac09738daaf 2026-03-09 03:00:17,413 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/b6e940e8-8c24-49d8-b1ec-065d72b1dce7 2026-03-09 03:00:17,420 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-09 03:00:17,420 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,429 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b18d2d51-705f-49d4-bec8-9ac09738daaf 2026-03-09 03:00:17,443 - INFO - Verified VN network id 14 for VN 6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,443 - INFO - Verifications in API Server for VN ctest-trans_right_vn-25963161 passed 2026-03-09 03:00:17,443 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,455 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b18d2d51-705f-49d4-bec8-9ac09738daaf 2026-03-09 03:00:17,462 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b18d2d51-705f-49d4-bec8-9ac09738daaf 2026-03-09 03:00:17,468 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/b6e940e8-8c24-49d8-b1ec-065d72b1dce7 2026-03-09 03:00:17,482 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8031298169558614942', 'uuid-lslong': '12475480435503794127'}, 'enable': 'true', 'created': '2026-03-09T03:00:16', 'last-modified': '2026-03-09T03:00:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398406'} 2026-03-09 03:00:17,487 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-09 03:00:17,492 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8031298169558614942', 'uuid-lslong': '12475480435503794127'}, 'enable': 'true', 'created': '2026-03-09T03:00:16', 'last-modified': '2026-03-09T03:00:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411526'} 2026-03-09 03:00:17,498 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-09 03:00:17,504 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-13479483', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8031298169558614942', 'uuid-lslong': '12475480435503794127'}, 'enable': 'true', 'created': '2026-03-09T03:00:16', 'last-modified': '2026-03-09T03:00:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420372'} 2026-03-09 03:00:17,510 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-09 03:00:17,510 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-25963161 passed 2026-03-09 03:00:17,511 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-25963161 in API_Server ====== 2026-03-09 03:00:17,511 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:17,516 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:17,527 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:17,623 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/6f74e722-31c9-439e-ad21-cf5bb08a07cf 2026-03-09 03:00:17,632 - DEBUG - =>VN ctest-trans_right_vn-25963161 has no policy to be verified 2026-03-09 03:00:17,632 - DEBUG - Verifying the vn in opserver 2026-03-09 03:00:17,632 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161 virtual network link through opserver 10.0.0.22 2026-03-09 03:00:17,632 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-03-09 03:00:17,645 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161?flat'} 2026-03-09 03:00:17,645 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161 virtual network link through opserver 10.0.0.249 2026-03-09 03:00:17,645 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-03-09 03:00:17,656 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161?flat'} 2026-03-09 03:00:17,656 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161 virtual network link through opserver 10.0.0.23 2026-03-09 03:00:17,656 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-09 03:00:17,670 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161?flat'} 2026-03-09 03:00:17,670 - INFO - Validated that VN default-domain:ctest-TestSvcHC-13479483:ctest-trans_right_vn-25963161 is found in opserver 2026-03-09 03:00:17,690 - DEBUG - Do not have enough data to verify VN in agent 2026-03-09 03:00:17,700 - DEBUG - VRF ids for VN ctest-trans_right_vn-25963161: {} 2026-03-09 03:00:18,787 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5454-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5454-2) 2026-03-09 03:00:20,152 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5454-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5454-1) 2026-03-09 03:00:20,153 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-62228995'] 2026-03-09 03:00:20,453 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-62228995'] created succesfully 2026-03-09 03:00:20,867 - DEBUG - Image by name tiny_trans_fw not found 2026-03-09 03:00:20,867 - DEBUG - Installing image tiny_trans_fw 2026-03-09 03:00:20,867 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-03-09 03:00:20,868 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-09 03:00:20,868 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-09 03:00:20,868 - DEBUG - Unzip image 2026-03-09 03:00:20,868 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-09 03:00:20,890 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-03-09 03:00:20,891 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-62228995'] 2026-03-09 03:00:21,004 - INFO - Service template: ['default-domain', 'ctest-service_template_1-62228995'] deleted successfully. 2026-03-09 03:00:21,004 - INFO - Skip interface_detach for VM ctest-right_vm-85048613 in state BUILD 2026-03-09 03:00:21,004 - INFO - Deleting VM ctest-right_vm-85048613 2026-03-09 03:00:21,004 - ERROR - VM ctest-right_vm-85048613 has failed to come up 2026-03-09 03:00:21,004 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:21,004 - ERROR - VM ctest-right_vm-85048613 has failed to come up 2026-03-09 03:00:21,004 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:21,083 - INFO - Skip interface_detach for VM ctest-left_vm-55216726 in state BUILD 2026-03-09 03:00:21,083 - INFO - Deleting VM ctest-left_vm-55216726 2026-03-09 03:00:21,083 - ERROR - VM ctest-left_vm-55216726 has failed to come up 2026-03-09 03:00:21,083 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:21,083 - ERROR - VM ctest-left_vm-55216726 has failed to come up 2026-03-09 03:00:21,083 - ERROR - Nova failed to get host of the VM 2026-03-09 03:00:21,167 - INFO - Deleting VN ctest-trans_right_vn-25963161 2026-03-09 03:00:21,317 - DEBUG - Response for deleting network () 2026-03-09 03:00:21,317 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b18d2d51-705f-49d4-bec8-9ac09738daaf 2026-03-09 03:00:21,326 - DEBUG - Response Code: 404 2026-03-09 03:00:21,326 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:21,332 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:21,370 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:21,476 - INFO - Validated that VN ctest-trans_right_vn-25963161 is not found in API Server 2026-03-09 03:00:21,525 - DEBUG - VN ctest-trans_right_vn-25963161 is not present in Agent 10.0.0.41 2026-03-09 03:00:21,537 - DEBUG - VN ctest-trans_right_vn-25963161 is not present in Agent 10.0.0.27 2026-03-09 03:00:21,537 - INFO - Validated that VN ctest-trans_right_vn-25963161 is not in any agent 2026-03-09 03:00:21,614 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-25963161 info 2026-03-09 03:00:21,614 - INFO - Deleting VN ctest-trans_left_vn-70301853 2026-03-09 03:00:21,787 - DEBUG - Response for deleting network () 2026-03-09 03:00:21,787 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b221520e-9d6c-4a9e-8a6d-e8ae3712b8e4 2026-03-09 03:00:21,795 - DEBUG - Response Code: 404 2026-03-09 03:00:21,796 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:21,807 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:21,834 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:21,977 - INFO - Validated that VN ctest-trans_left_vn-70301853 is not found in API Server 2026-03-09 03:00:22,010 - DEBUG - VN ctest-trans_left_vn-70301853 is not present in Agent 10.0.0.41 2026-03-09 03:00:22,038 - DEBUG - VN ctest-trans_left_vn-70301853 is not present in Agent 10.0.0.27 2026-03-09 03:00:22,038 - INFO - Validated that VN ctest-trans_left_vn-70301853 is not in any agent 2026-03-09 03:00:22,088 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-70301853 info 2026-03-09 03:00:22,089 - INFO - Deleting VN ctest-right_vn-11915016 2026-03-09 03:00:22,146 - DEBUG - VN e5d632c7-277c-4eef-a32f-f06eec725bee still in use: Unable to complete operation on network e5d632c7-277c-4eef-a32f-f06eec725bee. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-16b6df3b-b5ea-44df-a1e5-eeb593cc93e0'] 2026-03-09 03:00:22,146 - WARNING - Deleting VN ctest-right_vn-11915016 failed..Will retry 2026-03-09 03:00:24,328 - DEBUG - Response for deleting network () 2026-03-09 03:00:24,328 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/8426325f-8aa1-4505-ba29-5fcf539d2621 2026-03-09 03:00:24,335 - DEBUG - Response Code: 404 2026-03-09 03:00:24,335 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:24,341 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:24,360 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:24,457 - INFO - Validated that VN ctest-right_vn-11915016 is not found in API Server 2026-03-09 03:00:24,467 - DEBUG - VN ctest-right_vn-11915016 is not present in Agent 10.0.0.41 2026-03-09 03:00:24,478 - DEBUG - VN ctest-right_vn-11915016 is not present in Agent 10.0.0.27 2026-03-09 03:00:24,478 - INFO - Validated that VN ctest-right_vn-11915016 is not in any agent 2026-03-09 03:00:24,507 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-11915016 info 2026-03-09 03:00:24,507 - INFO - Deleting VN ctest-left_vn-67313579 2026-03-09 03:00:24,654 - DEBUG - Response for deleting network () 2026-03-09 03:00:24,654 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/19919ae4-bcfc-420e-9aa4-e5c7999a1b7f 2026-03-09 03:00:24,660 - DEBUG - Response Code: 404 2026-03-09 03:00:24,660 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:24,665 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:24,677 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:24,781 - INFO - Validated that VN ctest-left_vn-67313579 is not found in API Server 2026-03-09 03:00:24,792 - DEBUG - VN ctest-left_vn-67313579 is not present in Agent 10.0.0.41 2026-03-09 03:00:24,803 - DEBUG - VN ctest-left_vn-67313579 is not present in Agent 10.0.0.27 2026-03-09 03:00:24,803 - INFO - Validated that VN ctest-left_vn-67313579 is not in any agent 2026-03-09 03:00:24,847 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-67313579 info 2026-03-09 03:00:24,847 - INFO - Deleting VN ctest-mgmt_vn-59111290 2026-03-09 03:00:25,050 - DEBUG - Response for deleting network () 2026-03-09 03:00:25,050 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/3edade59-623c-438e-ada7-cf66510135b0 2026-03-09 03:00:25,065 - DEBUG - Response Code: 404 2026-03-09 03:00:25,067 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2026-03-09 03:00:25,078 - DEBUG - Requesting: http://10.0.0.22:8082/domain/65872af6-2901-4194-bbe6-c1dbc9d32dc7 2026-03-09 03:00:25,094 - DEBUG - Requesting: http://10.0.0.22:8082/project/88cf84ca-f0fd-4f3f-b154-59308a62ec6a 2026-03-09 03:00:25,183 - INFO - Validated that VN ctest-mgmt_vn-59111290 is not found in API Server 2026-03-09 03:00:25,198 - DEBUG - VN ctest-mgmt_vn-59111290 is not present in Agent 10.0.0.41 2026-03-09 03:00:25,208 - DEBUG - VN ctest-mgmt_vn-59111290 is not present in Agent 10.0.0.27 2026-03-09 03:00:25,208 - INFO - Validated that VN ctest-mgmt_vn-59111290 is not in any agent 2026-03-09 03:00:25,244 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-59111290 info 2026-03-09 03:00:26,514 - DEBUG - No XMPP flaps were noticed during the test 2026-03-09 03:00:26,514 - INFO -

2026-03-09 03:00:26,514 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]

2026-03-09 03:00:26,514 - INFO - -------------------------------------------------------------------------------- 2026-03-09 03:00:27,230 - INFO - Deleted project: ctest-TestSvcHC-13479483, ID : 88cf84ca-f0fd-4f3f-b154-59308a62ec6a