2025-08-11 07:02:44,805 - INFO - Domain Default found not creating 2025-08-11 07:02:44,971 - INFO - Project ctest-TestSvcHC-44628327 not found, creating it 2025-08-11 07:02:45,575 - INFO - Created Project:ctest-TestSvcHC-44628327, ID : 673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:47,097 - INFO - ================================================================================ 2025-08-11 07:02:47,098 - INFO - STARTING TEST : test_svc_hc_basic 2025-08-11 07:02:48,386 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.57': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-08-11 07:02:48,386 - INFO - Initial checks done. Running the testcase now 2025-08-11 07:02:48,387 - INFO - 2025-08-11 07:02:49,039 - DEBUG - Response for create_network : {'network': {'id': '9d009512-19c7-493a-aea9-bf6cc7113bb7', 'name': 'ctest-mgmt_vn-15003572', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-mgmt_vn-15003572'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:02:49,293 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dab57312-daf8-4a79-8895-a4db5f64e63f', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '9d009512-19c7-493a-aea9-bf6cc7113bb7', 'ip_version': 4, 'cidr': '202.248.96.64/26', 'allocation_pools': [{'start': '202.248.96.66', 'end': '202.248.96.126'}], 'gateway_ip': '202.248.96.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '202.248.96.66', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:02:49,315 - INFO - Created VN ctest-mgmt_vn-15003572 2025-08-11 07:02:49,326 - DEBUG - VN ctest-mgmt_vn-15003572 UUID is 9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:49,395 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:49,701 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:49,731 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:49,752 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:49,854 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:49,869 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:49,881 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/704f7da5-34d8-4db5-be7d-32a92d23c26a 2025-08-11 07:02:49,891 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/704f7da5-34d8-4db5-be7d-32a92d23c26a 2025-08-11 07:02:49,901 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e3823093-04a2-4ac3-89a0-5a9790bf0fdf 2025-08-11 07:02:49,910 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:02:49,910 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:49,922 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/704f7da5-34d8-4db5-be7d-32a92d23c26a 2025-08-11 07:02:49,940 - INFO - Verified VN network id 14 for VN 9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:49,941 - INFO - Verifications in API Server for VN ctest-mgmt_vn-15003572 passed 2025-08-11 07:02:49,941 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:49,953 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/704f7da5-34d8-4db5-be7d-32a92d23c26a 2025-08-11 07:02:49,960 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/704f7da5-34d8-4db5-be7d-32a92d23c26a 2025-08-11 07:02:49,968 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e3823093-04a2-4ac3-89a0-5a9790bf0fdf 2025-08-11 07:02:49,981 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11313206168929126714', 'uuid-lslong': '12585801107580730295'}, 'enable': 'true', 'created': '2025-08-11T07:02:48', 'last-modified': '2025-08-11T07:02:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.733661'} 2025-08-11 07:02:49,988 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:02:49,994 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11313206168929126714', 'uuid-lslong': '12585801107580730295'}, 'enable': 'true', 'created': '2025-08-11T07:02:48', 'last-modified': '2025-08-11T07:02:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.751310'} 2025-08-11 07:02:50,001 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:02:50,007 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11313206168929126714', 'uuid-lslong': '12585801107580730295'}, 'enable': 'true', 'created': '2025-08-11T07:02:48', 'last-modified': '2025-08-11T07:02:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.763224'} 2025-08-11 07:02:50,014 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:02:50,014 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-15003572 passed 2025-08-11 07:02:50,014 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-15003572 in API_Server ====== 2025-08-11 07:02:50,014 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:50,021 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:50,032 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:50,126 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9d009512-19c7-493a-aea9-bf6cc7113bb7 2025-08-11 07:02:50,153 - DEBUG - =>VN ctest-mgmt_vn-15003572 has no policy to be verified 2025-08-11 07:02:50,153 - DEBUG - Verifying the vn in opserver 2025-08-11 07:02:50,153 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572 virtual network link through opserver 10.0.0.254 2025-08-11 07:02:50,153 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:02:50,461 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:02:50,534 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572?flat'} 2025-08-11 07:02:50,534 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572 virtual network link through opserver 10.0.0.38 2025-08-11 07:02:50,534 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:02:50,846 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:02:50,911 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572?flat'} 2025-08-11 07:02:50,911 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572 virtual network link through opserver 10.0.0.50 2025-08-11 07:02:50,911 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:02:51,225 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:02:51,290 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572?flat'} 2025-08-11 07:02:51,290 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-15003572 is found in opserver 2025-08-11 07:02:51,315 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:02:51,325 - DEBUG - VRF ids for VN ctest-mgmt_vn-15003572: {} 2025-08-11 07:02:51,585 - DEBUG - Response for create_network : {'network': {'id': '0ab50971-a811-45b6-b43a-ff00f74699f8', 'name': 'ctest-left_vn-83351639', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-left_vn-83351639'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:02:51,810 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e0a460c8-186e-4273-900f-229778ce4cd6', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '0ab50971-a811-45b6-b43a-ff00f74699f8', 'ip_version': 4, 'cidr': '190.53.134.0/26', 'allocation_pools': [{'start': '190.53.134.2', 'end': '190.53.134.62'}], 'gateway_ip': '190.53.134.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.53.134.2', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:02:51,834 - INFO - Created VN ctest-left_vn-83351639 2025-08-11 07:02:51,849 - DEBUG - VN ctest-left_vn-83351639 UUID is 0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:51,917 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:51,923 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:51,935 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:52,039 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:52,051 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:52,062 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf8b9bac-e6c7-4de8-86d7-d4a0f887872a 2025-08-11 07:02:52,071 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf8b9bac-e6c7-4de8-86d7-d4a0f887872a 2025-08-11 07:02:52,080 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/f3ca7891-00ab-42cd-972f-85e18af50ab6 2025-08-11 07:02:52,089 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:02:52,089 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:52,101 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf8b9bac-e6c7-4de8-86d7-d4a0f887872a 2025-08-11 07:02:52,119 - INFO - Verified VN network id 15 for VN 0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:52,119 - INFO - Verifications in API Server for VN ctest-left_vn-83351639 passed 2025-08-11 07:02:52,119 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:52,133 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf8b9bac-e6c7-4de8-86d7-d4a0f887872a 2025-08-11 07:02:52,141 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf8b9bac-e6c7-4de8-86d7-d4a0f887872a 2025-08-11 07:02:52,149 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/f3ca7891-00ab-42cd-972f-85e18af50ab6 2025-08-11 07:02:52,164 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '771533294919566774', 'uuid-lslong': '12986972855089928696'}, 'enable': 'true', 'created': '2025-08-11T07:02:51', 'last-modified': '2025-08-11T07:02:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428178'} 2025-08-11 07:02:52,173 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:02:52,181 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '771533294919566774', 'uuid-lslong': '12986972855089928696'}, 'enable': 'true', 'created': '2025-08-11T07:02:51', 'last-modified': '2025-08-11T07:02:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447725'} 2025-08-11 07:02:52,191 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:02:52,199 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '771533294919566774', 'uuid-lslong': '12986972855089928696'}, 'enable': 'true', 'created': '2025-08-11T07:02:51', 'last-modified': '2025-08-11T07:02:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462844'} 2025-08-11 07:02:52,206 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:02:52,206 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-83351639 passed 2025-08-11 07:02:52,206 - DEBUG - ====Verifying policy data for ctest-left_vn-83351639 in API_Server ====== 2025-08-11 07:02:52,206 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:52,214 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:52,229 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:52,325 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0ab50971-a811-45b6-b43a-ff00f74699f8 2025-08-11 07:02:52,336 - DEBUG - =>VN ctest-left_vn-83351639 has no policy to be verified 2025-08-11 07:02:52,336 - DEBUG - Verifying the vn in opserver 2025-08-11 07:02:52,336 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639 virtual network link through opserver 10.0.0.254 2025-08-11 07:02:52,336 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:02:52,398 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639?flat'} 2025-08-11 07:02:52,398 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639 virtual network link through opserver 10.0.0.38 2025-08-11 07:02:52,398 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:02:52,452 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639?flat'} 2025-08-11 07:02:52,452 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639 virtual network link through opserver 10.0.0.50 2025-08-11 07:02:52,452 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:02:52,510 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639?flat'} 2025-08-11 07:02:52,510 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-83351639 is found in opserver 2025-08-11 07:02:52,534 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:02:52,545 - DEBUG - VRF ids for VN ctest-left_vn-83351639: {} 2025-08-11 07:02:52,821 - DEBUG - Response for create_network : {'network': {'id': 'ea3a818c-01a7-46de-86c5-359c0cbcc9da', 'name': 'ctest-right_vn-87380104', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-right_vn-87380104'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:02:53,061 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a27251d3-81e5-4d3e-9f8c-3359acf1c9ec', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': 'ea3a818c-01a7-46de-86c5-359c0cbcc9da', 'ip_version': 4, 'cidr': '103.39.161.0/26', 'allocation_pools': [{'start': '103.39.161.2', 'end': '103.39.161.62'}], 'gateway_ip': '103.39.161.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.39.161.2', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:02:53,095 - INFO - Created VN ctest-right_vn-87380104 2025-08-11 07:02:53,111 - DEBUG - VN ctest-right_vn-87380104 UUID is ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,207 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:53,215 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:53,231 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:53,319 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,335 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,348 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c6549db7-66dc-4aa9-8526-46de74923a8c 2025-08-11 07:02:53,366 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c6549db7-66dc-4aa9-8526-46de74923a8c 2025-08-11 07:02:53,376 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/fc9e824d-85d8-4c69-b993-2ca737ed217b 2025-08-11 07:02:53,388 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:02:53,388 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,398 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c6549db7-66dc-4aa9-8526-46de74923a8c 2025-08-11 07:02:53,415 - INFO - Verified VN network id 16 for VN ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,415 - INFO - Verifications in API Server for VN ctest-right_vn-87380104 passed 2025-08-11 07:02:53,415 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,426 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c6549db7-66dc-4aa9-8526-46de74923a8c 2025-08-11 07:02:53,437 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c6549db7-66dc-4aa9-8526-46de74923a8c 2025-08-11 07:02:53,446 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/fc9e824d-85d8-4c69-b993-2ca737ed217b 2025-08-11 07:02:53,466 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16877944991847499486', 'uuid-lslong': '9711227115839211994'}, 'enable': 'true', 'created': '2025-08-11T07:02:52', 'last-modified': '2025-08-11T07:02:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.475158'} 2025-08-11 07:02:53,474 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:02:53,479 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16877944991847499486', 'uuid-lslong': '9711227115839211994'}, 'enable': 'true', 'created': '2025-08-11T07:02:52', 'last-modified': '2025-08-11T07:02:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.504162'} 2025-08-11 07:02:53,488 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:02:53,496 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16877944991847499486', 'uuid-lslong': '9711227115839211994'}, 'enable': 'true', 'created': '2025-08-11T07:02:52', 'last-modified': '2025-08-11T07:02:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516656'} 2025-08-11 07:02:53,503 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:02:53,503 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-87380104 passed 2025-08-11 07:02:53,503 - DEBUG - ====Verifying policy data for ctest-right_vn-87380104 in API_Server ====== 2025-08-11 07:02:53,503 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:53,510 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:53,523 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:53,616 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea3a818c-01a7-46de-86c5-359c0cbcc9da 2025-08-11 07:02:53,628 - DEBUG - =>VN ctest-right_vn-87380104 has no policy to be verified 2025-08-11 07:02:53,628 - DEBUG - Verifying the vn in opserver 2025-08-11 07:02:53,628 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104 virtual network link through opserver 10.0.0.254 2025-08-11 07:02:53,628 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:02:53,685 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104?flat'} 2025-08-11 07:02:53,685 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104 virtual network link through opserver 10.0.0.38 2025-08-11 07:02:53,685 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:02:53,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104?flat'} 2025-08-11 07:02:53,741 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104 virtual network link through opserver 10.0.0.50 2025-08-11 07:02:53,741 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:02:53,806 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104?flat'} 2025-08-11 07:02:53,806 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-87380104 is found in opserver 2025-08-11 07:02:53,833 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:02:53,844 - DEBUG - VRF ids for VN ctest-right_vn-87380104: {} 2025-08-11 07:02:53,907 - DEBUG - Services list from nova: [, , , ] 2025-08-11 07:02:54,923 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-2) 2025-08-11 07:02:56,217 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-1) 2025-08-11 07:02:56,217 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-20933485'] 2025-08-11 07:02:56,503 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-20933485'] created succesfully 2025-08-11 07:02:56,882 - DEBUG - Image by name tiny_nat_fw not found 2025-08-11 07:02:56,882 - DEBUG - Installing image tiny_nat_fw 2025-08-11 07:02:56,882 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-11 07:02:56,882 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-11 07:02:56,882 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-11 07:02:56,882 - DEBUG - Unzip image 2025-08-11 07:02:56,882 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-11 07:02:56,903 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-08-11 07:02:56,903 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-20933485'] 2025-08-11 07:02:56,997 - INFO - Service template: ['default-domain', 'ctest-service_template_1-20933485'] deleted successfully. 2025-08-11 07:02:56,997 - INFO - Skip interface_detach for VM ctest-right_vm-63095517 in state BUILD 2025-08-11 07:02:56,997 - INFO - Deleting VM ctest-right_vm-63095517 2025-08-11 07:02:57,044 - ERROR - VM ctest-right_vm-63095517 has failed to come up 2025-08-11 07:02:57,045 - ERROR - Nova failed to get host of the VM 2025-08-11 07:02:57,045 - ERROR - VM ctest-right_vm-63095517 has failed to come up 2025-08-11 07:02:57,045 - ERROR - Nova failed to get host of the VM 2025-08-11 07:02:57,154 - INFO - Skip interface_detach for VM ctest-left_vm-98668209 in state BUILD 2025-08-11 07:02:57,154 - INFO - Deleting VM ctest-left_vm-98668209 2025-08-11 07:02:57,155 - ERROR - VM ctest-left_vm-98668209 has failed to come up 2025-08-11 07:02:57,155 - ERROR - Nova failed to get host of the VM 2025-08-11 07:02:57,155 - ERROR - VM ctest-left_vm-98668209 has failed to come up 2025-08-11 07:02:57,155 - ERROR - Nova failed to get host of the VM 2025-08-11 07:02:57,232 - INFO - Deleting VN ctest-right_vn-87380104 2025-08-11 07:02:57,285 - DEBUG - VN ea3a818c-01a7-46de-86c5-359c0cbcc9da still in use: Unable to complete operation on network ea3a818c-01a7-46de-86c5-359c0cbcc9da. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1a4f3f70-3ee4-4c80-8673-c7d0c53fe2a6'] 2025-08-11 07:02:57,286 - WARNING - Deleting VN ctest-right_vn-87380104 failed..Will retry 2025-08-11 07:02:59,437 - DEBUG - Response for deleting network () 2025-08-11 07:02:59,438 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c6549db7-66dc-4aa9-8526-46de74923a8c 2025-08-11 07:02:59,444 - DEBUG - Response Code: 404 2025-08-11 07:02:59,444 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:59,452 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:59,514 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:59,607 - INFO - Validated that VN ctest-right_vn-87380104 is not found in API Server 2025-08-11 07:02:59,620 - DEBUG - VN ctest-right_vn-87380104 is not present in Agent 10.0.0.49 2025-08-11 07:02:59,631 - DEBUG - VN ctest-right_vn-87380104 is not present in Agent 10.0.0.57 2025-08-11 07:02:59,631 - INFO - Validated that VN ctest-right_vn-87380104 is not in any agent 2025-08-11 07:02:59,664 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-87380104 info 2025-08-11 07:02:59,664 - INFO - Deleting VN ctest-left_vn-83351639 2025-08-11 07:02:59,814 - DEBUG - Response for deleting network () 2025-08-11 07:02:59,814 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cf8b9bac-e6c7-4de8-86d7-d4a0f887872a 2025-08-11 07:02:59,820 - DEBUG - Response Code: 404 2025-08-11 07:02:59,821 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:02:59,826 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:02:59,845 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:02:59,953 - INFO - Validated that VN ctest-left_vn-83351639 is not found in API Server 2025-08-11 07:02:59,967 - DEBUG - VN ctest-left_vn-83351639 is not present in Agent 10.0.0.49 2025-08-11 07:02:59,978 - DEBUG - VN ctest-left_vn-83351639 is not present in Agent 10.0.0.57 2025-08-11 07:02:59,978 - INFO - Validated that VN ctest-left_vn-83351639 is not in any agent 2025-08-11 07:03:00,010 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-83351639 info 2025-08-11 07:03:00,011 - INFO - Deleting VN ctest-mgmt_vn-15003572 2025-08-11 07:03:00,154 - DEBUG - Response for deleting network () 2025-08-11 07:03:00,154 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/704f7da5-34d8-4db5-be7d-32a92d23c26a 2025-08-11 07:03:00,167 - DEBUG - Response Code: 404 2025-08-11 07:03:00,168 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:00,175 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:00,194 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:00,293 - INFO - Validated that VN ctest-mgmt_vn-15003572 is not found in API Server 2025-08-11 07:03:00,305 - DEBUG - VN ctest-mgmt_vn-15003572 is not present in Agent 10.0.0.49 2025-08-11 07:03:00,317 - DEBUG - VN ctest-mgmt_vn-15003572 is not present in Agent 10.0.0.57 2025-08-11 07:03:00,317 - INFO - Validated that VN ctest-mgmt_vn-15003572 is not in any agent 2025-08-11 07:03:00,349 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-15003572 info 2025-08-11 07:03:01,606 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 07:03:01,606 - INFO - 2025-08-11 07:03:01,606 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14] 2025-08-11 07:03:01,606 - INFO - -------------------------------------------------------------------------------- 2025-08-11 07:03:01,609 - INFO - ================================================================================ 2025-08-11 07:03:01,610 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-08-11 07:03:02,878 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.57': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-08-11 07:03:02,878 - INFO - Initial checks done. Running the testcase now 2025-08-11 07:03:02,878 - INFO - 2025-08-11 07:03:03,178 - DEBUG - Response for create_network : {'network': {'id': '89b85830-1c11-46e0-aad4-8dfeadafefab', 'name': 'ctest-mgmt_vn-26099566', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-mgmt_vn-26099566'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:03:03,438 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ad4866ca-b012-4935-918b-8b27d1152599', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '89b85830-1c11-46e0-aad4-8dfeadafefab', 'ip_version': 4, 'cidr': '165.122.238.0/26', 'allocation_pools': [{'start': '165.122.238.2', 'end': '165.122.238.62'}], 'gateway_ip': '165.122.238.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '165.122.238.2', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:03:03,465 - INFO - Created VN ctest-mgmt_vn-26099566 2025-08-11 07:03:03,492 - DEBUG - VN ctest-mgmt_vn-26099566 UUID is 89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,574 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:03,580 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:03,593 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:03,686 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,700 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,710 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/efe77419-1379-441e-8031-51542983c396 2025-08-11 07:03:03,717 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/efe77419-1379-441e-8031-51542983c396 2025-08-11 07:03:03,725 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/48fe8033-60db-42bc-8153-7d2be9862887 2025-08-11 07:03:03,734 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:03:03,734 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,745 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/efe77419-1379-441e-8031-51542983c396 2025-08-11 07:03:03,765 - INFO - Verified VN network id 14 for VN 89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,766 - INFO - Verifications in API Server for VN ctest-mgmt_vn-26099566 passed 2025-08-11 07:03:03,766 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,776 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/efe77419-1379-441e-8031-51542983c396 2025-08-11 07:03:03,784 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/efe77419-1379-441e-8031-51542983c396 2025-08-11 07:03:03,796 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/48fe8033-60db-42bc-8153-7d2be9862887 2025-08-11 07:03:03,813 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9923778742563456736', 'uuid-lslong': '12309619806485606315'}, 'enable': 'true', 'created': '2025-08-11T07:03:03', 'last-modified': '2025-08-11T07:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429598'} 2025-08-11 07:03:03,821 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:03:03,827 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9923778742563456736', 'uuid-lslong': '12309619806485606315'}, 'enable': 'true', 'created': '2025-08-11T07:03:03', 'last-modified': '2025-08-11T07:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442931'} 2025-08-11 07:03:03,836 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:03:03,844 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9923778742563456736', 'uuid-lslong': '12309619806485606315'}, 'enable': 'true', 'created': '2025-08-11T07:03:03', 'last-modified': '2025-08-11T07:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459492'} 2025-08-11 07:03:03,851 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 07:03:03,851 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-26099566 passed 2025-08-11 07:03:03,852 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-26099566 in API_Server ====== 2025-08-11 07:03:03,852 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:03,858 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:03,873 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:03,967 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/89b85830-1c11-46e0-aad4-8dfeadafefab 2025-08-11 07:03:03,979 - DEBUG - =>VN ctest-mgmt_vn-26099566 has no policy to be verified 2025-08-11 07:03:03,979 - DEBUG - Verifying the vn in opserver 2025-08-11 07:03:03,979 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566 virtual network link through opserver 10.0.0.254 2025-08-11 07:03:03,979 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:03:03,994 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566?flat'} 2025-08-11 07:03:03,994 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566 virtual network link through opserver 10.0.0.38 2025-08-11 07:03:03,994 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:03:04,010 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566?flat'} 2025-08-11 07:03:04,011 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566 virtual network link through opserver 10.0.0.50 2025-08-11 07:03:04,011 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:03:04,025 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566?flat'} 2025-08-11 07:03:04,025 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-mgmt_vn-26099566 is found in opserver 2025-08-11 07:03:04,050 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:03:04,060 - DEBUG - VRF ids for VN ctest-mgmt_vn-26099566: {} 2025-08-11 07:03:04,351 - DEBUG - Response for create_network : {'network': {'id': '6bc20276-9390-4729-ac44-7e1899e0059f', 'name': 'ctest-left_vn-62690946', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-left_vn-62690946'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:03:04,535 - DEBUG - Response for create_subnet : {'subnet': {'id': '42bb08d2-0313-454c-9c41-3420487fc026', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '6bc20276-9390-4729-ac44-7e1899e0059f', 'ip_version': 4, 'cidr': '194.63.101.192/26', 'allocation_pools': [{'start': '194.63.101.194', 'end': '194.63.101.254'}], 'gateway_ip': '194.63.101.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '194.63.101.194', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:03:04,555 - INFO - Created VN ctest-left_vn-62690946 2025-08-11 07:03:04,568 - DEBUG - VN ctest-left_vn-62690946 UUID is 6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:04,635 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:04,641 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:04,652 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:04,747 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:04,761 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:04,773 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b1942b31-facd-4d81-8a37-b870a16e6365 2025-08-11 07:03:04,783 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b1942b31-facd-4d81-8a37-b870a16e6365 2025-08-11 07:03:04,792 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/253607f1-637e-4011-be45-1c639b744e59 2025-08-11 07:03:04,800 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:03:04,800 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:04,811 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b1942b31-facd-4d81-8a37-b870a16e6365 2025-08-11 07:03:04,826 - INFO - Verified VN network id 15 for VN 6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:04,827 - INFO - Verifications in API Server for VN ctest-left_vn-62690946 passed 2025-08-11 07:03:04,827 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:04,838 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b1942b31-facd-4d81-8a37-b870a16e6365 2025-08-11 07:03:04,848 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b1942b31-facd-4d81-8a37-b870a16e6365 2025-08-11 07:03:04,856 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/253607f1-637e-4011-be45-1c639b744e59 2025-08-11 07:03:04,871 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7764771415845259049', 'uuid-lslong': '12413185117065840031'}, 'enable': 'true', 'created': '2025-08-11T07:03:04', 'last-modified': '2025-08-11T07:03:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.375797'} 2025-08-11 07:03:04,877 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:03:04,883 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7764771415845259049', 'uuid-lslong': '12413185117065840031'}, 'enable': 'true', 'created': '2025-08-11T07:03:04', 'last-modified': '2025-08-11T07:03:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399452'} 2025-08-11 07:03:04,891 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:03:04,898 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7764771415845259049', 'uuid-lslong': '12413185117065840031'}, 'enable': 'true', 'created': '2025-08-11T07:03:04', 'last-modified': '2025-08-11T07:03:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416342'} 2025-08-11 07:03:04,905 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 07:03:04,905 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-62690946 passed 2025-08-11 07:03:04,905 - DEBUG - ====Verifying policy data for ctest-left_vn-62690946 in API_Server ====== 2025-08-11 07:03:04,905 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:04,911 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:04,923 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:05,022 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6bc20276-9390-4729-ac44-7e1899e0059f 2025-08-11 07:03:05,033 - DEBUG - =>VN ctest-left_vn-62690946 has no policy to be verified 2025-08-11 07:03:05,033 - DEBUG - Verifying the vn in opserver 2025-08-11 07:03:05,033 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946 virtual network link through opserver 10.0.0.254 2025-08-11 07:03:05,033 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:03:05,046 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946?flat'} 2025-08-11 07:03:05,046 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946 virtual network link through opserver 10.0.0.38 2025-08-11 07:03:05,046 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:03:05,058 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946?flat'} 2025-08-11 07:03:05,058 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946 virtual network link through opserver 10.0.0.50 2025-08-11 07:03:05,058 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:03:05,072 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946?flat'} 2025-08-11 07:03:05,072 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-left_vn-62690946 is found in opserver 2025-08-11 07:03:05,095 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:03:05,105 - DEBUG - VRF ids for VN ctest-left_vn-62690946: {} 2025-08-11 07:03:05,348 - DEBUG - Response for create_network : {'network': {'id': '2810feef-9dfb-4e4e-8a32-b14d87eda5ac', 'name': 'ctest-right_vn-74681362', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-right_vn-74681362'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:03:05,556 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aed45a8f-1297-4c4b-b731-3782ec39a93f', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '2810feef-9dfb-4e4e-8a32-b14d87eda5ac', 'ip_version': 4, 'cidr': '134.202.222.64/26', 'allocation_pools': [{'start': '134.202.222.66', 'end': '134.202.222.126'}], 'gateway_ip': '134.202.222.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '134.202.222.66', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:03:05,577 - INFO - Created VN ctest-right_vn-74681362 2025-08-11 07:03:05,602 - DEBUG - VN ctest-right_vn-74681362 UUID is 2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:05,689 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:05,695 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:05,714 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:05,803 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:05,828 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:05,839 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ad655a18-3821-47da-a062-79a2746b7ff0 2025-08-11 07:03:05,848 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ad655a18-3821-47da-a062-79a2746b7ff0 2025-08-11 07:03:05,857 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8d9d8216-1333-4b56-8eba-d3a3eb596f8f 2025-08-11 07:03:05,866 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:03:05,866 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:05,877 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ad655a18-3821-47da-a062-79a2746b7ff0 2025-08-11 07:03:05,893 - INFO - Verified VN network id 16 for VN 2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:05,893 - INFO - Verifications in API Server for VN ctest-right_vn-74681362 passed 2025-08-11 07:03:05,893 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:05,904 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ad655a18-3821-47da-a062-79a2746b7ff0 2025-08-11 07:03:05,912 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ad655a18-3821-47da-a062-79a2746b7ff0 2025-08-11 07:03:05,919 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8d9d8216-1333-4b56-8eba-d3a3eb596f8f 2025-08-11 07:03:05,932 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2887087666245619278', 'uuid-lslong': '9958216672620684716'}, 'enable': 'true', 'created': '2025-08-11T07:03:05', 'last-modified': '2025-08-11T07:03:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446960'} 2025-08-11 07:03:05,938 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:03:05,944 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2887087666245619278', 'uuid-lslong': '9958216672620684716'}, 'enable': 'true', 'created': '2025-08-11T07:03:05', 'last-modified': '2025-08-11T07:03:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462676'} 2025-08-11 07:03:05,951 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:03:05,959 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2887087666245619278', 'uuid-lslong': '9958216672620684716'}, 'enable': 'true', 'created': '2025-08-11T07:03:05', 'last-modified': '2025-08-11T07:03:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.477629'} 2025-08-11 07:03:05,966 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 07:03:05,966 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-74681362 passed 2025-08-11 07:03:05,966 - DEBUG - ====Verifying policy data for ctest-right_vn-74681362 in API_Server ====== 2025-08-11 07:03:05,966 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:05,972 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:05,988 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:06,077 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2810feef-9dfb-4e4e-8a32-b14d87eda5ac 2025-08-11 07:03:06,088 - DEBUG - =>VN ctest-right_vn-74681362 has no policy to be verified 2025-08-11 07:03:06,088 - DEBUG - Verifying the vn in opserver 2025-08-11 07:03:06,088 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362 virtual network link through opserver 10.0.0.254 2025-08-11 07:03:06,088 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:03:06,100 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362?flat'} 2025-08-11 07:03:06,100 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362 virtual network link through opserver 10.0.0.38 2025-08-11 07:03:06,100 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:03:06,113 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362?flat'} 2025-08-11 07:03:06,113 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362 virtual network link through opserver 10.0.0.50 2025-08-11 07:03:06,113 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:03:06,126 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362?flat'} 2025-08-11 07:03:06,126 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-right_vn-74681362 is found in opserver 2025-08-11 07:03:06,150 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:03:06,161 - DEBUG - VRF ids for VN ctest-right_vn-74681362: {} 2025-08-11 07:03:06,432 - DEBUG - Response for create_network : {'network': {'id': '5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2', 'name': 'ctest-trans_left_vn-13237282', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-trans_left_vn-13237282'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:03:06,703 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f336bf37-b4e2-4fba-883e-a8d17bbccf60', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2', 'ip_version': 4, 'cidr': '191.90.195.64/26', 'allocation_pools': [{'start': '191.90.195.66', 'end': '191.90.195.126'}], 'gateway_ip': '191.90.195.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.90.195.66', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:03:06,724 - INFO - Created VN ctest-trans_left_vn-13237282 2025-08-11 07:03:06,735 - DEBUG - VN ctest-trans_left_vn-13237282 UUID is 5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:06,810 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:06,817 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:06,829 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:06,928 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:06,942 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:06,952 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/58d128e5-857e-4e19-a806-d0a592c5dcfb 2025-08-11 07:03:06,961 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/58d128e5-857e-4e19-a806-d0a592c5dcfb 2025-08-11 07:03:06,969 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e739c26f-c3a5-47b6-a24b-1e558d1b0638 2025-08-11 07:03:06,977 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 07:03:06,977 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:06,987 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/58d128e5-857e-4e19-a806-d0a592c5dcfb 2025-08-11 07:03:07,004 - INFO - Verified VN network id 17 for VN 5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:07,004 - INFO - Verifications in API Server for VN ctest-trans_left_vn-13237282 passed 2025-08-11 07:03:07,004 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:07,017 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/58d128e5-857e-4e19-a806-d0a592c5dcfb 2025-08-11 07:03:07,025 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/58d128e5-857e-4e19-a806-d0a592c5dcfb 2025-08-11 07:03:07,033 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e739c26f-c3a5-47b6-a24b-1e558d1b0638 2025-08-11 07:03:07,047 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6774458223690073573', 'uuid-lslong': '9970303008629339042'}, 'enable': 'true', 'created': '2025-08-11T07:03:06', 'last-modified': '2025-08-11T07:03:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403950'} 2025-08-11 07:03:07,055 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 07:03:07,060 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6774458223690073573', 'uuid-lslong': '9970303008629339042'}, 'enable': 'true', 'created': '2025-08-11T07:03:06', 'last-modified': '2025-08-11T07:03:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416705'} 2025-08-11 07:03:07,066 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 07:03:07,072 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6774458223690073573', 'uuid-lslong': '9970303008629339042'}, 'enable': 'true', 'created': '2025-08-11T07:03:06', 'last-modified': '2025-08-11T07:03:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428467'} 2025-08-11 07:03:07,078 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 07:03:07,078 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-13237282 passed 2025-08-11 07:03:07,078 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-13237282 in API_Server ====== 2025-08-11 07:03:07,078 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:07,084 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:07,096 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:07,199 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5e03b5dc-a0c5-45e5-8a5d-a1c2ec5c33a2 2025-08-11 07:03:07,216 - DEBUG - =>VN ctest-trans_left_vn-13237282 has no policy to be verified 2025-08-11 07:03:07,216 - DEBUG - Verifying the vn in opserver 2025-08-11 07:03:07,216 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282 virtual network link through opserver 10.0.0.254 2025-08-11 07:03:07,216 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:03:07,231 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282?flat'} 2025-08-11 07:03:07,231 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282 virtual network link through opserver 10.0.0.38 2025-08-11 07:03:07,231 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:03:07,246 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282?flat'} 2025-08-11 07:03:07,246 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282 virtual network link through opserver 10.0.0.50 2025-08-11 07:03:07,246 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:03:07,258 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282?flat'} 2025-08-11 07:03:07,258 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-trans_left_vn-13237282 is found in opserver 2025-08-11 07:03:07,280 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:03:07,292 - DEBUG - VRF ids for VN ctest-trans_left_vn-13237282: {} 2025-08-11 07:03:07,617 - DEBUG - Response for create_network : {'network': {'id': '0303226f-c295-4b32-8953-b080a364b50c', 'name': 'ctest-trans_right_vn-66276576', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'project_id': '673c523ea9f74197bbba255e5671cfba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-44628327', 'ctest-trans_right_vn-66276576'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 07:03:07,849 - DEBUG - Response for create_subnet : {'subnet': {'id': '6b801a2f-f74a-4aec-b6ea-af2f2df641d5', 'name': '', 'tenant_id': '673c523ea9f74197bbba255e5671cfba', 'network_id': '0303226f-c295-4b32-8953-b080a364b50c', 'ip_version': 4, 'cidr': '6.109.14.192/26', 'allocation_pools': [{'start': '6.109.14.194', 'end': '6.109.14.254'}], 'gateway_ip': '6.109.14.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.109.14.194', 'tags': [], 'project_id': '673c523ea9f74197bbba255e5671cfba'}} 2025-08-11 07:03:07,870 - INFO - Created VN ctest-trans_right_vn-66276576 2025-08-11 07:03:07,882 - DEBUG - VN ctest-trans_right_vn-66276576 UUID is 0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:07,957 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:07,965 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:07,978 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:08,081 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:08,093 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:08,104 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eb1be590-776a-4095-a697-464bc2e531af 2025-08-11 07:03:08,114 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eb1be590-776a-4095-a697-464bc2e531af 2025-08-11 07:03:08,122 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e26013d7-789e-49fb-bac1-b06875ac8fd7 2025-08-11 07:03:08,130 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 07:03:08,130 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:08,141 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eb1be590-776a-4095-a697-464bc2e531af 2025-08-11 07:03:08,160 - INFO - Verified VN network id 18 for VN 0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:08,160 - INFO - Verifications in API Server for VN ctest-trans_right_vn-66276576 passed 2025-08-11 07:03:08,160 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:08,173 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eb1be590-776a-4095-a697-464bc2e531af 2025-08-11 07:03:08,181 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eb1be590-776a-4095-a697-464bc2e531af 2025-08-11 07:03:08,189 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e26013d7-789e-49fb-bac1-b06875ac8fd7 2025-08-11 07:03:08,203 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '217055070445194034', 'uuid-lslong': '9895446872806700300'}, 'enable': 'true', 'created': '2025-08-11T07:03:07', 'last-modified': '2025-08-11T07:03:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401315'} 2025-08-11 07:03:08,210 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 07:03:08,216 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '217055070445194034', 'uuid-lslong': '9895446872806700300'}, 'enable': 'true', 'created': '2025-08-11T07:03:07', 'last-modified': '2025-08-11T07:03:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414088'} 2025-08-11 07:03:08,222 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 07:03:08,228 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-44628327', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '217055070445194034', 'uuid-lslong': '9895446872806700300'}, 'enable': 'true', 'created': '2025-08-11T07:03:07', 'last-modified': '2025-08-11T07:03:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433775'} 2025-08-11 07:03:08,235 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 07:03:08,235 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-66276576 passed 2025-08-11 07:03:08,235 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-66276576 in API_Server ====== 2025-08-11 07:03:08,235 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:08,242 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:08,255 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:08,362 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0303226f-c295-4b32-8953-b080a364b50c 2025-08-11 07:03:08,386 - DEBUG - =>VN ctest-trans_right_vn-66276576 has no policy to be verified 2025-08-11 07:03:08,387 - DEBUG - Verifying the vn in opserver 2025-08-11 07:03:08,387 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576 virtual network link through opserver 10.0.0.254 2025-08-11 07:03:08,387 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-11 07:03:08,400 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576?flat'} 2025-08-11 07:03:08,400 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576 virtual network link through opserver 10.0.0.38 2025-08-11 07:03:08,400 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 07:03:08,413 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576?flat'} 2025-08-11 07:03:08,413 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576 virtual network link through opserver 10.0.0.50 2025-08-11 07:03:08,413 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-11 07:03:08,432 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576?flat'} 2025-08-11 07:03:08,432 - INFO - Validated that VN default-domain:ctest-TestSvcHC-44628327:ctest-trans_right_vn-66276576 is found in opserver 2025-08-11 07:03:08,459 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 07:03:08,476 - DEBUG - VRF ids for VN ctest-trans_right_vn-66276576: {} 2025-08-11 07:03:09,699 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-1) 2025-08-11 07:03:11,110 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-2) 2025-08-11 07:03:11,111 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-90115252'] 2025-08-11 07:03:11,403 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-90115252'] created succesfully 2025-08-11 07:03:11,715 - DEBUG - Image by name tiny_trans_fw not found 2025-08-11 07:03:11,715 - DEBUG - Installing image tiny_trans_fw 2025-08-11 07:03:11,715 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-11 07:03:11,715 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-11 07:03:11,715 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-11 07:03:11,715 - DEBUG - Unzip image 2025-08-11 07:03:11,715 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-11 07:03:11,749 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-08-11 07:03:11,750 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-90115252'] 2025-08-11 07:03:11,876 - INFO - Service template: ['default-domain', 'ctest-service_template_1-90115252'] deleted successfully. 2025-08-11 07:03:11,877 - INFO - Skip interface_detach for VM ctest-right_vm-61829788 in state BUILD 2025-08-11 07:03:11,877 - INFO - Deleting VM ctest-right_vm-61829788 2025-08-11 07:03:11,877 - ERROR - VM ctest-right_vm-61829788 has failed to come up 2025-08-11 07:03:11,877 - ERROR - Nova failed to get host of the VM 2025-08-11 07:03:11,877 - ERROR - VM ctest-right_vm-61829788 has failed to come up 2025-08-11 07:03:11,877 - ERROR - Nova failed to get host of the VM 2025-08-11 07:03:12,043 - INFO - Skip interface_detach for VM ctest-left_vm-94010250 in state BUILD 2025-08-11 07:03:12,043 - INFO - Deleting VM ctest-left_vm-94010250 2025-08-11 07:03:12,043 - ERROR - VM ctest-left_vm-94010250 has failed to come up 2025-08-11 07:03:12,043 - ERROR - Nova failed to get host of the VM 2025-08-11 07:03:12,043 - ERROR - VM ctest-left_vm-94010250 has failed to come up 2025-08-11 07:03:12,043 - ERROR - Nova failed to get host of the VM 2025-08-11 07:03:12,138 - INFO - Deleting VN ctest-trans_right_vn-66276576 2025-08-11 07:03:12,361 - DEBUG - Response for deleting network () 2025-08-11 07:03:12,361 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eb1be590-776a-4095-a697-464bc2e531af 2025-08-11 07:03:12,383 - DEBUG - Response Code: 404 2025-08-11 07:03:12,383 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:12,402 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:12,434 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:12,536 - INFO - Validated that VN ctest-trans_right_vn-66276576 is not found in API Server 2025-08-11 07:03:12,548 - DEBUG - VN ctest-trans_right_vn-66276576 is not present in Agent 10.0.0.49 2025-08-11 07:03:12,585 - DEBUG - VN ctest-trans_right_vn-66276576 is not present in Agent 10.0.0.57 2025-08-11 07:03:12,585 - INFO - Validated that VN ctest-trans_right_vn-66276576 is not in any agent 2025-08-11 07:03:12,625 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-66276576 info 2025-08-11 07:03:12,625 - INFO - Deleting VN ctest-trans_left_vn-13237282 2025-08-11 07:03:12,875 - DEBUG - Response for deleting network () 2025-08-11 07:03:12,875 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/58d128e5-857e-4e19-a806-d0a592c5dcfb 2025-08-11 07:03:12,880 - DEBUG - Response Code: 404 2025-08-11 07:03:12,881 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:12,888 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:12,942 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:13,067 - INFO - Validated that VN ctest-trans_left_vn-13237282 is not found in API Server 2025-08-11 07:03:13,080 - DEBUG - VN ctest-trans_left_vn-13237282 is not present in Agent 10.0.0.49 2025-08-11 07:03:13,099 - DEBUG - VN ctest-trans_left_vn-13237282 is not present in Agent 10.0.0.57 2025-08-11 07:03:13,099 - INFO - Validated that VN ctest-trans_left_vn-13237282 is not in any agent 2025-08-11 07:03:13,147 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-13237282 info 2025-08-11 07:03:13,147 - INFO - Deleting VN ctest-right_vn-74681362 2025-08-11 07:03:13,206 - DEBUG - VN 2810feef-9dfb-4e4e-8a32-b14d87eda5ac still in use: Unable to complete operation on network 2810feef-9dfb-4e4e-8a32-b14d87eda5ac. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-03c8c335-56e4-4184-9448-d7d96e41afdf'] 2025-08-11 07:03:13,206 - WARNING - Deleting VN ctest-right_vn-74681362 failed..Will retry 2025-08-11 07:03:15,355 - DEBUG - Response for deleting network () 2025-08-11 07:03:15,355 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ad655a18-3821-47da-a062-79a2746b7ff0 2025-08-11 07:03:15,367 - DEBUG - Response Code: 404 2025-08-11 07:03:15,367 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:15,375 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:15,391 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:15,482 - INFO - Validated that VN ctest-right_vn-74681362 is not found in API Server 2025-08-11 07:03:15,497 - DEBUG - VN ctest-right_vn-74681362 is not present in Agent 10.0.0.49 2025-08-11 07:03:15,507 - DEBUG - VN ctest-right_vn-74681362 is not present in Agent 10.0.0.57 2025-08-11 07:03:15,508 - INFO - Validated that VN ctest-right_vn-74681362 is not in any agent 2025-08-11 07:03:15,541 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-74681362 info 2025-08-11 07:03:15,541 - INFO - Deleting VN ctest-left_vn-62690946 2025-08-11 07:03:15,668 - DEBUG - Response for deleting network () 2025-08-11 07:03:15,668 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b1942b31-facd-4d81-8a37-b870a16e6365 2025-08-11 07:03:15,674 - DEBUG - Response Code: 404 2025-08-11 07:03:15,674 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:15,681 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:15,721 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:15,828 - INFO - Validated that VN ctest-left_vn-62690946 is not found in API Server 2025-08-11 07:03:15,841 - DEBUG - VN ctest-left_vn-62690946 is not present in Agent 10.0.0.49 2025-08-11 07:03:15,852 - DEBUG - VN ctest-left_vn-62690946 is not present in Agent 10.0.0.57 2025-08-11 07:03:15,852 - INFO - Validated that VN ctest-left_vn-62690946 is not in any agent 2025-08-11 07:03:15,887 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-62690946 info 2025-08-11 07:03:15,887 - INFO - Deleting VN ctest-mgmt_vn-26099566 2025-08-11 07:03:16,046 - DEBUG - Response for deleting network () 2025-08-11 07:03:16,046 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/efe77419-1379-441e-8031-51542983c396 2025-08-11 07:03:16,058 - DEBUG - Response Code: 404 2025-08-11 07:03:16,058 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-11 07:03:16,066 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979 2025-08-11 07:03:16,125 - DEBUG - Requesting: http://10.0.0.254:8082/project/673c523e-a9f7-4197-bbba-255e5671cfba 2025-08-11 07:03:16,225 - INFO - Validated that VN ctest-mgmt_vn-26099566 is not found in API Server 2025-08-11 07:03:16,236 - DEBUG - VN ctest-mgmt_vn-26099566 is not present in Agent 10.0.0.49 2025-08-11 07:03:16,248 - DEBUG - VN ctest-mgmt_vn-26099566 is not present in Agent 10.0.0.57 2025-08-11 07:03:16,248 - INFO - Validated that VN ctest-mgmt_vn-26099566 is not in any agent 2025-08-11 07:03:16,283 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-26099566 info 2025-08-11 07:03:17,564 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 07:03:17,564 - INFO - 2025-08-11 07:03:17,564 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2025-08-11 07:03:17,564 - INFO - -------------------------------------------------------------------------------- 2025-08-11 07:03:18,290 - INFO - Deleted project: ctest-TestSvcHC-44628327, ID : 673c523e-a9f7-4197-bbba-255e5671cfba