2026-05-25 03:18:37,981 - INFO - Domain Default found not creating 2026-05-25 03:18:38,205 - INFO - Project ctest-TestSvcHC-60227980 not found, creating it 2026-05-25 03:18:38,807 - INFO - Created Project:ctest-TestSvcHC-60227980, ID : 784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:40,550 - INFO - ================================================================================ 2026-05-25 03:18:40,550 - INFO - STARTING TEST : test_svc_hc_basic 2026-05-25 03:18:41,848 - DEBUG - Nothing to compare xmpp stats {'10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.240': {'10.20.0.241': '0', '10.20.0.249': '0'}} with 2026-05-25 03:18:41,848 - INFO - Initial checks done. Running the testcase now 2026-05-25 03:18:41,848 - INFO - 2026-05-25 03:18:42,620 - DEBUG - Response for create_network : {'network': {'id': '08368363-5b12-4aa4-9b67-845ddea91de3', 'name': 'ctest-mgmt_vn-00547168', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-mgmt_vn-00547168'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:18:42,903 - DEBUG - Response for create_subnet : {'subnet': {'id': '3eb751f3-2438-4bba-9f9e-7c988c84a85d', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': '08368363-5b12-4aa4-9b67-845ddea91de3', 'ip_version': 4, 'cidr': '28.35.63.128/26', 'allocation_pools': [{'start': '28.35.63.130', 'end': '28.35.63.190'}], 'gateway_ip': '28.35.63.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '28.35.63.130', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:18:42,936 - INFO - Created VN ctest-mgmt_vn-00547168 2026-05-25 03:18:42,954 - DEBUG - VN ctest-mgmt_vn-00547168 UUID is 08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,050 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:43,375 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:43,413 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:43,430 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:43,535 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,550 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,564 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/881832b2-a93e-4968-b0a2-6dc14c9ee23b 2026-05-25 03:18:43,573 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/881832b2-a93e-4968-b0a2-6dc14c9ee23b 2026-05-25 03:18:43,583 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/08c4a089-f7a0-4a8c-84a8-c2504e921940 2026-05-25 03:18:43,594 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:43,595 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,612 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/881832b2-a93e-4968-b0a2-6dc14c9ee23b 2026-05-25 03:18:43,636 - INFO - Verified VN network id 18 for VN 08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,636 - INFO - Verifications in API Server for VN ctest-mgmt_vn-00547168 passed 2026-05-25 03:18:43,636 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,651 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/881832b2-a93e-4968-b0a2-6dc14c9ee23b 2026-05-25 03:18:43,663 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/881832b2-a93e-4968-b0a2-6dc14c9ee23b 2026-05-25 03:18:43,673 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/08c4a089-f7a0-4a8c-84a8-c2504e921940 2026-05-25 03:18:43,691 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '591804863798725284', 'uuid-lslong': '11198064537182477795'}, 'enable': 'true', 'created': '2026-05-25T03:18:42', 'last-modified': '2026-05-25T03:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.844484'} 2026-05-25 03:18:43,703 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:43,709 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '591804863798725284', 'uuid-lslong': '11198064537182477795'}, 'enable': 'true', 'created': '2026-05-25T03:18:42', 'last-modified': '2026-05-25T03:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.864086'} 2026-05-25 03:18:43,717 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:43,726 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '591804863798725284', 'uuid-lslong': '11198064537182477795'}, 'enable': 'true', 'created': '2026-05-25T03:18:42', 'last-modified': '2026-05-25T03:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.880983'} 2026-05-25 03:18:43,734 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:43,734 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-00547168 passed 2026-05-25 03:18:43,734 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-00547168 in API_Server ====== 2026-05-25 03:18:43,734 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:43,742 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:43,757 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:43,860 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/08368363-5b12-4aa4-9b67-845ddea91de3 2026-05-25 03:18:43,872 - DEBUG - =>VN ctest-mgmt_vn-00547168 has no policy to be verified 2026-05-25 03:18:43,872 - DEBUG - Verifying the vn in opserver 2026-05-25 03:18:43,872 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168 virtual network link through opserver 10.0.0.73 2026-05-25 03:18:43,873 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:18:44,183 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:18:44,276 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168?flat'} 2026-05-25 03:18:44,276 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168 virtual network link through opserver 10.0.0.19 2026-05-25 03:18:44,276 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:18:44,613 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:18:44,699 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168?flat'} 2026-05-25 03:18:44,699 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168 virtual network link through opserver 10.0.0.131 2026-05-25 03:18:44,699 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:18:45,027 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:18:45,112 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168?flat'} 2026-05-25 03:18:45,112 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-00547168 is found in opserver 2026-05-25 03:18:45,138 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:18:45,151 - DEBUG - VRF ids for VN ctest-mgmt_vn-00547168: {} 2026-05-25 03:18:45,463 - DEBUG - Response for create_network : {'network': {'id': '55a25662-475d-45bc-92ff-b9815438d4cc', 'name': 'ctest-left_vn-95661318', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-left_vn-95661318'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:18:45,719 - DEBUG - Response for create_subnet : {'subnet': {'id': '20b3924b-9fdc-4de2-9c52-bae095458c1e', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': '55a25662-475d-45bc-92ff-b9815438d4cc', 'ip_version': 4, 'cidr': '158.1.97.64/26', 'allocation_pools': [{'start': '158.1.97.66', 'end': '158.1.97.126'}], 'gateway_ip': '158.1.97.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '158.1.97.66', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:18:45,747 - INFO - Created VN ctest-left_vn-95661318 2026-05-25 03:18:45,761 - DEBUG - VN ctest-left_vn-95661318 UUID is 55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:45,850 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:45,859 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:45,877 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:45,980 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:45,995 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:46,010 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/a3cd5293-25bf-4235-bb5e-a7ad47f0bb45 2026-05-25 03:18:46,023 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/a3cd5293-25bf-4235-bb5e-a7ad47f0bb45 2026-05-25 03:18:46,033 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/31558568-9334-4e6a-8bfa-a12c388b81ca 2026-05-25 03:18:46,044 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:18:46,044 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:46,055 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/a3cd5293-25bf-4235-bb5e-a7ad47f0bb45 2026-05-25 03:18:46,075 - INFO - Verified VN network id 19 for VN 55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:46,076 - INFO - Verifications in API Server for VN ctest-left_vn-95661318 passed 2026-05-25 03:18:46,076 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:46,090 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/a3cd5293-25bf-4235-bb5e-a7ad47f0bb45 2026-05-25 03:18:46,100 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/a3cd5293-25bf-4235-bb5e-a7ad47f0bb45 2026-05-25 03:18:46,108 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/31558568-9334-4e6a-8bfa-a12c388b81ca 2026-05-25 03:18:46,124 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6170589419555079612', 'uuid-lslong': '10592388813713626316'}, 'enable': 'true', 'created': '2026-05-25T03:18:45', 'last-modified': '2026-05-25T03:18:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461614'} 2026-05-25 03:18:46,130 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:18:46,137 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6170589419555079612', 'uuid-lslong': '10592388813713626316'}, 'enable': 'true', 'created': '2026-05-25T03:18:45', 'last-modified': '2026-05-25T03:18:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476561'} 2026-05-25 03:18:46,145 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:18:46,153 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6170589419555079612', 'uuid-lslong': '10592388813713626316'}, 'enable': 'true', 'created': '2026-05-25T03:18:45', 'last-modified': '2026-05-25T03:18:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.497296'} 2026-05-25 03:18:46,163 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:18:46,164 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-95661318 passed 2026-05-25 03:18:46,164 - DEBUG - ====Verifying policy data for ctest-left_vn-95661318 in API_Server ====== 2026-05-25 03:18:46,164 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:46,172 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:46,186 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:46,293 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/55a25662-475d-45bc-92ff-b9815438d4cc 2026-05-25 03:18:46,315 - DEBUG - =>VN ctest-left_vn-95661318 has no policy to be verified 2026-05-25 03:18:46,315 - DEBUG - Verifying the vn in opserver 2026-05-25 03:18:46,315 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318 virtual network link through opserver 10.0.0.73 2026-05-25 03:18:46,315 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:18:46,394 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318?flat'} 2026-05-25 03:18:46,394 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318 virtual network link through opserver 10.0.0.19 2026-05-25 03:18:46,394 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:18:46,478 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318?flat'} 2026-05-25 03:18:46,478 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318 virtual network link through opserver 10.0.0.131 2026-05-25 03:18:46,478 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:18:46,561 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318?flat'} 2026-05-25 03:18:46,561 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-95661318 is found in opserver 2026-05-25 03:18:46,588 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:18:46,606 - DEBUG - VRF ids for VN ctest-left_vn-95661318: {} 2026-05-25 03:18:46,925 - DEBUG - Response for create_network : {'network': {'id': '000e8540-a1d1-4393-a121-6e41c64d037a', 'name': 'ctest-right_vn-49585298', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-right_vn-49585298'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:18:47,192 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a2e9f9f4-40cc-466f-949a-cf7554c11d87', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': '000e8540-a1d1-4393-a121-6e41c64d037a', 'ip_version': 4, 'cidr': '116.47.118.64/26', 'allocation_pools': [{'start': '116.47.118.66', 'end': '116.47.118.126'}], 'gateway_ip': '116.47.118.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '116.47.118.66', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:18:47,215 - INFO - Created VN ctest-right_vn-49585298 2026-05-25 03:18:47,234 - DEBUG - VN ctest-right_vn-49585298 UUID is 000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,339 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:47,346 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:47,403 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:47,498 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,516 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,528 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/03cef4a8-cb64-48c5-be38-17f065fd4cc8 2026-05-25 03:18:47,537 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/03cef4a8-cb64-48c5-be38-17f065fd4cc8 2026-05-25 03:18:47,547 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/1012b519-c860-4f14-ae58-9169b6ba1a15 2026-05-25 03:18:47,555 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:18:47,555 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,566 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/03cef4a8-cb64-48c5-be38-17f065fd4cc8 2026-05-25 03:18:47,609 - INFO - Verified VN network id 20 for VN 000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,609 - INFO - Verifications in API Server for VN ctest-right_vn-49585298 passed 2026-05-25 03:18:47,609 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,638 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/03cef4a8-cb64-48c5-be38-17f065fd4cc8 2026-05-25 03:18:47,653 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/03cef4a8-cb64-48c5-be38-17f065fd4cc8 2026-05-25 03:18:47,664 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/1012b519-c860-4f14-ae58-9169b6ba1a15 2026-05-25 03:18:47,688 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4087162313196435', 'uuid-lslong': '11610682543116714874'}, 'enable': 'true', 'created': '2026-05-25T03:18:46', 'last-modified': '2026-05-25T03:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.569097'} 2026-05-25 03:18:47,712 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:18:47,720 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4087162313196435', 'uuid-lslong': '11610682543116714874'}, 'enable': 'true', 'created': '2026-05-25T03:18:46', 'last-modified': '2026-05-25T03:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.610656'} 2026-05-25 03:18:47,735 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:18:47,744 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4087162313196435', 'uuid-lslong': '11610682543116714874'}, 'enable': 'true', 'created': '2026-05-25T03:18:46', 'last-modified': '2026-05-25T03:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.636336'} 2026-05-25 03:18:47,753 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:18:47,754 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-49585298 passed 2026-05-25 03:18:47,754 - DEBUG - ====Verifying policy data for ctest-right_vn-49585298 in API_Server ====== 2026-05-25 03:18:47,754 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:47,761 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:47,824 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:47,945 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/000e8540-a1d1-4393-a121-6e41c64d037a 2026-05-25 03:18:47,959 - DEBUG - =>VN ctest-right_vn-49585298 has no policy to be verified 2026-05-25 03:18:47,959 - DEBUG - Verifying the vn in opserver 2026-05-25 03:18:47,959 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298 virtual network link through opserver 10.0.0.73 2026-05-25 03:18:47,959 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:18:48,043 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298?flat'} 2026-05-25 03:18:48,043 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298 virtual network link through opserver 10.0.0.19 2026-05-25 03:18:48,043 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:18:48,149 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298?flat'} 2026-05-25 03:18:48,149 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298 virtual network link through opserver 10.0.0.131 2026-05-25 03:18:48,149 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:18:48,234 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298?flat'} 2026-05-25 03:18:48,234 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-49585298 is found in opserver 2026-05-25 03:18:48,258 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:18:48,269 - DEBUG - VRF ids for VN ctest-right_vn-49585298: {} 2026-05-25 03:18:48,453 - DEBUG - Services list from nova: [, , , ] 2026-05-25 03:18:49,714 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5822-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5822-2) 2026-05-25 03:18:51,452 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5822-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5822-1) 2026-05-25 03:18:51,452 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-83413544'] 2026-05-25 03:18:51,788 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-83413544'] created succesfully 2026-05-25 03:18:52,359 - DEBUG - Image by name tiny_nat_fw not found 2026-05-25 03:18:52,360 - DEBUG - Installing image tiny_nat_fw 2026-05-25 03:18:52,360 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-05-25 03:18:52,360 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-25 03:18:52,360 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-25 03:18:52,360 - DEBUG - Unzip image 2026-05-25 03:18:52,360 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-05-25 03:18:52,390 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-05-25 03:18:52,391 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-83413544'] 2026-05-25 03:18:52,547 - INFO - Service template: ['default-domain', 'ctest-service_template_1-83413544'] deleted successfully. 2026-05-25 03:18:52,548 - INFO - Skip interface_detach for VM ctest-right_vm-76794849 in state BUILD 2026-05-25 03:18:52,548 - INFO - Deleting VM ctest-right_vm-76794849 2026-05-25 03:18:52,597 - ERROR - VM ctest-right_vm-76794849 has failed to come up 2026-05-25 03:18:52,598 - ERROR - Nova failed to get host of the VM 2026-05-25 03:18:52,598 - ERROR - VM ctest-right_vm-76794849 has failed to come up 2026-05-25 03:18:52,598 - ERROR - Nova failed to get host of the VM 2026-05-25 03:18:52,726 - INFO - Skip interface_detach for VM ctest-left_vm-73754427 in state BUILD 2026-05-25 03:18:52,726 - INFO - Deleting VM ctest-left_vm-73754427 2026-05-25 03:18:52,726 - ERROR - VM ctest-left_vm-73754427 has failed to come up 2026-05-25 03:18:52,727 - ERROR - Nova failed to get host of the VM 2026-05-25 03:18:52,727 - ERROR - VM ctest-left_vm-73754427 has failed to come up 2026-05-25 03:18:52,727 - ERROR - Nova failed to get host of the VM 2026-05-25 03:18:52,824 - INFO - Deleting VN ctest-right_vn-49585298 2026-05-25 03:18:52,880 - DEBUG - VN 000e8540-a1d1-4393-a121-6e41c64d037a still in use: Unable to complete operation on network 000e8540-a1d1-4393-a121-6e41c64d037a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-cde136ff-fc7d-44a1-a774-1752b1a2cdb0'] 2026-05-25 03:18:52,881 - WARNING - Deleting VN ctest-right_vn-49585298 failed..Will retry 2026-05-25 03:18:55,088 - DEBUG - Response for deleting network () 2026-05-25 03:18:55,088 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/03cef4a8-cb64-48c5-be38-17f065fd4cc8 2026-05-25 03:18:55,099 - DEBUG - Response Code: 404 2026-05-25 03:18:55,100 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:55,111 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:55,131 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:55,237 - INFO - Validated that VN ctest-right_vn-49585298 is not found in API Server 2026-05-25 03:18:55,255 - DEBUG - VN ctest-right_vn-49585298 is not present in Agent 10.0.0.133 2026-05-25 03:18:55,268 - DEBUG - VN ctest-right_vn-49585298 is not present in Agent 10.0.0.240 2026-05-25 03:18:55,269 - INFO - Validated that VN ctest-right_vn-49585298 is not in any agent 2026-05-25 03:18:55,309 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-49585298 info 2026-05-25 03:18:55,309 - INFO - Deleting VN ctest-left_vn-95661318 2026-05-25 03:18:55,486 - DEBUG - Response for deleting network () 2026-05-25 03:18:55,486 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/a3cd5293-25bf-4235-bb5e-a7ad47f0bb45 2026-05-25 03:18:55,492 - DEBUG - Response Code: 404 2026-05-25 03:18:55,493 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:55,500 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:55,527 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:55,635 - INFO - Validated that VN ctest-left_vn-95661318 is not found in API Server 2026-05-25 03:18:55,647 - DEBUG - VN ctest-left_vn-95661318 is not present in Agent 10.0.0.133 2026-05-25 03:18:55,663 - DEBUG - VN ctest-left_vn-95661318 is not present in Agent 10.0.0.240 2026-05-25 03:18:55,663 - INFO - Validated that VN ctest-left_vn-95661318 is not in any agent 2026-05-25 03:18:55,702 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-95661318 info 2026-05-25 03:18:55,702 - INFO - Deleting VN ctest-mgmt_vn-00547168 2026-05-25 03:18:55,868 - DEBUG - Response for deleting network () 2026-05-25 03:18:55,868 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/881832b2-a93e-4968-b0a2-6dc14c9ee23b 2026-05-25 03:18:55,875 - DEBUG - Response Code: 404 2026-05-25 03:18:55,879 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:55,891 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:55,914 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:56,024 - INFO - Validated that VN ctest-mgmt_vn-00547168 is not found in API Server 2026-05-25 03:18:56,036 - DEBUG - VN ctest-mgmt_vn-00547168 is not present in Agent 10.0.0.133 2026-05-25 03:18:56,049 - DEBUG - VN ctest-mgmt_vn-00547168 is not present in Agent 10.0.0.240 2026-05-25 03:18:56,049 - INFO - Validated that VN ctest-mgmt_vn-00547168 is not in any agent 2026-05-25 03:18:56,107 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-00547168 info 2026-05-25 03:18:57,420 - DEBUG - No XMPP flaps were noticed during the test 2026-05-25 03:18:57,420 - INFO -

2026-05-25 03:18:57,420 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:17]

2026-05-25 03:18:57,421 - INFO - -------------------------------------------------------------------------------- 2026-05-25 03:18:57,424 - INFO - ================================================================================ 2026-05-25 03:18:57,424 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-05-25 03:18:58,755 - DEBUG - Nothing to compare xmpp stats {'10.0.0.133': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.240': {'10.20.0.241': '0', '10.20.0.249': '0'}} with 2026-05-25 03:18:58,755 - INFO - Initial checks done. Running the testcase now 2026-05-25 03:18:58,755 - INFO - 2026-05-25 03:18:59,068 - DEBUG - Response for create_network : {'network': {'id': '7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7', 'name': 'ctest-mgmt_vn-71860615', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-mgmt_vn-71860615'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:18:59,280 - DEBUG - Response for create_subnet : {'subnet': {'id': '8963e288-9c5a-4bb3-aca1-686614bbb3b0', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': '7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7', 'ip_version': 4, 'cidr': '184.64.144.192/26', 'allocation_pools': [{'start': '184.64.144.194', 'end': '184.64.144.254'}], 'gateway_ip': '184.64.144.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '184.64.144.194', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:18:59,309 - INFO - Created VN ctest-mgmt_vn-71860615 2026-05-25 03:18:59,323 - DEBUG - VN ctest-mgmt_vn-71860615 UUID is 7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,421 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:59,429 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:59,443 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:59,542 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,554 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,564 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/6fb05333-b6af-4ab5-a2ff-a052bb822c67 2026-05-25 03:18:59,575 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/6fb05333-b6af-4ab5-a2ff-a052bb822c67 2026-05-25 03:18:59,584 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/fa434486-d66f-40bf-afda-76c55a96aa3f 2026-05-25 03:18:59,593 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:59,593 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,605 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/6fb05333-b6af-4ab5-a2ff-a052bb822c67 2026-05-25 03:18:59,626 - INFO - Verified VN network id 18 for VN 7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,626 - INFO - Verifications in API Server for VN ctest-mgmt_vn-71860615 passed 2026-05-25 03:18:59,626 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,637 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/6fb05333-b6af-4ab5-a2ff-a052bb822c67 2026-05-25 03:18:59,655 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/6fb05333-b6af-4ab5-a2ff-a052bb822c67 2026-05-25 03:18:59,663 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/fa434486-d66f-40bf-afda-76c55a96aa3f 2026-05-25 03:18:59,682 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8902730647002172578', 'uuid-lslong': '12486819457988286455'}, 'enable': 'true', 'created': '2026-05-25T03:18:58', 'last-modified': '2026-05-25T03:18:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444729'} 2026-05-25 03:18:59,692 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:59,697 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8902730647002172578', 'uuid-lslong': '12486819457988286455'}, 'enable': 'true', 'created': '2026-05-25T03:18:58', 'last-modified': '2026-05-25T03:18:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462915'} 2026-05-25 03:18:59,703 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:59,709 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8902730647002172578', 'uuid-lslong': '12486819457988286455'}, 'enable': 'true', 'created': '2026-05-25T03:18:58', 'last-modified': '2026-05-25T03:18:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471742'} 2026-05-25 03:18:59,718 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-25 03:18:59,718 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-71860615 passed 2026-05-25 03:18:59,718 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-71860615 in API_Server ====== 2026-05-25 03:18:59,718 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:18:59,725 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:18:59,739 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:18:59,837 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/7b8cda5a-d18c-4ca2-ad4a-182397d3d7f7 2026-05-25 03:18:59,854 - DEBUG - =>VN ctest-mgmt_vn-71860615 has no policy to be verified 2026-05-25 03:18:59,854 - DEBUG - Verifying the vn in opserver 2026-05-25 03:18:59,854 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615 virtual network link through opserver 10.0.0.73 2026-05-25 03:18:59,854 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:18:59,870 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615?flat'} 2026-05-25 03:18:59,870 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615 virtual network link through opserver 10.0.0.19 2026-05-25 03:18:59,870 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:18:59,885 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615?flat'} 2026-05-25 03:18:59,885 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615 virtual network link through opserver 10.0.0.131 2026-05-25 03:18:59,885 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:18:59,901 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615?flat'} 2026-05-25 03:18:59,901 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-mgmt_vn-71860615 is found in opserver 2026-05-25 03:18:59,933 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:18:59,946 - DEBUG - VRF ids for VN ctest-mgmt_vn-71860615: {} 2026-05-25 03:19:00,245 - DEBUG - Response for create_network : {'network': {'id': '20123dc0-541e-4c19-a0b1-888a48c8b608', 'name': 'ctest-left_vn-91556382', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-left_vn-91556382'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:19:00,532 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd9837bd0-2130-4f69-838a-0a198089cff0', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': '20123dc0-541e-4c19-a0b1-888a48c8b608', 'ip_version': 4, 'cidr': '63.242.95.64/26', 'allocation_pools': [{'start': '63.242.95.66', 'end': '63.242.95.126'}], 'gateway_ip': '63.242.95.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.242.95.66', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:19:00,569 - INFO - Created VN ctest-left_vn-91556382 2026-05-25 03:19:00,586 - DEBUG - VN ctest-left_vn-91556382 UUID is 20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:00,686 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:00,696 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:00,714 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:00,842 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:00,857 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:00,869 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/104fd222-1260-456d-8eae-8dfe514766e9 2026-05-25 03:19:00,879 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/104fd222-1260-456d-8eae-8dfe514766e9 2026-05-25 03:19:00,897 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/75143ccc-405c-4046-8b5c-496bd45ee7ee 2026-05-25 03:19:00,907 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:19:00,907 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:00,921 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/104fd222-1260-456d-8eae-8dfe514766e9 2026-05-25 03:19:00,946 - INFO - Verified VN network id 19 for VN 20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:00,948 - INFO - Verifications in API Server for VN ctest-left_vn-91556382 passed 2026-05-25 03:19:00,948 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:00,966 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/104fd222-1260-456d-8eae-8dfe514766e9 2026-05-25 03:19:00,979 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/104fd222-1260-456d-8eae-8dfe514766e9 2026-05-25 03:19:00,990 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/75143ccc-405c-4046-8b5c-496bd45ee7ee 2026-05-25 03:19:01,018 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2310977455048772633', 'uuid-lslong': '11579186244454233608'}, 'enable': 'true', 'created': '2026-05-25T03:19:00', 'last-modified': '2026-05-25T03:19:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.543386'} 2026-05-25 03:19:01,034 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:19:01,043 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2310977455048772633', 'uuid-lslong': '11579186244454233608'}, 'enable': 'true', 'created': '2026-05-25T03:19:00', 'last-modified': '2026-05-25T03:19:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.575085'} 2026-05-25 03:19:01,049 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:19:01,056 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2310977455048772633', 'uuid-lslong': '11579186244454233608'}, 'enable': 'true', 'created': '2026-05-25T03:19:00', 'last-modified': '2026-05-25T03:19:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.579329'} 2026-05-25 03:19:01,065 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-25 03:19:01,065 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-91556382 passed 2026-05-25 03:19:01,065 - DEBUG - ====Verifying policy data for ctest-left_vn-91556382 in API_Server ====== 2026-05-25 03:19:01,065 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:01,073 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:01,090 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:01,202 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/20123dc0-541e-4c19-a0b1-888a48c8b608 2026-05-25 03:19:01,213 - DEBUG - =>VN ctest-left_vn-91556382 has no policy to be verified 2026-05-25 03:19:01,213 - DEBUG - Verifying the vn in opserver 2026-05-25 03:19:01,213 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382 virtual network link through opserver 10.0.0.73 2026-05-25 03:19:01,213 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:19:01,229 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382?flat'} 2026-05-25 03:19:01,229 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382 virtual network link through opserver 10.0.0.19 2026-05-25 03:19:01,229 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:19:01,250 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382?flat'} 2026-05-25 03:19:01,250 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382 virtual network link through opserver 10.0.0.131 2026-05-25 03:19:01,250 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:19:01,266 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382?flat'} 2026-05-25 03:19:01,266 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-left_vn-91556382 is found in opserver 2026-05-25 03:19:01,293 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:19:01,308 - DEBUG - VRF ids for VN ctest-left_vn-91556382: {} 2026-05-25 03:19:01,634 - DEBUG - Response for create_network : {'network': {'id': 'f332bd1d-45a1-435e-8145-c9d68b61e39d', 'name': 'ctest-right_vn-86913975', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-right_vn-86913975'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:19:01,933 - DEBUG - Response for create_subnet : {'subnet': {'id': '5de2632d-4cd7-4837-907f-464e6b467e7d', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': 'f332bd1d-45a1-435e-8145-c9d68b61e39d', 'ip_version': 4, 'cidr': '135.235.97.64/26', 'allocation_pools': [{'start': '135.235.97.66', 'end': '135.235.97.126'}], 'gateway_ip': '135.235.97.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '135.235.97.66', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:19:01,969 - INFO - Created VN ctest-right_vn-86913975 2026-05-25 03:19:01,994 - DEBUG - VN ctest-right_vn-86913975 UUID is f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,105 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:02,113 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:02,133 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:02,263 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,281 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,293 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/e8385c58-ee3b-41d0-8fee-ebf0e454253b 2026-05-25 03:19:02,303 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/e8385c58-ee3b-41d0-8fee-ebf0e454253b 2026-05-25 03:19:02,315 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/ab734586-0bbe-4fd6-8208-a690430cf280 2026-05-25 03:19:02,323 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:19:02,324 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,336 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/e8385c58-ee3b-41d0-8fee-ebf0e454253b 2026-05-25 03:19:02,360 - INFO - Verified VN network id 20 for VN f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,360 - INFO - Verifications in API Server for VN ctest-right_vn-86913975 passed 2026-05-25 03:19:02,360 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,372 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/e8385c58-ee3b-41d0-8fee-ebf0e454253b 2026-05-25 03:19:02,381 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/e8385c58-ee3b-41d0-8fee-ebf0e454253b 2026-05-25 03:19:02,389 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/ab734586-0bbe-4fd6-8208-a690430cf280 2026-05-25 03:19:02,404 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17524277033471918942', 'uuid-lslong': '9315073327584371613'}, 'enable': 'true', 'created': '2026-05-25T03:19:01', 'last-modified': '2026-05-25T03:19:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.555510'} 2026-05-25 03:19:02,417 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:19:02,425 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17524277033471918942', 'uuid-lslong': '9315073327584371613'}, 'enable': 'true', 'created': '2026-05-25T03:19:01', 'last-modified': '2026-05-25T03:19:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.571503'} 2026-05-25 03:19:02,431 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:19:02,440 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17524277033471918942', 'uuid-lslong': '9315073327584371613'}, 'enable': 'true', 'created': '2026-05-25T03:19:01', 'last-modified': '2026-05-25T03:19:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.588379'} 2026-05-25 03:19:02,447 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-25 03:19:02,447 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-86913975 passed 2026-05-25 03:19:02,447 - DEBUG - ====Verifying policy data for ctest-right_vn-86913975 in API_Server ====== 2026-05-25 03:19:02,447 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:02,454 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:02,467 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:02,573 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/f332bd1d-45a1-435e-8145-c9d68b61e39d 2026-05-25 03:19:02,589 - DEBUG - =>VN ctest-right_vn-86913975 has no policy to be verified 2026-05-25 03:19:02,589 - DEBUG - Verifying the vn in opserver 2026-05-25 03:19:02,589 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975 virtual network link through opserver 10.0.0.73 2026-05-25 03:19:02,590 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:19:02,614 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975?flat'} 2026-05-25 03:19:02,614 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975 virtual network link through opserver 10.0.0.19 2026-05-25 03:19:02,614 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:19:02,629 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975?flat'} 2026-05-25 03:19:02,629 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975 virtual network link through opserver 10.0.0.131 2026-05-25 03:19:02,629 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:19:02,649 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975?flat'} 2026-05-25 03:19:02,649 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-right_vn-86913975 is found in opserver 2026-05-25 03:19:02,675 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:19:02,688 - DEBUG - VRF ids for VN ctest-right_vn-86913975: {} 2026-05-25 03:19:03,035 - DEBUG - Response for create_network : {'network': {'id': 'b04f5ad1-f879-48b9-98c8-e274e097d75b', 'name': 'ctest-trans_left_vn-79589659', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-trans_left_vn-79589659'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:19:03,252 - DEBUG - Response for create_subnet : {'subnet': {'id': '8738fe76-e431-416a-bdd0-33dd9a85914e', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': 'b04f5ad1-f879-48b9-98c8-e274e097d75b', 'ip_version': 4, 'cidr': '34.8.148.0/26', 'allocation_pools': [{'start': '34.8.148.2', 'end': '34.8.148.62'}], 'gateway_ip': '34.8.148.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '34.8.148.2', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:19:03,289 - INFO - Created VN ctest-trans_left_vn-79589659 2026-05-25 03:19:03,303 - DEBUG - VN ctest-trans_left_vn-79589659 UUID is b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,411 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:03,420 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:03,442 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:03,570 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,582 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,593 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/4db377a0-fd70-411a-b745-3516934b1887 2026-05-25 03:19:03,606 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/4db377a0-fd70-411a-b745-3516934b1887 2026-05-25 03:19:03,616 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/38d7c944-cb96-49e4-952b-7ef720b2e7a7 2026-05-25 03:19:03,625 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-25 03:19:03,625 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,638 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/4db377a0-fd70-411a-b745-3516934b1887 2026-05-25 03:19:03,661 - INFO - Verified VN network id 21 for VN b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,661 - INFO - Verifications in API Server for VN ctest-trans_left_vn-79589659 passed 2026-05-25 03:19:03,662 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,675 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/4db377a0-fd70-411a-b745-3516934b1887 2026-05-25 03:19:03,684 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/4db377a0-fd70-411a-b745-3516934b1887 2026-05-25 03:19:03,692 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/38d7c944-cb96-49e4-952b-7ef720b2e7a7 2026-05-25 03:19:03,710 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12704472931698821305', 'uuid-lslong': '11009298280719308635'}, 'enable': 'true', 'created': '2026-05-25T03:19:02', 'last-modified': '2026-05-25T03:19:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516986'} 2026-05-25 03:19:03,718 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-25 03:19:03,728 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12704472931698821305', 'uuid-lslong': '11009298280719308635'}, 'enable': 'true', 'created': '2026-05-25T03:19:02', 'last-modified': '2026-05-25T03:19:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.535952'} 2026-05-25 03:19:03,736 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-25 03:19:03,743 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12704472931698821305', 'uuid-lslong': '11009298280719308635'}, 'enable': 'true', 'created': '2026-05-25T03:19:02', 'last-modified': '2026-05-25T03:19:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.549945'} 2026-05-25 03:19:03,750 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-25 03:19:03,751 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-79589659 passed 2026-05-25 03:19:03,751 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-79589659 in API_Server ====== 2026-05-25 03:19:03,751 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:03,761 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:03,779 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:03,885 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/b04f5ad1-f879-48b9-98c8-e274e097d75b 2026-05-25 03:19:03,899 - DEBUG - =>VN ctest-trans_left_vn-79589659 has no policy to be verified 2026-05-25 03:19:03,899 - DEBUG - Verifying the vn in opserver 2026-05-25 03:19:03,899 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659 virtual network link through opserver 10.0.0.73 2026-05-25 03:19:03,899 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:19:03,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659?flat'} 2026-05-25 03:19:03,916 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659 virtual network link through opserver 10.0.0.19 2026-05-25 03:19:03,916 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:19:03,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659?flat'} 2026-05-25 03:19:03,932 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659 virtual network link through opserver 10.0.0.131 2026-05-25 03:19:03,932 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:19:03,949 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659?flat'} 2026-05-25 03:19:03,949 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-trans_left_vn-79589659 is found in opserver 2026-05-25 03:19:03,979 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:19:03,989 - DEBUG - VRF ids for VN ctest-trans_left_vn-79589659: {} 2026-05-25 03:19:04,304 - DEBUG - Response for create_network : {'network': {'id': '81402814-46a0-4a6a-9160-43f6e7fb8c02', 'name': 'ctest-trans_right_vn-21144830', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'project_id': '784dadaa55684f13a44eadc690f78f6f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-60227980', 'ctest-trans_right_vn-21144830'], 'port_security_enabled': True, 'description': ''}} 2026-05-25 03:19:04,579 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c6ab928b-d988-4f0b-92c6-e7c7857222ab', 'name': '', 'tenant_id': '784dadaa55684f13a44eadc690f78f6f', 'network_id': '81402814-46a0-4a6a-9160-43f6e7fb8c02', 'ip_version': 4, 'cidr': '53.51.73.64/26', 'allocation_pools': [{'start': '53.51.73.66', 'end': '53.51.73.126'}], 'gateway_ip': '53.51.73.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.51.73.66', 'tags': [], 'project_id': '784dadaa55684f13a44eadc690f78f6f'}} 2026-05-25 03:19:04,606 - INFO - Created VN ctest-trans_right_vn-21144830 2026-05-25 03:19:04,618 - DEBUG - VN ctest-trans_right_vn-21144830 UUID is 81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:04,708 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:04,716 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:04,731 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:04,838 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:04,858 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:04,870 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/cb997d55-c7a3-4cc4-857b-2b321cbf440a 2026-05-25 03:19:04,883 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/cb997d55-c7a3-4cc4-857b-2b321cbf440a 2026-05-25 03:19:04,893 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/0bb7fa5b-2516-4c9b-85b0-bbe0bafe0ae3 2026-05-25 03:19:04,906 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-25 03:19:04,906 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:04,923 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/cb997d55-c7a3-4cc4-857b-2b321cbf440a 2026-05-25 03:19:04,957 - INFO - Verified VN network id 22 for VN 81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:04,957 - INFO - Verifications in API Server for VN ctest-trans_right_vn-21144830 passed 2026-05-25 03:19:04,957 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:04,974 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/cb997d55-c7a3-4cc4-857b-2b321cbf440a 2026-05-25 03:19:04,984 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/cb997d55-c7a3-4cc4-857b-2b321cbf440a 2026-05-25 03:19:04,997 - DEBUG - Requesting: http://10.0.0.73:8082/route-target/0bb7fa5b-2516-4c9b-85b0-bbe0bafe0ae3 2026-05-25 03:19:05,025 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9313488096951552618', 'uuid-lslong': '10475447460996811778'}, 'enable': 'true', 'created': '2026-05-25T03:19:04', 'last-modified': '2026-05-25T03:19:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496452'} 2026-05-25 03:19:05,034 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-25 03:19:05,041 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9313488096951552618', 'uuid-lslong': '10475447460996811778'}, 'enable': 'true', 'created': '2026-05-25T03:19:04', 'last-modified': '2026-05-25T03:19:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.517242'} 2026-05-25 03:19:05,048 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-25 03:19:05,055 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-60227980', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9313488096951552618', 'uuid-lslong': '10475447460996811778'}, 'enable': 'true', 'created': '2026-05-25T03:19:04', 'last-modified': '2026-05-25T03:19:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.521172'} 2026-05-25 03:19:05,066 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-25 03:19:05,066 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-21144830 passed 2026-05-25 03:19:05,066 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-21144830 in API_Server ====== 2026-05-25 03:19:05,066 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:05,074 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:05,091 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:05,195 - DEBUG - Requesting: http://10.0.0.73:8082/virtual-network/81402814-46a0-4a6a-9160-43f6e7fb8c02 2026-05-25 03:19:05,207 - DEBUG - =>VN ctest-trans_right_vn-21144830 has no policy to be verified 2026-05-25 03:19:05,207 - DEBUG - Verifying the vn in opserver 2026-05-25 03:19:05,208 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830 virtual network link through opserver 10.0.0.73 2026-05-25 03:19:05,208 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2026-05-25 03:19:05,222 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830?flat'} 2026-05-25 03:19:05,223 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830 virtual network link through opserver 10.0.0.19 2026-05-25 03:19:05,223 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2026-05-25 03:19:05,237 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830?flat'} 2026-05-25 03:19:05,237 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830 virtual network link through opserver 10.0.0.131 2026-05-25 03:19:05,237 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2026-05-25 03:19:05,254 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830?flat'} 2026-05-25 03:19:05,254 - INFO - Validated that VN default-domain:ctest-TestSvcHC-60227980:ctest-trans_right_vn-21144830 is found in opserver 2026-05-25 03:19:05,286 - DEBUG - Do not have enough data to verify VN in agent 2026-05-25 03:19:05,299 - DEBUG - VRF ids for VN ctest-trans_right_vn-21144830: {} 2026-05-25 03:19:06,748 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5822-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5822-1) 2026-05-25 03:19:08,279 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5822-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5822-2) 2026-05-25 03:19:08,279 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-15051980'] 2026-05-25 03:19:08,600 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-15051980'] created succesfully 2026-05-25 03:19:09,027 - DEBUG - Image by name tiny_trans_fw not found 2026-05-25 03:19:09,027 - DEBUG - Installing image tiny_trans_fw 2026-05-25 03:19:09,027 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-05-25 03:19:09,027 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-25 03:19:09,028 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-25 03:19:09,028 - DEBUG - Unzip image 2026-05-25 03:19:09,028 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-05-25 03:19:09,085 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-05-25 03:19:09,085 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-15051980'] 2026-05-25 03:19:09,188 - INFO - Service template: ['default-domain', 'ctest-service_template_1-15051980'] deleted successfully. 2026-05-25 03:19:09,188 - INFO - Skip interface_detach for VM ctest-right_vm-34178931 in state BUILD 2026-05-25 03:19:09,188 - INFO - Deleting VM ctest-right_vm-34178931 2026-05-25 03:19:09,188 - ERROR - VM ctest-right_vm-34178931 has failed to come up 2026-05-25 03:19:09,188 - ERROR - Nova failed to get host of the VM 2026-05-25 03:19:09,189 - ERROR - VM ctest-right_vm-34178931 has failed to come up 2026-05-25 03:19:09,189 - ERROR - Nova failed to get host of the VM 2026-05-25 03:19:09,299 - INFO - Skip interface_detach for VM ctest-left_vm-29265007 in state BUILD 2026-05-25 03:19:09,299 - INFO - Deleting VM ctest-left_vm-29265007 2026-05-25 03:19:09,299 - ERROR - VM ctest-left_vm-29265007 has failed to come up 2026-05-25 03:19:09,299 - ERROR - Nova failed to get host of the VM 2026-05-25 03:19:09,299 - ERROR - VM ctest-left_vm-29265007 has failed to come up 2026-05-25 03:19:09,299 - ERROR - Nova failed to get host of the VM 2026-05-25 03:19:09,444 - INFO - Deleting VN ctest-trans_right_vn-21144830 2026-05-25 03:19:09,661 - DEBUG - Response for deleting network () 2026-05-25 03:19:09,661 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/cb997d55-c7a3-4cc4-857b-2b321cbf440a 2026-05-25 03:19:09,668 - DEBUG - Response Code: 404 2026-05-25 03:19:09,668 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:09,676 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:09,709 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:09,822 - INFO - Validated that VN ctest-trans_right_vn-21144830 is not found in API Server 2026-05-25 03:19:09,843 - DEBUG - VN ctest-trans_right_vn-21144830 is not present in Agent 10.0.0.133 2026-05-25 03:19:09,854 - DEBUG - VN ctest-trans_right_vn-21144830 is not present in Agent 10.0.0.240 2026-05-25 03:19:09,854 - INFO - Validated that VN ctest-trans_right_vn-21144830 is not in any agent 2026-05-25 03:19:09,897 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-21144830 info 2026-05-25 03:19:09,897 - INFO - Deleting VN ctest-trans_left_vn-79589659 2026-05-25 03:19:10,118 - DEBUG - Response for deleting network () 2026-05-25 03:19:10,118 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/4db377a0-fd70-411a-b745-3516934b1887 2026-05-25 03:19:10,128 - DEBUG - Response Code: 404 2026-05-25 03:19:10,128 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:10,151 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:10,173 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:10,311 - INFO - Validated that VN ctest-trans_left_vn-79589659 is not found in API Server 2026-05-25 03:19:10,336 - DEBUG - VN ctest-trans_left_vn-79589659 is not present in Agent 10.0.0.133 2026-05-25 03:19:10,347 - DEBUG - VN ctest-trans_left_vn-79589659 is not present in Agent 10.0.0.240 2026-05-25 03:19:10,347 - INFO - Validated that VN ctest-trans_left_vn-79589659 is not in any agent 2026-05-25 03:19:10,410 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-79589659 info 2026-05-25 03:19:10,410 - INFO - Deleting VN ctest-right_vn-86913975 2026-05-25 03:19:10,477 - DEBUG - VN f332bd1d-45a1-435e-8145-c9d68b61e39d still in use: Unable to complete operation on network f332bd1d-45a1-435e-8145-c9d68b61e39d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5ce8f016-1670-4798-a9c6-23f278b4ca47'] 2026-05-25 03:19:10,478 - WARNING - Deleting VN ctest-right_vn-86913975 failed..Will retry 2026-05-25 03:19:12,696 - DEBUG - Response for deleting network () 2026-05-25 03:19:12,696 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/e8385c58-ee3b-41d0-8fee-ebf0e454253b 2026-05-25 03:19:12,704 - DEBUG - Response Code: 404 2026-05-25 03:19:12,705 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:12,720 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:12,740 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:12,854 - INFO - Validated that VN ctest-right_vn-86913975 is not found in API Server 2026-05-25 03:19:12,867 - DEBUG - VN ctest-right_vn-86913975 is not present in Agent 10.0.0.133 2026-05-25 03:19:28,233 - DEBUG - VN ctest-right_vn-86913975 is not present in Agent 10.0.0.240 2026-05-25 03:19:28,233 - INFO - Validated that VN ctest-right_vn-86913975 is not in any agent 2026-05-25 03:19:28,280 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-86913975 info 2026-05-25 03:19:28,280 - INFO - Deleting VN ctest-left_vn-91556382 2026-05-25 03:19:28,530 - DEBUG - Response for deleting network () 2026-05-25 03:19:28,530 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/104fd222-1260-456d-8eae-8dfe514766e9 2026-05-25 03:19:28,538 - DEBUG - Response Code: 404 2026-05-25 03:19:28,538 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:28,552 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:28,605 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:28,706 - INFO - Validated that VN ctest-left_vn-91556382 is not found in API Server 2026-05-25 03:19:28,717 - DEBUG - VN ctest-left_vn-91556382 is not present in Agent 10.0.0.133 2026-05-25 03:19:28,728 - DEBUG - VN ctest-left_vn-91556382 is not present in Agent 10.0.0.240 2026-05-25 03:19:28,728 - INFO - Validated that VN ctest-left_vn-91556382 is not in any agent 2026-05-25 03:19:28,768 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-91556382 info 2026-05-25 03:19:28,768 - INFO - Deleting VN ctest-mgmt_vn-71860615 2026-05-25 03:19:28,920 - DEBUG - Response for deleting network () 2026-05-25 03:19:28,920 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/6fb05333-b6af-4ab5-a2ff-a052bb822c67 2026-05-25 03:19:28,927 - DEBUG - Response Code: 404 2026-05-25 03:19:28,927 - DEBUG - Requesting: http://10.0.0.73:8082/domains 2026-05-25 03:19:28,934 - DEBUG - Requesting: http://10.0.0.73:8082/domain/e8ff46f5-59ad-486b-ab96-d07259341f10 2026-05-25 03:19:28,947 - DEBUG - Requesting: http://10.0.0.73:8082/project/784dadaa-5568-4f13-a44e-adc690f78f6f 2026-05-25 03:19:29,070 - INFO - Validated that VN ctest-mgmt_vn-71860615 is not found in API Server 2026-05-25 03:19:29,084 - DEBUG - VN ctest-mgmt_vn-71860615 is not present in Agent 10.0.0.133 2026-05-25 03:19:29,101 - DEBUG - VN ctest-mgmt_vn-71860615 is not present in Agent 10.0.0.240 2026-05-25 03:19:29,101 - INFO - Validated that VN ctest-mgmt_vn-71860615 is not in any agent 2026-05-25 03:19:29,154 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-71860615 info 2026-05-25 03:19:30,204 - ERROR - [Errno 104] Connection reset by peer Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/svc_health_check/test_svc_health_check.py", line 137, in test_svc_trans_segment_right_hc_fail_svm assert self.svc_hc_fail_svm_common() File "/contrail-test/scripts/svc_health_check/test_svc_health_check.py", line 179, in svc_hc_fail_svm_common ret_dict = self.verify_svc_chain(service_mode=svc_mode, File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs) File "/contrail-test/common/servicechain/config.py", line 528, in config_svc_chain svm_fixtures = self.create_service_vms(vns, File "/contrail-test/common/servicechain/config.py", line 330, in create_service_vms svm_fixture = self.config_vm_only( File "/contrail-test/common/servicechain/config.py", line 159, in config_vm_only vm_fixture = self.config_vm( File "/contrail-test/common/servicechain/config.py", line 200, in config_vm vm_fixture = self.useFixture(VMFixture( File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 756, in useFixture reraise(*exc_info) File "/usr/local/lib/python3.9/site-packages/testtools/_compat3x.py", line 16, in reraise raise exc_obj.with_traceback(exc_tb) File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 731, in useFixture fixture.setUp() File "/contrail-test/fixtures/vm_test.py", line 193, in setUp self.create() File "/contrail-test/fixtures/vm_test.py", line 233, in create objs = self.orch.create_vm( File "/contrail-test/fixtures/openstack.py", line 118, in create_vm return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs) File "/contrail-test/fixtures/nova_test.py", line 582, in create_vm image = self.get_image(image_name=image_name) File "/contrail-test/fixtures/nova_test.py", line 199, in get_image self._install_image(image_name=image_name) File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image return self.copy_and_glance(build_path, image_name, params) File "/contrail-test/fixtures/nova_test.py", line 409, in copy_and_glance raise TestSkipped(f"image {image_path_real} is not found") unittest2.case.SkipTest: image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/cores.py", line 42, in get_cores_node if exists(CORE_DIR): File "/usr/local/lib/python3.9/site-packages/fabric/contrib/files.py", line 31, in exists cmd = 'stat %s' % _expand_path(path) File "/usr/local/lib/python3.9/site-packages/fabric/contrib/files.py", line 485, in _expand_path return path if is_win() else '"$(echo %s)"' % path File "/usr/local/lib/python3.9/site-packages/fabric/contrib/files.py", line 472, in is_win return '"' in run('echo "Will you echo quotation marks"') File "/usr/local/lib/python3.9/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 1092, in run return _run_command( File "/usr/local/lib/python3.9/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.9/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/usr/local/lib/python3.9/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/usr/local/lib/python3.9/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/usr/local/lib64/python3.9/site-packages/gevent/_socketcommon.py", line 660, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer 2026-05-25 03:19:30,238 - DEBUG - No XMPP flaps were noticed during the test 2026-05-25 03:19:30,238 - INFO -

2026-05-25 03:19:30,238 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:33]

2026-05-25 03:19:30,238 - INFO - -------------------------------------------------------------------------------- 2026-05-25 03:19:31,097 - INFO - Deleted project: ctest-TestSvcHC-60227980, ID : 784dadaa-5568-4f13-a44e-adc690f78f6f