2025-11-20 02:55:52,027 - INFO - Domain Default found not creating 2025-11-20 02:55:52,201 - INFO - Project ctest-TestSvcHC-45966624 not found, creating it 2025-11-20 02:55:52,729 - INFO - Created Project:ctest-TestSvcHC-45966624, ID : cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:55:54,313 - INFO - ================================================================================ 2025-11-20 02:55:54,314 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-20 02:55:55,581 - DEBUG - Nothing to compare xmpp stats {'10.0.0.131': {'10.20.0.201': '0', '10.20.0.129': '0'}, '10.0.0.48': {'10.20.0.201': '0', '10.20.0.129': '0'}} with 2025-11-20 02:55:55,581 - INFO - Initial checks done. Running the testcase now 2025-11-20 02:55:55,581 - INFO - 2025-11-20 02:55:56,255 - DEBUG - Response for create_network : {'network': {'id': '36aaa0b2-4da8-4b4d-bcf0-b9216d35766d', 'name': 'ctest-mgmt_vn-21844395', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-mgmt_vn-21844395'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:55:56,538 - DEBUG - Response for create_subnet : {'subnet': {'id': '556a75c4-1ceb-488e-a455-63dbade909a9', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': '36aaa0b2-4da8-4b4d-bcf0-b9216d35766d', 'ip_version': 4, 'cidr': '36.209.170.128/26', 'allocation_pools': [{'start': '36.209.170.130', 'end': '36.209.170.190'}], 'gateway_ip': '36.209.170.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '36.209.170.130', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:55:56,564 - INFO - Created VN ctest-mgmt_vn-21844395 2025-11-20 02:55:56,578 - DEBUG - VN ctest-mgmt_vn-21844395 UUID is 36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:56,658 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:55:56,956 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:55:56,984 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:55:56,997 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:55:57,100 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:57,112 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:57,123 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/572f5854-b688-4dd8-b38e-c650dcbce42d 2025-11-20 02:55:57,133 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/572f5854-b688-4dd8-b38e-c650dcbce42d 2025-11-20 02:55:57,139 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/cc5d304e-6da7-4772-9bf4-c3588c72833e 2025-11-20 02:55:57,146 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:55:57,146 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:57,154 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/572f5854-b688-4dd8-b38e-c650dcbce42d 2025-11-20 02:55:57,171 - INFO - Verified VN network id 15 for VN 36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:57,171 - INFO - Verifications in API Server for VN ctest-mgmt_vn-21844395 passed 2025-11-20 02:55:57,171 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:57,182 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/572f5854-b688-4dd8-b38e-c650dcbce42d 2025-11-20 02:55:57,189 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/572f5854-b688-4dd8-b38e-c650dcbce42d 2025-11-20 02:55:57,196 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/cc5d304e-6da7-4772-9bf4-c3588c72833e 2025-11-20 02:55:57,208 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3939137511756417869', 'uuid-lslong': '13614585226758289005'}, 'enable': 'true', 'created': '2025-11-20T02:55:56', 'last-modified': '2025-11-20T02:55:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.722368'} 2025-11-20 02:55:57,213 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:55:57,219 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3939137511756417869', 'uuid-lslong': '13614585226758289005'}, 'enable': 'true', 'created': '2025-11-20T02:55:56', 'last-modified': '2025-11-20T02:55:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.740556'} 2025-11-20 02:55:57,225 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:55:57,231 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3939137511756417869', 'uuid-lslong': '13614585226758289005'}, 'enable': 'true', 'created': '2025-11-20T02:55:56', 'last-modified': '2025-11-20T02:55:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.742669'} 2025-11-20 02:55:57,237 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:55:57,237 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-21844395 passed 2025-11-20 02:55:57,237 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-21844395 in API_Server ====== 2025-11-20 02:55:57,237 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:55:57,244 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:55:57,255 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:55:57,361 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/36aaa0b2-4da8-4b4d-bcf0-b9216d35766d 2025-11-20 02:55:57,374 - DEBUG - =>VN ctest-mgmt_vn-21844395 has no policy to be verified 2025-11-20 02:55:57,374 - DEBUG - Verifying the vn in opserver 2025-11-20 02:55:57,375 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395 virtual network link through opserver 10.0.0.23 2025-11-20 02:55:57,375 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:55:57,698 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:55:57,783 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395?flat'} 2025-11-20 02:55:57,783 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395 virtual network link through opserver 10.0.0.50 2025-11-20 02:55:57,783 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:55:58,084 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:55:58,146 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395?flat'} 2025-11-20 02:55:58,146 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395 virtual network link through opserver 10.0.0.22 2025-11-20 02:55:58,146 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:55:58,440 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:55:58,503 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395?flat'} 2025-11-20 02:55:58,503 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-21844395 is found in opserver 2025-11-20 02:55:58,526 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:55:58,536 - DEBUG - VRF ids for VN ctest-mgmt_vn-21844395: {} 2025-11-20 02:55:58,817 - DEBUG - Response for create_network : {'network': {'id': '2ffc409a-7e8a-485c-9706-ccb2da045fb7', 'name': 'ctest-left_vn-65669782', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-left_vn-65669782'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:55:59,082 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bab59d4e-4ef1-426c-802c-bc67d6b6ddaa', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': '2ffc409a-7e8a-485c-9706-ccb2da045fb7', 'ip_version': 4, 'cidr': '167.152.240.64/26', 'allocation_pools': [{'start': '167.152.240.66', 'end': '167.152.240.126'}], 'gateway_ip': '167.152.240.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '167.152.240.66', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:55:59,105 - INFO - Created VN ctest-left_vn-65669782 2025-11-20 02:55:59,118 - DEBUG - VN ctest-left_vn-65669782 UUID is 2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:55:59,191 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:55:59,197 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:55:59,207 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:55:59,287 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:55:59,299 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:55:59,310 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:55:59,319 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:55:59,329 - DEBUG - Route Targets: [] 2025-11-20 02:55:59,329 - DEBUG - RT names not yet present for VN ctest-left_vn-65669782 2025-11-20 02:56:04,330 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:04,337 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:04,350 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:04,435 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:56:04,459 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:56:04,468 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:56:04,479 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:56:04,486 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c225dc7-ccda-47fa-9104-12110c1f666b 2025-11-20 02:56:04,493 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:04,493 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:56:04,502 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:56:04,519 - INFO - Verified VN network id 16 for VN 2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:56:04,519 - INFO - Verifications in API Server for VN ctest-left_vn-65669782 passed 2025-11-20 02:56:04,519 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:56:04,528 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:56:04,536 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:56:04,544 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c225dc7-ccda-47fa-9104-12110c1f666b 2025-11-20 02:56:04,556 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3457709646205831260', 'uuid-lslong': '10882610618121346999'}, 'enable': 'true', 'created': '2025-11-20T02:55:58', 'last-modified': '2025-11-20T02:55:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.518009'} 2025-11-20 02:56:04,561 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:04,567 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3457709646205831260', 'uuid-lslong': '10882610618121346999'}, 'enable': 'true', 'created': '2025-11-20T02:55:58', 'last-modified': '2025-11-20T02:55:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.536623'} 2025-11-20 02:56:04,576 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:04,581 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3457709646205831260', 'uuid-lslong': '10882610618121346999'}, 'enable': 'true', 'created': '2025-11-20T02:55:58', 'last-modified': '2025-11-20T02:55:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.548367'} 2025-11-20 02:56:04,587 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:04,587 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-65669782 passed 2025-11-20 02:56:04,587 - DEBUG - ====Verifying policy data for ctest-left_vn-65669782 in API_Server ====== 2025-11-20 02:56:04,587 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:04,593 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:04,603 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:04,709 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2ffc409a-7e8a-485c-9706-ccb2da045fb7 2025-11-20 02:56:04,719 - DEBUG - =>VN ctest-left_vn-65669782 has no policy to be verified 2025-11-20 02:56:04,719 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:04,719 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:04,719 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:04,783 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782?flat'} 2025-11-20 02:56:04,783 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:04,783 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:04,846 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782?flat'} 2025-11-20 02:56:04,846 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:04,846 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:04,921 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782?flat'} 2025-11-20 02:56:04,921 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-65669782 is found in opserver 2025-11-20 02:56:04,940 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:04,949 - DEBUG - VRF ids for VN ctest-left_vn-65669782: {} 2025-11-20 02:56:05,280 - DEBUG - Response for create_network : {'network': {'id': '7d9dad86-7c1e-4205-9609-26b606ec7e7e', 'name': 'ctest-right_vn-65166183', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-right_vn-65166183'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:56:05,570 - DEBUG - Response for create_subnet : {'subnet': {'id': '5353bd36-f1a4-4e78-9acf-d597dbc37be5', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': '7d9dad86-7c1e-4205-9609-26b606ec7e7e', 'ip_version': 4, 'cidr': '142.213.231.0/26', 'allocation_pools': [{'start': '142.213.231.2', 'end': '142.213.231.62'}], 'gateway_ip': '142.213.231.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.213.231.2', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:56:05,592 - INFO - Created VN ctest-right_vn-65166183 2025-11-20 02:56:05,605 - DEBUG - VN ctest-right_vn-65166183 UUID is 7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:05,681 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:05,687 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:05,697 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:05,789 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:05,803 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:05,813 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ff0bea48-d1fc-47bb-a50d-d66c910eb0a8 2025-11-20 02:56:05,819 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ff0bea48-d1fc-47bb-a50d-d66c910eb0a8 2025-11-20 02:56:05,826 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/64813737-3594-46dd-a688-65f1416d0fbd 2025-11-20 02:56:05,834 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:05,834 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:05,845 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ff0bea48-d1fc-47bb-a50d-d66c910eb0a8 2025-11-20 02:56:05,860 - INFO - Verified VN network id 17 for VN 7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:05,860 - INFO - Verifications in API Server for VN ctest-right_vn-65166183 passed 2025-11-20 02:56:05,860 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:05,869 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ff0bea48-d1fc-47bb-a50d-d66c910eb0a8 2025-11-20 02:56:05,876 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ff0bea48-d1fc-47bb-a50d-d66c910eb0a8 2025-11-20 02:56:05,884 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/64813737-3594-46dd-a688-65f1416d0fbd 2025-11-20 02:56:05,896 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9051581619204145669', 'uuid-lslong': '10811214943721651838'}, 'enable': 'true', 'created': '2025-11-20T02:56:05', 'last-modified': '2025-11-20T02:56:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388884'} 2025-11-20 02:56:05,902 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:05,907 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9051581619204145669', 'uuid-lslong': '10811214943721651838'}, 'enable': 'true', 'created': '2025-11-20T02:56:05', 'last-modified': '2025-11-20T02:56:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399529'} 2025-11-20 02:56:05,915 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:05,921 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9051581619204145669', 'uuid-lslong': '10811214943721651838'}, 'enable': 'true', 'created': '2025-11-20T02:56:05', 'last-modified': '2025-11-20T02:56:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406558'} 2025-11-20 02:56:05,929 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:05,930 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-65166183 passed 2025-11-20 02:56:05,930 - DEBUG - ====Verifying policy data for ctest-right_vn-65166183 in API_Server ====== 2025-11-20 02:56:05,930 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:05,937 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:05,951 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:06,042 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7d9dad86-7c1e-4205-9609-26b606ec7e7e 2025-11-20 02:56:06,056 - DEBUG - =>VN ctest-right_vn-65166183 has no policy to be verified 2025-11-20 02:56:06,056 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:06,056 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:06,056 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:06,127 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183?flat'} 2025-11-20 02:56:06,127 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:06,127 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:06,195 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183?flat'} 2025-11-20 02:56:06,195 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:06,195 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:06,257 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183?flat'} 2025-11-20 02:56:06,257 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-65166183 is found in opserver 2025-11-20 02:56:06,280 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:06,291 - DEBUG - VRF ids for VN ctest-right_vn-65166183: {} 2025-11-20 02:56:06,347 - DEBUG - Services list from nova: [, , , ] 2025-11-20 02:56:07,371 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 02:56:08,718 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 02:56:08,718 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-99051599'] 2025-11-20 02:56:09,008 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-99051599'] created succesfully 2025-11-20 02:56:09,346 - DEBUG - Image by name tiny_nat_fw not found 2025-11-20 02:56:09,346 - DEBUG - Installing image tiny_nat_fw 2025-11-20 02:56:09,346 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-20 02:56:09,346 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-20 02:56:09,346 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-20 02:56:09,346 - DEBUG - Unzip image 2025-11-20 02:56:09,346 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-20 02:56:09,364 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-20 02:56:09,364 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-99051599'] 2025-11-20 02:56:09,468 - INFO - Service template: ['default-domain', 'ctest-service_template_1-99051599'] deleted successfully. 2025-11-20 02:56:09,469 - INFO - Skip interface_detach for VM ctest-right_vm-52146180 in state BUILD 2025-11-20 02:56:09,469 - INFO - Deleting VM ctest-right_vm-52146180 2025-11-20 02:56:09,497 - ERROR - VM ctest-right_vm-52146180 has failed to come up 2025-11-20 02:56:09,497 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:09,497 - ERROR - VM ctest-right_vm-52146180 has failed to come up 2025-11-20 02:56:09,497 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:09,572 - INFO - Skip interface_detach for VM ctest-left_vm-24384625 in state BUILD 2025-11-20 02:56:09,572 - INFO - Deleting VM ctest-left_vm-24384625 2025-11-20 02:56:09,572 - ERROR - VM ctest-left_vm-24384625 has failed to come up 2025-11-20 02:56:09,572 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:09,572 - ERROR - VM ctest-left_vm-24384625 has failed to come up 2025-11-20 02:56:09,572 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:09,646 - INFO - Deleting VN ctest-right_vn-65166183 2025-11-20 02:56:09,699 - DEBUG - VN 7d9dad86-7c1e-4205-9609-26b606ec7e7e still in use: Unable to complete operation on network 7d9dad86-7c1e-4205-9609-26b606ec7e7e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-995a5682-1fd5-4b74-b6ab-e5e8c0d22f61'] 2025-11-20 02:56:09,700 - WARNING - Deleting VN ctest-right_vn-65166183 failed..Will retry 2025-11-20 02:56:11,868 - DEBUG - Response for deleting network () 2025-11-20 02:56:11,868 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ff0bea48-d1fc-47bb-a50d-d66c910eb0a8 2025-11-20 02:56:11,873 - DEBUG - Response Code: 404 2025-11-20 02:56:11,873 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:11,881 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:11,904 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:12,007 - INFO - Validated that VN ctest-right_vn-65166183 is not found in API Server 2025-11-20 02:56:12,019 - DEBUG - VN ctest-right_vn-65166183 is not present in Agent 10.0.0.131 2025-11-20 02:56:12,028 - DEBUG - VN ctest-right_vn-65166183 is not present in Agent 10.0.0.48 2025-11-20 02:56:12,028 - INFO - Validated that VN ctest-right_vn-65166183 is not in any agent 2025-11-20 02:56:12,059 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-65166183 info 2025-11-20 02:56:12,059 - INFO - Deleting VN ctest-left_vn-65669782 2025-11-20 02:56:12,226 - DEBUG - Response for deleting network () 2025-11-20 02:56:12,226 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/47bc1c63-c695-42d8-880b-bd077b932062 2025-11-20 02:56:12,231 - DEBUG - Response Code: 404 2025-11-20 02:56:12,232 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:12,243 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:12,255 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:12,343 - INFO - Validated that VN ctest-left_vn-65669782 is not found in API Server 2025-11-20 02:56:12,356 - DEBUG - VN ctest-left_vn-65669782 is not present in Agent 10.0.0.131 2025-11-20 02:56:12,366 - DEBUG - VN ctest-left_vn-65669782 is not present in Agent 10.0.0.48 2025-11-20 02:56:12,366 - INFO - Validated that VN ctest-left_vn-65669782 is not in any agent 2025-11-20 02:56:12,397 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-65669782 info 2025-11-20 02:56:12,397 - INFO - Deleting VN ctest-mgmt_vn-21844395 2025-11-20 02:56:12,537 - DEBUG - Response for deleting network () 2025-11-20 02:56:12,537 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/572f5854-b688-4dd8-b38e-c650dcbce42d 2025-11-20 02:56:12,552 - DEBUG - Response Code: 404 2025-11-20 02:56:12,552 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:12,558 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:12,612 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:12,704 - INFO - Validated that VN ctest-mgmt_vn-21844395 is not found in API Server 2025-11-20 02:56:12,719 - DEBUG - VN ctest-mgmt_vn-21844395 is not present in Agent 10.0.0.131 2025-11-20 02:56:12,729 - DEBUG - VN ctest-mgmt_vn-21844395 is not present in Agent 10.0.0.48 2025-11-20 02:56:12,729 - INFO - Validated that VN ctest-mgmt_vn-21844395 is not in any agent 2025-11-20 02:56:12,763 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-21844395 info 2025-11-20 02:56:14,057 - DEBUG - No XMPP flaps were noticed during the test 2025-11-20 02:56:14,057 - INFO - 2025-11-20 02:56:14,057 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:20] 2025-11-20 02:56:14,057 - INFO - -------------------------------------------------------------------------------- 2025-11-20 02:56:14,060 - INFO - ================================================================================ 2025-11-20 02:56:14,060 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-20 02:56:15,344 - DEBUG - Nothing to compare xmpp stats {'10.0.0.131': {'10.20.0.201': '0', '10.20.0.129': '0'}, '10.0.0.48': {'10.20.0.201': '0', '10.20.0.129': '0'}} with 2025-11-20 02:56:15,344 - INFO - Initial checks done. Running the testcase now 2025-11-20 02:56:15,344 - INFO - 2025-11-20 02:56:15,596 - DEBUG - Response for create_network : {'network': {'id': 'd00239c1-1795-4aa5-aa96-43267a960347', 'name': 'ctest-mgmt_vn-98889324', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-mgmt_vn-98889324'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:56:15,841 - DEBUG - Response for create_subnet : {'subnet': {'id': '46328cfd-3efb-4134-bc94-1c1a0c1dff5c', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': 'd00239c1-1795-4aa5-aa96-43267a960347', 'ip_version': 4, 'cidr': '219.119.124.128/26', 'allocation_pools': [{'start': '219.119.124.130', 'end': '219.119.124.190'}], 'gateway_ip': '219.119.124.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.119.124.130', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:56:15,865 - INFO - Created VN ctest-mgmt_vn-98889324 2025-11-20 02:56:15,883 - DEBUG - VN ctest-mgmt_vn-98889324 UUID is d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:15,954 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:15,961 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:15,973 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:16,070 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:16,081 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:16,090 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d532e057-cb9d-4465-82cb-852331405370 2025-11-20 02:56:16,098 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d532e057-cb9d-4465-82cb-852331405370 2025-11-20 02:56:16,105 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f38d8f1e-885c-4b8c-9284-472cd94774c8 2025-11-20 02:56:16,112 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:56:16,112 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:16,121 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d532e057-cb9d-4465-82cb-852331405370 2025-11-20 02:56:16,137 - INFO - Verified VN network id 15 for VN d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:16,137 - INFO - Verifications in API Server for VN ctest-mgmt_vn-98889324 passed 2025-11-20 02:56:16,137 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:16,147 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d532e057-cb9d-4465-82cb-852331405370 2025-11-20 02:56:16,157 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d532e057-cb9d-4465-82cb-852331405370 2025-11-20 02:56:16,165 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f38d8f1e-885c-4b8c-9284-472cd94774c8 2025-11-20 02:56:16,179 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14988606011329563301', 'uuid-lslong': '12292086065498817351'}, 'enable': 'true', 'created': '2025-11-20T02:56:15', 'last-modified': '2025-11-20T02:56:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404117'} 2025-11-20 02:56:16,184 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:56:16,190 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14988606011329563301', 'uuid-lslong': '12292086065498817351'}, 'enable': 'true', 'created': '2025-11-20T02:56:15', 'last-modified': '2025-11-20T02:56:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419996'} 2025-11-20 02:56:16,197 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:56:16,202 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14988606011329563301', 'uuid-lslong': '12292086065498817351'}, 'enable': 'true', 'created': '2025-11-20T02:56:15', 'last-modified': '2025-11-20T02:56:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429728'} 2025-11-20 02:56:16,208 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-20 02:56:16,208 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-98889324 passed 2025-11-20 02:56:16,208 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-98889324 in API_Server ====== 2025-11-20 02:56:16,208 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:16,215 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:16,226 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:16,330 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d00239c1-1795-4aa5-aa96-43267a960347 2025-11-20 02:56:16,341 - DEBUG - =>VN ctest-mgmt_vn-98889324 has no policy to be verified 2025-11-20 02:56:16,341 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:16,341 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:16,341 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:16,354 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324?flat'} 2025-11-20 02:56:16,354 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:16,354 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:16,369 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324?flat'} 2025-11-20 02:56:16,369 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:16,369 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:16,383 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324?flat'} 2025-11-20 02:56:16,383 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-mgmt_vn-98889324 is found in opserver 2025-11-20 02:56:16,407 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:16,419 - DEBUG - VRF ids for VN ctest-mgmt_vn-98889324: {} 2025-11-20 02:56:16,688 - DEBUG - Response for create_network : {'network': {'id': 'd3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70', 'name': 'ctest-left_vn-45054403', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-left_vn-45054403'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:56:16,933 - DEBUG - Response for create_subnet : {'subnet': {'id': '35ff488c-75a4-4df6-9da7-aeff386be2cb', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': 'd3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70', 'ip_version': 4, 'cidr': '182.82.107.64/26', 'allocation_pools': [{'start': '182.82.107.66', 'end': '182.82.107.126'}], 'gateway_ip': '182.82.107.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '182.82.107.66', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:56:16,954 - INFO - Created VN ctest-left_vn-45054403 2025-11-20 02:56:16,966 - DEBUG - VN ctest-left_vn-45054403 UUID is d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,041 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:17,049 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:17,061 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:17,160 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,175 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,184 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/35ef9024-1319-438c-af5c-1e31f9c22e04 2025-11-20 02:56:17,194 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/35ef9024-1319-438c-af5c-1e31f9c22e04 2025-11-20 02:56:17,202 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/5ac6c6af-9ca5-4afd-8b3f-f59f4de6b238 2025-11-20 02:56:17,208 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:17,208 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,216 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/35ef9024-1319-438c-af5c-1e31f9c22e04 2025-11-20 02:56:17,232 - INFO - Verified VN network id 16 for VN d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,232 - INFO - Verifications in API Server for VN ctest-left_vn-45054403 passed 2025-11-20 02:56:17,232 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,242 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/35ef9024-1319-438c-af5c-1e31f9c22e04 2025-11-20 02:56:17,250 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/35ef9024-1319-438c-af5c-1e31f9c22e04 2025-11-20 02:56:17,257 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/5ac6c6af-9ca5-4afd-8b3f-f59f4de6b238 2025-11-20 02:56:17,272 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15275045748126404544', 'uuid-lslong': '13387135797511814768'}, 'enable': 'true', 'created': '2025-11-20T02:56:16', 'last-modified': '2025-11-20T02:56:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.395239'} 2025-11-20 02:56:17,277 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:17,283 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15275045748126404544', 'uuid-lslong': '13387135797511814768'}, 'enable': 'true', 'created': '2025-11-20T02:56:16', 'last-modified': '2025-11-20T02:56:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403838'} 2025-11-20 02:56:17,290 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:17,295 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15275045748126404544', 'uuid-lslong': '13387135797511814768'}, 'enable': 'true', 'created': '2025-11-20T02:56:16', 'last-modified': '2025-11-20T02:56:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414474'} 2025-11-20 02:56:17,302 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-20 02:56:17,302 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-45054403 passed 2025-11-20 02:56:17,302 - DEBUG - ====Verifying policy data for ctest-left_vn-45054403 in API_Server ====== 2025-11-20 02:56:17,302 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:17,309 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:17,319 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:17,414 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d3fbdd2d-60ea-4fc0-b9c8-a9146a9b7e70 2025-11-20 02:56:17,423 - DEBUG - =>VN ctest-left_vn-45054403 has no policy to be verified 2025-11-20 02:56:17,423 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:17,423 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:17,423 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:17,436 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403?flat'} 2025-11-20 02:56:17,436 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:17,436 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:17,449 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403?flat'} 2025-11-20 02:56:17,449 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:17,449 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:17,462 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403?flat'} 2025-11-20 02:56:17,462 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-left_vn-45054403 is found in opserver 2025-11-20 02:56:17,484 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:17,494 - DEBUG - VRF ids for VN ctest-left_vn-45054403: {} 2025-11-20 02:56:17,740 - DEBUG - Response for create_network : {'network': {'id': 'b3a005fb-eac9-4a50-a799-d2421301d348', 'name': 'ctest-right_vn-68986249', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-right_vn-68986249'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:56:17,954 - DEBUG - Response for create_subnet : {'subnet': {'id': '4ff5ce3d-bde2-40ba-b2df-bafaf5717d31', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': 'b3a005fb-eac9-4a50-a799-d2421301d348', 'ip_version': 4, 'cidr': '129.98.83.0/26', 'allocation_pools': [{'start': '129.98.83.2', 'end': '129.98.83.62'}], 'gateway_ip': '129.98.83.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '129.98.83.2', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:56:17,974 - INFO - Created VN ctest-right_vn-68986249 2025-11-20 02:56:17,985 - DEBUG - VN ctest-right_vn-68986249 UUID is b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,055 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:18,061 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:18,071 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:18,161 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,177 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,189 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ca72fe67-c2c8-4fc2-ab5e-1514410de9fc 2025-11-20 02:56:18,199 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ca72fe67-c2c8-4fc2-ab5e-1514410de9fc 2025-11-20 02:56:18,206 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/67fedeee-0c5f-41b5-a261-8d3d13da7d6c 2025-11-20 02:56:18,212 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:18,212 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,222 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ca72fe67-c2c8-4fc2-ab5e-1514410de9fc 2025-11-20 02:56:18,238 - INFO - Verified VN network id 17 for VN b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,239 - INFO - Verifications in API Server for VN ctest-right_vn-68986249 passed 2025-11-20 02:56:18,239 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,250 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ca72fe67-c2c8-4fc2-ab5e-1514410de9fc 2025-11-20 02:56:18,256 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ca72fe67-c2c8-4fc2-ab5e-1514410de9fc 2025-11-20 02:56:18,263 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/67fedeee-0c5f-41b5-a261-8d3d13da7d6c 2025-11-20 02:56:18,274 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12943351908596795984', 'uuid-lslong': '12076915056999256904'}, 'enable': 'true', 'created': '2025-11-20T02:56:17', 'last-modified': '2025-11-20T02:56:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393024'} 2025-11-20 02:56:18,281 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:18,286 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12943351908596795984', 'uuid-lslong': '12076915056999256904'}, 'enable': 'true', 'created': '2025-11-20T02:56:17', 'last-modified': '2025-11-20T02:56:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405872'} 2025-11-20 02:56:18,292 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:18,298 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12943351908596795984', 'uuid-lslong': '12076915056999256904'}, 'enable': 'true', 'created': '2025-11-20T02:56:17', 'last-modified': '2025-11-20T02:56:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412064'} 2025-11-20 02:56:18,303 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-20 02:56:18,304 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-68986249 passed 2025-11-20 02:56:18,304 - DEBUG - ====Verifying policy data for ctest-right_vn-68986249 in API_Server ====== 2025-11-20 02:56:18,304 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:18,310 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:18,320 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:18,415 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b3a005fb-eac9-4a50-a799-d2421301d348 2025-11-20 02:56:18,424 - DEBUG - =>VN ctest-right_vn-68986249 has no policy to be verified 2025-11-20 02:56:18,424 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:18,425 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:18,425 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:18,436 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249?flat'} 2025-11-20 02:56:18,436 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:18,436 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:18,454 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249?flat'} 2025-11-20 02:56:18,454 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:18,454 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:18,466 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249?flat'} 2025-11-20 02:56:18,466 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-right_vn-68986249 is found in opserver 2025-11-20 02:56:18,487 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:18,496 - DEBUG - VRF ids for VN ctest-right_vn-68986249: {} 2025-11-20 02:56:18,782 - DEBUG - Response for create_network : {'network': {'id': 'f7b870e1-c82c-4177-aa1f-6874bd162359', 'name': 'ctest-trans_left_vn-49991311', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-trans_left_vn-49991311'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:56:19,047 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f4cdca12-da20-4e34-9ada-94a6b558675e', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': 'f7b870e1-c82c-4177-aa1f-6874bd162359', 'ip_version': 4, 'cidr': '94.53.18.192/26', 'allocation_pools': [{'start': '94.53.18.194', 'end': '94.53.18.254'}], 'gateway_ip': '94.53.18.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '94.53.18.194', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:56:19,071 - INFO - Created VN ctest-trans_left_vn-49991311 2025-11-20 02:56:19,085 - DEBUG - VN ctest-trans_left_vn-49991311 UUID is f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,154 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:19,161 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:19,174 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:19,262 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,274 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,282 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/089b9ea3-87e3-418f-b526-21bd129d3e79 2025-11-20 02:56:19,289 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/089b9ea3-87e3-418f-b526-21bd129d3e79 2025-11-20 02:56:19,296 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/160afc3d-42da-42dc-8f25-369d6a7fd334 2025-11-20 02:56:19,303 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-20 02:56:19,303 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,313 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/089b9ea3-87e3-418f-b526-21bd129d3e79 2025-11-20 02:56:19,329 - INFO - Verified VN network id 18 for VN f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,329 - INFO - Verifications in API Server for VN ctest-trans_left_vn-49991311 passed 2025-11-20 02:56:19,329 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,338 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/089b9ea3-87e3-418f-b526-21bd129d3e79 2025-11-20 02:56:19,345 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/089b9ea3-87e3-418f-b526-21bd129d3e79 2025-11-20 02:56:19,353 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/160afc3d-42da-42dc-8f25-369d6a7fd334 2025-11-20 02:56:19,366 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17850141238111256951', 'uuid-lslong': '12258631561323619161'}, 'enable': 'true', 'created': '2025-11-20T02:56:18', 'last-modified': '2025-11-20T02:56:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387403'} 2025-11-20 02:56:19,372 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-20 02:56:19,377 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17850141238111256951', 'uuid-lslong': '12258631561323619161'}, 'enable': 'true', 'created': '2025-11-20T02:56:18', 'last-modified': '2025-11-20T02:56:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399847'} 2025-11-20 02:56:19,383 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-20 02:56:19,389 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17850141238111256951', 'uuid-lslong': '12258631561323619161'}, 'enable': 'true', 'created': '2025-11-20T02:56:18', 'last-modified': '2025-11-20T02:56:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415520'} 2025-11-20 02:56:19,394 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-20 02:56:19,395 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-49991311 passed 2025-11-20 02:56:19,395 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-49991311 in API_Server ====== 2025-11-20 02:56:19,395 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:19,401 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:19,413 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:19,514 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f7b870e1-c82c-4177-aa1f-6874bd162359 2025-11-20 02:56:19,529 - DEBUG - =>VN ctest-trans_left_vn-49991311 has no policy to be verified 2025-11-20 02:56:19,529 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:19,529 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:19,529 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:19,542 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311?flat'} 2025-11-20 02:56:19,542 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:19,542 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:19,559 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311?flat'} 2025-11-20 02:56:19,559 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:19,559 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:19,574 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311?flat'} 2025-11-20 02:56:19,574 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-trans_left_vn-49991311 is found in opserver 2025-11-20 02:56:19,597 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:19,607 - DEBUG - VRF ids for VN ctest-trans_left_vn-49991311: {} 2025-11-20 02:56:19,894 - DEBUG - Response for create_network : {'network': {'id': 'a1faf678-cc05-4ef1-b8a4-6bf3e82b763b', 'name': 'ctest-trans_right_vn-58541160', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'project_id': 'cad87164de88428aadd056d137769c53', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-45966624', 'ctest-trans_right_vn-58541160'], 'port_security_enabled': True, 'description': ''}} 2025-11-20 02:56:20,121 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fb7bf413-b6ff-4c1e-b558-d63f7fd50db8', 'name': '', 'tenant_id': 'cad87164de88428aadd056d137769c53', 'network_id': 'a1faf678-cc05-4ef1-b8a4-6bf3e82b763b', 'ip_version': 4, 'cidr': '197.69.59.64/26', 'allocation_pools': [{'start': '197.69.59.66', 'end': '197.69.59.126'}], 'gateway_ip': '197.69.59.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.69.59.66', 'tags': [], 'project_id': 'cad87164de88428aadd056d137769c53'}} 2025-11-20 02:56:20,146 - INFO - Created VN ctest-trans_right_vn-58541160 2025-11-20 02:56:20,157 - DEBUG - VN ctest-trans_right_vn-58541160 UUID is a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,236 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:20,242 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:20,252 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:20,346 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,357 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,365 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d8789f85-776f-46e2-87d6-4b5956d37353 2025-11-20 02:56:20,374 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d8789f85-776f-46e2-87d6-4b5956d37353 2025-11-20 02:56:20,380 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f6c820de-3f7a-4d36-b3d1-fcb74e71dbf4 2025-11-20 02:56:20,387 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-20 02:56:20,387 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,395 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d8789f85-776f-46e2-87d6-4b5956d37353 2025-11-20 02:56:20,410 - INFO - Verified VN network id 19 for VN a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,410 - INFO - Verifications in API Server for VN ctest-trans_right_vn-58541160 passed 2025-11-20 02:56:20,411 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,421 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d8789f85-776f-46e2-87d6-4b5956d37353 2025-11-20 02:56:20,429 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d8789f85-776f-46e2-87d6-4b5956d37353 2025-11-20 02:56:20,437 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f6c820de-3f7a-4d36-b3d1-fcb74e71dbf4 2025-11-20 02:56:20,455 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11671912382963470065', 'uuid-lslong': '13304877894475675195'}, 'enable': 'true', 'created': '2025-11-20T02:56:19', 'last-modified': '2025-11-20T02:56:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390540'} 2025-11-20 02:56:20,461 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-20 02:56:20,466 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11671912382963470065', 'uuid-lslong': '13304877894475675195'}, 'enable': 'true', 'created': '2025-11-20T02:56:19', 'last-modified': '2025-11-20T02:56:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402667'} 2025-11-20 02:56:20,473 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-20 02:56:20,479 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-45966624', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11671912382963470065', 'uuid-lslong': '13304877894475675195'}, 'enable': 'true', 'created': '2025-11-20T02:56:19', 'last-modified': '2025-11-20T02:56:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406543'} 2025-11-20 02:56:20,485 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-20 02:56:20,485 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-58541160 passed 2025-11-20 02:56:20,486 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-58541160 in API_Server ====== 2025-11-20 02:56:20,486 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:20,492 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:20,504 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:20,601 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a1faf678-cc05-4ef1-b8a4-6bf3e82b763b 2025-11-20 02:56:20,612 - DEBUG - =>VN ctest-trans_right_vn-58541160 has no policy to be verified 2025-11-20 02:56:20,612 - DEBUG - Verifying the vn in opserver 2025-11-20 02:56:20,612 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160 virtual network link through opserver 10.0.0.23 2025-11-20 02:56:20,612 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-20 02:56:20,624 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160?flat'} 2025-11-20 02:56:20,624 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160 virtual network link through opserver 10.0.0.50 2025-11-20 02:56:20,624 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-20 02:56:20,637 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160?flat'} 2025-11-20 02:56:20,637 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160 virtual network link through opserver 10.0.0.22 2025-11-20 02:56:20,637 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-20 02:56:20,657 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160?flat'} 2025-11-20 02:56:20,657 - INFO - Validated that VN default-domain:ctest-TestSvcHC-45966624:ctest-trans_right_vn-58541160 is found in opserver 2025-11-20 02:56:20,678 - DEBUG - Do not have enough data to verify VN in agent 2025-11-20 02:56:20,688 - DEBUG - VRF ids for VN ctest-trans_right_vn-58541160: {} 2025-11-20 02:56:21,759 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-1) 2025-11-20 02:56:23,004 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4768-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4768-2) 2025-11-20 02:56:23,004 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-94298800'] 2025-11-20 02:56:23,287 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-94298800'] created succesfully 2025-11-20 02:56:23,685 - DEBUG - Image by name tiny_trans_fw not found 2025-11-20 02:56:23,685 - DEBUG - Installing image tiny_trans_fw 2025-11-20 02:56:23,685 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-20 02:56:23,685 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-20 02:56:23,685 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-20 02:56:23,686 - DEBUG - Unzip image 2025-11-20 02:56:23,686 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-20 02:56:23,705 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-20 02:56:23,706 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-94298800'] 2025-11-20 02:56:23,816 - INFO - Service template: ['default-domain', 'ctest-service_template_1-94298800'] deleted successfully. 2025-11-20 02:56:23,817 - INFO - Skip interface_detach for VM ctest-right_vm-94979802 in state BUILD 2025-11-20 02:56:23,817 - INFO - Deleting VM ctest-right_vm-94979802 2025-11-20 02:56:23,817 - ERROR - VM ctest-right_vm-94979802 has failed to come up 2025-11-20 02:56:23,817 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:23,817 - ERROR - VM ctest-right_vm-94979802 has failed to come up 2025-11-20 02:56:23,817 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:23,933 - INFO - Skip interface_detach for VM ctest-left_vm-75858172 in state BUILD 2025-11-20 02:56:23,933 - INFO - Deleting VM ctest-left_vm-75858172 2025-11-20 02:56:23,933 - ERROR - VM ctest-left_vm-75858172 has failed to come up 2025-11-20 02:56:23,933 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:23,933 - ERROR - VM ctest-left_vm-75858172 has failed to come up 2025-11-20 02:56:23,933 - ERROR - Nova failed to get host of the VM 2025-11-20 02:56:24,018 - INFO - Deleting VN ctest-trans_right_vn-58541160 2025-11-20 02:56:24,199 - DEBUG - Response for deleting network () 2025-11-20 02:56:24,199 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d8789f85-776f-46e2-87d6-4b5956d37353 2025-11-20 02:56:24,208 - DEBUG - Response Code: 404 2025-11-20 02:56:24,208 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:24,215 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:24,274 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:24,372 - INFO - Validated that VN ctest-trans_right_vn-58541160 is not found in API Server 2025-11-20 02:56:24,386 - DEBUG - VN ctest-trans_right_vn-58541160 is not present in Agent 10.0.0.131 2025-11-20 02:56:24,409 - DEBUG - VN ctest-trans_right_vn-58541160 is not present in Agent 10.0.0.48 2025-11-20 02:56:24,410 - INFO - Validated that VN ctest-trans_right_vn-58541160 is not in any agent 2025-11-20 02:56:24,471 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-58541160 info 2025-11-20 02:56:24,471 - INFO - Deleting VN ctest-trans_left_vn-49991311 2025-11-20 02:56:24,617 - DEBUG - Response for deleting network () 2025-11-20 02:56:24,618 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/089b9ea3-87e3-418f-b526-21bd129d3e79 2025-11-20 02:56:24,624 - DEBUG - Response Code: 404 2025-11-20 02:56:24,624 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:24,635 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:24,658 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:24,762 - INFO - Validated that VN ctest-trans_left_vn-49991311 is not found in API Server 2025-11-20 02:56:24,793 - DEBUG - VN ctest-trans_left_vn-49991311 is not present in Agent 10.0.0.131 2025-11-20 02:56:24,828 - DEBUG - VN ctest-trans_left_vn-49991311 is not present in Agent 10.0.0.48 2025-11-20 02:56:24,828 - INFO - Validated that VN ctest-trans_left_vn-49991311 is not in any agent 2025-11-20 02:56:24,887 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-49991311 info 2025-11-20 02:56:24,887 - INFO - Deleting VN ctest-right_vn-68986249 2025-11-20 02:56:24,952 - DEBUG - VN b3a005fb-eac9-4a50-a799-d2421301d348 still in use: Unable to complete operation on network b3a005fb-eac9-4a50-a799-d2421301d348. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6012fa97-88ff-4fb1-bb34-1146084fcbcb'] 2025-11-20 02:56:24,953 - WARNING - Deleting VN ctest-right_vn-68986249 failed..Will retry 2025-11-20 02:56:27,097 - DEBUG - Response for deleting network () 2025-11-20 02:56:27,097 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ca72fe67-c2c8-4fc2-ab5e-1514410de9fc 2025-11-20 02:56:27,113 - DEBUG - Response Code: 404 2025-11-20 02:56:27,113 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:27,121 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:27,133 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:27,220 - INFO - Validated that VN ctest-right_vn-68986249 is not found in API Server 2025-11-20 02:56:27,232 - DEBUG - VN ctest-right_vn-68986249 is not present in Agent 10.0.0.131 2025-11-20 02:56:27,241 - DEBUG - VN ctest-right_vn-68986249 is not present in Agent 10.0.0.48 2025-11-20 02:56:27,241 - INFO - Validated that VN ctest-right_vn-68986249 is not in any agent 2025-11-20 02:56:27,272 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-68986249 info 2025-11-20 02:56:27,272 - INFO - Deleting VN ctest-left_vn-45054403 2025-11-20 02:56:27,482 - DEBUG - Response for deleting network () 2025-11-20 02:56:27,482 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/35ef9024-1319-438c-af5c-1e31f9c22e04 2025-11-20 02:56:27,489 - DEBUG - Response Code: 404 2025-11-20 02:56:27,489 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:27,496 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:27,550 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:27,653 - INFO - Validated that VN ctest-left_vn-45054403 is not found in API Server 2025-11-20 02:56:27,665 - DEBUG - VN ctest-left_vn-45054403 is not present in Agent 10.0.0.131 2025-11-20 02:56:27,673 - DEBUG - VN ctest-left_vn-45054403 is not present in Agent 10.0.0.48 2025-11-20 02:56:27,673 - INFO - Validated that VN ctest-left_vn-45054403 is not in any agent 2025-11-20 02:56:27,705 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-45054403 info 2025-11-20 02:56:27,705 - INFO - Deleting VN ctest-mgmt_vn-98889324 2025-11-20 02:56:27,870 - DEBUG - Response for deleting network () 2025-11-20 02:56:27,870 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d532e057-cb9d-4465-82cb-852331405370 2025-11-20 02:56:27,881 - DEBUG - Response Code: 404 2025-11-20 02:56:27,881 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-11-20 02:56:27,887 - DEBUG - Requesting: http://10.0.0.23:8082/domain/785d7fdc-4b61-45a1-9add-76a6d523389b 2025-11-20 02:56:27,903 - DEBUG - Requesting: http://10.0.0.23:8082/project/cad87164-de88-428a-add0-56d137769c53 2025-11-20 02:56:28,025 - INFO - Validated that VN ctest-mgmt_vn-98889324 is not found in API Server 2025-11-20 02:56:28,036 - DEBUG - VN ctest-mgmt_vn-98889324 is not present in Agent 10.0.0.131 2025-11-20 02:56:28,046 - DEBUG - VN ctest-mgmt_vn-98889324 is not present in Agent 10.0.0.48 2025-11-20 02:56:28,046 - INFO - Validated that VN ctest-mgmt_vn-98889324 is not in any agent 2025-11-20 02:56:28,080 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-98889324 info 2025-11-20 02:56:29,341 - DEBUG - No XMPP flaps were noticed during the test 2025-11-20 02:56:29,341 - INFO - 2025-11-20 02:56:29,341 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2025-11-20 02:56:29,342 - INFO - -------------------------------------------------------------------------------- 2025-11-20 02:56:30,055 - INFO - Deleted project: ctest-TestSvcHC-45966624, ID : cad87164-de88-428a-add0-56d137769c53