2025-10-13 03:06:40,642 - INFO - Domain Default found not creating 2025-10-13 03:06:40,799 - INFO - Project ctest-TestSvcHC-20374590 not found, creating it 2025-10-13 03:06:41,316 - INFO - Created Project:ctest-TestSvcHC-20374590, ID : 56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:42,753 - INFO - ================================================================================ 2025-10-13 03:06:42,754 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-13 03:06:44,012 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.27': {'10.20.0.18': '0', '10.20.0.129': '0'}} with 2025-10-13 03:06:44,013 - INFO - Initial checks done. Running the testcase now 2025-10-13 03:06:44,013 - INFO - 2025-10-13 03:06:44,750 - DEBUG - Response for create_network : {'network': {'id': '363030db-7368-4887-89a7-10f931e03771', 'name': 'ctest-mgmt_vn-23418103', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-mgmt_vn-23418103'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:06:45,013 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a609cb9f-cd29-46fa-872c-d63d68a45965', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': '363030db-7368-4887-89a7-10f931e03771', 'ip_version': 4, 'cidr': '114.185.220.192/26', 'allocation_pools': [{'start': '114.185.220.194', 'end': '114.185.220.254'}], 'gateway_ip': '114.185.220.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '114.185.220.194', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:06:45,035 - INFO - Created VN ctest-mgmt_vn-23418103 2025-10-13 03:06:45,051 - DEBUG - VN ctest-mgmt_vn-23418103 UUID is 363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,113 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:45,433 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:45,461 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:45,476 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:45,569 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,581 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,590 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/6fd8488c-3760-49c7-81f8-e9e506b00a01 2025-10-13 03:06:45,598 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/6fd8488c-3760-49c7-81f8-e9e506b00a01 2025-10-13 03:06:45,604 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/edff182b-74bf-4a79-80d4-e99ef81fa7d4 2025-10-13 03:06:45,610 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:45,610 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,617 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/6fd8488c-3760-49c7-81f8-e9e506b00a01 2025-10-13 03:06:45,630 - INFO - Verified VN network id 13 for VN 363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,630 - INFO - Verifications in API Server for VN ctest-mgmt_vn-23418103 passed 2025-10-13 03:06:45,630 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,638 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/6fd8488c-3760-49c7-81f8-e9e506b00a01 2025-10-13 03:06:45,644 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/6fd8488c-3760-49c7-81f8-e9e506b00a01 2025-10-13 03:06:45,650 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/edff182b-74bf-4a79-80d4-e99ef81fa7d4 2025-10-13 03:06:45,660 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3904674596022405255', 'uuid-lslong': '9918915366776485745'}, 'enable': 'true', 'created': '2025-10-13T03:06:44', 'last-modified': '2025-10-13T03:06:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.697200'} 2025-10-13 03:06:45,665 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:45,670 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3904674596022405255', 'uuid-lslong': '9918915366776485745'}, 'enable': 'true', 'created': '2025-10-13T03:06:44', 'last-modified': '2025-10-13T03:06:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.708300'} 2025-10-13 03:06:45,675 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:45,680 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3904674596022405255', 'uuid-lslong': '9918915366776485745'}, 'enable': 'true', 'created': '2025-10-13T03:06:44', 'last-modified': '2025-10-13T03:06:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.718457'} 2025-10-13 03:06:45,685 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:45,685 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-23418103 passed 2025-10-13 03:06:45,686 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-23418103 in API_Server ====== 2025-10-13 03:06:45,686 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:45,691 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:45,700 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:45,787 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/363030db-7368-4887-89a7-10f931e03771 2025-10-13 03:06:45,795 - DEBUG - =>VN ctest-mgmt_vn-23418103 has no policy to be verified 2025-10-13 03:06:45,795 - DEBUG - Verifying the vn in opserver 2025-10-13 03:06:45,795 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103 virtual network link through opserver 10.0.0.22 2025-10-13 03:06:45,795 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:06:46,087 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:06:46,142 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103?flat'} 2025-10-13 03:06:46,142 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103 virtual network link through opserver 10.0.0.19 2025-10-13 03:06:46,142 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:06:46,435 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:06:46,487 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103?flat'} 2025-10-13 03:06:46,487 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103 virtual network link through opserver 10.0.0.41 2025-10-13 03:06:46,487 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:06:46,780 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:06:46,834 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103?flat'} 2025-10-13 03:06:46,834 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-23418103 is found in opserver 2025-10-13 03:06:46,853 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:06:46,862 - DEBUG - VRF ids for VN ctest-mgmt_vn-23418103: {} 2025-10-13 03:06:47,120 - DEBUG - Response for create_network : {'network': {'id': 'b12cfd96-0786-45d5-8f75-89a3c1004f1f', 'name': 'ctest-left_vn-83899247', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-left_vn-83899247'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:06:47,316 - DEBUG - Response for create_subnet : {'subnet': {'id': '0c3407c8-382c-461c-b695-6eb4bf7d1e11', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': 'b12cfd96-0786-45d5-8f75-89a3c1004f1f', 'ip_version': 4, 'cidr': '186.145.177.0/26', 'allocation_pools': [{'start': '186.145.177.2', 'end': '186.145.177.62'}], 'gateway_ip': '186.145.177.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.145.177.2', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:06:47,337 - INFO - Created VN ctest-left_vn-83899247 2025-10-13 03:06:47,348 - DEBUG - VN ctest-left_vn-83899247 UUID is b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,425 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:47,437 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:47,449 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:47,542 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,554 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,562 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c123ea0b-51f8-4c54-bc03-46c7e8272ed7 2025-10-13 03:06:47,570 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c123ea0b-51f8-4c54-bc03-46c7e8272ed7 2025-10-13 03:06:47,576 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/e101e094-85db-4874-b40b-f90627b2cfb8 2025-10-13 03:06:47,581 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:47,582 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,589 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c123ea0b-51f8-4c54-bc03-46c7e8272ed7 2025-10-13 03:06:47,604 - INFO - Verified VN network id 14 for VN b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,604 - INFO - Verifications in API Server for VN ctest-left_vn-83899247 passed 2025-10-13 03:06:47,604 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,613 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c123ea0b-51f8-4c54-bc03-46c7e8272ed7 2025-10-13 03:06:47,620 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c123ea0b-51f8-4c54-bc03-46c7e8272ed7 2025-10-13 03:06:47,626 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/e101e094-85db-4874-b40b-f90627b2cfb8 2025-10-13 03:06:47,639 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12766857864501675477', 'uuid-lslong': '10337319856109539103'}, 'enable': 'true', 'created': '2025-10-13T03:06:47', 'last-modified': '2025-10-13T03:06:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.370051'} 2025-10-13 03:06:47,646 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:47,651 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12766857864501675477', 'uuid-lslong': '10337319856109539103'}, 'enable': 'true', 'created': '2025-10-13T03:06:47', 'last-modified': '2025-10-13T03:06:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374883'} 2025-10-13 03:06:47,656 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:47,661 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12766857864501675477', 'uuid-lslong': '10337319856109539103'}, 'enable': 'true', 'created': '2025-10-13T03:06:47', 'last-modified': '2025-10-13T03:06:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392318'} 2025-10-13 03:06:47,666 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:47,666 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-83899247 passed 2025-10-13 03:06:47,666 - DEBUG - ====Verifying policy data for ctest-left_vn-83899247 in API_Server ====== 2025-10-13 03:06:47,666 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:47,672 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:47,682 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:47,773 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/b12cfd96-0786-45d5-8f75-89a3c1004f1f 2025-10-13 03:06:47,787 - DEBUG - =>VN ctest-left_vn-83899247 has no policy to be verified 2025-10-13 03:06:47,787 - DEBUG - Verifying the vn in opserver 2025-10-13 03:06:47,787 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247 virtual network link through opserver 10.0.0.22 2025-10-13 03:06:47,787 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:06:47,841 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247?flat'} 2025-10-13 03:06:47,841 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247 virtual network link through opserver 10.0.0.19 2025-10-13 03:06:47,841 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:06:47,898 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247?flat'} 2025-10-13 03:06:47,898 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247 virtual network link through opserver 10.0.0.41 2025-10-13 03:06:47,898 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:06:47,946 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247?flat'} 2025-10-13 03:06:47,946 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-83899247 is found in opserver 2025-10-13 03:06:47,964 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:06:47,973 - DEBUG - VRF ids for VN ctest-left_vn-83899247: {} 2025-10-13 03:06:48,215 - DEBUG - Response for create_network : {'network': {'id': '96116e53-603d-4a41-a45c-921f29984c86', 'name': 'ctest-right_vn-38117685', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-right_vn-38117685'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:06:48,478 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd8087db4-ebd3-4b88-ad77-ad7df0c1a1f0', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': '96116e53-603d-4a41-a45c-921f29984c86', 'ip_version': 4, 'cidr': '219.91.160.128/26', 'allocation_pools': [{'start': '219.91.160.130', 'end': '219.91.160.190'}], 'gateway_ip': '219.91.160.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.91.160.130', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:06:48,498 - INFO - Created VN ctest-right_vn-38117685 2025-10-13 03:06:48,508 - DEBUG - VN ctest-right_vn-38117685 UUID is 96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,572 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:48,578 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:48,587 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:48,677 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,686 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,695 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/25626286-d97e-47c2-a1d4-6313c6e62eee 2025-10-13 03:06:48,701 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/25626286-d97e-47c2-a1d4-6313c6e62eee 2025-10-13 03:06:48,706 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/62b00eab-1b5f-41d3-9172-4f00145930ef 2025-10-13 03:06:48,712 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:06:48,712 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,721 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/25626286-d97e-47c2-a1d4-6313c6e62eee 2025-10-13 03:06:48,735 - INFO - Verified VN network id 15 for VN 96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,735 - INFO - Verifications in API Server for VN ctest-right_vn-38117685 passed 2025-10-13 03:06:48,735 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,746 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/25626286-d97e-47c2-a1d4-6313c6e62eee 2025-10-13 03:06:48,752 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/25626286-d97e-47c2-a1d4-6313c6e62eee 2025-10-13 03:06:48,759 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/62b00eab-1b5f-41d3-9172-4f00145930ef 2025-10-13 03:06:48,771 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10813545484669241921', 'uuid-lslong': '11843501782617050246'}, 'enable': 'true', 'created': '2025-10-13T03:06:48', 'last-modified': '2025-10-13T03:06:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.347276'} 2025-10-13 03:06:48,776 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:06:48,783 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10813545484669241921', 'uuid-lslong': '11843501782617050246'}, 'enable': 'true', 'created': '2025-10-13T03:06:48', 'last-modified': '2025-10-13T03:06:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.349365'} 2025-10-13 03:06:48,788 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:06:48,793 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10813545484669241921', 'uuid-lslong': '11843501782617050246'}, 'enable': 'true', 'created': '2025-10-13T03:06:48', 'last-modified': '2025-10-13T03:06:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.373569'} 2025-10-13 03:06:48,798 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:06:48,798 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-38117685 passed 2025-10-13 03:06:48,798 - DEBUG - ====Verifying policy data for ctest-right_vn-38117685 in API_Server ====== 2025-10-13 03:06:48,798 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:48,804 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:48,816 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:48,906 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/96116e53-603d-4a41-a45c-921f29984c86 2025-10-13 03:06:48,915 - DEBUG - =>VN ctest-right_vn-38117685 has no policy to be verified 2025-10-13 03:06:48,915 - DEBUG - Verifying the vn in opserver 2025-10-13 03:06:48,915 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685 virtual network link through opserver 10.0.0.22 2025-10-13 03:06:48,915 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:06:48,966 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685?flat'} 2025-10-13 03:06:48,966 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685 virtual network link through opserver 10.0.0.19 2025-10-13 03:06:48,966 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:06:49,024 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685?flat'} 2025-10-13 03:06:49,024 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685 virtual network link through opserver 10.0.0.41 2025-10-13 03:06:49,024 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:06:49,088 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685?flat'} 2025-10-13 03:06:49,088 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-38117685 is found in opserver 2025-10-13 03:06:49,109 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:06:49,119 - DEBUG - VRF ids for VN ctest-right_vn-38117685: {} 2025-10-13 03:06:49,169 - DEBUG - Services list from nova: [, , , ] 2025-10-13 03:06:50,148 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-1) 2025-10-13 03:06:51,350 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-2) 2025-10-13 03:06:51,350 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-09632016'] 2025-10-13 03:06:51,651 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09632016'] created succesfully 2025-10-13 03:06:52,003 - DEBUG - Image by name tiny_nat_fw not found 2025-10-13 03:06:52,003 - DEBUG - Installing image tiny_nat_fw 2025-10-13 03:06:52,003 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-13 03:06:52,003 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-13 03:06:52,003 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-13 03:06:52,003 - DEBUG - Unzip image 2025-10-13 03:06:52,003 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-13 03:06:52,029 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-13 03:06:52,029 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-09632016'] 2025-10-13 03:06:52,120 - INFO - Service template: ['default-domain', 'ctest-service_template_1-09632016'] deleted successfully. 2025-10-13 03:06:52,120 - INFO - Skip interface_detach for VM ctest-right_vm-43898125 in state BUILD 2025-10-13 03:06:52,120 - INFO - Deleting VM ctest-right_vm-43898125 2025-10-13 03:06:52,171 - ERROR - VM ctest-right_vm-43898125 has failed to come up 2025-10-13 03:06:52,172 - ERROR - Nova failed to get host of the VM 2025-10-13 03:06:52,172 - ERROR - VM ctest-right_vm-43898125 has failed to come up 2025-10-13 03:06:52,172 - ERROR - Nova failed to get host of the VM 2025-10-13 03:06:52,262 - INFO - Skip interface_detach for VM ctest-left_vm-24647455 in state BUILD 2025-10-13 03:06:52,262 - INFO - Deleting VM ctest-left_vm-24647455 2025-10-13 03:06:52,262 - ERROR - VM ctest-left_vm-24647455 has failed to come up 2025-10-13 03:06:52,263 - ERROR - Nova failed to get host of the VM 2025-10-13 03:06:52,263 - ERROR - VM ctest-left_vm-24647455 has failed to come up 2025-10-13 03:06:52,263 - ERROR - Nova failed to get host of the VM 2025-10-13 03:06:52,326 - INFO - Deleting VN ctest-right_vn-38117685 2025-10-13 03:06:52,369 - DEBUG - VN 96116e53-603d-4a41-a45c-921f29984c86 still in use: Unable to complete operation on network 96116e53-603d-4a41-a45c-921f29984c86. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a58bf959-b907-4d52-b3e4-dfc041150620'] 2025-10-13 03:06:52,369 - WARNING - Deleting VN ctest-right_vn-38117685 failed..Will retry 2025-10-13 03:06:54,549 - DEBUG - Response for deleting network () 2025-10-13 03:06:54,550 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/25626286-d97e-47c2-a1d4-6313c6e62eee 2025-10-13 03:06:54,559 - DEBUG - Response Code: 404 2025-10-13 03:06:54,559 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:54,584 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:54,603 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:54,701 - INFO - Validated that VN ctest-right_vn-38117685 is not found in API Server 2025-10-13 03:06:54,710 - DEBUG - VN ctest-right_vn-38117685 is not present in Agent 10.0.0.249 2025-10-13 03:06:54,719 - DEBUG - VN ctest-right_vn-38117685 is not present in Agent 10.0.0.27 2025-10-13 03:06:54,719 - INFO - Validated that VN ctest-right_vn-38117685 is not in any agent 2025-10-13 03:06:54,744 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-38117685 info 2025-10-13 03:06:54,744 - INFO - Deleting VN ctest-left_vn-83899247 2025-10-13 03:06:54,879 - DEBUG - Response for deleting network () 2025-10-13 03:06:54,879 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c123ea0b-51f8-4c54-bc03-46c7e8272ed7 2025-10-13 03:06:54,887 - DEBUG - Response Code: 404 2025-10-13 03:06:54,887 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:54,896 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:54,949 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:55,034 - INFO - Validated that VN ctest-left_vn-83899247 is not found in API Server 2025-10-13 03:06:55,046 - DEBUG - VN ctest-left_vn-83899247 is not present in Agent 10.0.0.249 2025-10-13 03:06:55,056 - DEBUG - VN ctest-left_vn-83899247 is not present in Agent 10.0.0.27 2025-10-13 03:06:55,056 - INFO - Validated that VN ctest-left_vn-83899247 is not in any agent 2025-10-13 03:06:55,081 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-83899247 info 2025-10-13 03:06:55,081 - INFO - Deleting VN ctest-mgmt_vn-23418103 2025-10-13 03:06:55,225 - DEBUG - Response for deleting network () 2025-10-13 03:06:55,225 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/6fd8488c-3760-49c7-81f8-e9e506b00a01 2025-10-13 03:06:55,231 - DEBUG - Response Code: 404 2025-10-13 03:06:55,232 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:55,237 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:55,249 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:55,334 - INFO - Validated that VN ctest-mgmt_vn-23418103 is not found in API Server 2025-10-13 03:06:55,344 - DEBUG - VN ctest-mgmt_vn-23418103 is not present in Agent 10.0.0.249 2025-10-13 03:06:55,353 - DEBUG - VN ctest-mgmt_vn-23418103 is not present in Agent 10.0.0.27 2025-10-13 03:06:55,353 - INFO - Validated that VN ctest-mgmt_vn-23418103 is not in any agent 2025-10-13 03:06:55,380 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-23418103 info 2025-10-13 03:06:56,636 - DEBUG - No XMPP flaps were noticed during the test 2025-10-13 03:06:56,636 - INFO -

2025-10-13 03:06:56,636 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14]

2025-10-13 03:06:56,636 - INFO - -------------------------------------------------------------------------------- 2025-10-13 03:06:56,639 - INFO - ================================================================================ 2025-10-13 03:06:56,639 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-13 03:06:57,911 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.27': {'10.20.0.18': '0', '10.20.0.129': '0'}} with 2025-10-13 03:06:57,912 - INFO - Initial checks done. Running the testcase now 2025-10-13 03:06:57,912 - INFO - 2025-10-13 03:06:58,165 - DEBUG - Response for create_network : {'network': {'id': 'eb49b484-e5bc-459f-915f-44d5bf655f0b', 'name': 'ctest-mgmt_vn-84457856', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-mgmt_vn-84457856'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:06:58,408 - DEBUG - Response for create_subnet : {'subnet': {'id': '5add5ee8-7007-4360-bcf3-e4c8555ee0f8', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': 'eb49b484-e5bc-459f-915f-44d5bf655f0b', 'ip_version': 4, 'cidr': '56.161.125.128/26', 'allocation_pools': [{'start': '56.161.125.130', 'end': '56.161.125.190'}], 'gateway_ip': '56.161.125.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.161.125.130', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:06:58,428 - INFO - Created VN ctest-mgmt_vn-84457856 2025-10-13 03:06:58,439 - DEBUG - VN ctest-mgmt_vn-84457856 UUID is eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,510 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:58,515 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:58,524 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:58,618 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,636 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,645 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/a1dea96e-3aeb-455d-a2cf-2f918a7457e2 2025-10-13 03:06:58,653 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/a1dea96e-3aeb-455d-a2cf-2f918a7457e2 2025-10-13 03:06:58,659 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/35728635-5f61-4058-864d-6b83b3f08e07 2025-10-13 03:06:58,665 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:58,665 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,672 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/a1dea96e-3aeb-455d-a2cf-2f918a7457e2 2025-10-13 03:06:58,687 - INFO - Verified VN network id 13 for VN eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,687 - INFO - Verifications in API Server for VN ctest-mgmt_vn-84457856 passed 2025-10-13 03:06:58,687 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,697 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/a1dea96e-3aeb-455d-a2cf-2f918a7457e2 2025-10-13 03:06:58,704 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/a1dea96e-3aeb-455d-a2cf-2f918a7457e2 2025-10-13 03:06:58,711 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/35728635-5f61-4058-864d-6b83b3f08e07 2025-10-13 03:06:58,722 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16954280755095946655', 'uuid-lslong': '10475166943116877579'}, 'enable': 'true', 'created': '2025-10-13T03:06:58', 'last-modified': '2025-10-13T03:06:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.363867'} 2025-10-13 03:06:58,728 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:58,732 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16954280755095946655', 'uuid-lslong': '10475166943116877579'}, 'enable': 'true', 'created': '2025-10-13T03:06:58', 'last-modified': '2025-10-13T03:06:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.369518'} 2025-10-13 03:06:58,738 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:58,743 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16954280755095946655', 'uuid-lslong': '10475166943116877579'}, 'enable': 'true', 'created': '2025-10-13T03:06:58', 'last-modified': '2025-10-13T03:06:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385810'} 2025-10-13 03:06:58,749 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:06:58,749 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-84457856 passed 2025-10-13 03:06:58,749 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-84457856 in API_Server ====== 2025-10-13 03:06:58,749 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:58,754 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:58,764 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:58,856 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/eb49b484-e5bc-459f-915f-44d5bf655f0b 2025-10-13 03:06:58,865 - DEBUG - =>VN ctest-mgmt_vn-84457856 has no policy to be verified 2025-10-13 03:06:58,865 - DEBUG - Verifying the vn in opserver 2025-10-13 03:06:58,865 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856 virtual network link through opserver 10.0.0.22 2025-10-13 03:06:58,865 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:06:58,876 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856?flat'} 2025-10-13 03:06:58,876 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856 virtual network link through opserver 10.0.0.19 2025-10-13 03:06:58,876 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:06:58,886 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856?flat'} 2025-10-13 03:06:58,886 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856 virtual network link through opserver 10.0.0.41 2025-10-13 03:06:58,886 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:06:58,898 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856?flat'} 2025-10-13 03:06:58,898 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-mgmt_vn-84457856 is found in opserver 2025-10-13 03:06:58,917 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:06:58,925 - DEBUG - VRF ids for VN ctest-mgmt_vn-84457856: {} 2025-10-13 03:06:59,182 - DEBUG - Response for create_network : {'network': {'id': '37365867-76ba-4b4d-8e36-2478edaef7dd', 'name': 'ctest-left_vn-76005180', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-left_vn-76005180'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:06:59,417 - DEBUG - Response for create_subnet : {'subnet': {'id': '98fdef15-e97d-4c14-bd8e-69143a8f6362', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': '37365867-76ba-4b4d-8e36-2478edaef7dd', 'ip_version': 4, 'cidr': '136.184.138.64/26', 'allocation_pools': [{'start': '136.184.138.66', 'end': '136.184.138.126'}], 'gateway_ip': '136.184.138.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.184.138.66', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:06:59,437 - INFO - Created VN ctest-left_vn-76005180 2025-10-13 03:06:59,449 - DEBUG - VN ctest-left_vn-76005180 UUID is 37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,511 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:59,518 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:59,527 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:59,609 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,624 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,632 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2c10b344-908b-4b9c-b3e0-41409c2df3af 2025-10-13 03:06:59,639 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2c10b344-908b-4b9c-b3e0-41409c2df3af 2025-10-13 03:06:59,647 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/e967fb60-da59-4544-9f68-92baf6ee7495 2025-10-13 03:06:59,655 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:59,655 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,663 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2c10b344-908b-4b9c-b3e0-41409c2df3af 2025-10-13 03:06:59,679 - INFO - Verified VN network id 14 for VN 37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,679 - INFO - Verifications in API Server for VN ctest-left_vn-76005180 passed 2025-10-13 03:06:59,679 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,687 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2c10b344-908b-4b9c-b3e0-41409c2df3af 2025-10-13 03:06:59,693 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2c10b344-908b-4b9c-b3e0-41409c2df3af 2025-10-13 03:06:59,700 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/e967fb60-da59-4544-9f68-92baf6ee7495 2025-10-13 03:06:59,711 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3978464522225208141', 'uuid-lslong': '10247418103930484701'}, 'enable': 'true', 'created': '2025-10-13T03:06:59', 'last-modified': '2025-10-13T03:06:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.339339'} 2025-10-13 03:06:59,716 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:59,721 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3978464522225208141', 'uuid-lslong': '10247418103930484701'}, 'enable': 'true', 'created': '2025-10-13T03:06:59', 'last-modified': '2025-10-13T03:06:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.352763'} 2025-10-13 03:06:59,726 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:59,730 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3978464522225208141', 'uuid-lslong': '10247418103930484701'}, 'enable': 'true', 'created': '2025-10-13T03:06:59', 'last-modified': '2025-10-13T03:06:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.359066'} 2025-10-13 03:06:59,735 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:06:59,735 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-76005180 passed 2025-10-13 03:06:59,736 - DEBUG - ====Verifying policy data for ctest-left_vn-76005180 in API_Server ====== 2025-10-13 03:06:59,736 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:06:59,741 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:06:59,752 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:06:59,839 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/37365867-76ba-4b4d-8e36-2478edaef7dd 2025-10-13 03:06:59,851 - DEBUG - =>VN ctest-left_vn-76005180 has no policy to be verified 2025-10-13 03:06:59,851 - DEBUG - Verifying the vn in opserver 2025-10-13 03:06:59,851 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180 virtual network link through opserver 10.0.0.22 2025-10-13 03:06:59,851 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:06:59,861 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180?flat'} 2025-10-13 03:06:59,861 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180 virtual network link through opserver 10.0.0.19 2025-10-13 03:06:59,861 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:06:59,872 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180?flat'} 2025-10-13 03:06:59,872 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180 virtual network link through opserver 10.0.0.41 2025-10-13 03:06:59,872 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:06:59,884 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180?flat'} 2025-10-13 03:06:59,884 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-left_vn-76005180 is found in opserver 2025-10-13 03:06:59,902 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:06:59,912 - DEBUG - VRF ids for VN ctest-left_vn-76005180: {} 2025-10-13 03:07:00,228 - DEBUG - Response for create_network : {'network': {'id': 'f5a084bb-dd5e-485c-833e-1b145b9fec16', 'name': 'ctest-right_vn-01318334', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-right_vn-01318334'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:00,453 - DEBUG - Response for create_subnet : {'subnet': {'id': '0ef14e5f-30d4-413c-aa8f-b1326c3ce063', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': 'f5a084bb-dd5e-485c-833e-1b145b9fec16', 'ip_version': 4, 'cidr': '199.193.187.64/26', 'allocation_pools': [{'start': '199.193.187.66', 'end': '199.193.187.126'}], 'gateway_ip': '199.193.187.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '199.193.187.66', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:07:00,480 - INFO - Created VN ctest-right_vn-01318334 2025-10-13 03:07:00,491 - DEBUG - VN ctest-right_vn-01318334 UUID is f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,557 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:00,563 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:00,572 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:00,660 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,675 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,684 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/484bca1a-42b9-42c9-922d-badbbe9ec50c 2025-10-13 03:07:00,692 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/484bca1a-42b9-42c9-922d-badbbe9ec50c 2025-10-13 03:07:00,699 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/dc0d5041-b568-47df-98d4-5fd8e616dd54 2025-10-13 03:07:00,706 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:00,706 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,715 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/484bca1a-42b9-42c9-922d-badbbe9ec50c 2025-10-13 03:07:00,732 - INFO - Verified VN network id 15 for VN f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,732 - INFO - Verifications in API Server for VN ctest-right_vn-01318334 passed 2025-10-13 03:07:00,732 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,740 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/484bca1a-42b9-42c9-922d-badbbe9ec50c 2025-10-13 03:07:00,747 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/484bca1a-42b9-42c9-922d-badbbe9ec50c 2025-10-13 03:07:00,754 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/dc0d5041-b568-47df-98d4-5fd8e616dd54 2025-10-13 03:07:00,765 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17699292477973743708', 'uuid-lslong': '9457026041775123478'}, 'enable': 'true', 'created': '2025-10-13T03:07:00', 'last-modified': '2025-10-13T03:07:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384199'} 2025-10-13 03:07:00,769 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:00,774 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17699292477973743708', 'uuid-lslong': '9457026041775123478'}, 'enable': 'true', 'created': '2025-10-13T03:07:00', 'last-modified': '2025-10-13T03:07:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374105'} 2025-10-13 03:07:00,779 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:00,784 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17699292477973743708', 'uuid-lslong': '9457026041775123478'}, 'enable': 'true', 'created': '2025-10-13T03:07:00', 'last-modified': '2025-10-13T03:07:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400321'} 2025-10-13 03:07:00,790 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:00,790 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-01318334 passed 2025-10-13 03:07:00,790 - DEBUG - ====Verifying policy data for ctest-right_vn-01318334 in API_Server ====== 2025-10-13 03:07:00,790 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:00,796 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:00,811 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:00,923 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/f5a084bb-dd5e-485c-833e-1b145b9fec16 2025-10-13 03:07:00,931 - DEBUG - =>VN ctest-right_vn-01318334 has no policy to be verified 2025-10-13 03:07:00,931 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:00,932 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:00,932 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:00,944 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334?flat'} 2025-10-13 03:07:00,944 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:00,944 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:00,956 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334?flat'} 2025-10-13 03:07:00,956 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:00,956 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:00,971 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334?flat'} 2025-10-13 03:07:00,971 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-right_vn-01318334 is found in opserver 2025-10-13 03:07:00,994 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:01,005 - DEBUG - VRF ids for VN ctest-right_vn-01318334: {} 2025-10-13 03:07:01,270 - DEBUG - Response for create_network : {'network': {'id': '910db24f-38e1-4869-a40b-b3c063a2c09a', 'name': 'ctest-trans_left_vn-83266008', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-trans_left_vn-83266008'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:01,493 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e1194e06-4001-4cbb-a7b9-6641256adf57', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': '910db24f-38e1-4869-a40b-b3c063a2c09a', 'ip_version': 4, 'cidr': '206.150.191.128/26', 'allocation_pools': [{'start': '206.150.191.130', 'end': '206.150.191.190'}], 'gateway_ip': '206.150.191.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.150.191.130', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:07:01,515 - INFO - Created VN ctest-trans_left_vn-83266008 2025-10-13 03:07:01,532 - DEBUG - VN ctest-trans_left_vn-83266008 UUID is 910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:01,608 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:01,614 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:01,629 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:01,717 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:01,730 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:01,739 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/45fe805c-7935-40cc-bac0-62cfb41ffd37 2025-10-13 03:07:01,748 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/45fe805c-7935-40cc-bac0-62cfb41ffd37 2025-10-13 03:07:01,754 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/1bbd698f-309f-4bd7-a99f-094e817998a9 2025-10-13 03:07:01,761 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:01,762 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:01,774 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/45fe805c-7935-40cc-bac0-62cfb41ffd37 2025-10-13 03:07:01,790 - INFO - Verified VN network id 16 for VN 910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:01,790 - INFO - Verifications in API Server for VN ctest-trans_left_vn-83266008 passed 2025-10-13 03:07:01,790 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:01,799 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/45fe805c-7935-40cc-bac0-62cfb41ffd37 2025-10-13 03:07:01,805 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/45fe805c-7935-40cc-bac0-62cfb41ffd37 2025-10-13 03:07:01,811 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/1bbd698f-309f-4bd7-a99f-094e817998a9 2025-10-13 03:07:01,832 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10452206363523237993', 'uuid-lslong': '11820739285850701978'}, 'enable': 'true', 'created': '2025-10-13T03:07:01', 'last-modified': '2025-10-13T03:07:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399130'} 2025-10-13 03:07:01,839 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:01,844 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10452206363523237993', 'uuid-lslong': '11820739285850701978'}, 'enable': 'true', 'created': '2025-10-13T03:07:01', 'last-modified': '2025-10-13T03:07:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416455'} 2025-10-13 03:07:01,850 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:01,860 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10452206363523237993', 'uuid-lslong': '11820739285850701978'}, 'enable': 'true', 'created': '2025-10-13T03:07:01', 'last-modified': '2025-10-13T03:07:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432678'} 2025-10-13 03:07:01,866 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:01,866 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-83266008 passed 2025-10-13 03:07:01,866 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-83266008 in API_Server ====== 2025-10-13 03:07:01,866 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:01,872 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:01,882 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:01,993 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/910db24f-38e1-4869-a40b-b3c063a2c09a 2025-10-13 03:07:02,003 - DEBUG - =>VN ctest-trans_left_vn-83266008 has no policy to be verified 2025-10-13 03:07:02,003 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:02,003 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:02,003 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:02,014 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008?flat'} 2025-10-13 03:07:02,014 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:02,014 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:02,027 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008?flat'} 2025-10-13 03:07:02,027 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:02,027 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:02,037 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008?flat'} 2025-10-13 03:07:02,037 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-trans_left_vn-83266008 is found in opserver 2025-10-13 03:07:02,059 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:02,067 - DEBUG - VRF ids for VN ctest-trans_left_vn-83266008: {} 2025-10-13 03:07:02,329 - DEBUG - Response for create_network : {'network': {'id': '5090ec3d-8aa6-420b-9a58-1ccf852b33ef', 'name': 'ctest-trans_right_vn-63118206', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'project_id': '56c298e5b11a4f6c9286c0ae5b005725', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-20374590', 'ctest-trans_right_vn-63118206'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:02,522 - DEBUG - Response for create_subnet : {'subnet': {'id': '70509ec7-9654-4239-a747-cdb53d2e57e7', 'name': '', 'tenant_id': '56c298e5b11a4f6c9286c0ae5b005725', 'network_id': '5090ec3d-8aa6-420b-9a58-1ccf852b33ef', 'ip_version': 4, 'cidr': '164.186.179.0/26', 'allocation_pools': [{'start': '164.186.179.2', 'end': '164.186.179.62'}], 'gateway_ip': '164.186.179.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '164.186.179.2', 'tags': [], 'project_id': '56c298e5b11a4f6c9286c0ae5b005725'}} 2025-10-13 03:07:02,547 - INFO - Created VN ctest-trans_right_vn-63118206 2025-10-13 03:07:02,561 - DEBUG - VN ctest-trans_right_vn-63118206 UUID is 5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,626 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:02,633 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:02,644 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:02,726 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,742 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,753 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66ad75d2-3fa4-4a8c-8eff-27a1c4135a53 2025-10-13 03:07:02,761 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66ad75d2-3fa4-4a8c-8eff-27a1c4135a53 2025-10-13 03:07:02,768 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/bcc50856-2ced-4a7e-b299-fb0fc3e2e418 2025-10-13 03:07:02,776 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:02,776 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,788 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66ad75d2-3fa4-4a8c-8eff-27a1c4135a53 2025-10-13 03:07:02,803 - INFO - Verified VN network id 17 for VN 5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,803 - INFO - Verifications in API Server for VN ctest-trans_right_vn-63118206 passed 2025-10-13 03:07:02,803 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,813 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66ad75d2-3fa4-4a8c-8eff-27a1c4135a53 2025-10-13 03:07:02,820 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66ad75d2-3fa4-4a8c-8eff-27a1c4135a53 2025-10-13 03:07:02,827 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/bcc50856-2ced-4a7e-b299-fb0fc3e2e418 2025-10-13 03:07:02,839 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5805399668743881227', 'uuid-lslong': '11121670957409448943'}, 'enable': 'true', 'created': '2025-10-13T03:07:02', 'last-modified': '2025-10-13T03:07:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.373469'} 2025-10-13 03:07:02,844 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:02,851 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5805399668743881227', 'uuid-lslong': '11121670957409448943'}, 'enable': 'true', 'created': '2025-10-13T03:07:02', 'last-modified': '2025-10-13T03:07:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.382495'} 2025-10-13 03:07:02,859 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:02,864 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-20374590', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5805399668743881227', 'uuid-lslong': '11121670957409448943'}, 'enable': 'true', 'created': '2025-10-13T03:07:02', 'last-modified': '2025-10-13T03:07:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394073'} 2025-10-13 03:07:02,870 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:02,870 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-63118206 passed 2025-10-13 03:07:02,870 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-63118206 in API_Server ====== 2025-10-13 03:07:02,870 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:02,875 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:02,886 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:02,971 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/5090ec3d-8aa6-420b-9a58-1ccf852b33ef 2025-10-13 03:07:02,983 - DEBUG - =>VN ctest-trans_right_vn-63118206 has no policy to be verified 2025-10-13 03:07:02,983 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:02,983 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:02,983 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:02,999 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206?flat'} 2025-10-13 03:07:03,000 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:03,000 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:03,012 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206?flat'} 2025-10-13 03:07:03,012 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:03,012 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:03,024 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206?flat'} 2025-10-13 03:07:03,024 - INFO - Validated that VN default-domain:ctest-TestSvcHC-20374590:ctest-trans_right_vn-63118206 is found in opserver 2025-10-13 03:07:03,054 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:03,064 - DEBUG - VRF ids for VN ctest-trans_right_vn-63118206: {} 2025-10-13 03:07:04,203 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-2) 2025-10-13 03:07:05,805 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-1) 2025-10-13 03:07:05,806 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-57483925'] 2025-10-13 03:07:06,110 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-57483925'] created succesfully 2025-10-13 03:07:06,519 - DEBUG - Image by name tiny_trans_fw not found 2025-10-13 03:07:06,519 - DEBUG - Installing image tiny_trans_fw 2025-10-13 03:07:06,519 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-13 03:07:06,519 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-13 03:07:06,519 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-13 03:07:06,519 - DEBUG - Unzip image 2025-10-13 03:07:06,519 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-13 03:07:06,539 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-13 03:07:06,541 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-57483925'] 2025-10-13 03:07:06,648 - INFO - Service template: ['default-domain', 'ctest-service_template_1-57483925'] deleted successfully. 2025-10-13 03:07:06,648 - INFO - Skip interface_detach for VM ctest-right_vm-13019797 in state BUILD 2025-10-13 03:07:06,648 - INFO - Deleting VM ctest-right_vm-13019797 2025-10-13 03:07:06,648 - ERROR - VM ctest-right_vm-13019797 has failed to come up 2025-10-13 03:07:06,648 - ERROR - Nova failed to get host of the VM 2025-10-13 03:07:06,648 - ERROR - VM ctest-right_vm-13019797 has failed to come up 2025-10-13 03:07:06,648 - ERROR - Nova failed to get host of the VM 2025-10-13 03:07:06,749 - INFO - Skip interface_detach for VM ctest-left_vm-53644448 in state BUILD 2025-10-13 03:07:06,749 - INFO - Deleting VM ctest-left_vm-53644448 2025-10-13 03:07:06,749 - ERROR - VM ctest-left_vm-53644448 has failed to come up 2025-10-13 03:07:06,749 - ERROR - Nova failed to get host of the VM 2025-10-13 03:07:06,749 - ERROR - VM ctest-left_vm-53644448 has failed to come up 2025-10-13 03:07:06,749 - ERROR - Nova failed to get host of the VM 2025-10-13 03:07:06,820 - INFO - Deleting VN ctest-trans_right_vn-63118206 2025-10-13 03:07:07,004 - DEBUG - Response for deleting network () 2025-10-13 03:07:07,004 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/66ad75d2-3fa4-4a8c-8eff-27a1c4135a53 2025-10-13 03:07:07,011 - DEBUG - Response Code: 404 2025-10-13 03:07:07,011 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:07,024 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:07,041 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:07,141 - INFO - Validated that VN ctest-trans_right_vn-63118206 is not found in API Server 2025-10-13 03:07:07,182 - DEBUG - VN ctest-trans_right_vn-63118206 is not present in Agent 10.0.0.249 2025-10-13 03:07:07,195 - DEBUG - VN ctest-trans_right_vn-63118206 is not present in Agent 10.0.0.27 2025-10-13 03:07:07,195 - INFO - Validated that VN ctest-trans_right_vn-63118206 is not in any agent 2025-10-13 03:07:07,230 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-63118206 info 2025-10-13 03:07:07,231 - INFO - Deleting VN ctest-trans_left_vn-83266008 2025-10-13 03:07:07,371 - DEBUG - Response for deleting network () 2025-10-13 03:07:07,371 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/45fe805c-7935-40cc-bac0-62cfb41ffd37 2025-10-13 03:07:07,385 - DEBUG - Response Code: 404 2025-10-13 03:07:07,385 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:07,391 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:07,418 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:07,513 - INFO - Validated that VN ctest-trans_left_vn-83266008 is not found in API Server 2025-10-13 03:07:07,528 - DEBUG - VN ctest-trans_left_vn-83266008 is not present in Agent 10.0.0.249 2025-10-13 03:07:07,543 - DEBUG - VN ctest-trans_left_vn-83266008 is not present in Agent 10.0.0.27 2025-10-13 03:07:07,543 - INFO - Validated that VN ctest-trans_left_vn-83266008 is not in any agent 2025-10-13 03:07:07,594 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-83266008 info 2025-10-13 03:07:07,595 - INFO - Deleting VN ctest-right_vn-01318334 2025-10-13 03:07:07,648 - DEBUG - VN f5a084bb-dd5e-485c-833e-1b145b9fec16 still in use: Unable to complete operation on network f5a084bb-dd5e-485c-833e-1b145b9fec16. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f5b36d7e-256b-4e80-9ade-35fc64fff6bf'] 2025-10-13 03:07:07,648 - WARNING - Deleting VN ctest-right_vn-01318334 failed..Will retry 2025-10-13 03:07:09,806 - DEBUG - Response for deleting network () 2025-10-13 03:07:09,806 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/484bca1a-42b9-42c9-922d-badbbe9ec50c 2025-10-13 03:07:09,817 - DEBUG - Response Code: 404 2025-10-13 03:07:09,817 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:09,825 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:09,879 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:09,963 - INFO - Validated that VN ctest-right_vn-01318334 is not found in API Server 2025-10-13 03:07:09,974 - DEBUG - VN ctest-right_vn-01318334 is not present in Agent 10.0.0.249 2025-10-13 03:07:09,984 - DEBUG - VN ctest-right_vn-01318334 is not present in Agent 10.0.0.27 2025-10-13 03:07:09,984 - INFO - Validated that VN ctest-right_vn-01318334 is not in any agent 2025-10-13 03:07:10,012 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-01318334 info 2025-10-13 03:07:10,012 - INFO - Deleting VN ctest-left_vn-76005180 2025-10-13 03:07:10,152 - DEBUG - Response for deleting network () 2025-10-13 03:07:10,152 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2c10b344-908b-4b9c-b3e0-41409c2df3af 2025-10-13 03:07:10,157 - DEBUG - Response Code: 404 2025-10-13 03:07:10,157 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:10,164 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:10,186 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:10,265 - INFO - Validated that VN ctest-left_vn-76005180 is not found in API Server 2025-10-13 03:07:10,278 - DEBUG - VN ctest-left_vn-76005180 is not present in Agent 10.0.0.249 2025-10-13 03:07:10,290 - DEBUG - VN ctest-left_vn-76005180 is not present in Agent 10.0.0.27 2025-10-13 03:07:10,290 - INFO - Validated that VN ctest-left_vn-76005180 is not in any agent 2025-10-13 03:07:10,321 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-76005180 info 2025-10-13 03:07:10,321 - INFO - Deleting VN ctest-mgmt_vn-84457856 2025-10-13 03:07:10,449 - DEBUG - Response for deleting network () 2025-10-13 03:07:10,449 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/a1dea96e-3aeb-455d-a2cf-2f918a7457e2 2025-10-13 03:07:10,456 - DEBUG - Response Code: 404 2025-10-13 03:07:10,456 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:10,463 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:10,475 - DEBUG - Requesting: http://10.0.0.22:8082/project/56c298e5-b11a-4f6c-9286-c0ae5b005725 2025-10-13 03:07:10,570 - INFO - Validated that VN ctest-mgmt_vn-84457856 is not found in API Server 2025-10-13 03:07:10,582 - DEBUG - VN ctest-mgmt_vn-84457856 is not present in Agent 10.0.0.249 2025-10-13 03:07:10,595 - DEBUG - VN ctest-mgmt_vn-84457856 is not present in Agent 10.0.0.27 2025-10-13 03:07:10,595 - INFO - Validated that VN ctest-mgmt_vn-84457856 is not in any agent 2025-10-13 03:07:10,626 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-84457856 info 2025-10-13 03:07:11,893 - DEBUG - No XMPP flaps were noticed during the test 2025-10-13 03:07:11,893 - INFO -

2025-10-13 03:07:11,893 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]

2025-10-13 03:07:11,893 - INFO - -------------------------------------------------------------------------------- 2025-10-13 03:07:12,616 - INFO - Deleted project: ctest-TestSvcHC-20374590, ID : 56c298e5-b11a-4f6c-9286-c0ae5b005725