2025-11-05 08:29:25,165 - INFO - Domain Default found not creating 2025-11-05 08:29:25,336 - INFO - Project ctest-TestBasicPolicy-54198442 not found, creating it 2025-11-05 08:29:25,846 - INFO - Created Project:ctest-TestBasicPolicy-54198442, ID : f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:29:27,551 - INFO - ================================================================================ 2025-11-05 08:29:27,551 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-11-05 08:29:27,551 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-11-05 08:29:27,810 - DEBUG - Nothing to compare xmpp stats {'10.0.0.137': {'10.20.0.129': '0'}} with 2025-11-05 08:29:27,810 - INFO - Initial checks done. Running the testcase now 2025-11-05 08:29:27,810 - INFO - 2025-11-05 08:29:28,427 - DEBUG - Response for create_network : {'network': {'id': '4b98caa5-1b10-445a-a7a3-17b684316c77', 'name': 'ctest-vn-89554001', 'tenant_id': 'f79050c605874c78b3c755ece5880a24', 'project_id': 'f79050c605874c78b3c755ece5880a24', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-vn-89554001'], 'port_security_enabled': True, 'description': ''}} 2025-11-05 08:29:28,678 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b8daefdf-1339-46d6-be01-f65b0dc3c5fa', 'name': '', 'tenant_id': 'f79050c605874c78b3c755ece5880a24', 'network_id': '4b98caa5-1b10-445a-a7a3-17b684316c77', 'ip_version': 4, 'cidr': '63.177.82.64/26', 'allocation_pools': [{'start': '63.177.82.66', 'end': '63.177.82.126'}], 'gateway_ip': '63.177.82.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.177.82.66', 'tags': [], 'project_id': 'f79050c605874c78b3c755ece5880a24'}} 2025-11-05 08:29:28,702 - INFO - Created VN ctest-vn-89554001 2025-11-05 08:29:28,757 - DEBUG - VN ctest-vn-89554001 UUID is 4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:29,061 - DEBUG - Response for create_network : {'network': {'id': 'cd569a67-8c20-4913-8d22-2fd0386ffae2', 'name': 'ctest-vn-42675887', 'tenant_id': 'f79050c605874c78b3c755ece5880a24', 'project_id': 'f79050c605874c78b3c755ece5880a24', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-vn-42675887'], 'port_security_enabled': True, 'description': ''}} 2025-11-05 08:29:29,230 - DEBUG - Response for create_subnet : {'subnet': {'id': '7b9a1389-846a-4c08-a139-1be46ab4bafc', 'name': '', 'tenant_id': 'f79050c605874c78b3c755ece5880a24', 'network_id': 'cd569a67-8c20-4913-8d22-2fd0386ffae2', 'ip_version': 4, 'cidr': '206.249.72.192/26', 'allocation_pools': [{'start': '206.249.72.194', 'end': '206.249.72.254'}], 'gateway_ip': '206.249.72.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.249.72.194', 'tags': [], 'project_id': 'f79050c605874c78b3c755ece5880a24'}} 2025-11-05 08:29:29,251 - INFO - Created VN ctest-vn-42675887 2025-11-05 08:29:29,305 - DEBUG - VN ctest-vn-42675887 UUID is cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:29,421 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-89554001, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-42675887, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-11-05 08:29:29,733 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '4b98caa5-1b10-445a-a7a3-17b684316c77', 'name': 'ctest-vn-89554001', 'tenant_id': 'f79050c605874c78b3c755ece5880a24', 'project_id': 'f79050c605874c78b3c755ece5880a24', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['b8daefdf-1339-46d6-be01-f65b0dc3c5fa'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-vn-89554001'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-policy-allow-all-54453543']], 'subnet_ipam': [{'subnet_cidr': '63.177.82.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-11-05 08:29:29,963 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'cd569a67-8c20-4913-8d22-2fd0386ffae2', 'name': 'ctest-vn-42675887', 'tenant_id': 'f79050c605874c78b3c755ece5880a24', 'project_id': 'f79050c605874c78b3c755ece5880a24', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['7b9a1389-846a-4c08-a139-1be46ab4bafc'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-vn-42675887'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-policy-allow-all-54453543']], 'subnet_ipam': [{'subnet_cidr': '206.249.72.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-11-05 08:29:30,117 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:29:30,472 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:29:30,506 - DEBUG - Requesting: http://10.0.0.137:8082/domain/c8459c21-9d03-48dd-8f06-1e66f6b8d132 2025-11-05 08:29:30,519 - DEBUG - Requesting: http://10.0.0.137:8082/project/f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:29:30,593 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:30,605 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:30,614 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/2bffe846-4343-4156-a6c1-9faabce0e66a 2025-11-05 08:29:30,621 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/2bffe846-4343-4156-a6c1-9faabce0e66a 2025-11-05 08:29:30,628 - DEBUG - Requesting: http://10.0.0.137:8082/route-target/b47f2d3f-394f-4a0a-959d-0d5270c3fd80 2025-11-05 08:29:30,634 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-05 08:29:30,634 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:30,644 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/2bffe846-4343-4156-a6c1-9faabce0e66a 2025-11-05 08:29:30,658 - INFO - Verified VN network id 12 for VN 4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:30,658 - INFO - Verifications in API Server for VN ctest-vn-89554001 passed 2025-11-05 08:29:30,658 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:30,667 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/2bffe846-4343-4156-a6c1-9faabce0e66a 2025-11-05 08:29:30,673 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/2bffe846-4343-4156-a6c1-9faabce0e66a 2025-11-05 08:29:30,680 - DEBUG - Requesting: http://10.0.0.137:8082/route-target/b47f2d3f-394f-4a0a-959d-0d5270c3fd80 2025-11-05 08:29:30,692 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-89554001', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-54198442', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5447326559777080410', 'uuid-lslong': '12079524698207120503'}, 'enable': 'true', 'created': '2025-11-05T08:29:28', 'last-modified': '2025-11-05T08:29:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.987491'} 2025-11-05 08:29:30,698 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-05 08:29:30,699 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-89554001 passed 2025-11-05 08:29:30,699 - DEBUG - ====Verifying policy data for ctest-vn-89554001 in API_Server ====== 2025-11-05 08:29:30,699 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:29:30,705 - DEBUG - Requesting: http://10.0.0.137:8082/domain/c8459c21-9d03-48dd-8f06-1e66f6b8d132 2025-11-05 08:29:30,716 - DEBUG - Requesting: http://10.0.0.137:8082/project/f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:29:30,791 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/4b98caa5-1b10-445a-a7a3-17b684316c77 2025-11-05 08:29:30,800 - DEBUG - ==>Verifying data for policy with id: cd22f6c0-7378-400b-a5fc-37149559d2ef, fqn: ['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-policy-allow-all-54453543'] 2025-11-05 08:29:30,800 - INFO - VN ctest-vn-89554001 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-05 08:29:30,801 - DEBUG - Verifying the vn in opserver 2025-11-05 08:29:30,801 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-89554001 virtual network link through opserver 10.0.0.137 2025-11-05 08:29:30,801 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-11-05 08:29:31,145 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-11-05 08:29:31,213 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-89554001', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-89554001?flat'} 2025-11-05 08:29:31,213 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-89554001 is found in opserver 2025-11-05 08:29:31,223 - DEBUG - Do not have enough data to verify VN in agent 2025-11-05 08:29:31,228 - DEBUG - VRF ids for VN ctest-vn-89554001: {} 2025-11-05 08:29:31,228 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:29:31,234 - DEBUG - Requesting: http://10.0.0.137:8082/domain/c8459c21-9d03-48dd-8f06-1e66f6b8d132 2025-11-05 08:29:31,252 - DEBUG - Requesting: http://10.0.0.137:8082/project/f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:29:31,332 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:31,347 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:31,359 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/44d6fec0-a4ed-4150-bb20-fc98afcd2217 2025-11-05 08:29:31,368 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/44d6fec0-a4ed-4150-bb20-fc98afcd2217 2025-11-05 08:29:31,376 - DEBUG - Requesting: http://10.0.0.137:8082/route-target/7c1ba5a5-05d6-453a-a8ef-c8ffdc8d704c 2025-11-05 08:29:31,383 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-05 08:29:31,384 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:31,394 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/44d6fec0-a4ed-4150-bb20-fc98afcd2217 2025-11-05 08:29:31,409 - INFO - Verified VN network id 13 for VN cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:31,409 - INFO - Verifications in API Server for VN ctest-vn-42675887 passed 2025-11-05 08:29:31,409 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:31,421 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/44d6fec0-a4ed-4150-bb20-fc98afcd2217 2025-11-05 08:29:31,429 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/44d6fec0-a4ed-4150-bb20-fc98afcd2217 2025-11-05 08:29:31,438 - DEBUG - Requesting: http://10.0.0.137:8082/route-target/7c1ba5a5-05d6-453a-a8ef-c8ffdc8d704c 2025-11-05 08:29:31,453 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-42675887', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-54198442', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14796183395295578387', 'uuid-lslong': '10169743479902567138'}, 'enable': 'true', 'created': '2025-11-05T08:29:29', 'last-modified': '2025-11-05T08:29:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.512138'} 2025-11-05 08:29:31,459 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-05 08:29:31,459 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-42675887 passed 2025-11-05 08:29:31,459 - DEBUG - ====Verifying policy data for ctest-vn-42675887 in API_Server ====== 2025-11-05 08:29:31,459 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:29:31,466 - DEBUG - Requesting: http://10.0.0.137:8082/domain/c8459c21-9d03-48dd-8f06-1e66f6b8d132 2025-11-05 08:29:31,477 - DEBUG - Requesting: http://10.0.0.137:8082/project/f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:29:31,557 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-network/cd569a67-8c20-4913-8d22-2fd0386ffae2 2025-11-05 08:29:31,568 - DEBUG - ==>Verifying data for policy with id: cd22f6c0-7378-400b-a5fc-37149559d2ef, fqn: ['default-domain', 'ctest-TestBasicPolicy-54198442', 'ctest-policy-allow-all-54453543'] 2025-11-05 08:29:31,568 - INFO - VN ctest-vn-42675887 Policy verification: verify_vn_policy_in_api_server, status: True 2025-11-05 08:29:31,569 - DEBUG - Verifying the vn in opserver 2025-11-05 08:29:31,569 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-42675887 virtual network link through opserver 10.0.0.137 2025-11-05 08:29:31,569 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-11-05 08:29:31,579 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-42675887', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-42675887?flat'} 2025-11-05 08:29:31,579 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-54198442:ctest-vn-42675887 is found in opserver 2025-11-05 08:29:31,590 - DEBUG - Do not have enough data to verify VN in agent 2025-11-05 08:29:31,596 - DEBUG - VRF ids for VN ctest-vn-42675887: {} 2025-11-05 08:29:31,723 - DEBUG - Services list from nova: [, , ] 2025-11-05 08:29:32,988 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4634-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4634-1) 2025-11-05 08:29:34,239 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4634-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4634-1) 2025-11-05 08:29:34,239 - INFO - Waiting for VM ctest-TestBasicPolicy-54198442-75028560 to be up.. 2025-11-05 08:29:34,303 - DEBUG - VM is in ERROR state now 2025-11-05 08:29:34,304 - ERROR - VM in error state. 2025-11-05 08:29:34,304 - ERROR - VM is not in ACTIVE state 2025-11-05 08:29:34,393 - ERROR - Fatal Nova Exception while getting VM detail 2025-11-05 08:29:34,393 - DEBUG - None 2025-11-05 08:29:34,393 - INFO - Waiting for VM ctest-TestBasicPolicy-54198442-58152068 to be up.. 2025-11-05 08:29:34,450 - DEBUG - VM is in ERROR state now 2025-11-05 08:29:34,451 - ERROR - VM in error state. 2025-11-05 08:29:34,451 - ERROR - VM is not in ACTIVE state 2025-11-05 08:29:34,536 - ERROR - Fatal Nova Exception while getting VM detail 2025-11-05 08:29:34,536 - DEBUG - None 2025-11-05 08:29:34,536 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:29:34,598 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:29:39,661 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:29:44,724 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:29:49,790 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:29:54,855 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:29:59,927 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:29:59,928 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:30:01,929 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:30:01,997 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:07,068 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:12,135 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:17,198 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:22,264 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:27,326 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:27,326 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:30:29,327 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:30:29,388 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:34,450 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:39,520 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:44,588 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:49,656 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:54,719 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:30:54,719 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:30:56,720 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:30:56,789 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:01,858 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:06,923 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:11,994 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:17,057 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:22,125 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:22,125 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:31:24,125 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:31:24,190 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:29,252 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:34,313 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:39,383 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:44,454 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:49,516 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:49,516 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:31:51,517 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:31:51,585 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:31:56,704 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:01,768 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:06,831 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:11,893 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:16,957 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:16,957 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:32:16,958 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:32:17,018 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:22,086 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:27,157 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:32,236 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:37,298 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:42,366 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:42,366 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:32:44,367 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:32:44,424 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:49,486 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:54,550 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:32:59,616 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:04,683 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:09,756 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:09,757 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:33:11,758 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:33:11,820 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:16,886 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:21,956 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:27,021 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:32,081 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:37,142 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:37,143 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:33:39,144 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:33:39,209 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:44,273 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:49,343 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:54,408 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:33:59,471 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:04,540 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:04,540 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:34:06,541 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:34:06,602 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:11,667 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:16,738 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:21,805 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:26,882 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:32,009 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:32,009 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:34:34,010 - INFO - VM name : ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:34:34,075 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:39,142 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:44,208 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:49,271 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:54,338 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:59,406 - DEBUG - VM ctest-TestBasicPolicy-54198442-58152068 : Status=ERROR, Addresses : {} 2025-11-05 08:34:59,406 - ERROR - VM 6852dc82-339b-4dcb-a843-6e3cd00df4d5 is not launched yet 2025-11-05 08:34:59,406 - INFO - Skip interface_detach for VM ctest-TestBasicPolicy-54198442-58152068 in state ERROR 2025-11-05 08:34:59,407 - INFO - Deleting VM ctest-TestBasicPolicy-54198442-58152068 2025-11-05 08:34:59,429 - ERROR - VM ctest-TestBasicPolicy-54198442-58152068 has failed to come up 2025-11-05 08:34:59,429 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-11-05T08:29:34Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-11-05 08:34:59,429 - INFO - Skip interface_detach for VM ctest-TestBasicPolicy-54198442-75028560 in state ERROR 2025-11-05 08:34:59,429 - INFO - Deleting VM ctest-TestBasicPolicy-54198442-75028560 2025-11-05 08:34:59,429 - ERROR - VM ctest-TestBasicPolicy-54198442-75028560 has failed to come up 2025-11-05 08:34:59,429 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-11-05T08:29:33Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-11-05 08:34:59,722 - INFO - Deleted policy ctest-policy-allow-all-54453543 2025-11-05 08:34:59,722 - INFO - Deleting VN ctest-vn-42675887 2025-11-05 08:34:59,844 - DEBUG - Response for deleting network () 2025-11-05 08:34:59,844 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/44d6fec0-a4ed-4150-bb20-fc98afcd2217 2025-11-05 08:34:59,873 - DEBUG - Response Code: 404 2025-11-05 08:34:59,873 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:34:59,879 - DEBUG - Requesting: http://10.0.0.137:8082/domain/c8459c21-9d03-48dd-8f06-1e66f6b8d132 2025-11-05 08:34:59,891 - DEBUG - Requesting: http://10.0.0.137:8082/project/f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:34:59,965 - INFO - Validated that VN ctest-vn-42675887 is not found in API Server 2025-11-05 08:34:59,975 - DEBUG - VN ctest-vn-42675887 is not present in Agent 10.0.0.137 2025-11-05 08:34:59,975 - INFO - Validated that VN ctest-vn-42675887 is not in any agent 2025-11-05 08:34:59,990 - DEBUG - Control-node config DB still has VN ctest-vn-42675887 2025-11-05 08:35:05,003 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-42675887 info 2025-11-05 08:35:05,003 - INFO - Deleting VN ctest-vn-89554001 2025-11-05 08:35:05,112 - DEBUG - Response for deleting network () 2025-11-05 08:35:05,112 - DEBUG - Requesting: http://10.0.0.137:8082/routing-instance/2bffe846-4343-4156-a6c1-9faabce0e66a 2025-11-05 08:35:05,118 - DEBUG - Response Code: 404 2025-11-05 08:35:05,118 - DEBUG - Requesting: http://10.0.0.137:8082/domains 2025-11-05 08:35:05,124 - DEBUG - Requesting: http://10.0.0.137:8082/domain/c8459c21-9d03-48dd-8f06-1e66f6b8d132 2025-11-05 08:35:05,177 - DEBUG - Requesting: http://10.0.0.137:8082/project/f79050c6-0587-4c78-b3c7-55ece5880a24 2025-11-05 08:35:05,254 - INFO - Validated that VN ctest-vn-89554001 is not found in API Server 2025-11-05 08:35:05,264 - DEBUG - VN ctest-vn-89554001 is not present in Agent 10.0.0.137 2025-11-05 08:35:05,264 - INFO - Validated that VN ctest-vn-89554001 is not in any agent 2025-11-05 08:35:05,280 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-89554001 info 2025-11-05 08:35:05,528 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/policy/test_policy_basic.py", line 118, in test_basic_policy_allow_deny
    assert vm1_fixture.ping_with_certainty(vm2_fixture.vm_ip), (
  File "/contrail-test/fixtures/vm_test.py", line 354, in vm_ip
    assert self.verify_vm_launched()
AssertionError
2025-11-05 08:35:05,534 - DEBUG - No XMPP flaps were noticed during the test 2025-11-05 08:35:05,534 - INFO - 2025-11-05 08:35:05,534 - INFO - END TEST : test_basic_policy_allow_deny : FAILED[0:05:38] 2025-11-05 08:35:05,534 - INFO - -------------------------------------------------------------------------------- 2025-11-05 08:35:06,305 - INFO - Deleted project: ctest-TestBasicPolicy-54198442, ID : f79050c6-0587-4c78-b3c7-55ece5880a24