2026-08-31 03:59:34,707 - INFO - Domain Default found not creating 2026-08-31 03:59:34,899 - INFO - Project ctest-TestRoutes-82205065 not found, creating it 2026-08-31 03:59:35,520 - INFO - Created Project:ctest-TestRoutes-82205065, ID : 6e0002a4-216f-436f-b848-8e2062132c1b 2026-08-31 03:59:37,253 - INFO - ================================================================================ 2026-08-31 03:59:37,254 - INFO - STARTING TEST : test_rt_table_scenario_1 2026-08-31 03:59:37,254 - INFO - TEST DESCRIPTION : In a VN, launch a VM each on two computes Add a shorter prefix intf static route to VM2 Delete the VMs. The route table on compute1 should be removed 2026-08-31 03:59:38,603 - DEBUG - Nothing to compare xmpp stats {'10.0.0.186': {'10.20.0.14': '0', '10.20.0.254': '0'}, '10.0.0.176': {'10.20.0.14': '0', '10.20.0.25': '0'}} with 2026-08-31 03:59:38,603 - INFO - Initial checks done. Running the testcase now 2026-08-31 03:59:38,603 - INFO - 2026-08-31 03:59:39,385 - DEBUG - Response for create_network : {'network': {'id': '63368958-c2fa-47cc-9217-642626313119', 'name': 'ctest-random-99257417', 'tenant_id': '6e0002a4216f436fb8488e2062132c1b', 'project_id': '6e0002a4216f436fb8488e2062132c1b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutes-82205065', 'ctest-random-99257417'], 'port_security_enabled': True, 'description': ''}} 2026-08-31 03:59:39,661 - DEBUG - Response for create_subnet : {'subnet': {'id': '0b865654-93e4-4bf2-a92e-48a6b5393865', 'name': '', 'tenant_id': '6e0002a4216f436fb8488e2062132c1b', 'network_id': '63368958-c2fa-47cc-9217-642626313119', 'ip_version': 4, 'cidr': '139.243.116.128/26', 'allocation_pools': [{'start': '139.243.116.130', 'end': '139.243.116.190'}], 'gateway_ip': '139.243.116.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.243.116.130', 'tags': [], 'project_id': '6e0002a4216f436fb8488e2062132c1b'}} 2026-08-31 03:59:39,683 - INFO - Created VN ctest-random-99257417 2026-08-31 03:59:39,696 - DEBUG - VN ctest-random-99257417 UUID is 63368958-c2fa-47cc-9217-642626313119 2026-08-31 03:59:39,769 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestRoutes-82205065', 'ctest-vmi-10647788']} 2026-08-31 03:59:40,239 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-10647788', 'id': '3b1ff2b1-1440-4419-a0c4-34f6bb3e936c', 'tenant_id': '6e0002a4216f436fb8488e2062132c1b', 'network_id': '63368958-c2fa-47cc-9217-642626313119', 'mac_address': '02:3b:1f:f2:b1:14', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '139.243.116.131', 'subnet_id': '0b865654-93e4-4bf2-a92e-48a6b5393865'}], 'security_groups': ['f505f385-87d8-4e8c-80ee-b70d82d86c58'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'tags': [], 'port_security_enabled': True, 'description': '', 'project_id': '6e0002a4216f436fb8488e2062132c1b'}} 2026-08-31 03:59:40,240 - DEBUG - Created port 3b1ff2b1-1440-4419-a0c4-34f6bb3e936c 2026-08-31 03:59:40,344 - DEBUG - Services list from nova: [, , , ] 2026-08-31 03:59:40,344 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6237-1', 'an-jenkins-deploy-platform-ansible-os-6237-2']} 2026-08-31 03:59:40,344 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6237-1', 'an-jenkins-deploy-platform-ansible-os-6237-2']} 2026-08-31 03:59:40,979 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6237-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6237-1) 2026-08-31 03:59:41,430 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6237-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6237-2) 2026-08-31 03:59:41,666 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-TestRoutes-82205065', 'ctest-irtb-07248577'](UUID 9fd7ea50-5e0b-41ad-8ec6-3a07f6bca958), prefixes : ['0.0.0.0/0'] 2026-08-31 03:59:41,667 - DEBUG - Sleeping for 1 seconds.. 2026-08-31 03:59:42,742 - INFO - Added intf route table 9fd7ea50-5e0b-41ad-8ec6-3a07f6bca958 to port 3b1ff2b1-1440-4419-a0c4-34f6bb3e936c 2026-08-31 03:59:42,801 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-31 03:59:47,912 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-31 03:59:53,003 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-31 03:59:58,097 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-31 04:00:03,298 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-31 04:00:08,399 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-08-31 04:00:13,495 - DEBUG - VM is in ACTIVE state now 2026-08-31 04:00:13,495 - INFO - VM name : ctest-TestRoutes-82205065-49935357 2026-08-31 04:00:13,595 - DEBUG - VM ctest-TestRoutes-82205065-49935357 ID is c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:13,682 - DEBUG - VM is in ACTIVE state now 2026-08-31 04:00:13,709 - DEBUG - VM ctest-TestRoutes-82205065-49935357 launched on Node an-jenkins-deploy-platform-ansible-os-6237-1 2026-08-31 04:00:13,808 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:14,161 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:14,200 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:14,209 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/554efb8e-56b3-436e-b41b-042f44ee481c 2026-08-31 04:00:14,224 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:14,234 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/554efb8e-56b3-436e-b41b-042f44ee481c 2026-08-31 04:00:14,256 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/2fb792d8-6faf-4cdf-9315-85f2b73cfe1d 2026-08-31 04:00:14,268 - DEBUG - Verifying in api server 10.0.0.38 2026-08-31 04:00:14,268 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:14,277 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/554efb8e-56b3-436e-b41b-042f44ee481c 2026-08-31 04:00:14,289 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/2fb792d8-6faf-4cdf-9315-85f2b73cfe1d 2026-08-31 04:00:14,299 - INFO - VM ctest-TestRoutes-82205065-49935357 verfication in all API Servers passed 2026-08-31 04:00:14,324 - DEBUG - VM ctest-TestRoutes-82205065-49935357 Tap interface: {'index': '3', 'name': 'tap554efb8e-56', 'uuid': '554efb8e-56b3-436e-b41b-042f44ee481c', 'vrf_name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417:ctest-random-99257417', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'vm_uuid': 'c4cd552b-2163-4f3b-8e0c-fc56bc6f230a', 'vm_name': 'ctest-TestRoutes-82205065-49935357', 'ip_addr': '139.243.116.132', 'mac_addr': '02:55:4e:fb:8e:56', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '88', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c', 'sg_uuid_list': ['f505f385-87d8-4e8c-80ee-b70d82d86c58'], 'static_route_list': None, 'vm_project_uuid': '6e0002a4-216f-436f-b848-8e2062132c1b', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-31 04:00:14,324 - DEBUG - Agent 10.0.0.186 vrf name: default-domain:ctest-TestRoutes-82205065:ctest-random-99257417:ctest-random-99257417 2026-08-31 04:00:14,332 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417:ctest-random-99257417', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'table_label': '-1', 'vxlan_id': '16', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.193:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-08-31 04:00:14,429 - DEBUG - VM ctest-TestRoutes-82205065-49935357 : Tap interface tap554efb8e-56 is set to Active 2026-08-31 04:00:14,430 - DEBUG - Tap interface tap554efb8e-56 detail : {'index': '3', 'name': 'tap554efb8e-56', 'uuid': '554efb8e-56b3-436e-b41b-042f44ee481c', 'vrf_name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417:ctest-random-99257417', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'vm_uuid': 'c4cd552b-2163-4f3b-8e0c-fc56bc6f230a', 'vm_name': 'ctest-TestRoutes-82205065-49935357', 'ip_addr': '139.243.116.132', 'mac_addr': '02:55:4e:fb:8e:56', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '88', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c', 'sg_uuid_list': ['f505f385-87d8-4e8c-80ee-b70d82d86c58'], 'static_route_list': None, 'vm_project_uuid': '6e0002a4-216f-436f-b848-8e2062132c1b', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-08-31 04:00:14,547 - DEBUG - Starting Layer 2 verification in Agent 2026-08-31 04:00:14,560 - DEBUG - Layer 2 path is seen for VM MAC 02:55:4e:fb:8e:56 in agent 10.0.0.186 2026-08-31 04:00:14,560 - DEBUG - Active layer 2 route in agent is present for VMI tap554efb8e-56 2026-08-31 04:00:14,560 - DEBUG - L2 label(29) matches bw route table and interface table 2026-08-31 04:00:14,583 - DEBUG - VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 is found in Agent of node 10.0.0.186 2026-08-31 04:00:14,690 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 is consistent in agent 10.0.0.186 2026-08-31 04:00:14,690 - DEBUG - Route for VM IP ['139.243.116.132'] is consistent in agent 10.0.0.186 2026-08-31 04:00:14,690 - DEBUG - VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 verification for VM ctest-TestRoutes-82205065-49935357 in Agent 10.0.0.186 passed 2026-08-31 04:00:14,813 - DEBUG - Starting all layer 2 verification in agent 10.0.0.186 2026-08-31 04:00:14,825 - DEBUG - Route for VM MAC 02:55:4e:fb:8e:56 is consistent in agent 10.0.0.186 2026-08-31 04:00:16,013 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.561 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.561/3.138/5.716/2.577 ms') 2026-08-31 04:00:16,013 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-82205065-49935357 passed 2026-08-31 04:00:16,014 - INFO - VM ctest-TestRoutes-82205065-49935357 verifications in Compute nodes passed 2026-08-31 04:00:16,242 - DEBUG - Validated VM route 139.243.116.132 in vrouter of 10.0.0.186 2026-08-31 04:00:16,248 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-08-31 04:00:16,248 - INFO - Validated routes of VM ctest-TestRoutes-82205065-49935357 in all vrouters 2026-08-31 04:00:16,795 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2026-08-31 04:00:16,937 - DEBUG - Layer2 route found for VM MAC 02:55:4e:fb:8e:56 in Control-node 10.0.0.50 2026-08-31 04:00:16,937 - DEBUG - L2 Label for VM ctest-TestRoutes-82205065-49935357 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2026-08-31 04:00:16,937 - DEBUG - Starting all layer2 verification in 10.0.0.185 Control Node 2026-08-31 04:00:17,075 - DEBUG - Layer2 route found for VM MAC 02:55:4e:fb:8e:56 in Control-node 10.0.0.185 2026-08-31 04:00:17,075 - DEBUG - L2 Label for VM ctest-TestRoutes-82205065-49935357 same between Control-node 10.0.0.185 and Agent, Expected: 29, Seen: 29 2026-08-31 04:00:17,075 - INFO - Verification in Control-nodes for VM ctest-TestRoutes-82205065-49935357 passed 2026-08-31 04:00:17,075 - DEBUG - Verifying the vm in opserver 2026-08-31 04:00:17,075 - DEBUG - Verifying in collector 10.0.0.38 ... 2026-08-31 04:00:17,075 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat 2026-08-31 04:00:17,414 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat 2026-08-31 04:00:17,815 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c?flat 2026-08-31 04:00:18,149 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c?flat 2026-08-31 04:00:18,541 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c?flat 2026-08-31 04:00:18,622 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat 2026-08-31 04:00:18,693 - DEBUG - Verifying vm in vn uve 2026-08-31 04:00:18,693 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c?flat 2026-08-31 04:00:18,763 - DEBUG - VM uve shows interface as {'ip6_address': '::', 'virtual_network': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'vm_uuid': 'c4cd552b-2163-4f3b-8e0c-fc56bc6f230a', 'l2_active': False, 'label': 1330316821, 'vm_name': 'ctest-TestRoutes-82205065-49935357', 'ip_address': '139.243.116.132', 'ip4_active': False, 'mac_address': '02:55:4e:fb:8e:56', 'ip6_active': False, 'rx_vlan': 65535, 'tx_vlan': 65535, 'vhostuser_mode': 0, 'gateway': '139.243.116.129', 'active': False, 'admin_state': True, 'uuid': '554efb8e-56b3-436e-b41b-042f44ee481c', 'vn_uuid': '63368958-c2fa-47cc-9217-642626313119', 'port_mirror_enabled': False, 'fixed_ip4_list': ['139.243.116.132'], '__T': 1788148799693182, 'is_health_check_active': True} 2026-08-31 04:00:18,763 - DEBUG - VM uve shows ip address as ['139.243.116.132', '::'] 2026-08-31 04:00:18,763 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:18,763 - INFO - Verifying through opserver in 10.0.0.50 2026-08-31 04:00:18,764 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-82205065:ctest-random-99257417?flat 2026-08-31 04:00:18,792 - DEBUG - expected vm list c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:18,792 - DEBUG - Extracted vm list ['c4cd552b-2163-4f3b-8e0c-fc56bc6f230a'] 2026-08-31 04:00:18,792 - INFO - VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is present in default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:18,792 - DEBUG - Verifying vm in vrouter uve 2026-08-31 04:00:18,792 - DEBUG - Getting info from collector 10.0.0.38.. 2026-08-31 04:00:18,793 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat 2026-08-31 04:00:18,857 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6237-1'] 2026-08-31 04:00:18,857 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6237-1:Compute:contrail-vrouter-agent:0?flat 2026-08-31 04:00:18,899 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6237-1?flat 2026-08-31 04:00:18,937 - DEBUG - VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:18,938 - DEBUG - Validated that VM ctest-TestRoutes-82205065-49935357 is in Vrouter an-jenkins-deploy-platform-ansible-os-6237-1 UVE 2026-08-31 04:00:18,938 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-08-31 04:00:18,960 - DEBUG - Expected tap interface of VM uuid c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c 2026-08-31 04:00:18,960 - DEBUG - Expected VN of VM uuid c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:18,960 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6237-1:Compute:contrail-vrouter-agent:0?flat 2026-08-31 04:00:18,995 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6237-1?flat 2026-08-31 04:00:19,031 - DEBUG - VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:19,031 - INFO - tap interface default-domain:ctest-TestRoutes-82205065:554efb8e-56b3-436e-b41b-042f44ee481c of vm c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:19,031 - DEBUG - Connected network default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 of vm c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:19,031 - DEBUG - Verifying the c4cd552b-2163-4f3b-8e0c-fc56bc6f230a virtual network link through opserver 10.0.0.50 2026-08-31 04:00:19,031 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-31 04:00:19,046 - DEBUG - VM link and name as {'name': 'c4cd552b-2163-4f3b-8e0c-fc56bc6f230a', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat'} 2026-08-31 04:00:19,046 - DEBUG - Verifying the c4cd552b-2163-4f3b-8e0c-fc56bc6f230a virtual network link through opserver 10.0.0.185 2026-08-31 04:00:19,046 - DEBUG - Requesting: http://10.0.0.185:8081/analytics/uves/virtual-machines 2026-08-31 04:00:19,386 - DEBUG - Requesting: http://10.0.0.185:8081/analytics/uves/virtual-machines 2026-08-31 04:00:19,456 - DEBUG - VM link and name as {'name': 'c4cd552b-2163-4f3b-8e0c-fc56bc6f230a', 'href': 'http://10.0.0.185:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat'} 2026-08-31 04:00:19,456 - DEBUG - Verifying the c4cd552b-2163-4f3b-8e0c-fc56bc6f230a virtual network link through opserver 10.0.0.38 2026-08-31 04:00:19,456 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-08-31 04:00:19,475 - DEBUG - VM link and name as {'name': 'c4cd552b-2163-4f3b-8e0c-fc56bc6f230a', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a?flat'} 2026-08-31 04:00:19,475 - INFO - VM ctest-TestRoutes-82205065-49935357 validations in Opserver passed 2026-08-31 04:00:19,475 - INFO - Waiting for VM ctest-TestRoutes-82205065-52753181 to be up.. 2026-08-31 04:00:19,562 - DEBUG - VM is in ERROR state now 2026-08-31 04:00:19,562 - ERROR - VM in error state. 2026-08-31 04:00:19,562 - ERROR - VM is not in ACTIVE state 2026-08-31 04:00:19,705 - ERROR - Fatal Nova Exception while getting VM detail 2026-08-31 04:00:19,705 - DEBUG - None 2026-08-31 04:00:19,706 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-08-31 04:00:20,078 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-08-31 04:00:20,117 - DEBUG - Requesting: http://10.0.0.50:8082/domain/e2dd173c-f32f-4272-81b1-e77dae6a5597 2026-08-31 04:00:20,141 - DEBUG - Requesting: http://10.0.0.50:8082/project/6e0002a4-216f-436f-b848-8e2062132c1b 2026-08-31 04:00:20,262 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/63368958-c2fa-47cc-9217-642626313119 2026-08-31 04:00:20,283 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/63368958-c2fa-47cc-9217-642626313119 2026-08-31 04:00:20,298 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/492f9cbc-70bb-4f2f-b82a-6aaef689c568 2026-08-31 04:00:20,311 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/492f9cbc-70bb-4f2f-b82a-6aaef689c568 2026-08-31 04:00:20,323 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/700ce3f5-ef60-4f2e-901c-d6ac7b01dad2 2026-08-31 04:00:20,334 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-08-31 04:00:20,334 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/63368958-c2fa-47cc-9217-642626313119 2026-08-31 04:00:20,345 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/492f9cbc-70bb-4f2f-b82a-6aaef689c568 2026-08-31 04:00:20,365 - INFO - Verified VN network id 16 for VN 63368958-c2fa-47cc-9217-642626313119 2026-08-31 04:00:20,365 - INFO - Verifications in API Server for VN ctest-random-99257417 passed 2026-08-31 04:00:20,365 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/63368958-c2fa-47cc-9217-642626313119 2026-08-31 04:00:20,379 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/492f9cbc-70bb-4f2f-b82a-6aaef689c568 2026-08-31 04:00:20,389 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/492f9cbc-70bb-4f2f-b82a-6aaef689c568 2026-08-31 04:00:20,402 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/700ce3f5-ef60-4f2e-901c-d6ac7b01dad2 2026-08-31 04:00:20,438 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-82205065', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7149052472818550732', 'uuid-lslong': '10526992769014116633'}, 'enable': 'true', 'created': '2026-08-31T03:59:39', 'last-modified': '2026-08-31T03:59:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:40.853102'} 2026-08-31 04:00:20,447 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-08-31 04:00:20,455 - DEBUG - Control-node 10.0.0.185 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-82205065', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7149052472818550732', 'uuid-lslong': '10526992769014116633'}, 'enable': 'true', 'created': '2026-08-31T03:59:39', 'last-modified': '2026-08-31T03:59:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:40.861777'} 2026-08-31 04:00:20,462 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-08-31 04:00:20,471 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-82205065', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7149052472818550732', 'uuid-lslong': '10526992769014116633'}, 'enable': 'true', 'created': '2026-08-31T03:59:39', 'last-modified': '2026-08-31T03:59:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:40.878917'} 2026-08-31 04:00:20,496 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-08-31 04:00:20,496 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-random-99257417 passed 2026-08-31 04:00:20,497 - DEBUG - ====Verifying policy data for ctest-random-99257417 in API_Server ====== 2026-08-31 04:00:20,497 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-08-31 04:00:20,504 - DEBUG - Requesting: http://10.0.0.50:8082/domain/e2dd173c-f32f-4272-81b1-e77dae6a5597 2026-08-31 04:00:20,517 - DEBUG - Requesting: http://10.0.0.50:8082/project/6e0002a4-216f-436f-b848-8e2062132c1b 2026-08-31 04:00:20,632 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/63368958-c2fa-47cc-9217-642626313119 2026-08-31 04:00:20,647 - DEBUG - =>VN ctest-random-99257417 has no policy to be verified 2026-08-31 04:00:20,647 - DEBUG - Verifying the vn in opserver 2026-08-31 04:00:20,647 - DEBUG - Verifying the default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 virtual network link through opserver 10.0.0.50 2026-08-31 04:00:20,647 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-08-31 04:00:20,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-82205065:ctest-random-99257417?flat'} 2026-08-31 04:00:20,664 - DEBUG - Verifying the default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 virtual network link through opserver 10.0.0.185 2026-08-31 04:00:20,664 - DEBUG - Requesting: http://10.0.0.185:8081/analytics/uves/virtual-networks 2026-08-31 04:00:20,723 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'href': 'http://10.0.0.185:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-82205065:ctest-random-99257417?flat'} 2026-08-31 04:00:20,723 - DEBUG - Verifying the default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 virtual network link through opserver 10.0.0.38 2026-08-31 04:00:20,723 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-08-31 04:00:20,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-82205065:ctest-random-99257417', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-82205065:ctest-random-99257417?flat'} 2026-08-31 04:00:20,740 - INFO - Validated that VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 is found in opserver 2026-08-31 04:00:20,755 - DEBUG - VRF ids for VN ctest-random-99257417: {'10.0.0.186': '2'} 2026-08-31 04:00:20,755 - INFO - Deleting VM ctest-TestRoutes-82205065-49935357 2026-08-31 04:00:20,842 - DEBUG - Verifying in api server 10.0.0.38 2026-08-31 04:00:20,842 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:20,853 - DEBUG - VM ID c4cd552b-2163-4f3b-8e0c-fc56bc6f230a of VM ctest-TestRoutes-82205065-49935357 is still found in API Server 2026-08-31 04:00:22,854 - DEBUG - Verifying in api server 10.0.0.38 2026-08-31 04:00:22,854 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:22,866 - DEBUG - VM ID c4cd552b-2163-4f3b-8e0c-fc56bc6f230a of VM ctest-TestRoutes-82205065-49935357 is still found in API Server 2026-08-31 04:00:24,867 - DEBUG - Verifying in api server 10.0.0.38 2026-08-31 04:00:24,867 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:24,876 - DEBUG - Response Code: 404 2026-08-31 04:00:24,877 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:24,885 - DEBUG - Response Code: 404 2026-08-31 04:00:24,886 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/c4cd552b-2163-4f3b-8e0c-fc56bc6f230a 2026-08-31 04:00:24,893 - DEBUG - Response Code: 404 2026-08-31 04:00:24,893 - INFO - VM ctest-TestRoutes-82205065-49935357 is fully removed in API-Server 2026-08-31 04:00:25,046 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-08-31 04:00:25,100 - DEBUG - Validated that vrouter 10.0.0.186 does not have VMs route for VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:25,113 - DEBUG - Validated that vrouter 10.0.0.176 does not have VMs route for VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:25,113 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:25,113 - INFO - VM ctest-TestRoutes-82205065-49935357 is removed in Compute, and routes are removed in all compute nodes 2026-08-31 04:00:25,363 - INFO - Routes for VM ctest-TestRoutes-82205065-49935357 is removed in all control-nodes 2026-08-31 04:00:25,363 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6237-1:Compute:contrail-vrouter-agent:0?flat 2026-08-31 04:00:25,407 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6237-1?flat 2026-08-31 04:00:25,444 - DEBUG - VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is still present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:25,444 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-31 04:00:25,444 - DEBUG - interface for vm c4cd552b-2163-4f3b-8e0c-fc56bc6f230a deleted from vrouter uve ... 2026-08-31 04:00:28,445 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6237-1:Compute:contrail-vrouter-agent:0?flat 2026-08-31 04:00:28,486 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6237-1?flat 2026-08-31 04:00:28,518 - DEBUG - VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is still present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:28,519 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-31 04:00:28,519 - DEBUG - interface for vm c4cd552b-2163-4f3b-8e0c-fc56bc6f230a deleted from vrouter uve ... 2026-08-31 04:00:31,519 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6237-1:Compute:contrail-vrouter-agent:0?flat 2026-08-31 04:00:31,557 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6237-1?flat 2026-08-31 04:00:31,592 - DEBUG - VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is not present in vrouter an-jenkins-deploy-platform-ansible-os-6237-1 uve 2026-08-31 04:00:31,592 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-08-31 04:00:31,592 - DEBUG - interface for vm c4cd552b-2163-4f3b-8e0c-fc56bc6f230a deleted from vrouter uve ... 2026-08-31 04:00:31,592 - DEBUG - Deleted interface not in error interface list ... 2026-08-31 04:00:31,592 - DEBUG - Validated that VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is removed in Vrouter UVE 2026-08-31 04:00:31,592 - DEBUG - Verifying through opserver in 10.0.0.50 2026-08-31 04:00:31,592 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-82205065:ctest-random-99257417?flat 2026-08-31 04:00:31,616 - DEBUG - c4cd552b-2163-4f3b-8e0c-fc56bc6f230a BM not in default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 uve 2026-08-31 04:00:31,616 - DEBUG - Validated that VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is not present in the VN UVE 2026-08-31 04:00:31,616 - DEBUG - Verifying the c4cd552b-2163-4f3b-8e0c-fc56bc6f230a virtual network link through opserver 10.0.0.50 2026-08-31 04:00:31,616 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-08-31 04:00:31,632 - INFO - c4cd552b-2163-4f3b-8e0c-fc56bc6f230a vm uve deleted from opserver 2026-08-31 04:00:31,632 - DEBUG - Verifying the c4cd552b-2163-4f3b-8e0c-fc56bc6f230a virtual network link through opserver 10.0.0.185 2026-08-31 04:00:31,632 - DEBUG - Requesting: http://10.0.0.185:8081/analytics/uves/virtual-machines 2026-08-31 04:00:31,694 - INFO - c4cd552b-2163-4f3b-8e0c-fc56bc6f230a vm uve deleted from opserver 2026-08-31 04:00:31,694 - DEBUG - Verifying the c4cd552b-2163-4f3b-8e0c-fc56bc6f230a virtual network link through opserver 10.0.0.38 2026-08-31 04:00:31,694 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-08-31 04:00:31,710 - INFO - c4cd552b-2163-4f3b-8e0c-fc56bc6f230a vm uve deleted from opserver 2026-08-31 04:00:31,710 - INFO - Validated that VM c4cd552b-2163-4f3b-8e0c-fc56bc6f230a is removed from Opserver 2026-08-31 04:00:31,710 - INFO - Validate that Vrouter Route table does get cleared 2026-08-31 04:00:31,794 - INFO - Removed intf route table 9fd7ea50-5e0b-41ad-8ec6-3a07f6bca958 from port 3b1ff2b1-1440-4419-a0c4-34f6bb3e936c 2026-08-31 04:00:31,852 - INFO - Deleted Interface route table 9fd7ea50-5e0b-41ad-8ec6-3a07f6bca958 2026-08-31 04:00:31,852 - INFO - Skip interface_detach for VM ctest-TestRoutes-82205065-52753181 in state ERROR 2026-08-31 04:00:31,852 - INFO - Deleting VM ctest-TestRoutes-82205065-52753181 2026-08-31 04:00:31,852 - ERROR - VM ctest-TestRoutes-82205065-52753181 has failed to come up 2026-08-31 04:00:31,852 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-08-31T03:59:56Z', 'message': 'An error occurred, but the cause is unknown', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/compute/manager.py", line 2642, in _build_and_run_instance\n self.driver.spawn(context, instance, image_meta,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/driver.py", line 4768, in spawn\n self._create_guest_with_network(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/driver.py", line 8173, in _create_guest_with_network\n self._cleanup(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/driver.py", line 8150, in _create_guest_with_network\n guest = self._create_guest(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/driver.py", line 8083, in _create_guest\n guest = libvirt_guest.Guest.create(xml, self._host)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/guest.py", line 154, in create\n LOG.error(\'Error defining a guest with XML: %s\',\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/guest.py", line 151, in create\n guest = host.write_instance_config(xml)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/virt/libvirt/host.py", line 1246, in write_instance_config\n domain = self.get_connection().defineXML(xml)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/eventlet/tpool.py", line 186, in doit\n result = proxy_call(self._autowrap, f, *args, **kwargs)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/eventlet/tpool.py", line 144, in proxy_call\n rv = execute(f, *args, **kwargs)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/eventlet/tpool.py", line 125, in execute\n raise e.with_traceback(tb)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/eventlet/tpool.py", line 82, in tworker\n rv = meth(*args, **kwargs)\n File "/usr/lib64/python3.9/site-packages/libvirt.py", line 4559, in defineXML\n raise libvirtError(\'virDomainDefineXML() failed\')\nlibvirt.libvirtError: An error occurred, but the cause is unknown\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/compute/manager.py", line 2457, in _do_build_and_run_instance\n self._build_and_run_instance(context, instance, image,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/compute/manager.py", line 2749, in _build_and_run_instance\n raise exception.RescheduledException(\nnova.exception.RescheduledException: Build of instance 347a5ba1-a0de-4724-8535-16a585d45887 was re-scheduled: An error occurred, but the cause is unknown\n'} 2026-08-31 04:00:32,041 - DEBUG - Response for delete_port : () 2026-08-31 04:00:32,042 - INFO - Deleted port 3b1ff2b1-1440-4419-a0c4-34f6bb3e936c 2026-08-31 04:00:32,042 - INFO - Deleting VN ctest-random-99257417 2026-08-31 04:00:32,303 - DEBUG - Response for deleting network () 2026-08-31 04:00:32,303 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/492f9cbc-70bb-4f2f-b82a-6aaef689c568 2026-08-31 04:00:32,314 - DEBUG - Response Code: 404 2026-08-31 04:00:32,314 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-08-31 04:00:32,324 - DEBUG - Requesting: http://10.0.0.50:8082/domain/e2dd173c-f32f-4272-81b1-e77dae6a5597 2026-08-31 04:00:32,342 - DEBUG - Requesting: http://10.0.0.50:8082/project/6e0002a4-216f-436f-b848-8e2062132c1b 2026-08-31 04:00:32,466 - INFO - Validated that VN ctest-random-99257417 is not found in API Server 2026-08-31 04:00:32,483 - DEBUG - VN ctest-random-99257417 is not present in Agent 10.0.0.186 2026-08-31 04:00:32,497 - DEBUG - VN ctest-random-99257417 is not present in Agent 10.0.0.176 2026-08-31 04:00:32,497 - INFO - Validated that VN ctest-random-99257417 is not in any agent 2026-08-31 04:00:32,520 - DEBUG - VRF 2 is not seen in agent 10.0.0.186 2026-08-31 04:00:32,537 - DEBUG - Vrouter 10.0.0.186 does not have vrf 2 for VN ctest-random-99257417 2026-08-31 04:00:32,538 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestRoutes-82205065:ctest-random-99257417 2026-08-31 04:00:32,573 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-random-99257417 info 2026-08-31 04:00:33,897 - DEBUG - No XMPP flaps were noticed during the test
2026-08-31 04:00:33,897 - INFO - END TEST : test_rt_table_scenario_1 : PASSED[0:00:56]
2026-08-31 04:00:33,897 - INFO - -------------------------------------------------------------------------------- 2026-08-31 04:00:34,783 - INFO - Deleted project: ctest-TestRoutes-82205065, ID : 6e0002a4-216f-436f-b848-8e2062132c1b