2026-11-09 04:06:18,400 - INFO - Domain Default found not creating 2026-11-09 04:06:18,659 - INFO - Project ctest-TestBGPaasZone-82437920 not found, creating it 2026-11-09 04:06:19,311 - INFO - Created Project:ctest-TestBGPaasZone-82437920, ID : b9bbd36f-02eb-484a-a6c9-3a7ee62056a7 2026-11-09 04:06:21,312 - DEBUG - Services list from nova: [, , , ] 2026-11-09 04:06:21,312 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6500-2', 'an-jenkins-deploy-platform-ansible-os-6500-1']} 2026-11-09 04:06:21,315 - INFO - ================================================================================ 2026-11-09 04:06:21,315 - INFO - STARTING TEST : test_bgp_control_node_zone 2026-11-09 04:06:21,974 - DEBUG - Skipping xmpp flap check 2026-11-09 04:06:21,975 - INFO - Initial checks done. Running the testcase now 2026-11-09 04:06:21,975 - INFO - 2026-11-09 04:06:21,975 - INFO - executing bgp_control_zone test 2026-11-09 04:06:22,761 - DEBUG - Response for create_network : {'network': {'id': '60c01279-1734-43e7-8cdb-2864579fe8d4', 'name': 'ctest-cnz_vn-74558812', 'tenant_id': 'b9bbd36f02eb484aa6c93a7ee62056a7', 'project_id': 'b9bbd36f02eb484aa6c93a7ee62056a7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-82437920', 'ctest-cnz_vn-74558812'], 'port_security_enabled': True, 'description': ''}} 2026-11-09 04:06:23,080 - DEBUG - Response for create_subnet : {'subnet': {'id': '80ac2c6f-739e-43c8-92d2-30b83684742d', 'name': '', 'tenant_id': 'b9bbd36f02eb484aa6c93a7ee62056a7', 'network_id': '60c01279-1734-43e7-8cdb-2864579fe8d4', 'ip_version': 4, 'cidr': '222.131.253.0/26', 'allocation_pools': [{'start': '222.131.253.2', 'end': '222.131.253.62'}], 'gateway_ip': '222.131.253.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '222.131.253.2', 'tags': [], 'project_id': 'b9bbd36f02eb484aa6c93a7ee62056a7'}} 2026-11-09 04:06:23,104 - INFO - Created VN ctest-cnz_vn-74558812 2026-11-09 04:06:23,125 - DEBUG - VN ctest-cnz_vn-74558812 UUID is 60c01279-1734-43e7-8cdb-2864579fe8d4 2026-11-09 04:06:24,138 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2) 2026-11-09 04:06:25,088 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1) 2026-11-09 04:06:26,124 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2) 2026-11-09 04:06:26,124 - INFO - Waiting for VM ctest-TestBGPaasZone-82437920-49026806 to be up.. 2026-11-09 04:06:26,185 - DEBUG - VM is in ERROR state now 2026-11-09 04:06:26,185 - ERROR - VM in error state. 2026-11-09 04:06:26,185 - ERROR - VM is not in ACTIVE state 2026-11-09 04:06:26,281 - ERROR - Fatal Nova Exception while getting VM detail 2026-11-09 04:06:26,281 - DEBUG - None 2026-11-09 04:06:26,281 - ERROR - VM ctest-TestBGPaasZone-82437920-49026806 has not booted 2026-11-09 04:06:26,281 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-49026806 in state ERROR 2026-11-09 04:06:26,281 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-49026806 2026-11-09 04:06:26,310 - ERROR - VM ctest-TestBGPaasZone-82437920-49026806 has failed to come up 2026-11-09 04:06:26,310 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:06:24Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:06:26,314 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-28803344 in state BUILD 2026-11-09 04:06:26,314 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-28803344 2026-11-09 04:06:26,314 - ERROR - VM ctest-TestBGPaasZone-82437920-28803344 has failed to come up 2026-11-09 04:06:26,314 - ERROR - Nova failed to get host of the VM 2026-11-09 04:06:26,314 - ERROR - VM ctest-TestBGPaasZone-82437920-28803344 has failed to come up 2026-11-09 04:06:26,314 - ERROR - Nova failed to get host of the VM 2026-11-09 04:06:26,439 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-23293887 in state BUILD 2026-11-09 04:06:26,439 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-23293887 2026-11-09 04:06:26,439 - ERROR - VM ctest-TestBGPaasZone-82437920-23293887 has failed to come up 2026-11-09 04:06:26,439 - ERROR - Nova failed to get host of the VM 2026-11-09 04:06:26,439 - ERROR - VM ctest-TestBGPaasZone-82437920-23293887 has failed to come up 2026-11-09 04:06:26,439 - ERROR - Nova failed to get host of the VM 2026-11-09 04:06:26,670 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-49026806 in state ERROR 2026-11-09 04:06:26,670 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-49026806 2026-11-09 04:06:26,670 - ERROR - VM ctest-TestBGPaasZone-82437920-49026806 has failed to come up 2026-11-09 04:06:26,670 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:06:24Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:06:26,671 - INFO - Deleting VN ctest-cnz_vn-74558812 2026-11-09 04:06:26,895 - DEBUG - Response for deleting network () 2026-11-09 04:06:27,706 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Nov 9 04:06:26 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py in test_bgp_control_node_zone(self=) 57 cnt = 0 58 self.logger.info('executing bgp_control_zone test') 59 assert self.basic_control_node_zone_setup() 60 # update control node zone with different bgp routers 61 self.update_control_node_zones(self.cnzs) self = self.basic_control_node_zone_setup = > /contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py in basic_control_node_zone_setup(self=, ctrl_zone=None) 31 self.vms.append(self.create_vm(vn_fixture=self.vn, image_name='ubuntu-bird')) 32 self.client_vm = self.create_vm(vn_fixture=self.vn, image_name='ubuntu-bird') 33 self.check_vms_booted(self.vms + [self.client_vm]) 34 for bgp_name in self.inputs.bgp_names: 35 self.cnzs += self.create_control_node_zones("test-zone",[bgp_name]) self = self.check_vms_booted = > self.vms = [, ] self.client_vm = /contrail-test/common/base.py in check_vms_booted(cls=, vms_list=[, , ], do_assert=True) 719 if failed and do_assert: 720 for vm_fixture in vms_list: 721 vm_fixture.cleanUp() 722 assert False, 'One or more vm-boots failed. Check logs' 723 if failed: vm_fixture = vm_fixture.cleanUp = > /contrail-test/fixtures/vm_test.py in cleanUp(self=) 2050 2051 def cleanUp(self): 2052 self.delete() 2053 super(VMFixture, self).cleanUp() 2054 self = self.delete = > /contrail-test/fixtures/vm_test.py in delete(self=, verify=False, force=False) 2080 self.webui.delete_vm(self) 2081 else: 2082 self.orch.delete_vm(vm_obj, force=force) 2083 self.vm_objs.remove(vm_obj) 2084 if self.inputs.ns_agilio_vrouter_data: self = self.orch = self.orch.delete_vm = > vm_obj = force = False /contrail-test/fixtures/openstack.py in delete_vm(self=, vm_obj=, **kwargs={'force': False}) 119 120 def delete_vm(self, vm_obj, **kwargs): 121 return self.nova_h.delete_vm(vm_obj, **kwargs) 122 123 def is_vm_deleted(self, vm_obj, **kwargs): self = self.nova_h = self.nova_h.delete_vm = > vm_obj = kwargs = {'force': False} /contrail-test/fixtures/nova_test.py in delete_vm(self=, vm_obj=, force=False) 772 def delete_vm(self, vm_obj, force=False): 773 if not force: 774 self.get_nova_host_of_vm(vm_obj) 775 vm_obj.delete() 776 # end _delete_vm self = self.get_nova_host_of_vm = > vm_obj = /contrail-test/fixtures/nova_test.py in get_nova_host_of_vm(self=, vm_obj=) 743 self.logger.error('VM %s has failed to come up' % vm_obj.name) 744 self.logger.error('Fault seen in nova show is: %s' % vm_obj.__dict__['fault']) 745 assert False, 'Fault seen in nova show %s is: %s' % ( 746 vm_obj.id, vm_obj.__dict__['fault']) 747 else: vm_obj = vm_obj.id = 'd8261b76-a12a-43f4-8c67-f21d75a62eff' vm_obj.__dict__ = {'OS-DCF:diskConfig': 'MANUAL', 'OS-EXT-AZ:availability_zone': 'nova', 'OS-EXT-SRV-ATTR:host': None, 'OS-EXT-SRV-ATTR:hypervisor_hostname': None, 'OS-EXT-SRV-ATTR:instance_name': 'instance-0000001f', 'OS-EXT-STS:power_state': 0, 'OS-EXT-STS:task_state': None, 'OS-EXT-STS:vm_state': 'error', 'OS-SRV-USG:launched_at': None, 'OS-SRV-USG:terminated_at': None, ...} AssertionError: Fault seen in nova show d8261b76-a12a-43f4-8c67-f21d75a62eff is: {'code': 500, 'created': '2026-11-09T04:06:24Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = (r"Fault seen in nova show d8261b76-a12a-43f4-8c67-...tion.NoValidHost: No valid host was found. \n\n'}",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py", line 59, in test_bgp_control_node_zone assert self.basic_control_node_zone_setup() File "/contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py", line 33, in basic_control_node_zone_setup self.check_vms_booted(self.vms + [self.client_vm]) File "/contrail-test/common/base.py", line 721, in check_vms_booted vm_fixture.cleanUp() File "/contrail-test/fixtures/vm_test.py", line 2052, in cleanUp self.delete() File "/contrail-test/fixtures/vm_test.py", line 2082, in delete self.orch.delete_vm(vm_obj, force=force) File "/contrail-test/fixtures/openstack.py", line 121, in delete_vm return self.nova_h.delete_vm(vm_obj, **kwargs) File "/contrail-test/fixtures/nova_test.py", line 774, in delete_vm self.get_nova_host_of_vm(vm_obj) File "/contrail-test/fixtures/nova_test.py", line 745, in get_nova_host_of_vm assert False, 'Fault seen in nova show %s is: %s' % ( AssertionError: Fault seen in nova show d8261b76-a12a-43f4-8c67-f21d75a62eff is: {'code': 500, 'created': '2026-11-09T04:06:24Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:06:27,707 - DEBUG - Skipping xmpp flap check 2026-11-09 04:06:27,707 - INFO -
2026-11-09 04:06:27,707 - INFO - END TEST : test_bgp_control_node_zone : FAILED[0:00:06]
2026-11-09 04:06:27,707 - INFO - -------------------------------------------------------------------------------- 2026-11-09 04:06:27,710 - INFO - ================================================================================ 2026-11-09 04:06:27,711 - INFO - STARTING TEST : test_bgp_control_node_zones_from_single_vnf 2026-11-09 04:06:28,524 - DEBUG - Skipping xmpp flap check 2026-11-09 04:06:28,525 - INFO - Initial checks done. Running the testcase now 2026-11-09 04:06:28,527 - INFO - 2026-11-09 04:06:28,528 - INFO - executing bgp_control_zone agent restart test 2026-11-09 04:06:28,969 - DEBUG - Response for create_network : {'network': {'id': 'bd2c9ab4-2004-4d87-99bd-bcb280ae8a63', 'name': 'ctest-cnz_vn-32396516', 'tenant_id': 'b9bbd36f02eb484aa6c93a7ee62056a7', 'project_id': 'b9bbd36f02eb484aa6c93a7ee62056a7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBGPaasZone-82437920', 'ctest-cnz_vn-32396516'], 'port_security_enabled': True, 'description': ''}} 2026-11-09 04:06:29,336 - DEBUG - Response for create_subnet : {'subnet': {'id': '9f9b14f5-17d5-46e0-952d-9aca3a4af339', 'name': '', 'tenant_id': 'b9bbd36f02eb484aa6c93a7ee62056a7', 'network_id': 'bd2c9ab4-2004-4d87-99bd-bcb280ae8a63', 'ip_version': 4, 'cidr': '177.250.20.0/26', 'allocation_pools': [{'start': '177.250.20.2', 'end': '177.250.20.62'}], 'gateway_ip': '177.250.20.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '177.250.20.2', 'tags': [], 'project_id': 'b9bbd36f02eb484aa6c93a7ee62056a7'}} 2026-11-09 04:06:29,416 - INFO - Created VN ctest-cnz_vn-32396516 2026-11-09 04:06:29,434 - DEBUG - VN ctest-cnz_vn-32396516 UUID is bd2c9ab4-2004-4d87-99bd-bcb280ae8a63 2026-11-09 04:06:31,396 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1) 2026-11-09 04:06:32,907 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2) 2026-11-09 04:06:34,470 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1) 2026-11-09 04:06:34,470 - INFO - Waiting for VM ctest-TestBGPaasZone-82437920-41815897 to be up.. 2026-11-09 04:06:34,545 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:06:39,911 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:06:45,014 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:06:50,121 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:06:55,226 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:00,333 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:05,460 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:10,558 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:15,673 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:20,766 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:25,858 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:30,954 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:36,054 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-11-09 04:07:41,148 - DEBUG - VM is in ACTIVE state now 2026-11-09 04:07:41,148 - INFO - VM name : ctest-TestBGPaasZone-82437920-41815897 2026-11-09 04:07:41,249 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 ID is 96f1afe0-63c2-4b50-8423-04c8a164c3f9 2026-11-09 04:07:41,249 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 launched on Node an-jenkins-deploy-platform-ansible-os-6500-1 2026-11-09 04:07:41,349 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/96f1afe0-63c2-4b50-8423-04c8a164c3f9 2026-11-09 04:07:41,726 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/96f1afe0-63c2-4b50-8423-04c8a164c3f9 2026-11-09 04:07:41,761 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/26aac62d-e06f-488f-a2a5-35f8368f21e0 2026-11-09 04:07:44,951 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2026-11-09 04:07:44,951 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:07:44,967 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:07:49,022 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2026-11-09 04:07:49,022 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:07:49,038 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:07:53,079 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2026-11-09 04:07:53,079 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:07:53,096 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:07:57,148 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2026-11-09 04:07:57,148 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:07:57,165 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:01,205 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2026-11-09 04:08:01,205 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:01,224 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:05,278 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2026-11-09 04:08:05,278 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:05,294 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:09,330 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2026-11-09 04:08:09,330 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:09,346 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:13,394 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2026-11-09 04:08:13,394 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:13,410 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:17,457 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2026-11-09 04:08:17,457 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:17,474 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:21,524 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2026-11-09 04:08:21,524 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:21,540 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:25,589 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2026-11-09 04:08:25,589 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:25,606 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:29,651 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2026-11-09 04:08:29,651 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:29,666 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:33,715 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2026-11-09 04:08:33,715 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:33,730 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:37,782 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2026-11-09 04:08:37,782 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 failed! 2026-11-09 04:08:37,797 - DEBUG - Gateway for vn default-domain:ctest-TestBGPaasZone-82437920:ctest-cnz_vn-32396516 is 177.250.20.1 and allocation pool is NOT set 2026-11-09 04:08:39,827 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=17.3 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.44 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.443/9.353/17.264/7.910 ms') 2026-11-09 04:08:39,827 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBGPaasZone-82437920-41815897 passed 2026-11-09 04:08:39,898 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:08:39,898 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:08:39,923 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:08:40,111 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:08:45,112 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:08:45,112 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:08:45,148 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:08:45,254 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:08:50,255 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:08:50,255 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:08:50,280 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:08:50,372 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:08:55,373 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:08:55,374 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:08:55,399 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:08:55,505 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:00,507 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:00,507 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:00,535 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:09:00,645 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:05,646 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:05,646 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:05,681 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:09:05,811 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:10,812 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:10,812 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:10,836 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:09:10,955 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:15,956 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:15,957 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:15,982 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:09:16,076 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:21,077 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:21,077 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:21,102 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:09:21,205 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:26,206 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:26,206 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:26,231 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-11-09 04:09:26,324 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is NOT ready for SSH connections, VM status: ACTIVE 2026-11-09 04:09:31,326 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-11-09 04:09:31,326 - DEBUG - Waiting to SSH to VM ctest-TestBGPaasZone-82437920-41815897, IP 177.250.20.3, Port 22 2026-11-09 04:09:31,416 - DEBUG - VM ctest-TestBGPaasZone-82437920-41815897 is ready for SSH connections 2026-11-09 04:09:31,416 - INFO - Waiting for VM ctest-TestBGPaasZone-82437920-64913445 to be up.. 2026-11-09 04:09:31,488 - DEBUG - VM is in ERROR state now 2026-11-09 04:09:31,488 - ERROR - VM in error state. 2026-11-09 04:09:31,488 - ERROR - VM is not in ACTIVE state 2026-11-09 04:09:31,589 - ERROR - Fatal Nova Exception while getting VM detail 2026-11-09 04:09:31,590 - DEBUG - None 2026-11-09 04:09:31,590 - ERROR - VM ctest-TestBGPaasZone-82437920-64913445 has not booted 2026-11-09 04:09:31,590 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-41815897 2026-11-09 04:09:31,678 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-64913445 in state ERROR 2026-11-09 04:09:31,679 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-64913445 2026-11-09 04:09:31,680 - ERROR - VM ctest-TestBGPaasZone-82437920-64913445 has failed to come up 2026-11-09 04:09:31,680 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:06:33Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:09:31,685 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-39689049 in state BUILD 2026-11-09 04:09:31,685 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-39689049 2026-11-09 04:09:31,685 - ERROR - VM ctest-TestBGPaasZone-82437920-39689049 has failed to come up 2026-11-09 04:09:31,686 - ERROR - Nova failed to get host of the VM 2026-11-09 04:09:31,686 - ERROR - VM ctest-TestBGPaasZone-82437920-39689049 has failed to come up 2026-11-09 04:09:31,686 - ERROR - Nova failed to get host of the VM 2026-11-09 04:09:31,762 - INFO - Skip interface_detach for VM ctest-TestBGPaasZone-82437920-64913445 in state ERROR 2026-11-09 04:09:31,763 - INFO - Deleting VM ctest-TestBGPaasZone-82437920-64913445 2026-11-09 04:09:31,763 - ERROR - VM ctest-TestBGPaasZone-82437920-64913445 has failed to come up 2026-11-09 04:09:31,763 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:06:33Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:09:31,765 - INFO - Deleting VN ctest-cnz_vn-32396516 2026-11-09 04:09:31,825 - DEBUG - VN bd2c9ab4-2004-4d87-99bd-bcb280ae8a63 still in use: Unable to complete operation on network bd2c9ab4-2004-4d87-99bd-bcb280ae8a63. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f02cda9b-5cb6-4dbb-99df-4851ba51b6f8'] 2026-11-09 04:09:31,825 - WARNING - Deleting VN ctest-cnz_vn-32396516 failed..Will retry 2026-11-09 04:09:33,890 - DEBUG - VN bd2c9ab4-2004-4d87-99bd-bcb280ae8a63 still in use: Unable to complete operation on network bd2c9ab4-2004-4d87-99bd-bcb280ae8a63. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a3c8ba3f-a2b0-4c56-ac2e-8ba4b3a3011f'] 2026-11-09 04:09:33,891 - WARNING - Deleting VN ctest-cnz_vn-32396516 failed..Will retry 2026-11-09 04:09:36,140 - DEBUG - Response for deleting network () 2026-11-09 04:09:36,836 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Nov 9 04:09:31 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py in test_bgp_control_node_zones_from_single_vnf(self=) 145 self.logger.info('executing bgp_control_zone agent restart test') 146 host_ips = [] 147 assert self.basic_control_node_zone_setup('both-zones') 148 for vm in self.vms: 149 assert self.verify_bgpaas_in_control_nodes_and_agent(self.bgpaas_fixtures[cnt],vm) self = self.basic_control_node_zone_setup = > /contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py in basic_control_node_zone_setup(self=, ctrl_zone='both-zones') 31 self.vms.append(self.create_vm(vn_fixture=self.vn, image_name='ubuntu-bird')) 32 self.client_vm = self.create_vm(vn_fixture=self.vn, image_name='ubuntu-bird') 33 self.check_vms_booted(self.vms + [self.client_vm]) 34 for bgp_name in self.inputs.bgp_names: 35 self.cnzs += self.create_control_node_zones("test-zone",[bgp_name]) self = self.check_vms_booted = > self.vms = [, ] self.client_vm = /contrail-test/common/base.py in check_vms_booted(cls=, vms_list=[, , ], do_assert=True) 719 if failed and do_assert: 720 for vm_fixture in vms_list: 721 vm_fixture.cleanUp() 722 assert False, 'One or more vm-boots failed. Check logs' 723 if failed: vm_fixture = vm_fixture.cleanUp = > /contrail-test/fixtures/vm_test.py in cleanUp(self=) 2050 2051 def cleanUp(self): 2052 self.delete() 2053 super(VMFixture, self).cleanUp() 2054 self = self.delete = > /contrail-test/fixtures/vm_test.py in delete(self=, verify=False, force=False) 2080 self.webui.delete_vm(self) 2081 else: 2082 self.orch.delete_vm(vm_obj, force=force) 2083 self.vm_objs.remove(vm_obj) 2084 if self.inputs.ns_agilio_vrouter_data: self = self.orch = self.orch.delete_vm = > vm_obj = force = False /contrail-test/fixtures/openstack.py in delete_vm(self=, vm_obj=, **kwargs={'force': False}) 119 120 def delete_vm(self, vm_obj, **kwargs): 121 return self.nova_h.delete_vm(vm_obj, **kwargs) 122 123 def is_vm_deleted(self, vm_obj, **kwargs): self = self.nova_h = self.nova_h.delete_vm = > vm_obj = kwargs = {'force': False} /contrail-test/fixtures/nova_test.py in delete_vm(self=, vm_obj=, force=False) 772 def delete_vm(self, vm_obj, force=False): 773 if not force: 774 self.get_nova_host_of_vm(vm_obj) 775 vm_obj.delete() 776 # end _delete_vm self = self.get_nova_host_of_vm = > vm_obj = /contrail-test/fixtures/nova_test.py in get_nova_host_of_vm(self=, vm_obj=) 743 self.logger.error('VM %s has failed to come up' % vm_obj.name) 744 self.logger.error('Fault seen in nova show is: %s' % vm_obj.__dict__['fault']) 745 assert False, 'Fault seen in nova show %s is: %s' % ( 746 vm_obj.id, vm_obj.__dict__['fault']) 747 else: vm_obj = vm_obj.id = '04208577-0434-4924-a1be-887ae9c0d65d' vm_obj.__dict__ = {'OS-DCF:diskConfig': 'MANUAL', 'OS-EXT-AZ:availability_zone': 'nova', 'OS-EXT-SRV-ATTR:host': None, 'OS-EXT-SRV-ATTR:hypervisor_hostname': None, 'OS-EXT-SRV-ATTR:instance_name': 'instance-00000021', 'OS-EXT-STS:power_state': 0, 'OS-EXT-STS:task_state': None, 'OS-EXT-STS:vm_state': 'error', 'OS-SRV-USG:launched_at': None, 'OS-SRV-USG:terminated_at': None, ...} AssertionError: Fault seen in nova show 04208577-0434-4924-a1be-887ae9c0d65d is: {'code': 500, 'created': '2026-11-09T04:06:33Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = (r"Fault seen in nova show 04208577-0434-4924-a1be-...tion.NoValidHost: No valid host was found. \n\n'}",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py", line 147, in test_bgp_control_node_zones_from_single_vnf assert self.basic_control_node_zone_setup('both-zones') File "/contrail-test/serial_scripts/bgpaas/test_bgpaas_zone.py", line 33, in basic_control_node_zone_setup self.check_vms_booted(self.vms + [self.client_vm]) File "/contrail-test/common/base.py", line 721, in check_vms_booted vm_fixture.cleanUp() File "/contrail-test/fixtures/vm_test.py", line 2052, in cleanUp self.delete() File "/contrail-test/fixtures/vm_test.py", line 2082, in delete self.orch.delete_vm(vm_obj, force=force) File "/contrail-test/fixtures/openstack.py", line 121, in delete_vm return self.nova_h.delete_vm(vm_obj, **kwargs) File "/contrail-test/fixtures/nova_test.py", line 774, in delete_vm self.get_nova_host_of_vm(vm_obj) File "/contrail-test/fixtures/nova_test.py", line 745, in get_nova_host_of_vm assert False, 'Fault seen in nova show %s is: %s' % ( AssertionError: Fault seen in nova show 04208577-0434-4924-a1be-887ae9c0d65d is: {'code': 500, 'created': '2026-11-09T04:06:33Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:09:36,837 - DEBUG - Skipping xmpp flap check 2026-11-09 04:09:36,837 - INFO -
2026-11-09 04:09:36,838 - INFO - END TEST : test_bgp_control_node_zones_from_single_vnf : FAILED[0:03:09]
2026-11-09 04:09:36,838 - INFO - -------------------------------------------------------------------------------- 2026-11-09 04:09:37,776 - INFO - Deleted project: ctest-TestBGPaasZone-82437920, ID : b9bbd36f-02eb-484a-a6c9-3a7ee62056a7