2025-10-10 12:14:41,433 - INFO - Domain Default found not creating
2025-10-10 12:14:41,622 - INFO - Project ctest-TestBasicVMVN-81967089 not found, creating it
2025-10-10 12:14:42,135 - INFO - Created Project:ctest-TestBasicVMVN-81967089, ID : 96db0cc3-3b02-442f-986f-36bb15271a31
2025-10-10 12:14:43,761 - INFO - ================================================================================
2025-10-10 12:14:43,761 - INFO - STARTING TEST : test_generic_link_local_service
2025-10-10 12:14:43,761 - INFO - TEST DESCRIPTION :
Description: Test to validate generic linklocal service - running nova list from vm.
1.Create generic link local service to be able to wget to jenkins
2.Create a vm
3.Try wget to jenkins - passes if successful else fails
Maintainer: sandipd@juniper.net
2025-10-10 12:14:43,890 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.254': '0'}} with
2025-10-10 12:14:43,890 - INFO - Initial checks done. Running the testcase now
2025-10-10 12:14:43,890 - INFO -
2025-10-10 12:14:44,459 - DEBUG - Response for create_network : {'network': {'id': '1d075683-327a-4f84-af17-8ad61250e554', 'name': 'ctest-vn2_metadata-06571365', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'project_id': '96db0cc33b02442f986f36bb15271a31', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-81967089', 'ctest-vn2_metadata-06571365'], 'port_security_enabled': True, 'description': ''}}
2025-10-10 12:14:44,630 - DEBUG - Response for create_subnet : {'subnet': {'id': '8a117d48-ee67-4ebf-b0b9-c3aa210a779b', 'name': '', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'network_id': '1d075683-327a-4f84-af17-8ad61250e554', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '96db0cc33b02442f986f36bb15271a31'}}
2025-10-10 12:14:44,651 - INFO - Created VN ctest-vn2_metadata-06571365
2025-10-10 12:14:44,707 - DEBUG - VN ctest-vn2_metadata-06571365 UUID is 1d075683-327a-4f84-af17-8ad61250e554
2025-10-10 12:14:44,990 - DEBUG - Services list from nova: [, , ]
2025-10-10 12:14:46,115 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4285-1)
2025-10-10 12:14:46,226 - DEBUG - Link local service introspect added
2025-10-10 12:14:46,290 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-10 12:14:51,357 - DEBUG - VM is in ERROR state now
2025-10-10 12:14:51,357 - ERROR - VM in error state.
2025-10-10 12:14:51,427 - DEBUG - VM is in ERROR state now
2025-10-10 12:14:51,427 - ERROR - VM in error state.
2025-10-10 12:14:51,538 - DEBUG - Link local service introspect removed
2025-10-10 12:14:51,539 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-81967089-66961626 in state ERROR
2025-10-10 12:14:51,539 - INFO - Deleting VM ctest-TestBasicVMVN-81967089-66961626
2025-10-10 12:14:51,565 - ERROR - VM ctest-TestBasicVMVN-81967089-66961626 has failed to come up
2025-10-10 12:14:51,565 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-10-10T12:14:47Z', 'message': "Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:ce:8e:a4:0d:2c,has_traffic_filtering=True,id=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8,network=Network(1d075683-327a-4f84-af17-8ad61250e554),plugin='vrouter',port_p", 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/os_vif/__init__.py", line 77, in plug\n plugin.plug(vif, instance_info)\n File "/opt/plugin/site-packages/vif_plug_vrouter/vrouter.py", line 271, in plug\n self._vrouter_port_add(instance_info, vif)\n File "/opt/plugin/site-packages/vif_plug_vrouter/vrouter.py", line 263, in _vrouter_port_add\n vhostuser_socket, vhostuser_mode)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 272, in _wrap\n r_call_timeout)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 215, in remote_call\n raise exc_type(*result[2])\nvif_plug_vrouter.exception.VrouterPortControlError: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8\', \'--instance_uuid=6eff6a4f-8c79-4077-b0e2-283c62ae6956\', \'--vn_uuid=1d075683-327a-4f84-af17-8ad61250e554\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=11.1.1.3\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-66961626\', \'--mac=02:ce:8e:a4:0d:2c\', \'--tap_name=tapce8ea40d-2c\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 699, in _plug_os_vif\n os_vif.plug(vif, instance_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/os_vif/__init__.py", line 82, in plug\n raise os_vif.exception.PlugException(vif=vif, err=err)\nos_vif.exception.PlugException: Failed to plug VIF VIFGeneric(active=True,address=02:ce:8e:a4:0d:2c,has_traffic_filtering=True,id=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8,network=Network(1d075683-327a-4f84-af17-8ad61250e554),plugin=\'vrouter\',port_profile=>,preserve_on_delete=False,vif_name=\'tapce8ea40d-2c\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8\', \'--instance_uuid=6eff6a4f-8c79-4077-b0e2-283c62ae6956\', \'--vn_uuid=1d075683-327a-4f84-af17-8ad61250e554\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=11.1.1.3\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-66961626\', \'--mac=02:ce:8e:a4:0d:2c\', \'--tap_name=tapce8ea40d-2c\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2521, in _build_and_run_instance\n accel_info=accel_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 4339, in spawn\n cleanup_instance_disks=created_disks)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7523, in _create_guest_with_network\n cleanup_instance_disks=cleanup_instance_disks)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7492, in _create_guest_with_network\n self.plug_vifs(instance, network_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 1386, in plug_vifs\n self.vif_driver.plug(instance, vif)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 723, in plug\n self._plug_os_vif(instance, vif_obj)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 703, in _plug_os_vif\n raise exception.InternalError(msg)\nnova.exception.InternalError: Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:ce:8e:a4:0d:2c,has_traffic_filtering=True,id=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8,network=Network(1d075683-327a-4f84-af17-8ad61250e554),plugin=\'vrouter\',port_profile=>,preserve_on_delete=False,vif_name=\'tapce8ea40d-2c\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8\', \'--instance_uuid=6eff6a4f-8c79-4077-b0e2-283c62ae6956\', \'--vn_uuid=1d075683-327a-4f84-af17-8ad61250e554\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=11.1.1.3\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-66961626\', \'--mac=02:ce:8e:a4:0d:2c\', \'--tap_name=tapce8ea40d-2c\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2337, in _do_build_and_run_instance\n filter_properties, request_spec, accel_uuids)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2625, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=str(e))\nnova.exception.RescheduledException: Build of instance 6eff6a4f-8c79-4077-b0e2-283c62ae6956 was re-scheduled: Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:ce:8e:a4:0d:2c,has_traffic_filtering=True,id=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8,network=Network(1d075683-327a-4f84-af17-8ad61250e554),plugin=\'vrouter\',port_profile=>,preserve_on_delete=False,vif_name=\'tapce8ea40d-2c\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=ce8ea40d-2c93-4666-8e11-bdcbbf66cec8\', \'--instance_uuid=6eff6a4f-8c79-4077-b0e2-283c62ae6956\', \'--vn_uuid=1d075683-327a-4f84-af17-8ad61250e554\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=11.1.1.3\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-66961626\', \'--mac=02:ce:8e:a4:0d:2c\', \'--tap_name=tapce8ea40d-2c\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n'}
2025-10-10 12:14:51,566 - INFO - Deleting VN ctest-vn2_metadata-06571365
2025-10-10 12:14:51,692 - DEBUG - Response for deleting network ()
2025-10-10 12:14:51,817 - ERROR - Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 290, in test_generic_link_local_service
compute_user = self.inputs.host_data[vm1_fixture.vm_node_ip]['username']
File "/contrail-test/fixtures/vm_test.py", line 386, in vm_node_ip
self.get_host_of_vm(refresh=True))
File "/contrail-test/fixtures/vm_test.py", line 400, in get_host_of_vm
assert self.wait_till_vm_is_active()
AssertionError
2025-10-10 12:14:51,823 - DEBUG - No XMPP flaps were noticed during the test
2025-10-10 12:14:51,823 - INFO -
2025-10-10 12:14:51,823 - INFO - END TEST : test_generic_link_local_service : FAILED[0:00:08]
2025-10-10 12:14:51,823 - INFO - --------------------------------------------------------------------------------
2025-10-10 12:14:51,826 - INFO - ================================================================================
2025-10-10 12:14:51,826 - INFO - STARTING TEST : test_metadata_service
2025-10-10 12:14:51,826 - INFO - TEST DESCRIPTION :
Description: Test to validate metadata service on VM creation.
1.Verify from global-vrouter-config if metadata configures or not - fails otherwise
2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node
3.Create a vm with userdata pointing to that script - script should get executed during vm boot up
4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise
Maintainer: sandipd@juniper.net
2025-10-10 12:14:51,987 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.254': '0'}} with
2025-10-10 12:14:51,987 - INFO - Initial checks done. Running the testcase now
2025-10-10 12:14:51,987 - INFO -
2025-10-10 12:14:51,987 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-configs
2025-10-10 12:14:52,285 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-configs
2025-10-10 12:14:52,323 - DEBUG - Requesting: http://10.0.0.27:8082/global-vrouter-config/96a3bf7e-eba5-47c0-b34e-6b1046387df1
2025-10-10 12:14:52,537 - DEBUG - Response for create_network : {'network': {'id': '6418343b-5d12-4045-ab22-6d240d0bb4e9', 'name': 'ctest-vn-72166235', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'project_id': '96db0cc33b02442f986f36bb15271a31', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-81967089', 'ctest-vn-72166235'], 'port_security_enabled': True, 'description': ''}}
2025-10-10 12:14:52,745 - DEBUG - Response for create_subnet : {'subnet': {'id': '3e1f6b64-8c13-4d18-84fc-4d9848c29a1c', 'name': '', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'network_id': '6418343b-5d12-4045-ab22-6d240d0bb4e9', 'ip_version': 4, 'cidr': '143.230.129.128/26', 'allocation_pools': [{'start': '143.230.129.130', 'end': '143.230.129.190'}], 'gateway_ip': '143.230.129.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.230.129.130', 'tags': [], 'project_id': '96db0cc33b02442f986f36bb15271a31'}}
2025-10-10 12:14:52,766 - INFO - Created VN ctest-vn-72166235
2025-10-10 12:14:52,823 - DEBUG - VN ctest-vn-72166235 UUID is 6418343b-5d12-4045-ab22-6d240d0bb4e9
2025-10-10 12:14:54,223 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4285-1)
2025-10-10 12:14:54,223 - INFO - Waiting for VM ctest-TestBasicVMVN-81967089-64628953 to be up..
2025-10-10 12:14:54,270 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-10 12:14:59,339 - DEBUG - VM is in ERROR state now
2025-10-10 12:14:59,339 - ERROR - VM in error state.
2025-10-10 12:14:59,339 - ERROR - VM is not in ACTIVE state
2025-10-10 12:14:59,433 - ERROR - Fatal Nova Exception while getting VM detail
2025-10-10 12:14:59,433 - DEBUG - None
2025-10-10 12:14:59,434 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-81967089-64628953 in state ERROR
2025-10-10 12:14:59,434 - INFO - Deleting VM ctest-TestBasicVMVN-81967089-64628953
2025-10-10 12:14:59,434 - ERROR - VM ctest-TestBasicVMVN-81967089-64628953 has failed to come up
2025-10-10 12:14:59,434 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-10-10T12:14:55Z', 'message': "Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:90:37:a0:3d:05,has_traffic_filtering=True,id=9037a03d-0521-4ad2-b77f-9a8e45f47462,network=Network(6418343b-5d12-4045-ab22-6d240d0bb4e9),plugin='vrouter',port_p", 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/os_vif/__init__.py", line 77, in plug\n plugin.plug(vif, instance_info)\n File "/opt/plugin/site-packages/vif_plug_vrouter/vrouter.py", line 271, in plug\n self._vrouter_port_add(instance_info, vif)\n File "/opt/plugin/site-packages/vif_plug_vrouter/vrouter.py", line 263, in _vrouter_port_add\n vhostuser_socket, vhostuser_mode)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 272, in _wrap\n r_call_timeout)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 215, in remote_call\n raise exc_type(*result[2])\nvif_plug_vrouter.exception.VrouterPortControlError: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=9037a03d-0521-4ad2-b77f-9a8e45f47462\', \'--instance_uuid=bfe4a873-8328-485e-b780-02c32071b213\', \'--vn_uuid=6418343b-5d12-4045-ab22-6d240d0bb4e9\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=143.230.129.131\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-64628953\', \'--mac=02:90:37:a0:3d:05\', \'--tap_name=tap9037a03d-05\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 699, in _plug_os_vif\n os_vif.plug(vif, instance_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/os_vif/__init__.py", line 82, in plug\n raise os_vif.exception.PlugException(vif=vif, err=err)\nos_vif.exception.PlugException: Failed to plug VIF VIFGeneric(active=True,address=02:90:37:a0:3d:05,has_traffic_filtering=True,id=9037a03d-0521-4ad2-b77f-9a8e45f47462,network=Network(6418343b-5d12-4045-ab22-6d240d0bb4e9),plugin=\'vrouter\',port_profile=>,preserve_on_delete=False,vif_name=\'tap9037a03d-05\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=9037a03d-0521-4ad2-b77f-9a8e45f47462\', \'--instance_uuid=bfe4a873-8328-485e-b780-02c32071b213\', \'--vn_uuid=6418343b-5d12-4045-ab22-6d240d0bb4e9\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=143.230.129.131\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-64628953\', \'--mac=02:90:37:a0:3d:05\', \'--tap_name=tap9037a03d-05\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2521, in _build_and_run_instance\n accel_info=accel_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 4339, in spawn\n cleanup_instance_disks=created_disks)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7523, in _create_guest_with_network\n cleanup_instance_disks=cleanup_instance_disks)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7492, in _create_guest_with_network\n self.plug_vifs(instance, network_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 1386, in plug_vifs\n self.vif_driver.plug(instance, vif)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 723, in plug\n self._plug_os_vif(instance, vif_obj)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 703, in _plug_os_vif\n raise exception.InternalError(msg)\nnova.exception.InternalError: Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:90:37:a0:3d:05,has_traffic_filtering=True,id=9037a03d-0521-4ad2-b77f-9a8e45f47462,network=Network(6418343b-5d12-4045-ab22-6d240d0bb4e9),plugin=\'vrouter\',port_profile=>,preserve_on_delete=False,vif_name=\'tap9037a03d-05\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=9037a03d-0521-4ad2-b77f-9a8e45f47462\', \'--instance_uuid=bfe4a873-8328-485e-b780-02c32071b213\', \'--vn_uuid=6418343b-5d12-4045-ab22-6d240d0bb4e9\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=143.230.129.131\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-64628953\', \'--mac=02:90:37:a0:3d:05\', \'--tap_name=tap9037a03d-05\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2337, in _do_build_and_run_instance\n filter_properties, request_spec, accel_uuids)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2625, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=str(e))\nnova.exception.RescheduledException: Build of instance bfe4a873-8328-485e-b780-02c32071b213 was re-scheduled: Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:90:37:a0:3d:05,has_traffic_filtering=True,id=9037a03d-0521-4ad2-b77f-9a8e45f47462,network=Network(6418343b-5d12-4045-ab22-6d240d0bb4e9),plugin=\'vrouter\',port_profile=>,preserve_on_delete=False,vif_name=\'tap9037a03d-05\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=9037a03d-0521-4ad2-b77f-9a8e45f47462\', \'--instance_uuid=bfe4a873-8328-485e-b780-02c32071b213\', \'--vn_uuid=6418343b-5d12-4045-ab22-6d240d0bb4e9\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=143.230.129.131\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-64628953\', \'--mac=02:90:37:a0:3d:05\', \'--tap_name=tap9037a03d-05\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n'}
2025-10-10 12:14:59,434 - INFO - Deleting VN ctest-vn-72166235
2025-10-10 12:14:59,554 - DEBUG - Response for deleting network ()
2025-10-10 12:14:59,688 - ERROR - AssertionError
Python 3.9.21: /usr/bin/python3
Fri Oct 10 12:14:59 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/vm_regression/test_vm_basic.py in test_metadata_service(self=)
55 image_name='cirros',
56 userdata='/tmp/metadata_script.txt')
57 assert vm1_fixture.wait_till_vm_is_up()
58
59 cmd = 'cat /tmp/output.txt'
vm1_fixture =
vm1_fixture.wait_till_vm_is_up = >
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 57, in test_metadata_service
assert vm1_fixture.wait_till_vm_is_up()
AssertionError
2025-10-10 12:14:59,695 - DEBUG - No XMPP flaps were noticed during the test
2025-10-10 12:14:59,695 - INFO -
2025-10-10 12:14:59,695 - INFO - END TEST : test_metadata_service : FAILED[0:00:08]
2025-10-10 12:14:59,695 - INFO - --------------------------------------------------------------------------------
2025-10-10 12:14:59,697 - INFO - ================================================================================
2025-10-10 12:14:59,698 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets
2025-10-10 12:14:59,698 - INFO - TEST DESCRIPTION :
Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN
subnets.
Test steps:
1. Create 1 IPAM's.
2. Create 1 VN with 2 subnets and launch 2 VMs in them.
3. Ping between the VMs in the same VN should go thru fine.
4. Ping to the subnet broadcast and all-broadcast address.
Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the
all-broadcast address.
Maintainer : ganeshahv@juniper.net
2025-10-10 12:14:59,864 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.254': '0'}} with
2025-10-10 12:14:59,864 - INFO - Initial checks done. Running the testcase now
2025-10-10 12:14:59,864 - INFO -
2025-10-10 12:15:00,390 - DEBUG - Response for create_network : {'network': {'id': '15439a33-fdee-4c7d-ad07-096f639e5674', 'name': 'ctest-vn-14153784', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'project_id': '96db0cc33b02442f986f36bb15271a31', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-81967089', 'ctest-vn-14153784'], 'port_security_enabled': True, 'description': ''}}
2025-10-10 12:15:00,587 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f3d726b8-5b13-4c0b-a04b-d0795376c657', 'name': '', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'network_id': '15439a33-fdee-4c7d-ad07-096f639e5674', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '96db0cc33b02442f986f36bb15271a31'}}
2025-10-10 12:15:00,805 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ee186ac3-c700-454b-9362-3a0adfaee311', 'name': '', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'network_id': '15439a33-fdee-4c7d-ad07-096f639e5674', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '96db0cc33b02442f986f36bb15271a31'}}
2025-10-10 12:15:00,834 - INFO - Created VN ctest-vn-14153784
2025-10-10 12:15:00,895 - DEBUG - VN ctest-vn-14153784 UUID is 15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:01,334 - DEBUG - Response for create_port : {'port': {'name': '84a9c822-c3fa-44d7-85dd-c4d53206ffee', 'id': '84a9c822-c3fa-44d7-85dd-c4d53206ffee', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'network_id': '15439a33-fdee-4c7d-ad07-096f639e5674', 'mac_address': '02:84:a9:c8:22:c3', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'f3d726b8-5b13-4c0b-a04b-d0795376c657'}], 'security_groups': ['d9a2f4cf-3df0-4e19-9ed2-0155123269c3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '96db0cc33b02442f986f36bb15271a31'}}
2025-10-10 12:15:01,572 - DEBUG - Response for create_port : {'port': {'name': '16af6e65-c985-4732-8407-8d1682c98a63', 'id': '16af6e65-c985-4732-8407-8d1682c98a63', 'tenant_id': '96db0cc33b02442f986f36bb15271a31', 'network_id': '15439a33-fdee-4c7d-ad07-096f639e5674', 'mac_address': '02:16:af:6e:65:c9', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'ee186ac3-c700-454b-9362-3a0adfaee311'}], 'security_groups': ['d9a2f4cf-3df0-4e19-9ed2-0155123269c3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '96db0cc33b02442f986f36bb15271a31'}}
2025-10-10 12:15:02,216 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4285-1)
2025-10-10 12:15:02,895 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4285-1)
2025-10-10 12:15:04,391 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-4285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-4285-1)
2025-10-10 12:15:04,391 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-10-10 12:15:04,399 - DEBUG - Requesting: http://10.0.0.27:8082/domain/9aaeb56d-85ca-447c-89d9-59b0c8370332
2025-10-10 12:15:04,414 - DEBUG - Requesting: http://10.0.0.27:8082/project/96db0cc3-3b02-442f-986f-36bb15271a31
2025-10-10 12:15:04,493 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/27253223-a474-4b14-8fb7-f86ac65785a1
2025-10-10 12:15:04,505 - INFO - Verifications in API Server for IPAM: ctest-ipam-49719465 passed
2025-10-10 12:15:04,515 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-81967089:ctest-ipam-49719465', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-81967089', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2820715870281812756', 'uuid-lslong': '10356019005639591329'}, 'enable': 'true', 'created': '2025-10-10T12:14:59', 'last-modified': '2025-10-10T12:15:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.403355'}
2025-10-10 12:15:04,515 - INFO - Verifications in Control node for IPAM: ctest-ipam-49719465 passed
2025-10-10 12:15:04,515 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-10-10 12:15:04,524 - DEBUG - Requesting: http://10.0.0.27:8082/domain/9aaeb56d-85ca-447c-89d9-59b0c8370332
2025-10-10 12:15:04,536 - DEBUG - Requesting: http://10.0.0.27:8082/project/96db0cc3-3b02-442f-986f-36bb15271a31
2025-10-10 12:15:04,627 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:04,642 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:04,661 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/920023c1-0c2a-4c5d-9dfd-c26076cc1cb5
2025-10-10 12:15:04,670 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/920023c1-0c2a-4c5d-9dfd-c26076cc1cb5
2025-10-10 12:15:04,685 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/1609108c-5186-4810-9f7e-776341cefe8c
2025-10-10 12:15:04,695 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-10 12:15:04,695 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:04,710 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/920023c1-0c2a-4c5d-9dfd-c26076cc1cb5
2025-10-10 12:15:04,748 - INFO - Verified VN network id 11 for VN 15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:04,748 - INFO - Verifications in API Server for VN ctest-vn-14153784 passed
2025-10-10 12:15:04,748 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:04,764 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/920023c1-0c2a-4c5d-9dfd-c26076cc1cb5
2025-10-10 12:15:04,776 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/920023c1-0c2a-4c5d-9dfd-c26076cc1cb5
2025-10-10 12:15:04,787 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/1609108c-5186-4810-9f7e-776341cefe8c
2025-10-10 12:15:04,800 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-81967089:ctest-vn-14153784', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-81967089', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1532237846330363005', 'uuid-lslong': '12467944467415848564'}, 'enable': 'true', 'created': '2025-10-10T12:15:00', 'last-modified': '2025-10-10T12:15:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.037001'}
2025-10-10 12:15:04,807 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-10 12:15:04,807 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-14153784 passed
2025-10-10 12:15:04,807 - DEBUG - ====Verifying policy data for ctest-vn-14153784 in API_Server ======
2025-10-10 12:15:04,807 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-10-10 12:15:04,816 - DEBUG - Requesting: http://10.0.0.27:8082/domain/9aaeb56d-85ca-447c-89d9-59b0c8370332
2025-10-10 12:15:04,837 - DEBUG - Requesting: http://10.0.0.27:8082/project/96db0cc3-3b02-442f-986f-36bb15271a31
2025-10-10 12:15:04,942 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/15439a33-fdee-4c7d-ad07-096f639e5674
2025-10-10 12:15:04,952 - DEBUG - =>VN ctest-vn-14153784 has no policy to be verified
2025-10-10 12:15:04,952 - DEBUG - Verifying the vn in opserver
2025-10-10 12:15:04,952 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-81967089:ctest-vn-14153784 virtual network link through opserver 10.0.0.27
2025-10-10 12:15:04,952 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-10-10 12:15:05,272 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-10-10 12:15:05,395 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-81967089:ctest-vn-14153784', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-81967089:ctest-vn-14153784?flat'}
2025-10-10 12:15:05,395 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-81967089:ctest-vn-14153784 is found in opserver
2025-10-10 12:15:05,406 - DEBUG - Do not have enough data to verify VN in agent
2025-10-10 12:15:05,410 - DEBUG - VRF ids for VN ctest-vn-14153784: {}
2025-10-10 12:15:05,411 - INFO - Waiting for VM ctest-TestBasicVMVN-81967089-53515656 to be up..
2025-10-10 12:15:05,530 - DEBUG - VM is in ERROR state now
2025-10-10 12:15:05,530 - ERROR - VM in error state.
2025-10-10 12:15:05,530 - ERROR - VM is not in ACTIVE state
2025-10-10 12:15:05,676 - ERROR - Fatal Nova Exception while getting VM detail
2025-10-10 12:15:05,677 - DEBUG - None
2025-10-10 12:15:05,678 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-81967089-78858780 in state BUILD
2025-10-10 12:15:05,678 - INFO - Deleting VM ctest-TestBasicVMVN-81967089-78858780
2025-10-10 12:15:05,678 - ERROR - VM ctest-TestBasicVMVN-81967089-78858780 has failed to come up
2025-10-10 12:15:05,678 - ERROR - Nova failed to get host of the VM
2025-10-10 12:15:05,821 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-81967089-05845733 in state BUILD
2025-10-10 12:15:05,821 - INFO - Deleting VM ctest-TestBasicVMVN-81967089-05845733
2025-10-10 12:15:05,821 - ERROR - VM ctest-TestBasicVMVN-81967089-05845733 has failed to come up
2025-10-10 12:15:05,821 - ERROR - Nova failed to get host of the VM
2025-10-10 12:15:06,122 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-81967089-53515656 in state ERROR
2025-10-10 12:15:06,122 - INFO - Deleting VM ctest-TestBasicVMVN-81967089-53515656
2025-10-10 12:15:06,122 - ERROR - VM ctest-TestBasicVMVN-81967089-53515656 has failed to come up
2025-10-10 12:15:06,122 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-10-10T12:15:04Z', 'message': "Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:84:a9:c8:22:c3,has_traffic_filtering=True,id=84a9c822-c3fa-44d7-85dd-c4d53206ffee,network=Network(15439a33-fdee-4c7d-ad07-096f639e5674),plugin='vrouter',port_p", 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/os_vif/__init__.py", line 77, in plug\n plugin.plug(vif, instance_info)\n File "/opt/plugin/site-packages/vif_plug_vrouter/vrouter.py", line 271, in plug\n self._vrouter_port_add(instance_info, vif)\n File "/opt/plugin/site-packages/vif_plug_vrouter/vrouter.py", line 263, in _vrouter_port_add\n vhostuser_socket, vhostuser_mode)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 272, in _wrap\n r_call_timeout)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 215, in remote_call\n raise exc_type(*result[2])\nvif_plug_vrouter.exception.VrouterPortControlError: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=84a9c822-c3fa-44d7-85dd-c4d53206ffee\', \'--instance_uuid=2655c4f1-60a6-4bdb-8304-e09db911aceb\', \'--vn_uuid=15439a33-fdee-4c7d-ad07-096f639e5674\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=31.1.1.4\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-53515656\', \'--mac=02:84:a9:c8:22:c3\', \'--tap_name=tap84a9c822-c3\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 699, in _plug_os_vif\n os_vif.plug(vif, instance_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/os_vif/__init__.py", line 82, in plug\n raise os_vif.exception.PlugException(vif=vif, err=err)\nos_vif.exception.PlugException: Failed to plug VIF VIFGeneric(active=True,address=02:84:a9:c8:22:c3,has_traffic_filtering=True,id=84a9c822-c3fa-44d7-85dd-c4d53206ffee,network=Network(15439a33-fdee-4c7d-ad07-096f639e5674),plugin=\'vrouter\',port_profile=>,preserve_on_delete=True,vif_name=\'tap84a9c822-c3\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=84a9c822-c3fa-44d7-85dd-c4d53206ffee\', \'--instance_uuid=2655c4f1-60a6-4bdb-8304-e09db911aceb\', \'--vn_uuid=15439a33-fdee-4c7d-ad07-096f639e5674\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=31.1.1.4\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-53515656\', \'--mac=02:84:a9:c8:22:c3\', \'--tap_name=tap84a9c822-c3\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2521, in _build_and_run_instance\n accel_info=accel_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 4339, in spawn\n cleanup_instance_disks=created_disks)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7523, in _create_guest_with_network\n cleanup_instance_disks=cleanup_instance_disks)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 7492, in _create_guest_with_network\n self.plug_vifs(instance, network_info)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 1386, in plug_vifs\n self.vif_driver.plug(instance, vif)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 723, in plug\n self._plug_os_vif(instance, vif_obj)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/virt/libvirt/vif.py", line 703, in _plug_os_vif\n raise exception.InternalError(msg)\nnova.exception.InternalError: Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:84:a9:c8:22:c3,has_traffic_filtering=True,id=84a9c822-c3fa-44d7-85dd-c4d53206ffee,network=Network(15439a33-fdee-4c7d-ad07-096f639e5674),plugin=\'vrouter\',port_profile=>,preserve_on_delete=True,vif_name=\'tap84a9c822-c3\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=84a9c822-c3fa-44d7-85dd-c4d53206ffee\', \'--instance_uuid=2655c4f1-60a6-4bdb-8304-e09db911aceb\', \'--vn_uuid=15439a33-fdee-4c7d-ad07-096f639e5674\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=31.1.1.4\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-53515656\', \'--mac=02:84:a9:c8:22:c3\', \'--tap_name=tap84a9c822-c3\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2337, in _do_build_and_run_instance\n filter_properties, request_spec, accel_uuids)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/compute/manager.py", line 2625, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=str(e))\nnova.exception.RescheduledException: Build of instance 2655c4f1-60a6-4bdb-8304-e09db911aceb was re-scheduled: Failure running os_vif plugin plug method: Failed to plug VIF VIFGeneric(active=True,address=02:84:a9:c8:22:c3,has_traffic_filtering=True,id=84a9c822-c3fa-44d7-85dd-c4d53206ffee,network=Network(15439a33-fdee-4c7d-ad07-096f639e5674),plugin=\'vrouter\',port_profile=>,preserve_on_delete=True,vif_name=\'tap84a9c822-c3\'). Got error: Error during the call to vrouter-port-control: (\'vrouter-port-control\', \'--oper=add\', \'--uuid=84a9c822-c3fa-44d7-85dd-c4d53206ffee\', \'--instance_uuid=2655c4f1-60a6-4bdb-8304-e09db911aceb\', \'--vn_uuid=15439a33-fdee-4c7d-ad07-096f639e5674\', \'--vm_project_uuid=96db0cc33b02442f986f36bb15271a31\', \'--ip_address=31.1.1.4\', \'--ipv6_address=None\', \'--vm_name=ctest-TestBasicVMVN-81967089-53515656\', \'--mac=02:84:a9:c8:22:c3\', \'--tap_name=tap84a9c822-c3\', \'--port_type=NovaVMPort\', \'--tx_vlan_id=-1\', \'--rx_vlan_id=-1\')\n'}
2025-10-10 12:15:06,123 - INFO - Deleting VN ctest-vn-14153784
2025-10-10 12:15:06,296 - DEBUG - Response for delete_port : ()
2025-10-10 12:15:06,481 - DEBUG - Response for delete_port : ()
2025-10-10 12:15:06,684 - DEBUG - Response for deleting network ()
2025-10-10 12:15:06,684 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/920023c1-0c2a-4c5d-9dfd-c26076cc1cb5
2025-10-10 12:15:06,690 - DEBUG - Response Code: 404
2025-10-10 12:15:06,691 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-10-10 12:15:06,696 - DEBUG - Requesting: http://10.0.0.27:8082/domain/9aaeb56d-85ca-447c-89d9-59b0c8370332
2025-10-10 12:15:06,758 - DEBUG - Requesting: http://10.0.0.27:8082/project/96db0cc3-3b02-442f-986f-36bb15271a31
2025-10-10 12:15:06,834 - INFO - Validated that VN ctest-vn-14153784 is not found in API Server
2025-10-10 12:15:06,850 - DEBUG - VN ctest-vn-14153784 is not present in Agent 10.0.0.27
2025-10-10 12:15:06,850 - INFO - Validated that VN ctest-vn-14153784 is not in any agent
2025-10-10 12:15:06,874 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-14153784 info
2025-10-10 12:15:06,978 - INFO - IPAM: ctest-ipam-49719465 is not found in API Server
2025-10-10 12:15:06,993 - INFO - IPAM:ctest-ipam-49719465 is not found in control node
2025-10-10 12:15:07,132 - ERROR - AssertionError
Python 3.9.21: /usr/bin/python3
Fri Oct 10 12:15:05 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=)
145 assert ipam_obj.verify_on_setup()
146 assert vn1_fixture.verify_on_setup()
147 assert vm1.wait_till_vm_is_up()
148 assert vm2.wait_till_vm_is_up()
149 assert vm3.wait_till_vm_is_up()
vm1 =
vm1.wait_till_vm_is_up = >
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 147, in test_ping_within_vn_two_vms_two_different_subnets
assert vm1.wait_till_vm_is_up()
AssertionError
2025-10-10 12:15:07,138 - DEBUG - No XMPP flaps were noticed during the test
2025-10-10 12:15:07,138 - INFO -
2025-10-10 12:15:07,138 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:08]
2025-10-10 12:15:07,138 - INFO - --------------------------------------------------------------------------------
2025-10-10 12:15:07,877 - INFO - Deleted project: ctest-TestBasicVMVN-81967089, ID : 96db0cc3-3b02-442f-986f-36bb15271a31