2026-11-09 04:15:27,451 - INFO - Domain Default found not creating 2026-11-09 04:15:27,649 - INFO - Project ctest-TestBasicVMVN0-34069908 not found, creating it 2026-11-09 04:15:28,166 - INFO - Created Project:ctest-TestBasicVMVN0-34069908, ID : 35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:30,010 - INFO - ================================================================================ 2026-11-09 04:15:30,010 - INFO - STARTING TEST : test_control_node_switchover 2026-11-09 04:15:30,011 - INFO - TEST DESCRIPTION : Stop the control node and check peering with agent fallback to other control node. 1. Pick one VN from respource pool which has 2 VM's in it 2. Verify ping between VM's 3. Find active control node in cluster by agent inspect 4. Stop control service on active control node 5. Verify agents are connected to new active control-node using xmpp connections 6. Bring back control service on previous active node 7. Verify ping between VM's again after bringing up control serveice Pass criteria: Step 2,5 and 7 should pass 2026-11-09 04:15:30,661 - DEBUG - Skipping xmpp flap check 2026-11-09 04:15:30,661 - INFO - Initial checks done. Running the testcase now 2026-11-09 04:15:30,661 - INFO - 2026-11-09 04:15:31,462 - DEBUG - Response for create_network : {'network': {'id': 'bdafc882-7572-4a43-893b-fa3def53e35c', 'name': 'ctest-vn1-15395046', 'tenant_id': '35763c96953a484da7f0636384a78efa', 'project_id': '35763c96953a484da7f0636384a78efa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN0-34069908', 'ctest-vn1-15395046'], 'port_security_enabled': True, 'description': ''}} 2026-11-09 04:15:31,762 - DEBUG - Response for create_subnet : {'subnet': {'id': '95781404-0b88-43e1-9440-06627caa27a6', 'name': '', 'tenant_id': '35763c96953a484da7f0636384a78efa', 'network_id': 'bdafc882-7572-4a43-893b-fa3def53e35c', 'ip_version': 4, 'cidr': '192.168.1.0/24', 'allocation_pools': [{'start': '192.168.1.2', 'end': '192.168.1.254'}], 'gateway_ip': '192.168.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.168.1.2', 'tags': [], 'project_id': '35763c96953a484da7f0636384a78efa'}} 2026-11-09 04:15:31,786 - INFO - Created VN ctest-vn1-15395046 2026-11-09 04:15:31,803 - DEBUG - VN ctest-vn1-15395046 UUID is bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:31,888 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:32,263 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:32,302 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:32,327 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:32,431 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:32,445 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:32,456 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02 2026-11-09 04:15:32,469 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02 2026-11-09 04:15:32,478 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/20b365df-5ce4-4213-af24-969751b31d67 2026-11-09 04:15:32,490 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:32,490 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:32,503 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02 2026-11-09 04:15:32,524 - INFO - Verified VN network id 25 for VN bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:32,524 - INFO - Verifications in API Server for VN ctest-vn1-15395046 passed 2026-11-09 04:15:32,524 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:32,535 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02 2026-11-09 04:15:32,543 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02 2026-11-09 04:15:32,553 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/20b365df-5ce4-4213-af24-969751b31d67 2026-11-09 04:15:32,572 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13668363856734472771', 'uuid-lslong': '9888772550737257308'}, 'enable': 'true', 'created': '2026-11-09T04:15:31', 'last-modified': '2026-11-09T04:15:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.890043'} 2026-11-09 04:15:32,580 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:32,587 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13668363856734472771', 'uuid-lslong': '9888772550737257308'}, 'enable': 'true', 'created': '2026-11-09T04:15:31', 'last-modified': '2026-11-09T04:15:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.913652'} 2026-11-09 04:15:32,594 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:32,600 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13668363856734472771', 'uuid-lslong': '9888772550737257308'}, 'enable': 'true', 'created': '2026-11-09T04:15:31', 'last-modified': '2026-11-09T04:15:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.931262'} 2026-11-09 04:15:32,609 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:32,609 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-15395046 passed 2026-11-09 04:15:32,610 - DEBUG - ====Verifying policy data for ctest-vn1-15395046 in API_Server ====== 2026-11-09 04:15:32,610 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:32,624 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:32,641 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:32,755 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c 2026-11-09 04:15:32,775 - DEBUG - =>VN ctest-vn1-15395046 has no policy to be verified 2026-11-09 04:15:32,775 - DEBUG - Verifying the vn in opserver 2026-11-09 04:15:32,775 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 virtual network link through opserver 10.0.0.248 2026-11-09 04:15:32,775 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks 2026-11-09 04:15:33,146 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks 2026-11-09 04:15:33,215 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046?flat'} 2026-11-09 04:15:33,215 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 virtual network link through opserver 10.0.0.249 2026-11-09 04:15:33,215 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-11-09 04:15:33,591 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-11-09 04:15:33,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046?flat'} 2026-11-09 04:15:33,663 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 virtual network link through opserver 10.0.0.33 2026-11-09 04:15:33,663 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-11-09 04:15:34,036 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-11-09 04:15:34,107 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046?flat'} 2026-11-09 04:15:34,107 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 is found in opserver 2026-11-09 04:15:34,131 - DEBUG - Do not have enough data to verify VN in agent 2026-11-09 04:15:34,142 - DEBUG - VRF ids for VN ctest-vn1-15395046: {} 2026-11-09 04:15:34,576 - DEBUG - Services list from nova: [, , , ] 2026-11-09 04:15:35,422 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2) 2026-11-09 04:15:36,634 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1) 2026-11-09 04:15:36,635 - INFO - Waiting for VM ctest-vn1_vm1-64408490 to be up.. 2026-11-09 04:15:36,710 - DEBUG - VM is in ERROR state now 2026-11-09 04:15:36,710 - ERROR - VM in error state. 2026-11-09 04:15:36,710 - ERROR - VM is not in ACTIVE state 2026-11-09 04:15:36,805 - ERROR - Fatal Nova Exception while getting VM detail 2026-11-09 04:15:36,805 - DEBUG - None 2026-11-09 04:15:36,809 - INFO - Skip interface_detach for VM ctest-vn1_vm2-66551375 in state BUILD 2026-11-09 04:15:36,809 - INFO - Deleting VM ctest-vn1_vm2-66551375 2026-11-09 04:15:36,838 - ERROR - VM ctest-vn1_vm2-66551375 has failed to come up 2026-11-09 04:15:36,838 - ERROR - Nova failed to get host of the VM 2026-11-09 04:15:36,838 - ERROR - VM ctest-vn1_vm2-66551375 has failed to come up 2026-11-09 04:15:36,838 - ERROR - Nova failed to get host of the VM 2026-11-09 04:15:36,977 - INFO - Skip interface_detach for VM ctest-vn1_vm1-64408490 in state ERROR 2026-11-09 04:15:36,977 - INFO - Deleting VM ctest-vn1_vm1-64408490 2026-11-09 04:15:36,977 - ERROR - VM ctest-vn1_vm1-64408490 has failed to come up 2026-11-09 04:15:36,977 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:15:35Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:15:36,977 - INFO - Deleting VN ctest-vn1-15395046 2026-11-09 04:15:37,221 - DEBUG - Response for deleting network () 2026-11-09 04:15:37,221 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02 2026-11-09 04:15:37,228 - DEBUG - Response Code: 404 2026-11-09 04:15:37,228 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:37,235 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:37,258 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:37,371 - INFO - Validated that VN ctest-vn1-15395046 is not found in API Server 2026-11-09 04:15:37,385 - DEBUG - VN ctest-vn1-15395046 is not present in Agent 10.0.0.250 2026-11-09 04:15:37,403 - DEBUG - VN ctest-vn1-15395046 is not present in Agent 10.0.0.38 2026-11-09 04:15:37,404 - INFO - Validated that VN ctest-vn1-15395046 is not in any agent 2026-11-09 04:15:37,461 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-15395046 info 2026-11-09 04:15:38,129 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Nov 9 04:15:36 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_control_node_switchover(self=) 635 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name) 636 vm2_fixture = self.create_vm(vn1_fixture, vn1_vm2_name) 637 assert vm1_fixture.wait_till_vm_is_up() 638 assert vm2_fixture.wait_till_vm_is_up() 639 assert vm1_fixture.ping_to_ip(vm2_fixture.vm_ip) vm1_fixture = vm1_fixture.wait_till_vm_is_up = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 637, in test_control_node_switchover assert vm1_fixture.wait_till_vm_is_up() AssertionError 2026-11-09 04:15:38,129 - DEBUG - Skipping xmpp flap check 2026-11-09 04:15:38,129 - INFO - 2026-11-09 04:15:38,129 - INFO - END TEST : test_control_node_switchover : FAILED[0:00:08] 2026-11-09 04:15:38,129 - INFO - -------------------------------------------------------------------------------- 2026-11-09 04:15:38,132 - INFO - ================================================================================ 2026-11-09 04:15:38,132 - INFO - STARTING TEST : test_process_restart_in_policy_between_vns 2026-11-09 04:15:38,132 - INFO - TEST DESCRIPTION : Test to validate that with policy having rule to check icmp fwding between VMs on different VNs , ping between VMs should pass with process restarts 1. Pick 2 VN's from resource pool which has one VM each 2. Create policy with icmp allow rule between those VN's and bind it networks 3. Ping from one VM to another VM 4. Restart process 'vrouter' and 'control' on setup 5. Ping again between VM's after process restart Pass criteria: Step 2,3,4 and 5 should pass 2026-11-09 04:15:38,777 - DEBUG - Skipping xmpp flap check 2026-11-09 04:15:38,777 - INFO - Initial checks done. Running the testcase now 2026-11-09 04:15:38,777 - INFO - 2026-11-09 04:15:38,785 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-11-09 04:15:39,065 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-11-09 04:15:39,673 - INFO - Created VN ctest-vn1-44321604, UUID :2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,031 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:40,039 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:40,052 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:40,163 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,178 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,189 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b 2026-11-09 04:15:40,200 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b 2026-11-09 04:15:40,208 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/0e5167dc-d9b6-4ced-a299-f4068a40d655 2026-11-09 04:15:40,217 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:40,217 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,228 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b 2026-11-09 04:15:40,247 - INFO - Verified VN network id 25 for VN 2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,248 - INFO - Verifications in API Server for VN ctest-vn1-44321604 passed 2026-11-09 04:15:40,248 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,259 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b 2026-11-09 04:15:40,267 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b 2026-11-09 04:15:40,276 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/0e5167dc-d9b6-4ced-a299-f4068a40d655 2026-11-09 04:15:40,293 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3338981488366535340', 'uuid-lslong': '13178287893471843998'}, 'enable': 'true', 'created': '2026-11-09T04:15:39', 'last-modified': '2026-11-09T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453379'} 2026-11-09 04:15:40,301 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:40,308 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3338981488366535340', 'uuid-lslong': '13178287893471843998'}, 'enable': 'true', 'created': '2026-11-09T04:15:39', 'last-modified': '2026-11-09T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467040'} 2026-11-09 04:15:40,314 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:40,321 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3338981488366535340', 'uuid-lslong': '13178287893471843998'}, 'enable': 'true', 'created': '2026-11-09T04:15:39', 'last-modified': '2026-11-09T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479029'} 2026-11-09 04:15:40,328 - DEBUG - Route Targets: ['target:64512:8000017'] 2026-11-09 04:15:40,328 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-44321604 passed 2026-11-09 04:15:40,328 - DEBUG - ====Verifying policy data for ctest-vn1-44321604 in API_Server ====== 2026-11-09 04:15:40,328 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:40,335 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:40,348 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:40,450 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e 2026-11-09 04:15:40,462 - DEBUG - =>VN ctest-vn1-44321604 has no policy to be verified 2026-11-09 04:15:40,462 - DEBUG - Verifying the vn in opserver 2026-11-09 04:15:40,462 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 virtual network link through opserver 10.0.0.248 2026-11-09 04:15:40,462 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks 2026-11-09 04:15:40,524 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604?flat'} 2026-11-09 04:15:40,524 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 virtual network link through opserver 10.0.0.249 2026-11-09 04:15:40,524 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-11-09 04:15:40,584 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604?flat'} 2026-11-09 04:15:40,584 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 virtual network link through opserver 10.0.0.33 2026-11-09 04:15:40,584 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-11-09 04:15:40,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604?flat'} 2026-11-09 04:15:40,654 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 is found in opserver 2026-11-09 04:15:40,680 - DEBUG - Do not have enough data to verify VN in agent 2026-11-09 04:15:40,693 - DEBUG - VRF ids for VN ctest-vn1-44321604: {} 2026-11-09 04:15:41,409 - INFO - Created VN ctest-vn2-34078452, UUID :571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:41,783 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:41,791 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:41,805 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:41,904 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:41,918 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:41,930 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54 2026-11-09 04:15:41,941 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54 2026-11-09 04:15:41,949 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/b35aabbb-fcef-451b-b5e5-650c6f3708d9 2026-11-09 04:15:41,958 - DEBUG - Route Targets: ['target:64512:8000018'] 2026-11-09 04:15:41,958 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:41,970 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54 2026-11-09 04:15:41,988 - INFO - Verified VN network id 26 for VN 571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:41,988 - INFO - Verifications in API Server for VN ctest-vn2-34078452 passed 2026-11-09 04:15:41,989 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:42,000 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54 2026-11-09 04:15:42,008 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54 2026-11-09 04:15:42,015 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/b35aabbb-fcef-451b-b5e5-650c6f3708d9 2026-11-09 04:15:42,029 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6276993236715916548', 'uuid-lslong': '9901857025995530915'}, 'enable': 'true', 'created': '2026-11-09T04:15:41', 'last-modified': '2026-11-09T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457361'} 2026-11-09 04:15:42,037 - DEBUG - Route Targets: ['target:64512:8000018'] 2026-11-09 04:15:42,044 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6276993236715916548', 'uuid-lslong': '9901857025995530915'}, 'enable': 'true', 'created': '2026-11-09T04:15:41', 'last-modified': '2026-11-09T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.473960'} 2026-11-09 04:15:42,051 - DEBUG - Route Targets: ['target:64512:8000018'] 2026-11-09 04:15:42,058 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6276993236715916548', 'uuid-lslong': '9901857025995530915'}, 'enable': 'true', 'created': '2026-11-09T04:15:41', 'last-modified': '2026-11-09T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493221'} 2026-11-09 04:15:42,065 - DEBUG - Route Targets: ['target:64512:8000018'] 2026-11-09 04:15:42,065 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-34078452 passed 2026-11-09 04:15:42,066 - DEBUG - ====Verifying policy data for ctest-vn2-34078452 in API_Server ====== 2026-11-09 04:15:42,066 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:42,073 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:42,086 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:42,191 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3 2026-11-09 04:15:42,202 - DEBUG - =>VN ctest-vn2-34078452 has no policy to be verified 2026-11-09 04:15:42,202 - DEBUG - Verifying the vn in opserver 2026-11-09 04:15:42,202 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 virtual network link through opserver 10.0.0.248 2026-11-09 04:15:42,202 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks 2026-11-09 04:15:42,257 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452?flat'} 2026-11-09 04:15:42,257 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 virtual network link through opserver 10.0.0.249 2026-11-09 04:15:42,257 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-11-09 04:15:42,311 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452?flat'} 2026-11-09 04:15:42,311 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 virtual network link through opserver 10.0.0.33 2026-11-09 04:15:42,311 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-11-09 04:15:42,361 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452?flat'} 2026-11-09 04:15:42,361 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 is found in opserver 2026-11-09 04:15:42,385 - DEBUG - Do not have enough data to verify VN in agent 2026-11-09 04:15:42,395 - DEBUG - VRF ids for VN ctest-vn2-34078452: {} 2026-11-09 04:15:43,900 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2) 2026-11-09 04:15:44,880 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1) 2026-11-09 04:15:44,880 - INFO - Waiting for VM ctest-vn1_vm1-57125584 to be up.. 2026-11-09 04:15:44,940 - DEBUG - VM is in ERROR state now 2026-11-09 04:15:44,941 - ERROR - VM in error state. 2026-11-09 04:15:44,941 - ERROR - VM is not in ACTIVE state 2026-11-09 04:15:45,034 - ERROR - Fatal Nova Exception while getting VM detail 2026-11-09 04:15:45,034 - DEBUG - None 2026-11-09 04:15:45,036 - INFO - Skip interface_detach for VM ctest-vn2_vm1-69763479 in state BUILD 2026-11-09 04:15:45,036 - INFO - Deleting VM ctest-vn2_vm1-69763479 2026-11-09 04:15:45,036 - ERROR - VM ctest-vn2_vm1-69763479 has failed to come up 2026-11-09 04:15:45,036 - ERROR - Nova failed to get host of the VM 2026-11-09 04:15:45,036 - ERROR - VM ctest-vn2_vm1-69763479 has failed to come up 2026-11-09 04:15:45,036 - ERROR - Nova failed to get host of the VM 2026-11-09 04:15:45,100 - INFO - Skip interface_detach for VM ctest-vn1_vm1-57125584 in state ERROR 2026-11-09 04:15:45,101 - INFO - Deleting VM ctest-vn1_vm1-57125584 2026-11-09 04:15:45,101 - ERROR - VM ctest-vn1_vm1-57125584 has failed to come up 2026-11-09 04:15:45,101 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:15:44Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 04:15:45,273 - INFO - Deleting VN ctest-vn2-34078452 2026-11-09 04:15:45,424 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54 2026-11-09 04:15:45,434 - DEBUG - Response Code: 404 2026-11-09 04:15:45,434 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:45,444 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:45,461 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:45,574 - INFO - Validated that VN ctest-vn2-34078452 is not found in API Server 2026-11-09 04:15:45,586 - DEBUG - VN ctest-vn2-34078452 is not present in Agent 10.0.0.250 2026-11-09 04:15:45,597 - DEBUG - VN ctest-vn2-34078452 is not present in Agent 10.0.0.38 2026-11-09 04:15:45,597 - INFO - Validated that VN ctest-vn2-34078452 is not in any agent 2026-11-09 04:15:45,636 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-34078452 info 2026-11-09 04:15:45,811 - INFO - Deleting VN ctest-vn1-44321604 2026-11-09 04:15:45,937 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b 2026-11-09 04:15:45,946 - DEBUG - Response Code: 404 2026-11-09 04:15:45,946 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 04:15:45,953 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 04:15:45,975 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa 2026-11-09 04:15:46,079 - INFO - Validated that VN ctest-vn1-44321604 is not found in API Server 2026-11-09 04:15:46,092 - DEBUG - VN ctest-vn1-44321604 is not present in Agent 10.0.0.250 2026-11-09 04:15:46,103 - DEBUG - VN ctest-vn1-44321604 is not present in Agent 10.0.0.38 2026-11-09 04:15:46,103 - INFO - Validated that VN ctest-vn1-44321604 is not in any agent 2026-11-09 04:15:46,144 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-44321604 info 2026-11-09 04:15:46,192 - INFO - Deleted policy policy2 2026-11-09 04:15:46,243 - INFO - Deleted policy policy1 2026-11-09 04:15:46,908 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Nov 9 04:15:45 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_process_restart_in_policy_between_vns(self=) 404 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name) 405 vm2_fixture = self.create_vm(vn2_fixture, vn2_vm1_name) 406 assert vm1_fixture.wait_till_vm_is_up() 407 assert vm2_fixture.wait_till_vm_is_up() 408 assert vm1_fixture.ping_with_certainty(vm2_fixture.vm_ip) vm1_fixture = vm1_fixture.wait_till_vm_is_up = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 406, in test_process_restart_in_policy_between_vns assert vm1_fixture.wait_till_vm_is_up() AssertionError 2026-11-09 04:15:46,909 - DEBUG - Skipping xmpp flap check 2026-11-09 04:15:46,909 - INFO - 2026-11-09 04:15:46,909 - INFO - END TEST : test_process_restart_in_policy_between_vns : FAILED[0:00:08] 2026-11-09 04:15:46,909 - INFO - -------------------------------------------------------------------------------- 2026-11-09 04:15:46,912 - INFO - ================================================================================ 2026-11-09 04:15:46,912 - INFO - STARTING TEST : test_underlay_broadcast_traffic_handling 2026-11-09 04:15:46,912 - INFO - TEST DESCRIPTION : Test the underlay brocast traffic handling by vrouter. (Bug-1545229). 1. Send broadcast traffic from one compute node. 2. Other compute in same subnet should receive that traffic. 3. Receiving compute should treat this traffic as underlay. 4. Compute should not replicate the packet and send the copy back. Pass criteria: Step 3-4 should pass Maintainer : chhandak@juniper.net 2026-11-09 04:15:47,581 - DEBUG - Skipping xmpp flap check 2026-11-09 04:15:47,581 - INFO - Initial checks done. Running the testcase now 2026-11-09 04:15:47,581 - INFO - 2026-11-09 04:15:47,809 - INFO - Agent interface name: enp5s0 2026-11-09 04:15:47,890 - DEBUG - Executing command: sudo tcpdump -nni enp5s0 -U host 10.20.0.255 -w /tmp/enp5s0_ctest-random-56194716.pcap 2026-11-09 04:15:53,407 - INFO - Pinging broacast address 10.20.0.255 from compute 10.20.0.14 2026-11-09 04:16:07,665 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-11-09 04:16:09,719 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/enp5s0_ctest-random-56194716.pcap | grep -c length 2026-11-09 04:16:09,736 - DEBUG - STDOUT: 10 2026-11-09 04:16:09,736 - DEBUG - STDERR: reading from file /tmp/enp5s0_ctest-random-56194716.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-11-09 04:16:09,736 - INFO - 10 packets are found in tcpdump output as expected 2026-11-09 04:16:09,737 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-11-09 04:16:11,779 - INFO - Packet count matched: Compute 10.0.0.38 has receive only 10 packet from source IP 10.20.0.255. No duplicate packet seen 2026-11-09 04:16:12,469 - DEBUG - Skipping xmpp flap check 2026-11-09 04:16:12,469 - INFO - END TEST : test_underlay_broadcast_traffic_handling : PASSED[0:00:26] 2026-11-09 04:16:12,470 - INFO - -------------------------------------------------------------------------------- 2026-11-09 04:16:13,473 - INFO - Deleted project: ctest-TestBasicVMVN0-34069908, ID : 35763c96-953a-484d-a7f0-636384a78efa