2026-11-09 04:15:27,451 - INFO - Domain Default found not creating
2026-11-09 04:15:27,649 - INFO - Project ctest-TestBasicVMVN0-34069908 not found, creating it
2026-11-09 04:15:28,166 - INFO - Created Project:ctest-TestBasicVMVN0-34069908, ID : 35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:30,010 - INFO - ================================================================================
2026-11-09 04:15:30,010 - INFO - STARTING TEST : test_control_node_switchover
2026-11-09 04:15:30,011 - INFO - TEST DESCRIPTION : Stop the control node and check peering with agent fallback to other control node.
1. Pick one VN from respource pool which has 2 VM's in it
2. Verify ping between VM's
3. Find active control node in cluster by agent inspect
4. Stop control service on active control node
5. Verify agents are connected to new active control-node using xmpp connections
6. Bring back control service on previous active node
7. Verify ping between VM's again after bringing up control serveice
Pass criteria: Step 2,5 and 7 should pass
2026-11-09 04:15:30,661 - DEBUG - Skipping xmpp flap check
2026-11-09 04:15:30,661 - INFO - Initial checks done. Running the testcase now
2026-11-09 04:15:30,661 - INFO -
2026-11-09 04:15:31,462 - DEBUG - Response for create_network : {'network': {'id': 'bdafc882-7572-4a43-893b-fa3def53e35c', 'name': 'ctest-vn1-15395046', 'tenant_id': '35763c96953a484da7f0636384a78efa', 'project_id': '35763c96953a484da7f0636384a78efa', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN0-34069908', 'ctest-vn1-15395046'], 'port_security_enabled': True, 'description': ''}}
2026-11-09 04:15:31,762 - DEBUG - Response for create_subnet : {'subnet': {'id': '95781404-0b88-43e1-9440-06627caa27a6', 'name': '', 'tenant_id': '35763c96953a484da7f0636384a78efa', 'network_id': 'bdafc882-7572-4a43-893b-fa3def53e35c', 'ip_version': 4, 'cidr': '192.168.1.0/24', 'allocation_pools': [{'start': '192.168.1.2', 'end': '192.168.1.254'}], 'gateway_ip': '192.168.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.168.1.2', 'tags': [], 'project_id': '35763c96953a484da7f0636384a78efa'}}
2026-11-09 04:15:31,786 - INFO - Created VN ctest-vn1-15395046
2026-11-09 04:15:31,803 - DEBUG - VN ctest-vn1-15395046 UUID is bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:31,888 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:32,263 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:32,302 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:32,327 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:32,431 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:32,445 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:32,456 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02
2026-11-09 04:15:32,469 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02
2026-11-09 04:15:32,478 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/20b365df-5ce4-4213-af24-969751b31d67
2026-11-09 04:15:32,490 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:32,490 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:32,503 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02
2026-11-09 04:15:32,524 - INFO - Verified VN network id 25 for VN bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:32,524 - INFO - Verifications in API Server for VN ctest-vn1-15395046 passed
2026-11-09 04:15:32,524 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:32,535 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02
2026-11-09 04:15:32,543 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02
2026-11-09 04:15:32,553 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/20b365df-5ce4-4213-af24-969751b31d67
2026-11-09 04:15:32,572 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13668363856734472771', 'uuid-lslong': '9888772550737257308'}, 'enable': 'true', 'created': '2026-11-09T04:15:31', 'last-modified': '2026-11-09T04:15:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.890043'}
2026-11-09 04:15:32,580 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:32,587 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13668363856734472771', 'uuid-lslong': '9888772550737257308'}, 'enable': 'true', 'created': '2026-11-09T04:15:31', 'last-modified': '2026-11-09T04:15:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.913652'}
2026-11-09 04:15:32,594 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:32,600 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13668363856734472771', 'uuid-lslong': '9888772550737257308'}, 'enable': 'true', 'created': '2026-11-09T04:15:31', 'last-modified': '2026-11-09T04:15:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.931262'}
2026-11-09 04:15:32,609 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:32,609 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-15395046 passed
2026-11-09 04:15:32,610 - DEBUG - ====Verifying policy data for ctest-vn1-15395046 in API_Server ======
2026-11-09 04:15:32,610 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:32,624 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:32,641 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:32,755 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/bdafc882-7572-4a43-893b-fa3def53e35c
2026-11-09 04:15:32,775 - DEBUG - =>VN ctest-vn1-15395046 has no policy to be verified
2026-11-09 04:15:32,775 - DEBUG - Verifying the vn in opserver
2026-11-09 04:15:32,775 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 virtual network link through opserver 10.0.0.248
2026-11-09 04:15:32,775 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks
2026-11-09 04:15:33,146 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks
2026-11-09 04:15:33,215 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046?flat'}
2026-11-09 04:15:33,215 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 virtual network link through opserver 10.0.0.249
2026-11-09 04:15:33,215 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-11-09 04:15:33,591 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-11-09 04:15:33,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046?flat'}
2026-11-09 04:15:33,663 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 virtual network link through opserver 10.0.0.33
2026-11-09 04:15:33,663 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-11-09 04:15:34,036 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-11-09 04:15:34,107 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046?flat'}
2026-11-09 04:15:34,107 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-15395046 is found in opserver
2026-11-09 04:15:34,131 - DEBUG - Do not have enough data to verify VN in agent
2026-11-09 04:15:34,142 - DEBUG - VRF ids for VN ctest-vn1-15395046: {}
2026-11-09 04:15:34,576 - DEBUG - Services list from nova: [, , , ]
2026-11-09 04:15:35,422 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2)
2026-11-09 04:15:36,634 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1)
2026-11-09 04:15:36,635 - INFO - Waiting for VM ctest-vn1_vm1-64408490 to be up..
2026-11-09 04:15:36,710 - DEBUG - VM is in ERROR state now
2026-11-09 04:15:36,710 - ERROR - VM in error state.
2026-11-09 04:15:36,710 - ERROR - VM is not in ACTIVE state
2026-11-09 04:15:36,805 - ERROR - Fatal Nova Exception while getting VM detail
2026-11-09 04:15:36,805 - DEBUG - None
2026-11-09 04:15:36,809 - INFO - Skip interface_detach for VM ctest-vn1_vm2-66551375 in state BUILD
2026-11-09 04:15:36,809 - INFO - Deleting VM ctest-vn1_vm2-66551375
2026-11-09 04:15:36,838 - ERROR - VM ctest-vn1_vm2-66551375 has failed to come up
2026-11-09 04:15:36,838 - ERROR - Nova failed to get host of the VM
2026-11-09 04:15:36,838 - ERROR - VM ctest-vn1_vm2-66551375 has failed to come up
2026-11-09 04:15:36,838 - ERROR - Nova failed to get host of the VM
2026-11-09 04:15:36,977 - INFO - Skip interface_detach for VM ctest-vn1_vm1-64408490 in state ERROR
2026-11-09 04:15:36,977 - INFO - Deleting VM ctest-vn1_vm1-64408490
2026-11-09 04:15:36,977 - ERROR - VM ctest-vn1_vm1-64408490 has failed to come up
2026-11-09 04:15:36,977 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:15:35Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-11-09 04:15:36,977 - INFO - Deleting VN ctest-vn1-15395046
2026-11-09 04:15:37,221 - DEBUG - Response for deleting network ()
2026-11-09 04:15:37,221 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/f9eb8c70-75b7-4907-b01c-e00f6f399a02
2026-11-09 04:15:37,228 - DEBUG - Response Code: 404
2026-11-09 04:15:37,228 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:37,235 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:37,258 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:37,371 - INFO - Validated that VN ctest-vn1-15395046 is not found in API Server
2026-11-09 04:15:37,385 - DEBUG - VN ctest-vn1-15395046 is not present in Agent 10.0.0.250
2026-11-09 04:15:37,403 - DEBUG - VN ctest-vn1-15395046 is not present in Agent 10.0.0.38
2026-11-09 04:15:37,404 - INFO - Validated that VN ctest-vn1-15395046 is not in any agent
2026-11-09 04:15:37,461 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-15395046 info
2026-11-09 04:15:38,129 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Mon Nov 9 04:15:36 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_control_node_switchover(self=)
635 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name)
636 vm2_fixture = self.create_vm(vn1_fixture, vn1_vm2_name)
637 assert vm1_fixture.wait_till_vm_is_up()
638 assert vm2_fixture.wait_till_vm_is_up()
639 assert vm1_fixture.ping_to_ip(vm2_fixture.vm_ip)
vm1_fixture =
vm1_fixture.wait_till_vm_is_up = >
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 637, in test_control_node_switchover
assert vm1_fixture.wait_till_vm_is_up()
AssertionError
2026-11-09 04:15:38,129 - DEBUG - Skipping xmpp flap check
2026-11-09 04:15:38,129 - INFO -
2026-11-09 04:15:38,129 - INFO - END TEST : test_control_node_switchover : FAILED[0:00:08]
2026-11-09 04:15:38,129 - INFO - --------------------------------------------------------------------------------
2026-11-09 04:15:38,132 - INFO - ================================================================================
2026-11-09 04:15:38,132 - INFO - STARTING TEST : test_process_restart_in_policy_between_vns
2026-11-09 04:15:38,132 - INFO - TEST DESCRIPTION : Test to validate that with policy having rule to check icmp fwding between VMs on different VNs , ping between VMs should pass
with process restarts
1. Pick 2 VN's from resource pool which has one VM each
2. Create policy with icmp allow rule between those VN's and bind it networks
3. Ping from one VM to another VM
4. Restart process 'vrouter' and 'control' on setup
5. Ping again between VM's after process restart
Pass criteria: Step 2,3,4 and 5 should pass
2026-11-09 04:15:38,777 - DEBUG - Skipping xmpp flap check
2026-11-09 04:15:38,777 - INFO - Initial checks done. Running the testcase now
2026-11-09 04:15:38,777 - INFO -
2026-11-09 04:15:38,785 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2026-11-09 04:15:39,065 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2026-11-09 04:15:39,673 - INFO - Created VN ctest-vn1-44321604, UUID :2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,031 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:40,039 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:40,052 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:40,163 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,178 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,189 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b
2026-11-09 04:15:40,200 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b
2026-11-09 04:15:40,208 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/0e5167dc-d9b6-4ced-a299-f4068a40d655
2026-11-09 04:15:40,217 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:40,217 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,228 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b
2026-11-09 04:15:40,247 - INFO - Verified VN network id 25 for VN 2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,248 - INFO - Verifications in API Server for VN ctest-vn1-44321604 passed
2026-11-09 04:15:40,248 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,259 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b
2026-11-09 04:15:40,267 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b
2026-11-09 04:15:40,276 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/0e5167dc-d9b6-4ced-a299-f4068a40d655
2026-11-09 04:15:40,293 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3338981488366535340', 'uuid-lslong': '13178287893471843998'}, 'enable': 'true', 'created': '2026-11-09T04:15:39', 'last-modified': '2026-11-09T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453379'}
2026-11-09 04:15:40,301 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:40,308 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3338981488366535340', 'uuid-lslong': '13178287893471843998'}, 'enable': 'true', 'created': '2026-11-09T04:15:39', 'last-modified': '2026-11-09T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467040'}
2026-11-09 04:15:40,314 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:40,321 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3338981488366535340', 'uuid-lslong': '13178287893471843998'}, 'enable': 'true', 'created': '2026-11-09T04:15:39', 'last-modified': '2026-11-09T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479029'}
2026-11-09 04:15:40,328 - DEBUG - Route Targets: ['target:64512:8000017']
2026-11-09 04:15:40,328 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-44321604 passed
2026-11-09 04:15:40,328 - DEBUG - ====Verifying policy data for ctest-vn1-44321604 in API_Server ======
2026-11-09 04:15:40,328 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:40,335 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:40,348 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:40,450 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/2e5671f9-15b1-42ac-b6e2-af047e38569e
2026-11-09 04:15:40,462 - DEBUG - =>VN ctest-vn1-44321604 has no policy to be verified
2026-11-09 04:15:40,462 - DEBUG - Verifying the vn in opserver
2026-11-09 04:15:40,462 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 virtual network link through opserver 10.0.0.248
2026-11-09 04:15:40,462 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks
2026-11-09 04:15:40,524 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604?flat'}
2026-11-09 04:15:40,524 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 virtual network link through opserver 10.0.0.249
2026-11-09 04:15:40,524 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-11-09 04:15:40,584 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604?flat'}
2026-11-09 04:15:40,584 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 virtual network link through opserver 10.0.0.33
2026-11-09 04:15:40,584 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-11-09 04:15:40,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604?flat'}
2026-11-09 04:15:40,654 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn1-44321604 is found in opserver
2026-11-09 04:15:40,680 - DEBUG - Do not have enough data to verify VN in agent
2026-11-09 04:15:40,693 - DEBUG - VRF ids for VN ctest-vn1-44321604: {}
2026-11-09 04:15:41,409 - INFO - Created VN ctest-vn2-34078452, UUID :571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:41,783 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:41,791 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:41,805 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:41,904 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:41,918 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:41,930 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54
2026-11-09 04:15:41,941 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54
2026-11-09 04:15:41,949 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/b35aabbb-fcef-451b-b5e5-650c6f3708d9
2026-11-09 04:15:41,958 - DEBUG - Route Targets: ['target:64512:8000018']
2026-11-09 04:15:41,958 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:41,970 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54
2026-11-09 04:15:41,988 - INFO - Verified VN network id 26 for VN 571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:41,988 - INFO - Verifications in API Server for VN ctest-vn2-34078452 passed
2026-11-09 04:15:41,989 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:42,000 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54
2026-11-09 04:15:42,008 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54
2026-11-09 04:15:42,015 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/b35aabbb-fcef-451b-b5e5-650c6f3708d9
2026-11-09 04:15:42,029 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6276993236715916548', 'uuid-lslong': '9901857025995530915'}, 'enable': 'true', 'created': '2026-11-09T04:15:41', 'last-modified': '2026-11-09T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457361'}
2026-11-09 04:15:42,037 - DEBUG - Route Targets: ['target:64512:8000018']
2026-11-09 04:15:42,044 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6276993236715916548', 'uuid-lslong': '9901857025995530915'}, 'enable': 'true', 'created': '2026-11-09T04:15:41', 'last-modified': '2026-11-09T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.473960'}
2026-11-09 04:15:42,051 - DEBUG - Route Targets: ['target:64512:8000018']
2026-11-09 04:15:42,058 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-34069908', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6276993236715916548', 'uuid-lslong': '9901857025995530915'}, 'enable': 'true', 'created': '2026-11-09T04:15:41', 'last-modified': '2026-11-09T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493221'}
2026-11-09 04:15:42,065 - DEBUG - Route Targets: ['target:64512:8000018']
2026-11-09 04:15:42,065 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-34078452 passed
2026-11-09 04:15:42,066 - DEBUG - ====Verifying policy data for ctest-vn2-34078452 in API_Server ======
2026-11-09 04:15:42,066 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:42,073 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:42,086 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:42,191 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/571c5c17-83fb-4d04-896a-7680bb2b62a3
2026-11-09 04:15:42,202 - DEBUG - =>VN ctest-vn2-34078452 has no policy to be verified
2026-11-09 04:15:42,202 - DEBUG - Verifying the vn in opserver
2026-11-09 04:15:42,202 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 virtual network link through opserver 10.0.0.248
2026-11-09 04:15:42,202 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks
2026-11-09 04:15:42,257 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452?flat'}
2026-11-09 04:15:42,257 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 virtual network link through opserver 10.0.0.249
2026-11-09 04:15:42,257 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-11-09 04:15:42,311 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452?flat'}
2026-11-09 04:15:42,311 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 virtual network link through opserver 10.0.0.33
2026-11-09 04:15:42,311 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-11-09 04:15:42,361 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452?flat'}
2026-11-09 04:15:42,361 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-34069908:ctest-vn2-34078452 is found in opserver
2026-11-09 04:15:42,385 - DEBUG - Do not have enough data to verify VN in agent
2026-11-09 04:15:42,395 - DEBUG - VRF ids for VN ctest-vn2-34078452: {}
2026-11-09 04:15:43,900 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2)
2026-11-09 04:15:44,880 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1)
2026-11-09 04:15:44,880 - INFO - Waiting for VM ctest-vn1_vm1-57125584 to be up..
2026-11-09 04:15:44,940 - DEBUG - VM is in ERROR state now
2026-11-09 04:15:44,941 - ERROR - VM in error state.
2026-11-09 04:15:44,941 - ERROR - VM is not in ACTIVE state
2026-11-09 04:15:45,034 - ERROR - Fatal Nova Exception while getting VM detail
2026-11-09 04:15:45,034 - DEBUG - None
2026-11-09 04:15:45,036 - INFO - Skip interface_detach for VM ctest-vn2_vm1-69763479 in state BUILD
2026-11-09 04:15:45,036 - INFO - Deleting VM ctest-vn2_vm1-69763479
2026-11-09 04:15:45,036 - ERROR - VM ctest-vn2_vm1-69763479 has failed to come up
2026-11-09 04:15:45,036 - ERROR - Nova failed to get host of the VM
2026-11-09 04:15:45,036 - ERROR - VM ctest-vn2_vm1-69763479 has failed to come up
2026-11-09 04:15:45,036 - ERROR - Nova failed to get host of the VM
2026-11-09 04:15:45,100 - INFO - Skip interface_detach for VM ctest-vn1_vm1-57125584 in state ERROR
2026-11-09 04:15:45,101 - INFO - Deleting VM ctest-vn1_vm1-57125584
2026-11-09 04:15:45,101 - ERROR - VM ctest-vn1_vm1-57125584 has failed to come up
2026-11-09 04:15:45,101 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T04:15:44Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-11-09 04:15:45,273 - INFO - Deleting VN ctest-vn2-34078452
2026-11-09 04:15:45,424 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/9a5d3d08-c466-42f4-884b-44339e7c9a54
2026-11-09 04:15:45,434 - DEBUG - Response Code: 404
2026-11-09 04:15:45,434 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:45,444 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:45,461 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:45,574 - INFO - Validated that VN ctest-vn2-34078452 is not found in API Server
2026-11-09 04:15:45,586 - DEBUG - VN ctest-vn2-34078452 is not present in Agent 10.0.0.250
2026-11-09 04:15:45,597 - DEBUG - VN ctest-vn2-34078452 is not present in Agent 10.0.0.38
2026-11-09 04:15:45,597 - INFO - Validated that VN ctest-vn2-34078452 is not in any agent
2026-11-09 04:15:45,636 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-34078452 info
2026-11-09 04:15:45,811 - INFO - Deleting VN ctest-vn1-44321604
2026-11-09 04:15:45,937 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/65de7a76-a817-4669-b157-787126bf376b
2026-11-09 04:15:45,946 - DEBUG - Response Code: 404
2026-11-09 04:15:45,946 - DEBUG - Requesting: http://10.0.0.248:8082/domains
2026-11-09 04:15:45,953 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062
2026-11-09 04:15:45,975 - DEBUG - Requesting: http://10.0.0.248:8082/project/35763c96-953a-484d-a7f0-636384a78efa
2026-11-09 04:15:46,079 - INFO - Validated that VN ctest-vn1-44321604 is not found in API Server
2026-11-09 04:15:46,092 - DEBUG - VN ctest-vn1-44321604 is not present in Agent 10.0.0.250
2026-11-09 04:15:46,103 - DEBUG - VN ctest-vn1-44321604 is not present in Agent 10.0.0.38
2026-11-09 04:15:46,103 - INFO - Validated that VN ctest-vn1-44321604 is not in any agent
2026-11-09 04:15:46,144 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-44321604 info
2026-11-09 04:15:46,192 - INFO - Deleted policy policy2
2026-11-09 04:15:46,243 - INFO - Deleted policy policy1
2026-11-09 04:15:46,908 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Mon Nov 9 04:15:45 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_process_restart_in_policy_between_vns(self=)
404 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name)
405 vm2_fixture = self.create_vm(vn2_fixture, vn2_vm1_name)
406 assert vm1_fixture.wait_till_vm_is_up()
407 assert vm2_fixture.wait_till_vm_is_up()
408 assert vm1_fixture.ping_with_certainty(vm2_fixture.vm_ip)
vm1_fixture =
vm1_fixture.wait_till_vm_is_up = >
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 406, in test_process_restart_in_policy_between_vns
assert vm1_fixture.wait_till_vm_is_up()
AssertionError
2026-11-09 04:15:46,909 - DEBUG - Skipping xmpp flap check
2026-11-09 04:15:46,909 - INFO -
2026-11-09 04:15:46,909 - INFO - END TEST : test_process_restart_in_policy_between_vns : FAILED[0:00:08]
2026-11-09 04:15:46,909 - INFO - --------------------------------------------------------------------------------
2026-11-09 04:15:46,912 - INFO - ================================================================================
2026-11-09 04:15:46,912 - INFO - STARTING TEST : test_underlay_broadcast_traffic_handling
2026-11-09 04:15:46,912 - INFO - TEST DESCRIPTION : Test the underlay brocast traffic handling by vrouter. (Bug-1545229).
1. Send broadcast traffic from one compute node.
2. Other compute in same subnet should receive that traffic.
3. Receiving compute should treat this traffic as underlay.
4. Compute should not replicate the packet and send the copy back.
Pass criteria: Step 3-4 should pass
Maintainer : chhandak@juniper.net
2026-11-09 04:15:47,581 - DEBUG - Skipping xmpp flap check
2026-11-09 04:15:47,581 - INFO - Initial checks done. Running the testcase now
2026-11-09 04:15:47,581 - INFO -
2026-11-09 04:15:47,809 - INFO - Agent interface name: enp5s0
2026-11-09 04:15:47,890 - DEBUG - Executing command: sudo tcpdump -nni enp5s0 -U host 10.20.0.255 -w /tmp/enp5s0_ctest-random-56194716.pcap
2026-11-09 04:15:53,407 - INFO - Pinging broacast address 10.20.0.255 from compute 10.20.0.14
2026-11-09 04:16:07,665 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2026-11-09 04:16:09,719 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/enp5s0_ctest-random-56194716.pcap | grep -c length
2026-11-09 04:16:09,736 - DEBUG - STDOUT: 10
2026-11-09 04:16:09,736 - DEBUG - STDERR: reading from file /tmp/enp5s0_ctest-random-56194716.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2026-11-09 04:16:09,736 - INFO - 10 packets are found in tcpdump output as expected
2026-11-09 04:16:09,737 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2026-11-09 04:16:11,779 - INFO - Packet count matched: Compute 10.0.0.38 has receive only 10 packet from source IP 10.20.0.255. No duplicate packet seen
2026-11-09 04:16:12,469 - DEBUG - Skipping xmpp flap check
2026-11-09 04:16:12,469 - INFO - END TEST : test_underlay_broadcast_traffic_handling : PASSED[0:00:26]
2026-11-09 04:16:12,470 - INFO - --------------------------------------------------------------------------------
2026-11-09 04:16:13,473 - INFO - Deleted project: ctest-TestBasicVMVN0-34069908, ID : 35763c96-953a-484d-a7f0-636384a78efa