2025-12-22 03:57:58,609 - INFO - Domain Default found not creating 2025-12-22 03:57:58,798 - INFO - Project ctest-TestBasicVMVN0-09768848 not found, creating it 2025-12-22 03:57:59,435 - INFO - Created Project:ctest-TestBasicVMVN0-09768848, ID : ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:00,936 - INFO - ================================================================================ 2025-12-22 03:58:00,936 - INFO - STARTING TEST : test_control_node_switchover 2025-12-22 03:58:00,936 - INFO - TEST DESCRIPTION : Stop the control node and check peering with agent fallback to other control node. 1. Pick one VN from respource pool which has 2 VM's in it 2. Verify ping between VM's 3. Find active control node in cluster by agent inspect 4. Stop control service on active control node 5. Verify agents are connected to new active control-node using xmpp connections 6. Bring back control service on previous active node 7. Verify ping between VM's again after bringing up control serveice Pass criteria: Step 2,5 and 7 should pass 2025-12-22 03:58:02,215 - DEBUG - Skipping xmpp flap check 2025-12-22 03:58:02,215 - INFO - Initial checks done. Running the testcase now 2025-12-22 03:58:02,215 - INFO - 2025-12-22 03:58:02,899 - DEBUG - Response for create_network : {'network': {'id': 'c6a41885-5890-46c8-a6e8-809ceaf74fc2', 'name': 'ctest-vn1-03679938', 'tenant_id': 'ac782e3234d2481e9130a71d24bda225', 'project_id': 'ac782e3234d2481e9130a71d24bda225', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN0-09768848', 'ctest-vn1-03679938'], 'port_security_enabled': True, 'description': ''}} 2025-12-22 03:58:03,194 - DEBUG - Response for create_subnet : {'subnet': {'id': '898f9c95-1195-46a2-95d3-f25a33ab34e4', 'name': '', 'tenant_id': 'ac782e3234d2481e9130a71d24bda225', 'network_id': 'c6a41885-5890-46c8-a6e8-809ceaf74fc2', 'ip_version': 4, 'cidr': '192.168.1.0/24', 'allocation_pools': [{'start': '192.168.1.2', 'end': '192.168.1.254'}], 'gateway_ip': '192.168.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '192.168.1.2', 'tags': [], 'project_id': 'ac782e3234d2481e9130a71d24bda225'}} 2025-12-22 03:58:03,216 - INFO - Created VN ctest-vn1-03679938 2025-12-22 03:58:03,228 - DEBUG - VN ctest-vn1-03679938 UUID is c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:03,298 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:03,595 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:03,628 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:03,648 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:03,742 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:03,755 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:03,767 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d52135b9-c348-4d28-b280-a5b1cb9de83a 2025-12-22 03:58:03,776 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d52135b9-c348-4d28-b280-a5b1cb9de83a 2025-12-22 03:58:03,785 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/d4aeef00-b3d4-4ea8-91e8-df5750258f48 2025-12-22 03:58:03,792 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:03,792 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:03,800 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d52135b9-c348-4d28-b280-a5b1cb9de83a 2025-12-22 03:58:03,815 - INFO - Verified VN network id 11 for VN c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:03,815 - INFO - Verifications in API Server for VN ctest-vn1-03679938 passed 2025-12-22 03:58:03,815 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:03,824 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d52135b9-c348-4d28-b280-a5b1cb9de83a 2025-12-22 03:58:03,831 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d52135b9-c348-4d28-b280-a5b1cb9de83a 2025-12-22 03:58:03,839 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/d4aeef00-b3d4-4ea8-91e8-df5750258f48 2025-12-22 03:58:03,852 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14313592476685846216', 'uuid-lslong': '12027004216338239426'}, 'enable': 'true', 'created': '2025-12-22T03:58:02', 'last-modified': '2025-12-22T03:58:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714736'} 2025-12-22 03:58:03,862 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:03,869 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14313592476685846216', 'uuid-lslong': '12027004216338239426'}, 'enable': 'true', 'created': '2025-12-22T03:58:02', 'last-modified': '2025-12-22T03:58:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.737545'} 2025-12-22 03:58:03,874 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:03,880 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14313592476685846216', 'uuid-lslong': '12027004216338239426'}, 'enable': 'true', 'created': '2025-12-22T03:58:02', 'last-modified': '2025-12-22T03:58:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.749045'} 2025-12-22 03:58:03,886 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:03,886 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-03679938 passed 2025-12-22 03:58:03,886 - DEBUG - ====Verifying policy data for ctest-vn1-03679938 in API_Server ====== 2025-12-22 03:58:03,886 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:03,893 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:03,904 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:03,998 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c6a41885-5890-46c8-a6e8-809ceaf74fc2 2025-12-22 03:58:04,009 - DEBUG - =>VN ctest-vn1-03679938 has no policy to be verified 2025-12-22 03:58:04,009 - DEBUG - Verifying the vn in opserver 2025-12-22 03:58:04,009 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938 virtual network link through opserver 10.0.0.23 2025-12-22 03:58:04,010 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-22 03:58:04,310 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-22 03:58:04,370 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938?flat'} 2025-12-22 03:58:04,370 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938 virtual network link through opserver 10.0.0.22 2025-12-22 03:58:04,370 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-22 03:58:04,668 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-22 03:58:04,728 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938?flat'} 2025-12-22 03:58:04,728 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938 virtual network link through opserver 10.0.0.65 2025-12-22 03:58:04,728 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-22 03:58:05,029 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-22 03:58:05,088 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938?flat'} 2025-12-22 03:58:05,088 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-03679938 is found in opserver 2025-12-22 03:58:05,113 - DEBUG - Do not have enough data to verify VN in agent 2025-12-22 03:58:05,124 - DEBUG - VRF ids for VN ctest-vn1-03679938: {} 2025-12-22 03:58:05,250 - DEBUG - Services list from nova: [, , , ] 2025-12-22 03:58:06,321 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4918-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4918-1) 2025-12-22 03:58:07,486 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4918-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4918-2) 2025-12-22 03:58:07,486 - INFO - Waiting for VM ctest-vn1_vm1-47944958 to be up.. 2025-12-22 03:58:07,551 - DEBUG - VM is in ERROR state now 2025-12-22 03:58:07,552 - ERROR - VM in error state. 2025-12-22 03:58:07,552 - ERROR - VM is not in ACTIVE state 2025-12-22 03:58:07,632 - ERROR - Fatal Nova Exception while getting VM detail 2025-12-22 03:58:07,633 - DEBUG - None 2025-12-22 03:58:07,636 - INFO - Skip interface_detach for VM ctest-vn1_vm2-63954679 in state BUILD 2025-12-22 03:58:07,637 - INFO - Deleting VM ctest-vn1_vm2-63954679 2025-12-22 03:58:07,669 - ERROR - VM ctest-vn1_vm2-63954679 has failed to come up 2025-12-22 03:58:07,669 - ERROR - Nova failed to get host of the VM 2025-12-22 03:58:07,670 - ERROR - VM ctest-vn1_vm2-63954679 has failed to come up 2025-12-22 03:58:07,670 - ERROR - Nova failed to get host of the VM 2025-12-22 03:58:07,808 - INFO - Skip interface_detach for VM ctest-vn1_vm1-47944958 in state ERROR 2025-12-22 03:58:07,808 - INFO - Deleting VM ctest-vn1_vm1-47944958 2025-12-22 03:58:07,808 - ERROR - VM ctest-vn1_vm1-47944958 has failed to come up 2025-12-22 03:58:07,808 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-12-22T03:58:06Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-12-22 03:58:07,808 - INFO - Deleting VN ctest-vn1-03679938 2025-12-22 03:58:07,983 - DEBUG - Response for deleting network () 2025-12-22 03:58:07,984 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d52135b9-c348-4d28-b280-a5b1cb9de83a 2025-12-22 03:58:07,994 - DEBUG - Response Code: 404 2025-12-22 03:58:07,994 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:08,004 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:08,016 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:08,125 - INFO - Validated that VN ctest-vn1-03679938 is not found in API Server 2025-12-22 03:58:08,138 - DEBUG - VN ctest-vn1-03679938 is not present in Agent 10.0.0.130 2025-12-22 03:58:08,149 - DEBUG - VN ctest-vn1-03679938 is not present in Agent 10.0.0.19 2025-12-22 03:58:08,149 - INFO - Validated that VN ctest-vn1-03679938 is not in any agent 2025-12-22 03:58:08,188 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-03679938 info 2025-12-22 03:58:09,498 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Dec 22 03:58:07 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_control_node_switchover(self=) 635 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name) 636 vm2_fixture = self.create_vm(vn1_fixture, vn1_vm2_name) 637 assert vm1_fixture.wait_till_vm_is_up() 638 assert vm2_fixture.wait_till_vm_is_up() 639 assert vm1_fixture.ping_to_ip(vm2_fixture.vm_ip) vm1_fixture = vm1_fixture.wait_till_vm_is_up = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 637, in test_control_node_switchover assert vm1_fixture.wait_till_vm_is_up() AssertionError 2025-12-22 03:58:09,499 - DEBUG - Skipping xmpp flap check 2025-12-22 03:58:09,499 - INFO -
2025-12-22 03:58:09,499 - INFO - END TEST : test_control_node_switchover : FAILED[0:00:09]
2025-12-22 03:58:09,499 - INFO - -------------------------------------------------------------------------------- 2025-12-22 03:58:09,502 - INFO - ================================================================================ 2025-12-22 03:58:09,503 - INFO - STARTING TEST : test_process_restart_in_policy_between_vns 2025-12-22 03:58:09,503 - INFO - TEST DESCRIPTION : Test to validate that with policy having rule to check icmp fwding between VMs on different VNs , ping between VMs should pass with process restarts 1. Pick 2 VN's from resource pool which has one VM each 2. Create policy with icmp allow rule between those VN's and bind it networks 3. Ping from one VM to another VM 4. Restart process 'vrouter' and 'control' on setup 5. Ping again between VM's after process restart Pass criteria: Step 2,3,4 and 5 should pass 2025-12-22 03:58:10,799 - DEBUG - Skipping xmpp flap check 2025-12-22 03:58:10,799 - INFO - Initial checks done. Running the testcase now 2025-12-22 03:58:10,799 - INFO - 2025-12-22 03:58:10,807 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-12-22 03:58:11,094 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-12-22 03:58:11,654 - INFO - Created VN ctest-vn1-87523354, UUID :1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,038 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:12,044 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:12,054 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:12,152 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,165 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,174 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0c824d21-3a7e-416e-b56e-90f7df19c18a 2025-12-22 03:58:12,181 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0c824d21-3a7e-416e-b56e-90f7df19c18a 2025-12-22 03:58:12,188 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/abcf0126-4c60-4fec-83c9-2d119521e3aa 2025-12-22 03:58:12,199 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:12,199 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,209 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0c824d21-3a7e-416e-b56e-90f7df19c18a 2025-12-22 03:58:12,226 - INFO - Verified VN network id 11 for VN 1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,226 - INFO - Verifications in API Server for VN ctest-vn1-87523354 passed 2025-12-22 03:58:12,226 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,237 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0c824d21-3a7e-416e-b56e-90f7df19c18a 2025-12-22 03:58:12,245 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0c824d21-3a7e-416e-b56e-90f7df19c18a 2025-12-22 03:58:12,251 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/abcf0126-4c60-4fec-83c9-2d119521e3aa 2025-12-22 03:58:12,261 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1628543672271457281', 'uuid-lslong': '10153458217801913661'}, 'enable': 'true', 'created': '2025-12-22T03:58:11', 'last-modified': '2025-12-22T03:58:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434778'} 2025-12-22 03:58:12,268 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:12,273 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1628543672271457281', 'uuid-lslong': '10153458217801913661'}, 'enable': 'true', 'created': '2025-12-22T03:58:11', 'last-modified': '2025-12-22T03:58:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445594'} 2025-12-22 03:58:12,279 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:12,285 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1628543672271457281', 'uuid-lslong': '10153458217801913661'}, 'enable': 'true', 'created': '2025-12-22T03:58:11', 'last-modified': '2025-12-22T03:58:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460349'} 2025-12-22 03:58:12,291 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-22 03:58:12,291 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-87523354 passed 2025-12-22 03:58:12,291 - DEBUG - ====Verifying policy data for ctest-vn1-87523354 in API_Server ====== 2025-12-22 03:58:12,291 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:12,297 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:12,307 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:12,405 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1699bfd7-6ef3-4c01-8ce8-547429da953d 2025-12-22 03:58:12,417 - DEBUG - =>VN ctest-vn1-87523354 has no policy to be verified 2025-12-22 03:58:12,418 - DEBUG - Verifying the vn in opserver 2025-12-22 03:58:12,418 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354 virtual network link through opserver 10.0.0.23 2025-12-22 03:58:12,418 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-22 03:58:12,479 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354?flat'} 2025-12-22 03:58:12,479 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354 virtual network link through opserver 10.0.0.22 2025-12-22 03:58:12,479 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-22 03:58:12,536 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354?flat'} 2025-12-22 03:58:12,536 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354 virtual network link through opserver 10.0.0.65 2025-12-22 03:58:12,536 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-22 03:58:12,596 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354?flat'} 2025-12-22 03:58:12,596 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn1-87523354 is found in opserver 2025-12-22 03:58:12,617 - DEBUG - Do not have enough data to verify VN in agent 2025-12-22 03:58:12,627 - DEBUG - VRF ids for VN ctest-vn1-87523354: {} 2025-12-22 03:58:13,354 - INFO - Created VN ctest-vn2-40296485, UUID :0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:13,709 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:13,715 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:13,728 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:13,820 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:13,829 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:13,838 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3da2c7b8-d745-47bb-8e71-9f95802d2f8d 2025-12-22 03:58:13,845 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3da2c7b8-d745-47bb-8e71-9f95802d2f8d 2025-12-22 03:58:13,852 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/afb5a9be-100f-4075-8e46-cd1efe33c9a1 2025-12-22 03:58:13,858 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-22 03:58:13,858 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:13,866 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3da2c7b8-d745-47bb-8e71-9f95802d2f8d 2025-12-22 03:58:13,881 - INFO - Verified VN network id 12 for VN 0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:13,881 - INFO - Verifications in API Server for VN ctest-vn2-40296485 passed 2025-12-22 03:58:13,882 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:13,890 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3da2c7b8-d745-47bb-8e71-9f95802d2f8d 2025-12-22 03:58:13,896 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3da2c7b8-d745-47bb-8e71-9f95802d2f8d 2025-12-22 03:58:13,904 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/afb5a9be-100f-4075-8e46-cd1efe33c9a1 2025-12-22 03:58:13,918 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '659760206843301729', 'uuid-lslong': '13002420085405361074'}, 'enable': 'true', 'created': '2025-12-22T03:58:13', 'last-modified': '2025-12-22T03:58:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.386500'} 2025-12-22 03:58:13,924 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-22 03:58:13,929 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '659760206843301729', 'uuid-lslong': '13002420085405361074'}, 'enable': 'true', 'created': '2025-12-22T03:58:13', 'last-modified': '2025-12-22T03:58:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.409117'} 2025-12-22 03:58:13,934 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-22 03:58:13,943 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN0-09768848', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '659760206843301729', 'uuid-lslong': '13002420085405361074'}, 'enable': 'true', 'created': '2025-12-22T03:58:13', 'last-modified': '2025-12-22T03:58:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420851'} 2025-12-22 03:58:13,950 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-22 03:58:13,950 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-40296485 passed 2025-12-22 03:58:13,950 - DEBUG - ====Verifying policy data for ctest-vn2-40296485 in API_Server ====== 2025-12-22 03:58:13,950 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:13,956 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:13,967 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:14,065 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0927f069-9dd5-4f61-b471-e02d8afda3b2 2025-12-22 03:58:14,083 - DEBUG - =>VN ctest-vn2-40296485 has no policy to be verified 2025-12-22 03:58:14,083 - DEBUG - Verifying the vn in opserver 2025-12-22 03:58:14,083 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485 virtual network link through opserver 10.0.0.23 2025-12-22 03:58:14,083 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-22 03:58:14,183 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485?flat'} 2025-12-22 03:58:14,183 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485 virtual network link through opserver 10.0.0.22 2025-12-22 03:58:14,183 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-22 03:58:14,264 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485?flat'} 2025-12-22 03:58:14,264 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485 virtual network link through opserver 10.0.0.65 2025-12-22 03:58:14,264 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-22 03:58:14,334 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485?flat'} 2025-12-22 03:58:14,335 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN0-09768848:ctest-vn2-40296485 is found in opserver 2025-12-22 03:58:14,361 - DEBUG - Do not have enough data to verify VN in agent 2025-12-22 03:58:14,372 - DEBUG - VRF ids for VN ctest-vn2-40296485: {} 2025-12-22 03:58:16,021 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4918-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4918-1) 2025-12-22 03:58:17,293 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4918-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4918-2) 2025-12-22 03:58:17,293 - INFO - Waiting for VM ctest-vn1_vm1-98448302 to be up.. 2025-12-22 03:58:17,356 - DEBUG - VM is in ERROR state now 2025-12-22 03:58:17,356 - ERROR - VM in error state. 2025-12-22 03:58:17,356 - ERROR - VM is not in ACTIVE state 2025-12-22 03:58:17,469 - ERROR - Fatal Nova Exception while getting VM detail 2025-12-22 03:58:17,469 - DEBUG - None 2025-12-22 03:58:17,470 - INFO - Skip interface_detach for VM ctest-vn2_vm1-30524958 in state BUILD 2025-12-22 03:58:17,471 - INFO - Deleting VM ctest-vn2_vm1-30524958 2025-12-22 03:58:17,471 - ERROR - VM ctest-vn2_vm1-30524958 has failed to come up 2025-12-22 03:58:17,471 - ERROR - Nova failed to get host of the VM 2025-12-22 03:58:17,471 - ERROR - VM ctest-vn2_vm1-30524958 has failed to come up 2025-12-22 03:58:17,471 - ERROR - Nova failed to get host of the VM 2025-12-22 03:58:17,671 - INFO - Skip interface_detach for VM ctest-vn1_vm1-98448302 in state ERROR 2025-12-22 03:58:17,671 - INFO - Deleting VM ctest-vn1_vm1-98448302 2025-12-22 03:58:17,671 - ERROR - VM ctest-vn1_vm1-98448302 has failed to come up 2025-12-22 03:58:17,671 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-12-22T03:58:15Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-12-22 03:58:17,922 - INFO - Deleting VN ctest-vn2-40296485 2025-12-22 03:58:18,143 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3da2c7b8-d745-47bb-8e71-9f95802d2f8d 2025-12-22 03:58:18,159 - DEBUG - Response Code: 404 2025-12-22 03:58:18,159 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:18,165 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:18,184 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:18,294 - INFO - Validated that VN ctest-vn2-40296485 is not found in API Server 2025-12-22 03:58:18,306 - DEBUG - VN ctest-vn2-40296485 is not present in Agent 10.0.0.130 2025-12-22 03:58:18,319 - DEBUG - VN ctest-vn2-40296485 is not present in Agent 10.0.0.19 2025-12-22 03:58:18,319 - INFO - Validated that VN ctest-vn2-40296485 is not in any agent 2025-12-22 03:58:18,361 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-40296485 info 2025-12-22 03:58:18,528 - INFO - Deleting VN ctest-vn1-87523354 2025-12-22 03:58:18,674 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0c824d21-3a7e-416e-b56e-90f7df19c18a 2025-12-22 03:58:18,679 - DEBUG - Response Code: 404 2025-12-22 03:58:18,679 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-22 03:58:18,686 - DEBUG - Requesting: http://10.0.0.23:8082/domain/cc89f09a-44c2-47d5-97ff-1101c2b1f822 2025-12-22 03:58:18,701 - DEBUG - Requesting: http://10.0.0.23:8082/project/ac782e32-34d2-481e-9130-a71d24bda225 2025-12-22 03:58:18,813 - INFO - Validated that VN ctest-vn1-87523354 is not found in API Server 2025-12-22 03:58:18,823 - DEBUG - VN ctest-vn1-87523354 is not present in Agent 10.0.0.130 2025-12-22 03:58:18,835 - DEBUG - VN ctest-vn1-87523354 is not present in Agent 10.0.0.19 2025-12-22 03:58:18,835 - INFO - Validated that VN ctest-vn1-87523354 is not in any agent 2025-12-22 03:58:18,870 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-87523354 info 2025-12-22 03:58:18,912 - INFO - Deleted policy policy2 2025-12-22 03:58:18,955 - INFO - Deleted policy policy1 2025-12-22 03:58:20,234 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Dec 22 03:58:17 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vm_regression/test_vm_serial.py in test_process_restart_in_policy_between_vns(self=) 404 vm1_fixture = self.create_vm(vn1_fixture, vn1_vm1_name) 405 vm2_fixture = self.create_vm(vn2_fixture, vn2_vm1_name) 406 assert vm1_fixture.wait_till_vm_is_up() 407 assert vm2_fixture.wait_till_vm_is_up() 408 assert vm1_fixture.ping_with_certainty(vm2_fixture.vm_ip) vm1_fixture = vm1_fixture.wait_till_vm_is_up = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vm_regression/test_vm_serial.py", line 406, in test_process_restart_in_policy_between_vns assert vm1_fixture.wait_till_vm_is_up() AssertionError 2025-12-22 03:58:20,234 - DEBUG - Skipping xmpp flap check 2025-12-22 03:58:20,234 - INFO -
2025-12-22 03:58:20,234 - INFO - END TEST : test_process_restart_in_policy_between_vns : FAILED[0:00:11]
2025-12-22 03:58:20,234 - INFO - -------------------------------------------------------------------------------- 2025-12-22 03:58:20,236 - INFO - ================================================================================ 2025-12-22 03:58:20,237 - INFO - STARTING TEST : test_underlay_broadcast_traffic_handling 2025-12-22 03:58:20,237 - INFO - TEST DESCRIPTION : Test the underlay brocast traffic handling by vrouter. (Bug-1545229). 1. Send broadcast traffic from one compute node. 2. Other compute in same subnet should receive that traffic. 3. Receiving compute should treat this traffic as underlay. 4. Compute should not replicate the packet and send the copy back. Pass criteria: Step 3-4 should pass Maintainer : chhandak@juniper.net 2025-12-22 03:58:21,525 - DEBUG - Skipping xmpp flap check 2025-12-22 03:58:21,525 - INFO - Initial checks done. Running the testcase now 2025-12-22 03:58:21,525 - INFO - 2025-12-22 03:58:21,934 - INFO - Agent interface name: ens6 2025-12-22 03:58:22,019 - DEBUG - Executing command: sudo tcpdump -nni ens6 -U host 10.20.0.255 -w /tmp/ens6_ctest-random-87871327.pcap 2025-12-22 03:58:27,457 - INFO - Pinging broacast address 10.20.0.255 from compute 10.20.0.200 2025-12-22 03:58:41,774 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-22 03:58:43,924 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/ens6_ctest-random-87871327.pcap | grep -c length 2025-12-22 03:58:43,939 - DEBUG - STDOUT: 10 2025-12-22 03:58:43,940 - DEBUG - STDERR: reading from file /tmp/ens6_ctest-random-87871327.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-22 03:58:43,940 - INFO - 10 packets are found in tcpdump output as expected 2025-12-22 03:58:43,940 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-22 03:58:45,990 - INFO - Packet count matched: Compute 10.0.0.19 has receive only 10 packet from source IP 10.20.0.255. No duplicate packet seen 2025-12-22 03:58:47,301 - DEBUG - Skipping xmpp flap check
2025-12-22 03:58:47,301 - INFO - END TEST : test_underlay_broadcast_traffic_handling : PASSED[0:00:27]
2025-12-22 03:58:47,301 - INFO - -------------------------------------------------------------------------------- 2025-12-22 03:58:48,108 - INFO - Deleted project: ctest-TestBasicVMVN0-09768848, ID : ac782e32-34d2-481e-9130-a71d24bda225