2025-09-11 03:23:34,590 - INFO - Domain Default found not creating 2025-09-11 03:23:34,730 - INFO - Project ctest-TestMd5testsOnControl-17404211 not found, creating it 2025-09-11 03:23:35,270 - INFO - Created Project:ctest-TestMd5testsOnControl-17404211, ID : f1040846-80d5-46a5-a112-7da246e0ac6d 2025-09-11 03:23:37,290 - DEBUG - Response for create_network : {'network': {'id': '208d7fe7-7f66-467b-b2f4-df479231de23', 'name': 'test_vnv6sr', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'test_vnv6sr'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:23:37,545 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ad582538-1279-4110-bdfc-78b883f4858b', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': '208d7fe7-7f66-467b-b2f4-df479231de23', 'ip_version': 6, 'cidr': '2001::101:0/120', 'allocation_pools': [{'start': '2001::101:2', 'end': '2001::101:fe'}], 'gateway_ip': '2001::101:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::101:2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:23:37,752 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a38a9a1-b3a8-4e1c-b09c-bd6a7d509187', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': '208d7fe7-7f66-467b-b2f4-df479231de23', 'ip_version': 4, 'cidr': '66.192.185.0/26', 'allocation_pools': [{'start': '66.192.185.2', 'end': '66.192.185.62'}], 'gateway_ip': '66.192.185.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '66.192.185.2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:23:37,776 - INFO - Created VN test_vnv6sr 2025-09-11 03:23:37,788 - DEBUG - VN test_vnv6sr UUID is 208d7fe7-7f66-467b-b2f4-df479231de23 2025-09-11 03:23:38,164 - DEBUG - Response for create_network : {'network': {'id': 'f7b54cd8-eb39-4ba6-98e1-fa61714ee3e1', 'name': 'test_vnv6dn', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'test_vnv6dn'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:23:38,452 - DEBUG - Response for create_subnet : {'subnet': {'id': '77ecc825-3804-4a46-b456-d717211ec6af', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'f7b54cd8-eb39-4ba6-98e1-fa61714ee3e1', 'ip_version': 6, 'cidr': '2001::201:0/120', 'allocation_pools': [{'start': '2001::201:2', 'end': '2001::201:fe'}], 'gateway_ip': '2001::201:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::201:2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:23:38,653 - DEBUG - Response for create_subnet : {'subnet': {'id': 'de9c9c56-e0fb-4c1f-b0ad-3643c635ed45', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'f7b54cd8-eb39-4ba6-98e1-fa61714ee3e1', 'ip_version': 4, 'cidr': '74.182.206.0/26', 'allocation_pools': [{'start': '74.182.206.2', 'end': '74.182.206.62'}], 'gateway_ip': '74.182.206.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '74.182.206.2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:23:38,677 - INFO - Created VN test_vnv6dn 2025-09-11 03:23:38,692 - DEBUG - VN test_vnv6dn UUID is f7b54cd8-eb39-4ba6-98e1-fa61714ee3e1 2025-09-11 03:23:39,026 - DEBUG - Services list from nova: [, , , ] 2025-09-11 03:23:40,238 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 03:23:41,915 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 03:23:41,915 - INFO - Waiting for VM source_vm to be up.. 2025-09-11 03:23:41,997 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-11 03:23:47,092 - DEBUG - VM is in ACTIVE state now 2025-09-11 03:23:47,092 - INFO - VM name : source_vm 2025-09-11 03:23:47,178 - DEBUG - VM source_vm ID is 5d3d870e-9e09-4abc-b886-4bcbf786a50a 2025-09-11 03:23:47,209 - DEBUG - VM source_vm launched on Node an-jenkins-deploy-platform-ansible-os-4079-1 2025-09-11 03:23:47,307 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/5d3d870e-9e09-4abc-b886-4bcbf786a50a 2025-09-11 03:23:47,604 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/5d3d870e-9e09-4abc-b886-4bcbf786a50a 2025-09-11 03:23:47,636 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/80352a7f-6625-499e-9dfa-a38609bb699f 2025-09-11 03:23:50,801 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-09-11 03:23:50,801 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM source_vm failed! 2025-09-11 03:23:50,815 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6sr is 2001::101:1 and allocation pool is NOT set 2025-09-11 03:23:50,815 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6sr is 66.192.185.1 and allocation pool is NOT set 2025-09-11 03:23:52,879 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=4.75 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.406 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.406/2.578/4.751/2.172 ms') 2025-09-11 03:23:52,879 - INFO - Ping to Metadata IP 169.254.0.7 of VM source_vm passed 2025-09-11 03:23:52,949 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-11 03:23:52,949 - DEBUG - Waiting to SSH to VM source_vm, IP 66.192.185.3, Port 22 2025-09-11 03:23:53,106 - DEBUG - VM source_vm is ready for SSH connections 2025-09-11 03:23:53,107 - INFO - Waiting for VM dest_vm to be up.. 2025-09-11 03:23:53,191 - DEBUG - VM is in ERROR state now 2025-09-11 03:23:53,191 - ERROR - VM in error state. 2025-09-11 03:23:53,191 - ERROR - VM is not in ACTIVE state 2025-09-11 03:23:53,271 - ERROR - Fatal Nova Exception while getting VM detail 2025-09-11 03:23:53,272 - DEBUG - None 2025-09-11 03:23:53,277 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6sr, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6dn, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-11 03:23:53,606 - INFO - Attaching policy allow_all to vn test_vnv6sr 2025-09-11 03:23:53,957 - INFO - Attaching policy allow_all to vn test_vnv6dn 2025-09-11 03:23:54,218 - INFO - Configure the policy with allow any 2025-09-11 03:23:54,532 - DEBUG - Response for create_network : {'network': {'id': 'ebd3f8d9-9072-42c6-b487-ca33fd026c2e', 'name': 'vn1', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'vn1'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:23:54,727 - DEBUG - Response for create_subnet : {'subnet': {'id': '207c15fe-2442-4c84-aa01-a853bb9a02a4', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'ebd3f8d9-9072-42c6-b487-ca33fd026c2e', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:23:54,748 - INFO - Created VN vn1 2025-09-11 03:23:54,761 - DEBUG - VN vn1 UUID is ebd3f8d9-9072-42c6-b487-ca33fd026c2e 2025-09-11 03:23:55,083 - DEBUG - Response for create_network : {'network': {'id': 'de3daf3c-3107-417c-9292-765ff0ceb84a', 'name': 'vn2', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'vn2'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:23:55,269 - DEBUG - Response for create_subnet : {'subnet': {'id': '4cfd4c74-7358-4c2c-81b0-540ca74604db', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'de3daf3c-3107-417c-9292-765ff0ceb84a', 'ip_version': 4, 'cidr': '20.1.1.0/24', 'allocation_pools': [{'start': '20.1.1.2', 'end': '20.1.1.254'}], 'gateway_ip': '20.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.1.1.2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:23:55,290 - INFO - Created VN vn2 2025-09-11 03:23:55,304 - DEBUG - VN vn2 UUID is de3daf3c-3107-417c-9292-765ff0ceb84a 2025-09-11 03:23:55,419 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:vn1, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:vn2, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-11 03:23:55,764 - INFO - Attaching policy sec_grp_policy_ctest-random-16692080 to vn vn1 2025-09-11 03:23:56,133 - INFO - Attaching policy sec_grp_policy_ctest-random-16692080 to vn vn2 2025-09-11 03:23:57,834 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 03:23:59,434 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 03:23:59,495 - INFO - ================================================================================ 2025-09-11 03:23:59,495 - INFO - STARTING TEST : test_check_per_peer_on_control 2025-09-11 03:23:59,495 - INFO - TEST DESCRIPTION : Description: Verify per peer md5 and specific protocol on all ports and policy with allow all between VN's 2025-09-11 03:24:00,762 - DEBUG - Skipping xmpp flap check 2025-09-11 03:24:00,762 - INFO - Initial checks done. Running the testcase now 2025-09-11 03:24:00,762 - INFO - 2025-09-11 03:24:00,762 - INFO - config per peer with auth_data None 2025-09-11 03:24:01,327 - INFO - configure MD5 on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:01,424 - INFO - config per peer with auth_data None 2025-09-11 03:24:02,031 - INFO - configure MD5 on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:02,123 - INFO - config per peer with auth_data None 2025-09-11 03:24:02,727 - INFO - configure MD5 on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:02,811 - INFO - check BGP peering is up before setting md5 config 2025-09-11 03:24:02,811 - INFO - Check BGP staus between peers 2025-09-11 03:24:02,830 - INFO - config per peer with auth_data {'key_items': [{'key': 'juniper', 'key_id': 0}], 'key_type': 'md5'} 2025-09-11 03:24:03,392 - INFO - Check BGP staus between peers 2025-09-11 03:24:03,408 - DEBUG - Check the BGP connection on 10.0.0.249 2025-09-11 03:24:03,408 - DEBUG - Check the BGP connection on 10.0.0.249 2025-09-11 03:24:13,409 - INFO - Check BGP staus between peers 2025-09-11 03:24:13,420 - INFO - remove md5 configured on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:13,420 - INFO - config per peer with auth_data None 2025-09-11 03:24:13,967 - INFO - configure MD5 on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:14,055 - INFO - remove md5 configured on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:14,055 - INFO - config per peer with auth_data None 2025-09-11 03:24:14,655 - INFO - configure MD5 on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:14,739 - INFO - remove md5 configured on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:14,739 - INFO - config per peer with auth_data None 2025-09-11 03:24:15,331 - INFO - configure MD5 on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:15,423 - INFO - Skip interface_detach for VM vn2_vm_0 in state ERROR 2025-09-11 03:24:15,423 - INFO - Deleting VM vn2_vm_0 2025-09-11 03:24:15,423 - ERROR - VM vn2_vm_0 has failed to come up 2025-09-11 03:24:15,423 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-09-11T03:23:59Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-09-11 03:24:15,423 - INFO - Skip interface_detach for VM vn1_vm_0 in state BUILD 2025-09-11 03:24:15,423 - INFO - Deleting VM vn1_vm_0 2025-09-11 03:24:15,424 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-11 03:24:15,424 - ERROR - Nova failed to get host of the VM 2025-09-11 03:24:15,424 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-11 03:24:15,424 - ERROR - Nova failed to get host of the VM 2025-09-11 03:24:15,517 - INFO - Dettaching policy sec_grp_policy_ctest-random-16692080 from vn vn2 2025-09-11 03:24:15,672 - INFO - Dettaching policy sec_grp_policy_ctest-random-16692080 from vn vn1 2025-09-11 03:24:15,910 - INFO - Deleted policy sec_grp_policy_ctest-random-16692080 2025-09-11 03:24:15,910 - INFO - Deleting VN vn2 2025-09-11 03:24:16,053 - DEBUG - Response for deleting network () 2025-09-11 03:24:16,053 - INFO - Deleting VN vn1 2025-09-11 03:24:16,104 - DEBUG - VN ebd3f8d9-9072-42c6-b487-ca33fd026c2e still in use: Unable to complete operation on network ebd3f8d9-9072-42c6-b487-ca33fd026c2e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-294735ff-5194-4692-8435-b53f9db08f78'] 2025-09-11 03:24:16,104 - WARNING - Deleting VN vn1 failed..Will retry 2025-09-11 03:24:18,256 - DEBUG - Response for deleting network () 2025-09-11 03:24:18,256 - INFO - Dettaching policy allow_all from vn test_vnv6dn 2025-09-11 03:24:18,454 - INFO - Dettaching policy allow_all from vn test_vnv6sr 2025-09-11 03:24:18,714 - INFO - Deleted policy allow_all 2025-09-11 03:24:18,714 - INFO - Skip interface_detach for VM dest_vm in state ERROR 2025-09-11 03:24:18,714 - INFO - Deleting VM dest_vm 2025-09-11 03:24:18,715 - ERROR - VM dest_vm has failed to come up 2025-09-11 03:24:18,715 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-09-11T03:23:41Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-09-11 03:24:18,715 - INFO - Deleting VM source_vm 2025-09-11 03:24:18,783 - INFO - Deleting VN test_vnv6dn 2025-09-11 03:24:18,947 - DEBUG - Response for deleting network () 2025-09-11 03:24:18,947 - INFO - Deleting VN test_vnv6sr 2025-09-11 03:24:18,999 - DEBUG - VN 208d7fe7-7f66-467b-b2f4-df479231de23 still in use: Unable to complete operation on network 208d7fe7-7f66-467b-b2f4-df479231de23. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f5f5255f-7708-45a7-8f74-705db7b475ea'] 2025-09-11 03:24:19,000 - WARNING - Deleting VN test_vnv6sr failed..Will retry 2025-09-11 03:24:21,178 - DEBUG - Response for deleting network () 2025-09-11 03:24:22,431 - DEBUG - Skipping xmpp flap check 2025-09-11 03:24:22,431 - INFO - END TEST : test_check_per_peer_on_control : PASSED[0:00:23] 2025-09-11 03:24:22,432 - INFO - -------------------------------------------------------------------------------- 2025-09-11 03:24:22,809 - DEBUG - Response for create_network : {'network': {'id': '1c601ef4-4276-4c05-b3c1-653602454fce', 'name': 'test_vnv6sr', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'test_vnv6sr'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:24:23,083 - DEBUG - Response for create_subnet : {'subnet': {'id': '7d867868-ff78-4d14-9bf0-d3907a738a7c', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': '1c601ef4-4276-4c05-b3c1-653602454fce', 'ip_version': 6, 'cidr': '2001::101:0/120', 'allocation_pools': [{'start': '2001::101:2', 'end': '2001::101:fe'}], 'gateway_ip': '2001::101:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::101:2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:24:23,269 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c477aece-de67-4bdc-a357-986e7c6afef4', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': '1c601ef4-4276-4c05-b3c1-653602454fce', 'ip_version': 4, 'cidr': '88.171.32.128/26', 'allocation_pools': [{'start': '88.171.32.130', 'end': '88.171.32.190'}], 'gateway_ip': '88.171.32.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '88.171.32.130', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:24:23,295 - INFO - Created VN test_vnv6sr 2025-09-11 03:24:23,310 - DEBUG - VN test_vnv6sr UUID is 1c601ef4-4276-4c05-b3c1-653602454fce 2025-09-11 03:24:23,693 - DEBUG - Response for create_network : {'network': {'id': 'bfab3d3a-f1a5-4d24-930b-6434cc3160cd', 'name': 'test_vnv6dn', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'test_vnv6dn'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:24:23,950 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c546b48a-99b6-4016-838f-81f23f39f84d', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'bfab3d3a-f1a5-4d24-930b-6434cc3160cd', 'ip_version': 6, 'cidr': '2001::201:0/120', 'allocation_pools': [{'start': '2001::201:2', 'end': '2001::201:fe'}], 'gateway_ip': '2001::201:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::201:2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:24:24,171 - DEBUG - Response for create_subnet : {'subnet': {'id': '7fe4643c-ddb2-4462-b0fa-39a4f00ecb96', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'bfab3d3a-f1a5-4d24-930b-6434cc3160cd', 'ip_version': 4, 'cidr': '222.57.106.128/26', 'allocation_pools': [{'start': '222.57.106.130', 'end': '222.57.106.190'}], 'gateway_ip': '222.57.106.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '222.57.106.130', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:24:24,197 - INFO - Created VN test_vnv6dn 2025-09-11 03:24:24,214 - DEBUG - VN test_vnv6dn UUID is bfab3d3a-f1a5-4d24-930b-6434cc3160cd 2025-09-11 03:24:25,818 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-1) 2025-09-11 03:24:26,501 - DEBUG - VM dest_vm already present, not creating it 2025-09-11 03:24:26,501 - INFO - Waiting for VM source_vm to be up.. 2025-09-11 03:24:26,617 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-11 03:24:31,732 - DEBUG - VM is in ACTIVE state now 2025-09-11 03:24:31,732 - INFO - VM name : source_vm 2025-09-11 03:24:31,828 - DEBUG - VM source_vm ID is d911dd19-a177-4a70-8adf-556de3f38e58 2025-09-11 03:24:31,828 - DEBUG - VM source_vm launched on Node an-jenkins-deploy-platform-ansible-os-4079-1 2025-09-11 03:24:31,928 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/d911dd19-a177-4a70-8adf-556de3f38e58 2025-09-11 03:24:31,938 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/44bf891e-1b4f-4e5a-8907-d66cedb54e6f 2025-09-11 03:24:35,112 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-09-11 03:24:35,112 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM source_vm failed! 2025-09-11 03:24:35,126 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6sr is 2001::101:1 and allocation pool is NOT set 2025-09-11 03:24:35,126 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6sr is 88.171.32.129 and allocation pool is NOT set 2025-09-11 03:24:37,192 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=8.23 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=1.86 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.858/5.044/8.231/3.186 ms') 2025-09-11 03:24:37,192 - INFO - Ping to Metadata IP 169.254.0.7 of VM source_vm passed 2025-09-11 03:24:37,264 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-11 03:24:37,265 - DEBUG - Waiting to SSH to VM source_vm, IP 88.171.32.131, Port 22 2025-09-11 03:24:37,423 - DEBUG - VM source_vm is ready for SSH connections 2025-09-11 03:24:37,423 - INFO - Waiting for VM dest_vm to be up.. 2025-09-11 03:24:37,483 - DEBUG - VM is in ERROR state now 2025-09-11 03:24:37,483 - ERROR - VM in error state. 2025-09-11 03:24:37,483 - ERROR - VM is not in ACTIVE state 2025-09-11 03:24:37,576 - ERROR - Fatal Nova Exception while getting VM detail 2025-09-11 03:24:37,576 - DEBUG - None 2025-09-11 03:24:37,582 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6sr, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:test_vnv6dn, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-11 03:24:37,932 - INFO - Attaching policy allow_all to vn test_vnv6sr 2025-09-11 03:24:38,310 - INFO - Attaching policy allow_all to vn test_vnv6dn 2025-09-11 03:24:38,581 - INFO - Configure the policy with allow any 2025-09-11 03:24:38,918 - DEBUG - Response for create_network : {'network': {'id': '36c09006-1bc6-4236-a936-f36a0d7646b8', 'name': 'vn1', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'vn1'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:24:39,195 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fbe4e9b3-ba53-4165-842c-9f0c4c53d9c5', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': '36c09006-1bc6-4236-a936-f36a0d7646b8', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:24:39,217 - INFO - Created VN vn1 2025-09-11 03:24:39,233 - DEBUG - VN vn1 UUID is 36c09006-1bc6-4236-a936-f36a0d7646b8 2025-09-11 03:24:39,585 - DEBUG - Response for create_network : {'network': {'id': 'cba3a369-cbcf-48b7-bbb8-c94d77e33132', 'name': 'vn2', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'project_id': 'f104084680d546a5a1127da246e0ac6d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-17404211', 'vn2'], 'port_security_enabled': True, 'description': ''}} 2025-09-11 03:24:39,862 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f349bdd6-e71b-44af-813b-68c2c5e800a0', 'name': '', 'tenant_id': 'f104084680d546a5a1127da246e0ac6d', 'network_id': 'cba3a369-cbcf-48b7-bbb8-c94d77e33132', 'ip_version': 4, 'cidr': '20.1.1.0/24', 'allocation_pools': [{'start': '20.1.1.2', 'end': '20.1.1.254'}], 'gateway_ip': '20.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.1.1.2', 'tags': [], 'project_id': 'f104084680d546a5a1127da246e0ac6d'}} 2025-09-11 03:24:39,884 - INFO - Created VN vn2 2025-09-11 03:24:39,896 - DEBUG - VN vn2 UUID is cba3a369-cbcf-48b7-bbb8-c94d77e33132 2025-09-11 03:24:39,980 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:vn1, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-17404211:vn2, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-11 03:24:40,323 - INFO - Attaching policy sec_grp_policy_ctest-random-81435295 to vn vn1 2025-09-11 03:24:40,678 - INFO - Attaching policy sec_grp_policy_ctest-random-81435295 to vn vn2 2025-09-11 03:24:42,457 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4079-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4079-2) 2025-09-11 03:24:42,971 - DEBUG - VM vn2_vm_0 already present, not creating it 2025-09-11 03:24:43,030 - INFO - ================================================================================ 2025-09-11 03:24:43,030 - INFO - STARTING TEST : test_create_md5_on_control 2025-09-11 03:24:43,030 - INFO - TEST DESCRIPTION : Description: Verify md5 with allow specific protocol on all ports and policy with allow all between VN's 2025-09-11 03:24:44,319 - DEBUG - Skipping xmpp flap check 2025-09-11 03:24:44,319 - INFO - Initial checks done. Running the testcase now 2025-09-11 03:24:44,319 - INFO - 2025-09-11 03:24:44,319 - INFO - config md5 on each host with auth_data None 2025-09-11 03:24:44,319 - INFO - config per peer with auth_data None 2025-09-11 03:24:44,895 - INFO - configure MD5 on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:44,999 - INFO - config per peer with auth_data None 2025-09-11 03:24:45,611 - INFO - configure MD5 on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:45,711 - INFO - config per peer with auth_data None 2025-09-11 03:24:46,307 - INFO - configure MD5 on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:46,391 - INFO - check if BGP between peers are up before setting md5 2025-09-11 03:24:46,391 - INFO - Check BGP staus between peers 2025-09-11 03:24:46,403 - INFO - setting MD5 config on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:46,403 - INFO - configure MD5 on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:46,483 - INFO - setting MD5 config on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:46,483 - INFO - configure MD5 on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:46,571 - INFO - setting MD5 config on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:46,571 - INFO - configure MD5 on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:46,648 - INFO - check if BGP peering is up after md5 config 2025-09-11 03:24:46,648 - INFO - Check BGP staus between peers 2025-09-11 03:24:46,661 - DEBUG - Check the BGP connection on 10.0.0.249 2025-09-11 03:24:46,661 - DEBUG - Check the BGP connection on 10.0.0.249 2025-09-11 03:24:56,662 - INFO - Check BGP staus between peers 2025-09-11 03:24:56,676 - INFO - remove md5 configured on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:56,676 - INFO - config per peer with auth_data None 2025-09-11 03:24:57,276 - INFO - configure MD5 on host 5eb89423-7589-4ad8-a082-2caf07309dfd 2025-09-11 03:24:57,387 - INFO - remove md5 configured on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:57,387 - INFO - config per peer with auth_data None 2025-09-11 03:24:57,947 - INFO - configure MD5 on host 9541799b-ea87-4301-9b0a-0b99fd5e532c 2025-09-11 03:24:58,027 - INFO - remove md5 configured on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:58,027 - INFO - config per peer with auth_data None 2025-09-11 03:24:58,607 - INFO - configure MD5 on host eb872124-7d16-4207-940e-399c77edb5f8 2025-09-11 03:24:58,699 - INFO - Skipping the deletion of VM vn2_vm_0 2025-09-11 03:24:58,699 - INFO - Skip interface_detach for VM vn1_vm_0 in state BUILD 2025-09-11 03:24:58,699 - INFO - Deleting VM vn1_vm_0 2025-09-11 03:24:58,700 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-11 03:24:58,700 - ERROR - Nova failed to get host of the VM 2025-09-11 03:24:58,700 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-11 03:24:58,700 - ERROR - Nova failed to get host of the VM 2025-09-11 03:24:58,942 - INFO - Dettaching policy sec_grp_policy_ctest-random-81435295 from vn vn2 2025-09-11 03:24:59,102 - INFO - Dettaching policy sec_grp_policy_ctest-random-81435295 from vn vn1 2025-09-11 03:24:59,335 - INFO - Deleted policy sec_grp_policy_ctest-random-81435295 2025-09-11 03:24:59,336 - INFO - Deleting VN vn2 2025-09-11 03:24:59,483 - DEBUG - Response for deleting network () 2025-09-11 03:24:59,483 - INFO - Deleting VN vn1 2025-09-11 03:24:59,610 - DEBUG - Response for deleting network () 2025-09-11 03:24:59,610 - INFO - Dettaching policy allow_all from vn test_vnv6dn 2025-09-11 03:24:59,810 - INFO - Dettaching policy allow_all from vn test_vnv6sr 2025-09-11 03:25:00,051 - INFO - Deleted policy allow_all 2025-09-11 03:25:00,052 - INFO - Skipping the deletion of VM dest_vm 2025-09-11 03:25:00,052 - INFO - Deleting VM source_vm 2025-09-11 03:25:00,137 - INFO - Deleting VN test_vnv6dn 2025-09-11 03:25:00,318 - DEBUG - Response for deleting network () 2025-09-11 03:25:00,318 - INFO - Deleting VN test_vnv6sr 2025-09-11 03:25:00,367 - DEBUG - VN 1c601ef4-4276-4c05-b3c1-653602454fce still in use: Unable to complete operation on network 1c601ef4-4276-4c05-b3c1-653602454fce. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-47e531b6-ed40-45e0-97b6-32d380a4a908'] 2025-09-11 03:25:00,367 - WARNING - Deleting VN test_vnv6sr failed..Will retry 2025-09-11 03:25:02,525 - DEBUG - Response for deleting network () 2025-09-11 03:25:03,799 - DEBUG - Skipping xmpp flap check 2025-09-11 03:25:03,800 - INFO - END TEST : test_create_md5_on_control : PASSED[0:00:20] 2025-09-11 03:25:03,800 - INFO - -------------------------------------------------------------------------------- 2025-09-11 03:25:04,525 - INFO - Deleted project: ctest-TestMd5testsOnControl-17404211, ID : f1040846-80d5-46a5-a112-7da246e0ac6d