2025-09-22 04:00:29,012 - INFO - Domain Default found not creating 2025-09-22 04:00:29,164 - INFO - Project ctest-TestMd5testsOnControl-39274262 not found, creating it 2025-09-22 04:00:29,677 - INFO - Created Project:ctest-TestMd5testsOnControl-39274262, ID : 90d3544e-5def-4d89-a45b-a8d5c9e4347f 2025-09-22 04:00:32,150 - DEBUG - Response for create_network : {'network': {'id': '1cfdaecb-8a76-4f7d-b824-1ac2f047ad4b', 'name': 'test_vnv6sr', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'test_vnv6sr'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:00:32,621 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c3eb89be-b6f0-45f4-95f9-2773378ea011', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '1cfdaecb-8a76-4f7d-b824-1ac2f047ad4b', 'ip_version': 6, 'cidr': '2001::101:0/120', 'allocation_pools': [{'start': '2001::101:2', 'end': '2001::101:fe'}], 'gateway_ip': '2001::101:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::101:2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:00:32,856 - DEBUG - Response for create_subnet : {'subnet': {'id': '44e0d03e-8059-4e65-baa5-b269d3a4ef76', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '1cfdaecb-8a76-4f7d-b824-1ac2f047ad4b', 'ip_version': 4, 'cidr': '186.73.196.0/26', 'allocation_pools': [{'start': '186.73.196.2', 'end': '186.73.196.62'}], 'gateway_ip': '186.73.196.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.73.196.2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:00:32,893 - INFO - Created VN test_vnv6sr 2025-09-22 04:00:32,908 - DEBUG - VN test_vnv6sr UUID is 1cfdaecb-8a76-4f7d-b824-1ac2f047ad4b 2025-09-22 04:00:33,319 - DEBUG - Response for create_network : {'network': {'id': '23c8fa4b-d885-4959-af00-924fe9ae6343', 'name': 'test_vnv6dn', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'test_vnv6dn'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:00:33,560 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cf787c58-bb42-4a5a-af26-f16f7db0a01a', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '23c8fa4b-d885-4959-af00-924fe9ae6343', 'ip_version': 6, 'cidr': '2001::201:0/120', 'allocation_pools': [{'start': '2001::201:2', 'end': '2001::201:fe'}], 'gateway_ip': '2001::201:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::201:2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:00:33,793 - DEBUG - Response for create_subnet : {'subnet': {'id': '88c47147-ae68-4c1f-ba34-3c64f1391a68', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '23c8fa4b-d885-4959-af00-924fe9ae6343', 'ip_version': 4, 'cidr': '190.177.158.64/26', 'allocation_pools': [{'start': '190.177.158.66', 'end': '190.177.158.126'}], 'gateway_ip': '190.177.158.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.177.158.66', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:00:33,830 - INFO - Created VN test_vnv6dn 2025-09-22 04:00:33,846 - DEBUG - VN test_vnv6dn UUID is 23c8fa4b-d885-4959-af00-924fe9ae6343 2025-09-22 04:00:34,040 - DEBUG - Services list from nova: [, , , ] 2025-09-22 04:00:35,292 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-2) 2025-09-22 04:00:36,721 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-1) 2025-09-22 04:00:36,721 - INFO - Waiting for VM source_vm to be up.. 2025-09-22 04:00:36,806 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-22 04:00:41,895 - DEBUG - VM is in ACTIVE state now 2025-09-22 04:00:41,895 - INFO - VM name : source_vm 2025-09-22 04:00:41,981 - DEBUG - VM source_vm ID is b5e3e9ae-d6d5-4c02-ab1c-ca852f452e6e 2025-09-22 04:00:42,007 - DEBUG - VM source_vm launched on Node an-jenkins-deploy-platform-ansible-os-4159-2 2025-09-22 04:00:42,092 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/b5e3e9ae-d6d5-4c02-ab1c-ca852f452e6e 2025-09-22 04:00:42,397 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/b5e3e9ae-d6d5-4c02-ab1c-ca852f452e6e 2025-09-22 04:00:42,432 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/6f533b0d-68b6-4273-a484-9e6bae9df120 2025-09-22 04:00:45,599 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-09-22 04:00:45,599 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM source_vm failed! 2025-09-22 04:00:45,614 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6sr is 2001::101:1 and allocation pool is NOT set 2025-09-22 04:00:45,614 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6sr is 186.73.196.1 and allocation pool is NOT set 2025-09-22 04:00:47,678 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.95 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.440 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.440/2.196/3.953/1.756 ms') 2025-09-22 04:00:47,678 - INFO - Ping to Metadata IP 169.254.0.3 of VM source_vm passed 2025-09-22 04:00:47,745 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-22 04:00:47,745 - DEBUG - Waiting to SSH to VM source_vm, IP 186.73.196.3, Port 22 2025-09-22 04:00:47,914 - DEBUG - VM source_vm is ready for SSH connections 2025-09-22 04:00:47,914 - INFO - Waiting for VM dest_vm to be up.. 2025-09-22 04:00:47,996 - DEBUG - VM is in ACTIVE state now 2025-09-22 04:00:47,996 - INFO - VM name : dest_vm 2025-09-22 04:00:48,073 - DEBUG - VM dest_vm ID is e8d2efc6-bd49-4ef5-8853-4c3b7c2efbbf 2025-09-22 04:00:48,074 - DEBUG - VM dest_vm launched on Node an-jenkins-deploy-platform-ansible-os-4159-1 2025-09-22 04:00:48,151 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e8d2efc6-bd49-4ef5-8853-4c3b7c2efbbf 2025-09-22 04:00:48,163 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/41058851-4cf7-4f74-8a94-c212e4c4a762 2025-09-22 04:00:49,325 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=13.1 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.51 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.513/7.809/13.105/5.296 ms') 2025-09-22 04:00:49,325 - INFO - Ping to Metadata IP 169.254.0.3 of VM dest_vm passed 2025-09-22 04:00:49,400 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-22 04:00:49,400 - DEBUG - Waiting to SSH to VM dest_vm, IP 190.177.158.67, Port 22 2025-09-22 04:00:49,466 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-22 04:00:49,539 - DEBUG - VM dest_vm is NOT ready for SSH connections, VM status: ACTIVE 2025-09-22 04:00:54,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-22 04:00:54,540 - DEBUG - Waiting to SSH to VM dest_vm, IP 190.177.158.67, Port 22 2025-09-22 04:00:54,710 - DEBUG - VM dest_vm is ready for SSH connections 2025-09-22 04:00:54,717 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6sr, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6dn, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-22 04:00:55,064 - INFO - Attaching policy allow_all to vn test_vnv6sr 2025-09-22 04:00:55,457 - INFO - Attaching policy allow_all to vn test_vnv6dn 2025-09-22 04:00:55,728 - INFO - Configure the policy with allow any 2025-09-22 04:00:56,053 - DEBUG - Response for create_network : {'network': {'id': '3c25e7e5-299e-4d15-aa33-cca57bf9a9e8', 'name': 'vn1', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'vn1'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:00:56,342 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f683e361-0120-457c-942b-df67b6fd1fbf', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '3c25e7e5-299e-4d15-aa33-cca57bf9a9e8', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:00:56,365 - INFO - Created VN vn1 2025-09-22 04:00:56,378 - DEBUG - VN vn1 UUID is 3c25e7e5-299e-4d15-aa33-cca57bf9a9e8 2025-09-22 04:00:56,776 - DEBUG - Response for create_network : {'network': {'id': 'dc71f58a-978c-485b-9786-c0d510b90357', 'name': 'vn2', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'vn2'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:00:56,994 - DEBUG - Response for create_subnet : {'subnet': {'id': '0cab539e-41fb-43fd-9c17-250fb80faee8', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': 'dc71f58a-978c-485b-9786-c0d510b90357', 'ip_version': 4, 'cidr': '20.1.1.0/24', 'allocation_pools': [{'start': '20.1.1.2', 'end': '20.1.1.254'}], 'gateway_ip': '20.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.1.1.2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:00:57,016 - INFO - Created VN vn2 2025-09-22 04:00:57,028 - DEBUG - VN vn2 UUID is dc71f58a-978c-485b-9786-c0d510b90357 2025-09-22 04:00:57,152 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:vn1, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:vn2, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-22 04:00:57,490 - INFO - Attaching policy sec_grp_policy_ctest-random-75628810 to vn vn1 2025-09-22 04:00:57,860 - INFO - Attaching policy sec_grp_policy_ctest-random-75628810 to vn vn2 2025-09-22 04:00:59,382 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-2) 2025-09-22 04:01:00,727 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-1) 2025-09-22 04:01:00,788 - INFO - ================================================================================ 2025-09-22 04:01:00,788 - INFO - STARTING TEST : test_check_per_peer_on_control 2025-09-22 04:01:00,788 - INFO - TEST DESCRIPTION : Description: Verify per peer md5 and specific protocol on all ports and policy with allow all between VN's 2025-09-22 04:01:02,111 - DEBUG - Skipping xmpp flap check 2025-09-22 04:01:02,111 - INFO - Initial checks done. Running the testcase now 2025-09-22 04:01:02,111 - INFO - 2025-09-22 04:01:02,111 - INFO - config per peer with auth_data None 2025-09-22 04:01:02,760 - INFO - configure MD5 on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:01:02,852 - INFO - config per peer with auth_data None 2025-09-22 04:01:03,516 - INFO - configure MD5 on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:01:03,608 - INFO - config per peer with auth_data None 2025-09-22 04:01:04,228 - INFO - configure MD5 on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:01:04,332 - INFO - check BGP peering is up before setting md5 config 2025-09-22 04:01:04,332 - INFO - Check BGP staus between peers 2025-09-22 04:01:04,343 - INFO - config per peer with auth_data {'key_items': [{'key': 'juniper', 'key_id': 0}], 'key_type': 'md5'} 2025-09-22 04:01:05,004 - INFO - Check BGP staus between peers 2025-09-22 04:01:05,020 - DEBUG - Check the BGP connection on 10.0.0.56 2025-09-22 04:01:05,021 - DEBUG - Check the BGP connection on 10.0.0.56 2025-09-22 04:01:15,022 - INFO - Check BGP staus between peers 2025-09-22 04:01:15,033 - INFO - remove md5 configured on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:01:15,033 - INFO - config per peer with auth_data None 2025-09-22 04:01:15,588 - INFO - configure MD5 on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:01:15,676 - INFO - remove md5 configured on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:01:15,676 - INFO - config per peer with auth_data None 2025-09-22 04:01:16,296 - INFO - configure MD5 on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:01:16,388 - INFO - remove md5 configured on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:01:16,388 - INFO - config per peer with auth_data None 2025-09-22 04:01:16,981 - INFO - configure MD5 on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:01:17,084 - INFO - Skip interface_detach for VM vn2_vm_0 in state BUILD 2025-09-22 04:01:17,084 - INFO - Deleting VM vn2_vm_0 2025-09-22 04:01:17,084 - ERROR - VM vn2_vm_0 has failed to come up 2025-09-22 04:01:17,084 - ERROR - Nova failed to get host of the VM 2025-09-22 04:01:17,084 - ERROR - VM vn2_vm_0 has failed to come up 2025-09-22 04:01:17,084 - ERROR - Nova failed to get host of the VM 2025-09-22 04:01:17,152 - INFO - Skip interface_detach for VM vn1_vm_0 in state BUILD 2025-09-22 04:01:17,152 - INFO - Deleting VM vn1_vm_0 2025-09-22 04:01:17,152 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-22 04:01:17,152 - ERROR - Nova failed to get host of the VM 2025-09-22 04:01:17,152 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-22 04:01:17,152 - ERROR - Nova failed to get host of the VM 2025-09-22 04:01:17,220 - INFO - Dettaching policy sec_grp_policy_ctest-random-75628810 from vn vn2 2025-09-22 04:01:17,387 - INFO - Dettaching policy sec_grp_policy_ctest-random-75628810 from vn vn1 2025-09-22 04:01:17,659 - INFO - Deleted policy sec_grp_policy_ctest-random-75628810 2025-09-22 04:01:17,659 - INFO - Deleting VN vn2 2025-09-22 04:01:17,713 - DEBUG - VN dc71f58a-978c-485b-9786-c0d510b90357 still in use: Unable to complete operation on network dc71f58a-978c-485b-9786-c0d510b90357. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f2e8b5ba-29e2-4f66-bbf5-87f8995dcc93'] 2025-09-22 04:01:17,713 - WARNING - Deleting VN vn2 failed..Will retry 2025-09-22 04:01:19,882 - DEBUG - Response for deleting network () 2025-09-22 04:01:19,882 - INFO - Deleting VN vn1 2025-09-22 04:01:20,042 - DEBUG - Response for deleting network () 2025-09-22 04:01:20,042 - INFO - Dettaching policy allow_all from vn test_vnv6dn 2025-09-22 04:01:20,240 - INFO - Dettaching policy allow_all from vn test_vnv6sr 2025-09-22 04:01:20,503 - INFO - Deleted policy allow_all 2025-09-22 04:01:20,503 - INFO - Deleting VM dest_vm 2025-09-22 04:01:20,572 - INFO - Deleting VM source_vm 2025-09-22 04:01:20,633 - INFO - Deleting VN test_vnv6dn 2025-09-22 04:01:20,677 - DEBUG - VN 23c8fa4b-d885-4959-af00-924fe9ae6343 still in use: Unable to complete operation on network 23c8fa4b-d885-4959-af00-924fe9ae6343. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b53bb353-0e46-4b8d-bd68-79eeac719d75'] 2025-09-22 04:01:20,677 - WARNING - Deleting VN test_vnv6dn failed..Will retry 2025-09-22 04:01:22,868 - DEBUG - Response for deleting network () 2025-09-22 04:01:22,868 - INFO - Deleting VN test_vnv6sr 2025-09-22 04:01:23,056 - DEBUG - Response for deleting network () 2025-09-22 04:01:24,336 - DEBUG - Skipping xmpp flap check 2025-09-22 04:01:24,336 - INFO - END TEST : test_check_per_peer_on_control : PASSED[0:00:24] 2025-09-22 04:01:24,336 - INFO - -------------------------------------------------------------------------------- 2025-09-22 04:01:24,608 - DEBUG - Response for create_network : {'network': {'id': '60550d90-ad0b-4fa0-bd4e-fe4aa7ab995e', 'name': 'test_vnv6sr', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'test_vnv6sr'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:01:24,826 - DEBUG - Response for create_subnet : {'subnet': {'id': '67f30750-6b9d-464b-9fe1-8f8ac02f7e66', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '60550d90-ad0b-4fa0-bd4e-fe4aa7ab995e', 'ip_version': 6, 'cidr': '2001::101:0/120', 'allocation_pools': [{'start': '2001::101:2', 'end': '2001::101:fe'}], 'gateway_ip': '2001::101:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::101:2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:01:25,091 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd4ce35e1-a5af-43fa-b0a7-77a1fd4d774d', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '60550d90-ad0b-4fa0-bd4e-fe4aa7ab995e', 'ip_version': 4, 'cidr': '43.121.58.64/26', 'allocation_pools': [{'start': '43.121.58.66', 'end': '43.121.58.126'}], 'gateway_ip': '43.121.58.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.121.58.66', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:01:25,116 - INFO - Created VN test_vnv6sr 2025-09-22 04:01:25,131 - DEBUG - VN test_vnv6sr UUID is 60550d90-ad0b-4fa0-bd4e-fe4aa7ab995e 2025-09-22 04:01:25,522 - DEBUG - Response for create_network : {'network': {'id': 'cf0120db-983f-4b7d-aba6-509db05713e2', 'name': 'test_vnv6dn', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'test_vnv6dn'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:01:25,806 - DEBUG - Response for create_subnet : {'subnet': {'id': '51a05c4e-e7a5-4d48-9ae5-e10b6b89810b', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': 'cf0120db-983f-4b7d-aba6-509db05713e2', 'ip_version': 6, 'cidr': '2001::201:0/120', 'allocation_pools': [{'start': '2001::201:2', 'end': '2001::201:fe'}], 'gateway_ip': '2001::201:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2001::201:2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:01:26,027 - DEBUG - Response for create_subnet : {'subnet': {'id': '8cf575c5-60aa-4901-b22a-996c82bc7591', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': 'cf0120db-983f-4b7d-aba6-509db05713e2', 'ip_version': 4, 'cidr': '179.143.189.128/26', 'allocation_pools': [{'start': '179.143.189.130', 'end': '179.143.189.190'}], 'gateway_ip': '179.143.189.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '179.143.189.130', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:01:26,058 - INFO - Created VN test_vnv6dn 2025-09-22 04:01:26,075 - DEBUG - VN test_vnv6dn UUID is cf0120db-983f-4b7d-aba6-509db05713e2 2025-09-22 04:01:27,249 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-2) 2025-09-22 04:01:28,561 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-1) 2025-09-22 04:01:28,562 - INFO - Waiting for VM source_vm to be up.. 2025-09-22 04:01:28,652 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-22 04:01:33,736 - DEBUG - VM is in ACTIVE state now 2025-09-22 04:01:33,736 - INFO - VM name : source_vm 2025-09-22 04:01:33,831 - DEBUG - VM source_vm ID is af48b2a6-6f44-4062-9be6-fb3804f05e16 2025-09-22 04:01:33,831 - DEBUG - VM source_vm launched on Node an-jenkins-deploy-platform-ansible-os-4159-2 2025-09-22 04:01:33,916 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/af48b2a6-6f44-4062-9be6-fb3804f05e16 2025-09-22 04:01:33,927 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/c7d6c659-60bf-4d94-ada4-26f4a4c6948b 2025-09-22 04:01:37,086 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-09-22 04:01:37,086 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM source_vm failed! 2025-09-22 04:01:37,100 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6sr is 2001::101:1 and allocation pool is NOT set 2025-09-22 04:01:37,100 - DEBUG - Gateway for vn default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6sr is 43.121.58.65 and allocation pool is NOT set 2025-09-22 04:01:39,157 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.51 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.430 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.430/1.971/3.512/1.541 ms') 2025-09-22 04:01:39,157 - INFO - Ping to Metadata IP 169.254.0.3 of VM source_vm passed 2025-09-22 04:01:39,230 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-22 04:01:39,230 - DEBUG - Waiting to SSH to VM source_vm, IP 43.121.58.67, Port 22 2025-09-22 04:01:39,387 - DEBUG - VM source_vm is ready for SSH connections 2025-09-22 04:01:39,387 - INFO - Waiting for VM dest_vm to be up.. 2025-09-22 04:01:39,489 - DEBUG - VM is in ACTIVE state now 2025-09-22 04:01:39,490 - INFO - VM name : dest_vm 2025-09-22 04:01:39,590 - DEBUG - VM dest_vm ID is 065bdbfc-791c-4e81-b95f-27467188d552 2025-09-22 04:01:39,590 - DEBUG - VM dest_vm launched on Node an-jenkins-deploy-platform-ansible-os-4159-1 2025-09-22 04:01:39,704 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/065bdbfc-791c-4e81-b95f-27467188d552 2025-09-22 04:01:39,716 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/d96379d6-3741-43f4-9139-c4edfdfa48ee 2025-09-22 04:01:40,897 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=15.7 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.70 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.704/8.678/15.652/6.974 ms') 2025-09-22 04:01:40,898 - INFO - Ping to Metadata IP 169.254.0.3 of VM dest_vm passed 2025-09-22 04:01:40,973 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-22 04:01:40,974 - DEBUG - Waiting to SSH to VM dest_vm, IP 179.143.189.131, Port 22 2025-09-22 04:01:41,038 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-22 04:01:41,136 - DEBUG - VM dest_vm is NOT ready for SSH connections, VM status: ACTIVE 2025-09-22 04:01:46,137 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-22 04:01:46,137 - DEBUG - Waiting to SSH to VM dest_vm, IP 179.143.189.131, Port 22 2025-09-22 04:01:46,302 - DEBUG - VM dest_vm is ready for SSH connections 2025-09-22 04:01:46,309 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6sr, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:test_vnv6dn, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-22 04:01:46,651 - INFO - Attaching policy allow_all to vn test_vnv6sr 2025-09-22 04:01:47,023 - INFO - Attaching policy allow_all to vn test_vnv6dn 2025-09-22 04:01:47,364 - INFO - Configure the policy with allow any 2025-09-22 04:01:47,709 - DEBUG - Response for create_network : {'network': {'id': 'e95b31dd-865b-454a-819b-faf8c053e7cf', 'name': 'vn1', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'vn1'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:01:47,946 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f52d7d61-392d-4a06-a344-8cf8d787339d', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': 'e95b31dd-865b-454a-819b-faf8c053e7cf', 'ip_version': 4, 'cidr': '10.1.1.0/24', 'allocation_pools': [{'start': '10.1.1.2', 'end': '10.1.1.254'}], 'gateway_ip': '10.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.1.1.2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:01:47,991 - INFO - Created VN vn1 2025-09-22 04:01:48,004 - DEBUG - VN vn1 UUID is e95b31dd-865b-454a-819b-faf8c053e7cf 2025-09-22 04:01:48,383 - DEBUG - Response for create_network : {'network': {'id': '7990f7d4-cc0b-4b13-ad2d-e23b4c3de0e5', 'name': 'vn2', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMd5testsOnControl-39274262', 'vn2'], 'port_security_enabled': True, 'description': ''}} 2025-09-22 04:01:48,614 - DEBUG - Response for create_subnet : {'subnet': {'id': '86ebcf7f-7d33-4537-91bb-8b0729edaaa7', 'name': '', 'tenant_id': '90d3544e5def4d89a45ba8d5c9e4347f', 'network_id': '7990f7d4-cc0b-4b13-ad2d-e23b4c3de0e5', 'ip_version': 4, 'cidr': '20.1.1.0/24', 'allocation_pools': [{'start': '20.1.1.2', 'end': '20.1.1.254'}], 'gateway_ip': '20.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.1.1.2', 'tags': [], 'project_id': '90d3544e5def4d89a45ba8d5c9e4347f'}} 2025-09-22 04:01:48,635 - INFO - Created VN vn2 2025-09-22 04:01:48,654 - DEBUG - VN vn2 UUID is 7990f7d4-cc0b-4b13-ad2d-e23b4c3de0e5 2025-09-22 04:01:48,784 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:vn1, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestMd5testsOnControl-39274262:vn2, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-09-22 04:01:49,160 - INFO - Attaching policy sec_grp_policy_ctest-random-75969434 to vn vn1 2025-09-22 04:01:49,553 - INFO - Attaching policy sec_grp_policy_ctest-random-75969434 to vn vn2 2025-09-22 04:01:51,086 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-2) 2025-09-22 04:01:52,444 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4159-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4159-1) 2025-09-22 04:01:52,508 - INFO - ================================================================================ 2025-09-22 04:01:52,508 - INFO - STARTING TEST : test_create_md5_on_control 2025-09-22 04:01:52,508 - INFO - TEST DESCRIPTION : Description: Verify md5 with allow specific protocol on all ports and policy with allow all between VN's 2025-09-22 04:01:53,827 - DEBUG - Skipping xmpp flap check 2025-09-22 04:01:53,828 - INFO - Initial checks done. Running the testcase now 2025-09-22 04:01:53,828 - INFO - 2025-09-22 04:01:53,828 - INFO - config md5 on each host with auth_data None 2025-09-22 04:01:53,828 - INFO - config per peer with auth_data None 2025-09-22 04:01:54,424 - INFO - configure MD5 on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:01:54,516 - INFO - config per peer with auth_data None 2025-09-22 04:01:55,156 - INFO - configure MD5 on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:01:55,252 - INFO - config per peer with auth_data None 2025-09-22 04:01:55,908 - INFO - configure MD5 on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:01:55,996 - INFO - check if BGP between peers are up before setting md5 2025-09-22 04:01:55,996 - INFO - Check BGP staus between peers 2025-09-22 04:01:56,006 - INFO - setting MD5 config on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:01:56,006 - INFO - configure MD5 on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:01:56,084 - INFO - setting MD5 config on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:01:56,084 - INFO - configure MD5 on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:01:56,172 - INFO - setting MD5 config on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:01:56,172 - INFO - configure MD5 on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:01:56,252 - INFO - check if BGP peering is up after md5 config 2025-09-22 04:01:56,252 - INFO - Check BGP staus between peers 2025-09-22 04:01:56,262 - DEBUG - Check the BGP connection on 10.0.0.56 2025-09-22 04:01:56,262 - DEBUG - Check the BGP connection on 10.0.0.56 2025-09-22 04:02:06,263 - INFO - Check BGP staus between peers 2025-09-22 04:02:06,274 - INFO - remove md5 configured on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:02:06,274 - INFO - config per peer with auth_data None 2025-09-22 04:02:06,876 - INFO - configure MD5 on host 1e4cf61b-b572-4937-bf94-8222e450b78a 2025-09-22 04:02:06,984 - INFO - remove md5 configured on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:02:06,984 - INFO - config per peer with auth_data None 2025-09-22 04:02:07,636 - INFO - configure MD5 on host e6d42133-db0a-499f-82c3-42ad4dee52d0 2025-09-22 04:02:07,724 - INFO - remove md5 configured on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:02:07,724 - INFO - config per peer with auth_data None 2025-09-22 04:02:08,328 - INFO - configure MD5 on host 295dda65-1e1d-471e-85ab-a92ee476d066 2025-09-22 04:02:08,420 - INFO - Skip interface_detach for VM vn2_vm_0 in state BUILD 2025-09-22 04:02:08,420 - INFO - Deleting VM vn2_vm_0 2025-09-22 04:02:08,420 - ERROR - VM vn2_vm_0 has failed to come up 2025-09-22 04:02:08,420 - ERROR - Nova failed to get host of the VM 2025-09-22 04:02:08,420 - ERROR - VM vn2_vm_0 has failed to come up 2025-09-22 04:02:08,420 - ERROR - Nova failed to get host of the VM 2025-09-22 04:02:08,486 - INFO - Skip interface_detach for VM vn1_vm_0 in state BUILD 2025-09-22 04:02:08,486 - INFO - Deleting VM vn1_vm_0 2025-09-22 04:02:08,487 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-22 04:02:08,487 - ERROR - Nova failed to get host of the VM 2025-09-22 04:02:08,487 - ERROR - VM vn1_vm_0 has failed to come up 2025-09-22 04:02:08,487 - ERROR - Nova failed to get host of the VM 2025-09-22 04:02:08,549 - INFO - Dettaching policy sec_grp_policy_ctest-random-75969434 from vn vn2 2025-09-22 04:02:08,781 - INFO - Dettaching policy sec_grp_policy_ctest-random-75969434 from vn vn1 2025-09-22 04:02:09,047 - INFO - Deleted policy sec_grp_policy_ctest-random-75969434 2025-09-22 04:02:09,047 - INFO - Deleting VN vn2 2025-09-22 04:02:09,293 - DEBUG - VN 7990f7d4-cc0b-4b13-ad2d-e23b4c3de0e5 still in use: Unable to complete operation on network 7990f7d4-cc0b-4b13-ad2d-e23b4c3de0e5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e3602b48-b656-4242-a363-90090ec8e547'] 2025-09-22 04:02:09,293 - WARNING - Deleting VN vn2 failed..Will retry 2025-09-22 04:02:11,480 - DEBUG - Response for deleting network () 2025-09-22 04:02:11,480 - INFO - Deleting VN vn1 2025-09-22 04:02:11,683 - DEBUG - Response for deleting network () 2025-09-22 04:02:11,683 - INFO - Dettaching policy allow_all from vn test_vnv6dn 2025-09-22 04:02:11,969 - INFO - Dettaching policy allow_all from vn test_vnv6sr 2025-09-22 04:02:12,314 - INFO - Deleted policy allow_all 2025-09-22 04:02:12,314 - INFO - Deleting VM dest_vm 2025-09-22 04:02:12,424 - INFO - Deleting VM source_vm 2025-09-22 04:02:12,497 - INFO - Deleting VN test_vnv6dn 2025-09-22 04:02:12,567 - DEBUG - VN cf0120db-983f-4b7d-aba6-509db05713e2 still in use: Unable to complete operation on network cf0120db-983f-4b7d-aba6-509db05713e2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-222948ac-12ce-40fb-aca7-782778a416e2'] 2025-09-22 04:02:12,567 - WARNING - Deleting VN test_vnv6dn failed..Will retry 2025-09-22 04:02:14,798 - DEBUG - Response for deleting network () 2025-09-22 04:02:14,798 - INFO - Deleting VN test_vnv6sr 2025-09-22 04:02:15,000 - DEBUG - Response for deleting network () 2025-09-22 04:02:16,296 - DEBUG - Skipping xmpp flap check 2025-09-22 04:02:16,296 - INFO - END TEST : test_create_md5_on_control : PASSED[0:00:24] 2025-09-22 04:02:16,296 - INFO - -------------------------------------------------------------------------------- 2025-09-22 04:02:16,998 - INFO - Deleted project: ctest-TestMd5testsOnControl-39274262, ID : 90d3544e-5def-4d89-a45b-a8d5c9e4347f