2024-09-13 21:30:12,520 - INFO - Reading existing Domain with UUID c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:12,539 - INFO - Using existing domain ['admin_domain'](c825d847-91d2-46e5-9bb6-0d300075fcb1) 2024-09-13 21:30:12,814 - INFO - Project ctest-FloatingipBasicTestSanity-44229724 not found, creating it 2024-09-13 21:30:15,648 - INFO - Created Project:ctest-FloatingipBasicTestSanity-44229724, ID : e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:17,749 - INFO - Using existing project ['admin_domain', 'admin'](4b59bd98-d528-49fe-849e-c16b301d4e8d) 2024-09-13 21:30:18,740 - INFO - Adding rules to the default security group in Project admin 2024-09-13 21:30:18,946 - INFO - ================================================================================ 2024-09-13 21:30:18,947 - INFO - STARTING TEST : test_floating_ip 2024-09-13 21:30:18,948 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN. 2024-09-13 21:30:19,541 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.12': '0', '10.0.0.41': '2'}, '10.0.0.36': {'10.0.0.12': '3', '10.0.0.41': '3'}} with 2024-09-13 21:30:19,541 - INFO - Initial checks done. Running the testcase now 2024-09-13 21:30:19,542 - INFO - 2024-09-13 21:30:19,591 - DEBUG - Services list from nova: [, , , ] 2024-09-13 21:30:19,591 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-juju-os-424-1', 'an-jenkins-deploy-platform-juju-os-424-2']} 2024-09-13 21:30:23,234 - DEBUG - Response for create_network : {'network': {'id': '2aca88f5-a957-4954-a4bc-e4c76ff88dd4', 'name': 'ctest-fvn-40855038', 'tenant_id': 'e18b67195b9a4df49670eb787d45ffe2', 'project_id': 'e18b67195b9a4df49670eb787d45ffe2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['admin_domain', 'ctest-FloatingipBasicTestSanity-44229724', 'ctest-fvn-40855038'], 'port_security_enabled': True, 'description': '', 'created_at': None, 'updated_at': None}} 2024-09-13 21:30:23,496 - DEBUG - Response for create_subnet : {'subnet': {'id': '373074cc-02ed-4e0f-a99c-15b8de66e479', 'name': '', 'tenant_id': 'e18b67195b9a4df49670eb787d45ffe2', 'network_id': '2aca88f5-a957-4954-a4bc-e4c76ff88dd4', 'ip_version': 4, 'cidr': '120.108.240.0/26', 'allocation_pools': [{'start': '120.108.240.2', 'end': '120.108.240.62'}], 'gateway_ip': '120.108.240.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2024-09-13T21:30:23.362869', 'updated_at': '2024-09-13T21:30:23.362869', 'dns_server_address': '120.108.240.2', 'tags': [], 'project_id': 'e18b67195b9a4df49670eb787d45ffe2'}} 2024-09-13 21:30:23,519 - INFO - Created VN ctest-fvn-40855038 2024-09-13 21:30:23,536 - DEBUG - VN ctest-fvn-40855038 UUID is 2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:23,621 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:23,941 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:23,983 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:24,004 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:24,080 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:24,098 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:24,113 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/8ee95405-17da-4893-8c6a-598bfd8c6163 2024-09-13 21:30:24,127 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/8ee95405-17da-4893-8c6a-598bfd8c6163 2024-09-13 21:30:24,137 - DEBUG - Requesting: http://10.0.0.12:8082/route-target/5edfba69-c095-4ee8-aaa4-15f6452e1e94 2024-09-13 21:30:24,147 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:30:24,147 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:24,164 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/8ee95405-17da-4893-8c6a-598bfd8c6163 2024-09-13 21:30:24,188 - INFO - Verified VN network id 6 for VN 2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:24,189 - INFO - Verifications in API Server for VN ctest-fvn-40855038 passed 2024-09-13 21:30:24,189 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:24,213 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/8ee95405-17da-4893-8c6a-598bfd8c6163 2024-09-13 21:30:24,225 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/8ee95405-17da-4893-8c6a-598bfd8c6163 2024-09-13 21:30:24,235 - DEBUG - Requesting: http://10.0.0.12:8082/route-target/5edfba69-c095-4ee8-aaa4-15f6452e1e94 2024-09-13 21:30:24,251 - DEBUG - Control-node 10.0.0.12 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-44229724', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3083427483577960788', 'uuid-lslong': '11870614263069969876'}, 'enable': 'true', 'created': '2024-09-13T21:30:21', 'last-modified': '2024-09-13T21:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.834223'} 2024-09-13 21:30:24,259 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:30:24,267 - DEBUG - Control-node 10.0.0.29 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-44229724', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3083427483577960788', 'uuid-lslong': '11870614263069969876'}, 'enable': 'true', 'created': '2024-09-13T21:30:21', 'last-modified': '2024-09-13T21:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.840854'} 2024-09-13 21:30:24,276 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:30:24,282 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-44229724', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3083427483577960788', 'uuid-lslong': '11870614263069969876'}, 'enable': 'true', 'created': '2024-09-13T21:30:21', 'last-modified': '2024-09-13T21:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.862769'} 2024-09-13 21:30:24,289 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:30:24,289 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-40855038 passed 2024-09-13 21:30:24,290 - DEBUG - ====Verifying policy data for ctest-fvn-40855038 in API_Server ====== 2024-09-13 21:30:24,290 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:24,297 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:24,312 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:24,383 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:24,401 - DEBUG - =>VN ctest-fvn-40855038 has no policy to be verified 2024-09-13 21:30:24,401 - DEBUG - Verifying the vn in opserver 2024-09-13 21:30:24,401 - DEBUG - Verifying the admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038 virtual network link through opserver 10.0.0.12 2024-09-13 21:30:24,401 - DEBUG - Requesting: http://10.0.0.12:8081/analytics/uves/virtual-networks 2024-09-13 21:30:24,726 - DEBUG - Requesting: http://10.0.0.12:8081/analytics/uves/virtual-networks 2024-09-13 21:30:24,811 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038', 'href': 'http://10.0.0.12:8081/analytics/uves/virtual-network/admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038?flat'} 2024-09-13 21:30:24,811 - DEBUG - Verifying the admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038 virtual network link through opserver 10.0.0.29 2024-09-13 21:30:24,811 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-09-13 21:30:25,130 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-09-13 21:30:25,209 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038', 'href': 'http://10.0.0.29:8081/analytics/uves/virtual-network/admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038?flat'} 2024-09-13 21:30:25,209 - DEBUG - Verifying the admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038 virtual network link through opserver 10.0.0.41 2024-09-13 21:30:25,209 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2024-09-13 21:30:25,522 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2024-09-13 21:30:25,635 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038?flat'} 2024-09-13 21:30:25,635 - INFO - Validated that VN admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038 is found in opserver 2024-09-13 21:30:25,660 - DEBUG - Do not have enough data to verify VN in agent 2024-09-13 21:30:25,672 - DEBUG - VRF ids for VN ctest-fvn-40855038: {} 2024-09-13 21:30:26,012 - DEBUG - Response for create_network : {'network': {'id': '08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf', 'name': 'ctest-vn1-80039881', 'tenant_id': 'e18b67195b9a4df49670eb787d45ffe2', 'project_id': 'e18b67195b9a4df49670eb787d45ffe2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['admin_domain', 'ctest-FloatingipBasicTestSanity-44229724', 'ctest-vn1-80039881'], 'port_security_enabled': True, 'description': '', 'created_at': None, 'updated_at': None}} 2024-09-13 21:30:26,286 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fa8268cd-ab2f-4856-afc3-e3c7020a3fad', 'name': '', 'tenant_id': 'e18b67195b9a4df49670eb787d45ffe2', 'network_id': '08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf', 'ip_version': 4, 'cidr': '71.163.212.64/26', 'allocation_pools': [{'start': '71.163.212.66', 'end': '71.163.212.126'}], 'gateway_ip': '71.163.212.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2024-09-13T21:30:26.163652', 'updated_at': '2024-09-13T21:30:26.163652', 'dns_server_address': '71.163.212.66', 'tags': [], 'project_id': 'e18b67195b9a4df49670eb787d45ffe2'}} 2024-09-13 21:30:26,310 - INFO - Created VN ctest-vn1-80039881 2024-09-13 21:30:26,334 - DEBUG - VN ctest-vn1-80039881 UUID is 08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:26,419 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:26,427 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:26,441 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:28,367 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:28,388 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:28,416 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/9ba669c2-eb51-4810-8c85-469d4f86d92d 2024-09-13 21:30:28,434 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/9ba669c2-eb51-4810-8c85-469d4f86d92d 2024-09-13 21:30:28,449 - DEBUG - Requesting: http://10.0.0.12:8082/route-target/d94c03bd-146b-42de-b3e9-c2a0e154edf0 2024-09-13 21:30:28,465 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-13 21:30:28,465 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:28,490 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/9ba669c2-eb51-4810-8c85-469d4f86d92d 2024-09-13 21:30:28,525 - INFO - Verified VN network id 7 for VN 08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:28,525 - INFO - Verifications in API Server for VN ctest-vn1-80039881 passed 2024-09-13 21:30:28,526 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:28,551 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/9ba669c2-eb51-4810-8c85-469d4f86d92d 2024-09-13 21:30:28,565 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/9ba669c2-eb51-4810-8c85-469d4f86d92d 2024-09-13 21:30:28,580 - DEBUG - Requesting: http://10.0.0.12:8082/route-target/d94c03bd-146b-42de-b3e9-c2a0e154edf0 2024-09-13 21:30:28,604 - DEBUG - Control-node 10.0.0.12 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-44229724', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '627495184328181213', 'uuid-lslong': '13661361210709631951'}, 'enable': 'true', 'created': '2024-09-13T21:30:25', 'last-modified': '2024-09-13T21:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.389302'} 2024-09-13 21:30:28,619 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-13 21:30:28,626 - DEBUG - Control-node 10.0.0.29 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-44229724', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '627495184328181213', 'uuid-lslong': '13661361210709631951'}, 'enable': 'true', 'created': '2024-09-13T21:30:25', 'last-modified': '2024-09-13T21:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.397830'} 2024-09-13 21:30:28,636 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-13 21:30:28,642 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-44229724', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '627495184328181213', 'uuid-lslong': '13661361210709631951'}, 'enable': 'true', 'created': '2024-09-13T21:30:25', 'last-modified': '2024-09-13T21:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.417400'} 2024-09-13 21:30:28,649 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-13 21:30:28,649 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-80039881 passed 2024-09-13 21:30:28,649 - DEBUG - ====Verifying policy data for ctest-vn1-80039881 in API_Server ====== 2024-09-13 21:30:28,650 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:28,657 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:28,672 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:28,797 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf 2024-09-13 21:30:28,813 - DEBUG - =>VN ctest-vn1-80039881 has no policy to be verified 2024-09-13 21:30:28,813 - DEBUG - Verifying the vn in opserver 2024-09-13 21:30:28,813 - DEBUG - Verifying the admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881 virtual network link through opserver 10.0.0.12 2024-09-13 21:30:28,813 - DEBUG - Requesting: http://10.0.0.12:8081/analytics/uves/virtual-networks 2024-09-13 21:30:28,897 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881', 'href': 'http://10.0.0.12:8081/analytics/uves/virtual-network/admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881?flat'} 2024-09-13 21:30:28,897 - DEBUG - Verifying the admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881 virtual network link through opserver 10.0.0.29 2024-09-13 21:30:28,897 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-09-13 21:30:29,003 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881', 'href': 'http://10.0.0.29:8081/analytics/uves/virtual-network/admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881?flat'} 2024-09-13 21:30:29,003 - DEBUG - Verifying the admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881 virtual network link through opserver 10.0.0.41 2024-09-13 21:30:29,004 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2024-09-13 21:30:29,086 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881?flat'} 2024-09-13 21:30:29,086 - INFO - Validated that VN admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881 is found in opserver 2024-09-13 21:30:29,112 - DEBUG - Do not have enough data to verify VN in agent 2024-09-13 21:30:29,123 - DEBUG - VRF ids for VN ctest-vn1-80039881: {} 2024-09-13 21:30:31,388 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-juju-os-424-1), Zone: (nova:an-jenkins-deploy-platform-juju-os-424-1) 2024-09-13 21:30:33,655 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-juju-os-424-2), Zone: (nova:an-jenkins-deploy-platform-juju-os-424-2) 2024-09-13 21:30:33,810 - INFO - Creating Floating IP pool ctest-some-pool-39556537 in API Server 2024-09-13 21:30:34,403 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:34,411 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:34,429 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:36,113 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:36,188 - DEBUG - Requesting: http://10.0.0.12:8082/floating-ip-pool/4231d99f-42c7-4ba1-9a87-ea6d2dc63ceb 2024-09-13 21:30:36,213 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:30:36,224 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:30:36,239 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:30:36,424 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/2aca88f5-a957-4954-a4bc-e4c76ff88dd4 2024-09-13 21:30:36,454 - DEBUG - FIP Pool ctest-some-pool-39556537 found in API Server 2024-09-13 21:30:36,454 - INFO - Verification for FIP pool ctest-some-pool-39556537 in API Server passed 2024-09-13 21:30:36,489 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-39556537 information 2024-09-13 21:30:36,497 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-39556537 information 2024-09-13 21:30:36,503 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-39556537 information 2024-09-13 21:30:36,503 - INFO - Verification for FIP pool ctest-some-pool-39556537 in Control-node passed 2024-09-13 21:30:36,504 - INFO - Waiting for VM ctest-vn1_vm1_name-23815895 to be up.. 2024-09-13 21:30:36,676 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-09-13 21:30:41,800 - DEBUG - VM is in ACTIVE state now 2024-09-13 21:30:41,801 - INFO - VM name : ctest-vn1_vm1_name-23815895 2024-09-13 21:30:41,934 - DEBUG - VM ctest-vn1_vm1_name-23815895 ID is 5406b10e-81ad-493a-94bb-648cb1487a82 2024-09-13 21:30:41,983 - DEBUG - VM ctest-vn1_vm1_name-23815895 launched on Node an-jenkins-deploy-platform-juju-os-424-1 2024-09-13 21:30:42,124 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/5406b10e-81ad-493a-94bb-648cb1487a82 2024-09-13 21:30:42,448 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/5406b10e-81ad-493a-94bb-648cb1487a82 2024-09-13 21:30:42,497 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/44bf73a7-d6c3-494f-a48d-1942181ec6ec 2024-09-13 21:30:45,674 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-09-13 21:30:45,674 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-23815895 failed! 2024-09-13 21:30:45,730 - DEBUG - Gateway for vn admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-vn1-80039881 is 71.163.212.65 and allocation pool is NOT set 2024-09-13 21:30:47,764 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.62 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.81 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.616/2.711/2.807/0.095 ms') 2024-09-13 21:30:47,764 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-23815895 passed 2024-09-13 21:30:47,845 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:30:47,845 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-23815895, IP 71.163.212.67, Port 22 2024-09-13 21:30:48,325 - DEBUG - VM ctest-vn1_vm1_name-23815895 is ready for SSH connections 2024-09-13 21:30:48,855 - DEBUG - Created Floating IP : ('120.108.240.4', '0b1bdf08-53fa-4266-9bea-3a0443a6cf8a') 2024-09-13 21:30:48,856 - DEBUG - Associating FIP 120.108.240.4 to 5406b10e-81ad-493a-94bb-648cb1487a82 2024-09-13 21:30:48,905 - DEBUG - Associating FIP ID 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a with Port ID 44bf73a7-d6c3-494f-a48d-1942181ec6ec 2024-09-13 21:30:49,011 - INFO - Waiting for VM ctest-fvn_vm1_name-45486086 to be up.. 2024-09-13 21:30:49,143 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-09-13 21:30:54,291 - DEBUG - VM is in ACTIVE state now 2024-09-13 21:30:54,291 - INFO - VM name : ctest-fvn_vm1_name-45486086 2024-09-13 21:30:54,423 - DEBUG - VM ctest-fvn_vm1_name-45486086 ID is bbedfeae-e0c8-4a10-9b16-1d914ba83592 2024-09-13 21:30:54,424 - DEBUG - VM ctest-fvn_vm1_name-45486086 launched on Node an-jenkins-deploy-platform-juju-os-424-2 2024-09-13 21:30:54,559 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/bbedfeae-e0c8-4a10-9b16-1d914ba83592 2024-09-13 21:30:54,572 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/d08c2793-9faf-4658-ba7e-713080bcc163 2024-09-13 21:30:57,726 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2024-09-13 21:30:57,726 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-45486086 failed! 2024-09-13 21:30:57,749 - DEBUG - Gateway for vn admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038 is 120.108.240.1 and allocation pool is NOT set 2024-09-13 21:30:59,773 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.85 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.330 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.330/2.090/3.850/1.760 ms') 2024-09-13 21:30:59,773 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-45486086 passed 2024-09-13 21:30:59,829 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:30:59,829 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-45486086, IP 120.108.240.3, Port 22 2024-09-13 21:30:59,853 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-13 21:31:00,075 - DEBUG - VM ctest-fvn_vm1_name-45486086 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-13 21:31:05,076 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:31:05,076 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-45486086, IP 120.108.240.3, Port 22 2024-09-13 21:31:05,175 - DEBUG - VM ctest-fvn_vm1_name-45486086 is ready for SSH connections 2024-09-13 21:31:05,323 - INFO - Route for FIP 120.108.240.4 is fine on Control-node 10.0.0.41 2024-09-13 21:31:05,338 - INFO - Route for FIP 120.108.240.4 is fine on Control-node 10.0.0.12 2024-09-13 21:31:05,340 - INFO - FIP 120.108.240.4 verification for passed on all Control-nodes 2024-09-13 21:31:05,341 - INFO - FIP ID 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a(120.108.240.4) validation in Control node passed 2024-09-13 21:31:06,937 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.0.0.27', 'dip': '10.0.0.36', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:92:79:e2'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '27', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.0.0.12', 'dest_vn_list': ['admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None} 2024-09-13 21:31:06,939 - DEBUG - Route for FIP IP 120.108.240.4 is present in agent 10.0.0.27 2024-09-13 21:31:06,939 - DEBUG - FIP 120.108.240.4 verification for VM ctest-vn1_vm1_name-23815895 in Agent 10.0.0.27 passed 2024-09-13 21:31:06,967 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '14', 'valid': 'true', 'policy': 'enabled', 'itf': 'tap44bf73a7-d6', 'mac': ['2:44:bf:73:a7:d6'], 'mcast': 'disabled', 'nh_index': '33', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.0.0.12', 'dest_vn_list': ['admin_domain:ctest-FloatingipBasicTestSanity-44229724:ctest-fvn-40855038'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '4', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None} 2024-09-13 21:31:06,967 - DEBUG - Route for FIP IP 120.108.240.4 is present in agent 10.0.0.36 2024-09-13 21:31:06,967 - DEBUG - FIP 120.108.240.4 verification for VM ctest-vn1_vm1_name-23815895 in Agent 10.0.0.36 passed 2024-09-13 21:31:06,967 - INFO - FIP ID 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a(120.108.240.4) validation in agents passed 2024-09-13 21:31:06,968 - DEBUG - Requesting: http://10.0.0.12:8082/floating-ip/0b1bdf08-53fa-4266-9bea-3a0443a6cf8a 2024-09-13 21:31:06,981 - DEBUG - FIP 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a is present in API server 2024-09-13 21:31:06,981 - INFO - FIP ID 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a(120.108.240.4) validation in API Server passed 2024-09-13 21:31:06,981 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:31:06,981 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 120.108.240.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.36, gateway password: c0ntrail123 2024-09-13 21:31:06,982 - DEBUG - ping -s 56 -c 3 -W 1 120.108.240.3 2024-09-13 21:31:09,886 - DEBUG - PING 120.108.240.3 (120.108.240.3): 56 data bytes 64 bytes from 120.108.240.3: seq=0 ttl=64 time=10.519 ms 64 bytes from 120.108.240.3: seq=1 ttl=64 time=1.213 ms 64 bytes from 120.108.240.3: seq=2 ttl=64 time=1.365 ms --- 120.108.240.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.213/4.365/10.519 ms 2024-09-13 21:31:09,886 - INFO - Ping to IP 120.108.240.3 from VM ctest-vn1_vm1_name-23815895 passed 2024-09-13 21:31:09,886 - DEBUG - Disassociating port from FIP ID : 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a 2024-09-13 21:31:10,001 - DEBUG - Deleting FIP ID 0b1bdf08-53fa-4266-9bea-3a0443a6cf8a 2024-09-13 21:31:10,148 - INFO - Deleting the FIP pool ctest-some-pool-39556537 2024-09-13 21:31:10,291 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-39556537 information 2024-09-13 21:31:10,307 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-39556537 information 2024-09-13 21:31:10,313 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-39556537 information 2024-09-13 21:31:10,313 - INFO - Deleting VM ctest-fvn_vm1_name-45486086 2024-09-13 21:31:10,528 - INFO - Deleting VM ctest-vn1_vm1_name-23815895 2024-09-13 21:31:10,760 - INFO - Deleting VN ctest-vn1-80039881 2024-09-13 21:31:10,807 - DEBUG - VN 08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf still in use: Unable to complete operation on network 08b54f8b-a826-45dd-bd96-e7a3e0a5e3cf. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a7d1d476-38bc-4c78-a595-c0ac1cc64166'] 2024-09-13 21:31:10,807 - WARNING - Deleting VN ctest-vn1-80039881 failed..Will retry 2024-09-13 21:31:13,230 - DEBUG - Response for deleting network () 2024-09-13 21:31:13,231 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/9ba669c2-eb51-4810-8c85-469d4f86d92d 2024-09-13 21:31:13,246 - DEBUG - Response Code: 404 2024-09-13 21:31:13,246 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:31:13,256 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:31:13,274 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:31:13,351 - INFO - Validated that VN ctest-vn1-80039881 is not found in API Server 2024-09-13 21:31:13,365 - DEBUG - VN ctest-vn1-80039881 is not present in Agent 10.0.0.27 2024-09-13 21:31:13,428 - DEBUG - VN ctest-vn1-80039881 is not present in Agent 10.0.0.36 2024-09-13 21:31:13,428 - INFO - Validated that VN ctest-vn1-80039881 is not in any agent 2024-09-13 21:31:13,473 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-80039881 info 2024-09-13 21:31:13,473 - INFO - Deleting VN ctest-fvn-40855038 2024-09-13 21:31:13,796 - DEBUG - Response for deleting network () 2024-09-13 21:31:13,796 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/8ee95405-17da-4893-8c6a-598bfd8c6163 2024-09-13 21:31:13,803 - DEBUG - Response Code: 404 2024-09-13 21:31:13,803 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:31:14,702 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:31:14,718 - DEBUG - Requesting: http://10.0.0.12:8082/project/e18b6719-5b9a-4df4-9670-eb787d45ffe2 2024-09-13 21:31:14,867 - INFO - Validated that VN ctest-fvn-40855038 is not found in API Server 2024-09-13 21:31:14,884 - DEBUG - VN ctest-fvn-40855038 is not present in Agent 10.0.0.27 2024-09-13 21:31:14,900 - DEBUG - VN ctest-fvn-40855038 is not present in Agent 10.0.0.36 2024-09-13 21:31:14,900 - INFO - Validated that VN ctest-fvn-40855038 is not in any agent 2024-09-13 21:31:14,951 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-40855038 info 2024-09-13 21:31:15,711 - DEBUG - No XMPP flaps were noticed during the test 2024-09-13 21:31:15,711 - INFO - END TEST : test_floating_ip : PASSED[0:00:57] 2024-09-13 21:31:15,712 - INFO - -------------------------------------------------------------------------------- 2024-09-13 21:31:16,466 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-44229724, ID : e18b6719-5b9a-4df4-9670-eb787d45ffe2