2026-03-05 02:10:27,960 - INFO - Domain Default found not creating 2026-03-05 02:10:28,114 - INFO - Project ctest-TestECMPSanityIPv6-18818010 not found, creating it 2026-03-05 02:10:28,655 - INFO - Created Project:ctest-TestECMPSanityIPv6-18818010, ID : 1955610a-91b2-4ab9-897c-8d2c346a5ace 2026-03-05 02:10:30,859 - DEBUG - Response for create_network : {'network': {'id': '03a599fb-f3b3-48e4-8de4-bf42a5d250d3', 'name': 'ctest-mgmt_ctest-TestECMPSanityIPv6-18818010-94065027', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'project_id': '1955610a91b24ab9897c8d2c346a5ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanityIPv6-18818010', 'ctest-mgmt_ctest-TestECMPSanityIPv6-18818010-94065027'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 02:10:31,141 - DEBUG - Response for create_subnet : {'subnet': {'id': '7465c1d5-8064-4ceb-8f98-2253d3e4dede', 'name': '', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'network_id': '03a599fb-f3b3-48e4-8de4-bf42a5d250d3', 'ip_version': 6, 'cidr': '2b19:1835:b79:b6db:5778:a976::/96', 'allocation_pools': [{'start': '2b19:1835:b79:b6db:5778:a976:0:2', 'end': '2b19:1835:b79:b6db:5778:a976:ffff:fffe'}], 'gateway_ip': '2b19:1835:b79:b6db:5778:a976:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2b19:1835:b79:b6db:5778:a976:0:2', 'tags': [], 'project_id': '1955610a91b24ab9897c8d2c346a5ace'}} 2026-03-05 02:10:31,411 - DEBUG - Response for create_subnet : {'subnet': {'id': '4dac43b1-1de2-4385-a9dc-91f6d844e9be', 'name': '', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'network_id': '03a599fb-f3b3-48e4-8de4-bf42a5d250d3', 'ip_version': 4, 'cidr': '174.91.201.192/26', 'allocation_pools': [{'start': '174.91.201.194', 'end': '174.91.201.254'}], 'gateway_ip': '174.91.201.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '174.91.201.194', 'tags': [], 'project_id': '1955610a91b24ab9897c8d2c346a5ace'}} 2026-03-05 02:10:31,434 - INFO - Created VN ctest-mgmt_ctest-TestECMPSanityIPv6-18818010-94065027 2026-03-05 02:10:31,447 - DEBUG - VN ctest-mgmt_ctest-TestECMPSanityIPv6-18818010-94065027 UUID is 03a599fb-f3b3-48e4-8de4-bf42a5d250d3 2026-03-05 02:10:31,801 - DEBUG - Response for create_network : {'network': {'id': 'd6931ad5-4a6b-40eb-ac8f-5f8c836e8f12', 'name': 'ctest-left_ctest-TestECMPSanityIPv6-18818010-44499723', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'project_id': '1955610a91b24ab9897c8d2c346a5ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanityIPv6-18818010', 'ctest-left_ctest-TestECMPSanityIPv6-18818010-44499723'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 02:10:32,059 - DEBUG - Response for create_subnet : {'subnet': {'id': '1b105e5d-2f90-45f6-b313-beef032939c3', 'name': '', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'network_id': 'd6931ad5-4a6b-40eb-ac8f-5f8c836e8f12', 'ip_version': 6, 'cidr': '3741:109d:1fb2:39d1:3249:fa35::/96', 'allocation_pools': [{'start': '3741:109d:1fb2:39d1:3249:fa35:0:2', 'end': '3741:109d:1fb2:39d1:3249:fa35:ffff:fffe'}], 'gateway_ip': '3741:109d:1fb2:39d1:3249:fa35:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3741:109d:1fb2:39d1:3249:fa35:0:2', 'tags': [], 'project_id': '1955610a91b24ab9897c8d2c346a5ace'}} 2026-03-05 02:10:32,246 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e48e8d3a-23a1-444b-93f0-1a3f1541924f', 'name': '', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'network_id': 'd6931ad5-4a6b-40eb-ac8f-5f8c836e8f12', 'ip_version': 4, 'cidr': '176.36.76.128/26', 'allocation_pools': [{'start': '176.36.76.130', 'end': '176.36.76.190'}], 'gateway_ip': '176.36.76.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '176.36.76.130', 'tags': [], 'project_id': '1955610a91b24ab9897c8d2c346a5ace'}} 2026-03-05 02:10:32,289 - INFO - Created VN ctest-left_ctest-TestECMPSanityIPv6-18818010-44499723 2026-03-05 02:10:32,302 - DEBUG - VN ctest-left_ctest-TestECMPSanityIPv6-18818010-44499723 UUID is d6931ad5-4a6b-40eb-ac8f-5f8c836e8f12 2026-03-05 02:10:32,713 - DEBUG - Response for create_network : {'network': {'id': '54e5bfd7-cd18-4cd0-8e2b-9fa365cdb56f', 'name': 'ctest-right_ctest-TestECMPSanityIPv6-18818010-28241719', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'project_id': '1955610a91b24ab9897c8d2c346a5ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanityIPv6-18818010', 'ctest-right_ctest-TestECMPSanityIPv6-18818010-28241719'], 'port_security_enabled': True, 'description': ''}} 2026-03-05 02:10:32,915 - DEBUG - Response for create_subnet : {'subnet': {'id': '36b69543-a526-43cd-90e5-c765755a7d1b', 'name': '', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'network_id': '54e5bfd7-cd18-4cd0-8e2b-9fa365cdb56f', 'ip_version': 6, 'cidr': '3718:5008:3ced:1b9f:de40:e5ca::/96', 'allocation_pools': [{'start': '3718:5008:3ced:1b9f:de40:e5ca:0:2', 'end': '3718:5008:3ced:1b9f:de40:e5ca:ffff:fffe'}], 'gateway_ip': '3718:5008:3ced:1b9f:de40:e5ca:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3718:5008:3ced:1b9f:de40:e5ca:0:2', 'tags': [], 'project_id': '1955610a91b24ab9897c8d2c346a5ace'}} 2026-03-05 02:10:33,157 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f39dee5f-30e2-4d4a-98e2-b5a2c92f0de4', 'name': '', 'tenant_id': '1955610a91b24ab9897c8d2c346a5ace', 'network_id': '54e5bfd7-cd18-4cd0-8e2b-9fa365cdb56f', 'ip_version': 4, 'cidr': '64.183.89.128/26', 'allocation_pools': [{'start': '64.183.89.130', 'end': '64.183.89.190'}], 'gateway_ip': '64.183.89.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '64.183.89.130', 'tags': [], 'project_id': '1955610a91b24ab9897c8d2c346a5ace'}} 2026-03-05 02:10:33,180 - INFO - Created VN ctest-right_ctest-TestECMPSanityIPv6-18818010-28241719 2026-03-05 02:10:33,194 - DEBUG - VN ctest-right_ctest-TestECMPSanityIPv6-18818010-28241719 UUID is 54e5bfd7-cd18-4cd0-8e2b-9fa365cdb56f 2026-03-05 02:10:33,344 - DEBUG - Services list from nova: [, , , ] 2026-03-05 02:10:34,399 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5433-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5433-2) 2026-03-05 02:10:35,761 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5433-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5433-1) 2026-03-05 02:10:35,765 - INFO - ================================================================================ 2026-03-05 02:10:35,768 - INFO - STARTING TEST : test_ecmp_svc_in_network_with_3_instance 2026-03-05 02:10:36,439 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.254': '0', '10.20.0.14': '0'}, '10.0.0.73': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2026-03-05 02:10:36,439 - INFO - Initial checks done. Running the testcase now 2026-03-05 02:10:36,439 - INFO - 2026-03-05 02:10:36,440 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5433-2', 'an-jenkins-deploy-platform-ansible-os-5433-1']} 2026-03-05 02:10:36,440 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2026-03-05 02:10:37,110 - DEBUG - No XMPP flaps were noticed during the test 2026-03-05 02:10:37,110 - INFO - 2026-03-05 02:10:37,110 - INFO - END TEST : test_ecmp_svc_in_network_with_3_instance : SKIPPED[0:00:02] 2026-03-05 02:10:37,110 - INFO - -------------------------------------------------------------------------------- 2026-03-05 02:10:37,114 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPSanityIPv6-18818010-74024985 in state BUILD 2026-03-05 02:10:37,114 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPSanityIPv6-18818010-74024985 2026-03-05 02:10:37,139 - ERROR - VM ctest-right_vm_ctest-TestECMPSanityIPv6-18818010-74024985 has failed to come up 2026-03-05 02:10:37,139 - ERROR - Nova failed to get host of the VM 2026-03-05 02:10:37,139 - ERROR - VM ctest-right_vm_ctest-TestECMPSanityIPv6-18818010-74024985 has failed to come up 2026-03-05 02:10:37,139 - ERROR - Nova failed to get host of the VM 2026-03-05 02:10:37,206 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPSanityIPv6-18818010-61594743 in state BUILD 2026-03-05 02:10:37,206 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPSanityIPv6-18818010-61594743 2026-03-05 02:10:37,206 - ERROR - VM ctest-left_vm_ctest-TestECMPSanityIPv6-18818010-61594743 has failed to come up 2026-03-05 02:10:37,206 - ERROR - Nova failed to get host of the VM 2026-03-05 02:10:37,206 - ERROR - VM ctest-left_vm_ctest-TestECMPSanityIPv6-18818010-61594743 has failed to come up 2026-03-05 02:10:37,206 - ERROR - Nova failed to get host of the VM 2026-03-05 02:10:37,283 - INFO - Deleting VN ctest-left_ctest-TestECMPSanityIPv6-18818010-44499723 2026-03-05 02:10:37,333 - DEBUG - VN d6931ad5-4a6b-40eb-ac8f-5f8c836e8f12 still in use: Unable to complete operation on network d6931ad5-4a6b-40eb-ac8f-5f8c836e8f12. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f5947ca4-683c-4cc4-bd2e-cdcb335e037c'] 2026-03-05 02:10:37,334 - WARNING - Deleting VN ctest-left_ctest-TestECMPSanityIPv6-18818010-44499723 failed..Will retry 2026-03-05 02:10:39,528 - DEBUG - Response for deleting network () 2026-03-05 02:10:39,528 - INFO - Deleting VN ctest-right_ctest-TestECMPSanityIPv6-18818010-28241719 2026-03-05 02:10:39,721 - DEBUG - Response for deleting network () 2026-03-05 02:10:39,721 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPSanityIPv6-18818010-94065027 2026-03-05 02:10:39,952 - DEBUG - Response for deleting network () 2026-03-05 02:10:40,770 - INFO - Deleted project: ctest-TestECMPSanityIPv6-18818010, ID : 1955610a-91b2-4ab9-897c-8d2c346a5ace