2026-04-27 02:40:31,405 - INFO - Domain Default found not creating 2026-04-27 02:40:31,616 - INFO - Project ctest-TestECMPFeature-14233083 not found, creating it 2026-04-27 02:40:32,370 - INFO - Created Project:ctest-TestECMPFeature-14233083, ID : 7cf2599a-0f3f-423e-b9c5-cc515d0736a8 2026-04-27 02:40:35,015 - DEBUG - Response for create_network : {'network': {'id': 'fe6ff9db-0d63-4b67-814a-8525827687c1', 'name': 'ctest-mgmt_ctest-TestECMPFeature-14233083-17144416', 'tenant_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'project_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPFeature-14233083', 'ctest-mgmt_ctest-TestECMPFeature-14233083-17144416'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 02:40:35,454 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b7b54157-da9a-41e8-b0af-305368180770', 'name': '', 'tenant_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'network_id': 'fe6ff9db-0d63-4b67-814a-8525827687c1', 'ip_version': 4, 'cidr': '82.189.190.192/26', 'allocation_pools': [{'start': '82.189.190.194', 'end': '82.189.190.254'}], 'gateway_ip': '82.189.190.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '82.189.190.194', 'tags': [], 'project_id': '7cf2599a0f3f423eb9c5cc515d0736a8'}} 2026-04-27 02:40:35,506 - INFO - Created VN ctest-mgmt_ctest-TestECMPFeature-14233083-17144416 2026-04-27 02:40:35,532 - DEBUG - VN ctest-mgmt_ctest-TestECMPFeature-14233083-17144416 UUID is fe6ff9db-0d63-4b67-814a-8525827687c1 2026-04-27 02:40:36,076 - DEBUG - Response for create_network : {'network': {'id': '1d81f2b5-3cd8-4f26-a192-6c1296d1cd16', 'name': 'ctest-left_ctest-TestECMPFeature-14233083-37213054', 'tenant_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'project_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPFeature-14233083', 'ctest-left_ctest-TestECMPFeature-14233083-37213054'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 02:40:36,405 - DEBUG - Response for create_subnet : {'subnet': {'id': '62613098-78c3-4a00-b161-bad26b23493b', 'name': '', 'tenant_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'network_id': '1d81f2b5-3cd8-4f26-a192-6c1296d1cd16', 'ip_version': 4, 'cidr': '111.100.142.128/26', 'allocation_pools': [{'start': '111.100.142.130', 'end': '111.100.142.190'}], 'gateway_ip': '111.100.142.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.100.142.130', 'tags': [], 'project_id': '7cf2599a0f3f423eb9c5cc515d0736a8'}} 2026-04-27 02:40:36,435 - INFO - Created VN ctest-left_ctest-TestECMPFeature-14233083-37213054 2026-04-27 02:40:36,451 - DEBUG - VN ctest-left_ctest-TestECMPFeature-14233083-37213054 UUID is 1d81f2b5-3cd8-4f26-a192-6c1296d1cd16 2026-04-27 02:40:36,985 - DEBUG - Response for create_network : {'network': {'id': 'ad1a0591-c256-4c7e-9c7b-08cff3e1bb35', 'name': 'ctest-right_ctest-TestECMPFeature-14233083-72649380', 'tenant_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'project_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPFeature-14233083', 'ctest-right_ctest-TestECMPFeature-14233083-72649380'], 'port_security_enabled': True, 'description': ''}} 2026-04-27 02:40:37,321 - DEBUG - Response for create_subnet : {'subnet': {'id': '3ad39281-ea6a-460e-8abb-0519638999b1', 'name': '', 'tenant_id': '7cf2599a0f3f423eb9c5cc515d0736a8', 'network_id': 'ad1a0591-c256-4c7e-9c7b-08cff3e1bb35', 'ip_version': 4, 'cidr': '13.125.240.0/26', 'allocation_pools': [{'start': '13.125.240.2', 'end': '13.125.240.62'}], 'gateway_ip': '13.125.240.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.125.240.2', 'tags': [], 'project_id': '7cf2599a0f3f423eb9c5cc515d0736a8'}} 2026-04-27 02:40:37,359 - INFO - Created VN ctest-right_ctest-TestECMPFeature-14233083-72649380 2026-04-27 02:40:37,377 - DEBUG - VN ctest-right_ctest-TestECMPFeature-14233083-72649380 UUID is ad1a0591-c256-4c7e-9c7b-08cff3e1bb35 2026-04-27 02:40:37,705 - DEBUG - Services list from nova: [, , , ] 2026-04-27 02:40:38,992 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-1) 2026-04-27 02:40:40,675 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5690-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5690-2) 2026-04-27 02:40:40,677 - INFO - ================================================================================ 2026-04-27 02:40:40,677 - INFO - STARTING TEST : test_ecmp_svc_v2_in_network_nat_with_3_instance 2026-04-27 02:40:40,677 - INFO - TEST DESCRIPTION : Description: Validate ECMP with v2 service chaining in-network-nat mode datapath having service instance Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network-nat mode with 3 instances and left-interface of the service instances sharing the IP and enabled for static route. 3. Creating a service chain by applying the service instance as a service in a policy between the VNs. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2026-04-27 02:40:41,356 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.18': '0'}} with 2026-04-27 02:40:41,356 - INFO - Initial checks done. Running the testcase now 2026-04-27 02:40:41,359 - INFO - 2026-04-27 02:40:41,361 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5690-1', 'an-jenkins-deploy-platform-ansible-os-5690-2']} 2026-04-27 02:40:41,362 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2026-04-27 02:40:42,071 - DEBUG - No XMPP flaps were noticed during the test 2026-04-27 02:40:42,071 - INFO - 2026-04-27 02:40:42,071 - INFO - END TEST : test_ecmp_svc_v2_in_network_nat_with_3_instance : SKIPPED[0:00:02] 2026-04-27 02:40:42,072 - INFO - -------------------------------------------------------------------------------- 2026-04-27 02:40:42,074 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPFeature-14233083-27241434 in state BUILD 2026-04-27 02:40:42,074 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPFeature-14233083-27241434 2026-04-27 02:40:42,114 - ERROR - VM ctest-right_vm_ctest-TestECMPFeature-14233083-27241434 has failed to come up 2026-04-27 02:40:42,114 - ERROR - Nova failed to get host of the VM 2026-04-27 02:40:42,114 - ERROR - VM ctest-right_vm_ctest-TestECMPFeature-14233083-27241434 has failed to come up 2026-04-27 02:40:42,114 - ERROR - Nova failed to get host of the VM 2026-04-27 02:40:42,199 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPFeature-14233083-89093617 in state BUILD 2026-04-27 02:40:42,200 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPFeature-14233083-89093617 2026-04-27 02:40:42,200 - ERROR - VM ctest-left_vm_ctest-TestECMPFeature-14233083-89093617 has failed to come up 2026-04-27 02:40:42,200 - ERROR - Nova failed to get host of the VM 2026-04-27 02:40:42,200 - ERROR - VM ctest-left_vm_ctest-TestECMPFeature-14233083-89093617 has failed to come up 2026-04-27 02:40:42,200 - ERROR - Nova failed to get host of the VM 2026-04-27 02:40:42,282 - INFO - Deleting VN ctest-left_ctest-TestECMPFeature-14233083-37213054 2026-04-27 02:40:42,347 - DEBUG - VN 1d81f2b5-3cd8-4f26-a192-6c1296d1cd16 still in use: Unable to complete operation on network 1d81f2b5-3cd8-4f26-a192-6c1296d1cd16. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-671b11ee-a64e-4b8c-b1b9-48ee0f87bfd6'] 2026-04-27 02:40:42,348 - WARNING - Deleting VN ctest-left_ctest-TestECMPFeature-14233083-37213054 failed..Will retry 2026-04-27 02:40:44,592 - DEBUG - Response for deleting network () 2026-04-27 02:40:44,592 - INFO - Deleting VN ctest-right_ctest-TestECMPFeature-14233083-72649380 2026-04-27 02:40:44,860 - DEBUG - Response for deleting network () 2026-04-27 02:40:44,860 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPFeature-14233083-17144416 2026-04-27 02:40:45,129 - DEBUG - Response for deleting network () 2026-04-27 02:40:46,082 - INFO - Deleted project: ctest-TestECMPFeature-14233083, ID : 7cf2599a-0f3f-423e-b9c5-cc515d0736a8