2026-01-08 02:09:26,149 - INFO - Domain Default found not creating 2026-01-08 02:09:26,309 - INFO - Project ctest-TestECMPSanity-81683062 not found, creating it 2026-01-08 02:09:26,907 - INFO - Created Project:ctest-TestECMPSanity-81683062, ID : 1ae8b47c-4a04-413c-91b3-c26a5ec84ce0 2026-01-08 02:09:29,126 - DEBUG - Response for create_network : {'network': {'id': '965ede3d-f913-425c-9184-4b200d49960d', 'name': 'ctest-mgmt_ctest-TestECMPSanity-81683062-32616421', 'tenant_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'project_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-81683062', 'ctest-mgmt_ctest-TestECMPSanity-81683062-32616421'], 'port_security_enabled': True, 'description': ''}} 2026-01-08 02:09:29,429 - DEBUG - Response for create_subnet : {'subnet': {'id': '4e960382-9185-48c7-9094-4938478976a5', 'name': '', 'tenant_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'network_id': '965ede3d-f913-425c-9184-4b200d49960d', 'ip_version': 4, 'cidr': '97.23.5.64/26', 'allocation_pools': [{'start': '97.23.5.66', 'end': '97.23.5.126'}], 'gateway_ip': '97.23.5.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '97.23.5.66', 'tags': [], 'project_id': '1ae8b47c4a04413c91b3c26a5ec84ce0'}} 2026-01-08 02:09:29,457 - INFO - Created VN ctest-mgmt_ctest-TestECMPSanity-81683062-32616421 2026-01-08 02:09:29,471 - DEBUG - VN ctest-mgmt_ctest-TestECMPSanity-81683062-32616421 UUID is 965ede3d-f913-425c-9184-4b200d49960d 2026-01-08 02:09:29,846 - DEBUG - Response for create_network : {'network': {'id': '49b899f7-67d0-40ce-aa08-5a5818624955', 'name': 'ctest-left_ctest-TestECMPSanity-81683062-46756756', 'tenant_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'project_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-81683062', 'ctest-left_ctest-TestECMPSanity-81683062-46756756'], 'port_security_enabled': True, 'description': ''}} 2026-01-08 02:09:30,163 - DEBUG - Response for create_subnet : {'subnet': {'id': '0b202c37-5190-43a3-8fc0-502db3ea389a', 'name': '', 'tenant_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'network_id': '49b899f7-67d0-40ce-aa08-5a5818624955', 'ip_version': 4, 'cidr': '104.27.20.64/26', 'allocation_pools': [{'start': '104.27.20.66', 'end': '104.27.20.126'}], 'gateway_ip': '104.27.20.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '104.27.20.66', 'tags': [], 'project_id': '1ae8b47c4a04413c91b3c26a5ec84ce0'}} 2026-01-08 02:09:30,185 - INFO - Created VN ctest-left_ctest-TestECMPSanity-81683062-46756756 2026-01-08 02:09:30,203 - DEBUG - VN ctest-left_ctest-TestECMPSanity-81683062-46756756 UUID is 49b899f7-67d0-40ce-aa08-5a5818624955 2026-01-08 02:09:30,621 - DEBUG - Response for create_network : {'network': {'id': '3478e22b-d250-4c51-8d1f-f1c28c55b8c2', 'name': 'ctest-right_ctest-TestECMPSanity-81683062-38587684', 'tenant_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'project_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-81683062', 'ctest-right_ctest-TestECMPSanity-81683062-38587684'], 'port_security_enabled': True, 'description': ''}} 2026-01-08 02:09:30,894 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a9a15e98-1ea6-4027-b0fe-1a6c9f552919', 'name': '', 'tenant_id': '1ae8b47c4a04413c91b3c26a5ec84ce0', 'network_id': '3478e22b-d250-4c51-8d1f-f1c28c55b8c2', 'ip_version': 4, 'cidr': '42.23.119.64/26', 'allocation_pools': [{'start': '42.23.119.66', 'end': '42.23.119.126'}], 'gateway_ip': '42.23.119.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '42.23.119.66', 'tags': [], 'project_id': '1ae8b47c4a04413c91b3c26a5ec84ce0'}} 2026-01-08 02:09:30,921 - INFO - Created VN ctest-right_ctest-TestECMPSanity-81683062-38587684 2026-01-08 02:09:30,935 - DEBUG - VN ctest-right_ctest-TestECMPSanity-81683062-38587684 UUID is 3478e22b-d250-4c51-8d1f-f1c28c55b8c2 2026-01-08 02:09:31,072 - DEBUG - Services list from nova: [, , , ] 2026-01-08 02:09:32,204 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4976-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4976-2) 2026-01-08 02:09:33,555 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4976-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4976-1) 2026-01-08 02:09:33,558 - INFO - ================================================================================ 2026-01-08 02:09:33,558 - INFO - STARTING TEST : test_ecmp_svc_in_network_with_static_route_no_policy 2026-01-08 02:09:33,558 - INFO - TEST DESCRIPTION : Description: Validate service chaining in-network mode datapath having a static route entries of the either virtual networks pointing to the corresponding interfaces of the service instance. We will not configure any policy. Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network mode with 1 instance and left-interface of the service instance sharing the IP and both the left and the right interfaces enabled for static route. 3. Delete the policy. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2026-01-08 02:09:34,287 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.56': {'10.20.0.25': '0', '10.20.0.193': '0'}} with 2026-01-08 02:09:34,287 - INFO - Initial checks done. Running the testcase now 2026-01-08 02:09:34,287 - INFO - 2026-01-08 02:09:34,288 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-66651631'] 2026-01-08 02:09:34,616 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-66651631'] created succesfully 2026-01-08 02:09:34,943 - DEBUG - Image by name tiny_in_net not found 2026-01-08 02:09:34,943 - DEBUG - Installing image tiny_in_net 2026-01-08 02:09:34,943 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-01-08 02:09:34,943 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-01-08 02:09:34,944 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-01-08 02:09:34,944 - DEBUG - Unzip image 2026-01-08 02:09:34,944 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2026-01-08 02:09:34,956 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found 2026-01-08 02:09:34,956 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-66651631'] 2026-01-08 02:09:35,051 - INFO - Service template: ['default-domain', 'ctest-service_template_1-66651631'] deleted successfully. 2026-01-08 02:09:35,741 - DEBUG - No XMPP flaps were noticed during the test 2026-01-08 02:09:35,741 - INFO - 2026-01-08 02:09:35,741 - INFO - END TEST : test_ecmp_svc_in_network_with_static_route_no_policy : SKIPPED[0:00:02] 2026-01-08 02:09:35,741 - INFO - -------------------------------------------------------------------------------- 2026-01-08 02:09:35,745 - INFO - ================================================================================ 2026-01-08 02:09:35,745 - INFO - STARTING TEST : test_ecmp_svc_v2_transparent_with_3_instance 2026-01-08 02:09:35,745 - INFO - TEST DESCRIPTION : Description: Validate ECMP with version 2 service chaining transparent mode datapath having service instance Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating a service instance in transparent mode with 3 instances. 3.Creating a service chain by applying the service instance as a service in a policy between the VNs. 4.Checking for ping and bidirectional tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1 and vice-versa. Maintainer : ganeshahv@juniper.net 2026-01-08 02:09:36,399 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.56': {'10.20.0.25': '0', '10.20.0.193': '0'}} with 2026-01-08 02:09:36,400 - INFO - Initial checks done. Running the testcase now 2026-01-08 02:09:36,400 - INFO - 2026-01-08 02:09:36,400 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4976-2', 'an-jenkins-deploy-platform-ansible-os-4976-1']} 2026-01-08 02:09:36,400 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2026-01-08 02:09:37,051 - DEBUG - No XMPP flaps were noticed during the test 2026-01-08 02:09:37,051 - INFO - 2026-01-08 02:09:37,051 - INFO - END TEST : test_ecmp_svc_v2_transparent_with_3_instance : SKIPPED[0:00:02] 2026-01-08 02:09:37,051 - INFO - -------------------------------------------------------------------------------- 2026-01-08 02:09:37,052 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPSanity-81683062-70069667 in state BUILD 2026-01-08 02:09:37,052 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPSanity-81683062-70069667 2026-01-08 02:09:37,077 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-81683062-70069667 has failed to come up 2026-01-08 02:09:37,077 - ERROR - Nova failed to get host of the VM 2026-01-08 02:09:37,078 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-81683062-70069667 has failed to come up 2026-01-08 02:09:37,078 - ERROR - Nova failed to get host of the VM 2026-01-08 02:09:37,148 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPSanity-81683062-77094407 in state BUILD 2026-01-08 02:09:37,148 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPSanity-81683062-77094407 2026-01-08 02:09:37,148 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-81683062-77094407 has failed to come up 2026-01-08 02:09:37,148 - ERROR - Nova failed to get host of the VM 2026-01-08 02:09:37,148 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-81683062-77094407 has failed to come up 2026-01-08 02:09:37,148 - ERROR - Nova failed to get host of the VM 2026-01-08 02:09:37,210 - INFO - Deleting VN ctest-left_ctest-TestECMPSanity-81683062-46756756 2026-01-08 02:09:37,249 - DEBUG - VN 49b899f7-67d0-40ce-aa08-5a5818624955 still in use: Unable to complete operation on network 49b899f7-67d0-40ce-aa08-5a5818624955. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a62ef97c-fbea-4ad8-9be2-b19c5da2450b'] 2026-01-08 02:09:37,250 - WARNING - Deleting VN ctest-left_ctest-TestECMPSanity-81683062-46756756 failed..Will retry 2026-01-08 02:09:39,402 - DEBUG - Response for deleting network () 2026-01-08 02:09:39,403 - INFO - Deleting VN ctest-right_ctest-TestECMPSanity-81683062-38587684 2026-01-08 02:09:39,572 - DEBUG - Response for deleting network () 2026-01-08 02:09:39,573 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPSanity-81683062-32616421 2026-01-08 02:09:39,736 - DEBUG - Response for deleting network () 2026-01-08 02:09:40,526 - INFO - Deleted project: ctest-TestECMPSanity-81683062, ID : 1ae8b47c-4a04-413c-91b3-c26a5ec84ce0