2026-03-19 02:33:23,599 - INFO - Domain Default found not creating 2026-03-19 02:33:23,789 - INFO - Project ctest-TestECMPSanity-71380745 not found, creating it 2026-03-19 02:33:24,336 - INFO - Created Project:ctest-TestECMPSanity-71380745, ID : c871a91a-a4ae-4139-9139-35fe3eb5fd44 2026-03-19 02:33:26,657 - DEBUG - Response for create_network : {'network': {'id': '39e8f74e-0d10-4cb6-8200-854fd8271b91', 'name': 'ctest-mgmt_ctest-TestECMPSanity-71380745-71766601', 'tenant_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'project_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-71380745', 'ctest-mgmt_ctest-TestECMPSanity-71380745-71766601'], 'port_security_enabled': True, 'description': ''}} 2026-03-19 02:33:27,012 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a2b25121-f2ea-4880-b9e5-c28b427cc3c7', 'name': '', 'tenant_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'network_id': '39e8f74e-0d10-4cb6-8200-854fd8271b91', 'ip_version': 4, 'cidr': '177.189.129.192/26', 'allocation_pools': [{'start': '177.189.129.194', 'end': '177.189.129.254'}], 'gateway_ip': '177.189.129.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '177.189.129.194', 'tags': [], 'project_id': 'c871a91aa4ae4139913935fe3eb5fd44'}} 2026-03-19 02:33:27,037 - INFO - Created VN ctest-mgmt_ctest-TestECMPSanity-71380745-71766601 2026-03-19 02:33:27,050 - DEBUG - VN ctest-mgmt_ctest-TestECMPSanity-71380745-71766601 UUID is 39e8f74e-0d10-4cb6-8200-854fd8271b91 2026-03-19 02:33:27,505 - DEBUG - Response for create_network : {'network': {'id': 'a44c02ed-2da0-4023-aaee-fe4eb028f5b6', 'name': 'ctest-left_ctest-TestECMPSanity-71380745-51034320', 'tenant_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'project_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-71380745', 'ctest-left_ctest-TestECMPSanity-71380745-51034320'], 'port_security_enabled': True, 'description': ''}} 2026-03-19 02:33:27,773 - DEBUG - Response for create_subnet : {'subnet': {'id': '4552c0c4-d28e-424e-ac6b-f67378b27914', 'name': '', 'tenant_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'network_id': 'a44c02ed-2da0-4023-aaee-fe4eb028f5b6', 'ip_version': 4, 'cidr': '49.73.34.0/26', 'allocation_pools': [{'start': '49.73.34.2', 'end': '49.73.34.62'}], 'gateway_ip': '49.73.34.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '49.73.34.2', 'tags': [], 'project_id': 'c871a91aa4ae4139913935fe3eb5fd44'}} 2026-03-19 02:33:27,809 - INFO - Created VN ctest-left_ctest-TestECMPSanity-71380745-51034320 2026-03-19 02:33:27,821 - DEBUG - VN ctest-left_ctest-TestECMPSanity-71380745-51034320 UUID is a44c02ed-2da0-4023-aaee-fe4eb028f5b6 2026-03-19 02:33:28,265 - DEBUG - Response for create_network : {'network': {'id': '6f7c3d3a-0b45-45bf-bec2-17e17ad402c6', 'name': 'ctest-right_ctest-TestECMPSanity-71380745-60125164', 'tenant_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'project_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-71380745', 'ctest-right_ctest-TestECMPSanity-71380745-60125164'], 'port_security_enabled': True, 'description': ''}} 2026-03-19 02:33:28,571 - DEBUG - Response for create_subnet : {'subnet': {'id': '9f282aec-6a19-4a12-98c7-48705909270d', 'name': '', 'tenant_id': 'c871a91aa4ae4139913935fe3eb5fd44', 'network_id': '6f7c3d3a-0b45-45bf-bec2-17e17ad402c6', 'ip_version': 4, 'cidr': '191.171.28.128/26', 'allocation_pools': [{'start': '191.171.28.130', 'end': '191.171.28.190'}], 'gateway_ip': '191.171.28.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.171.28.130', 'tags': [], 'project_id': 'c871a91aa4ae4139913935fe3eb5fd44'}} 2026-03-19 02:33:28,592 - INFO - Created VN ctest-right_ctest-TestECMPSanity-71380745-60125164 2026-03-19 02:33:28,602 - DEBUG - VN ctest-right_ctest-TestECMPSanity-71380745-60125164 UUID is 6f7c3d3a-0b45-45bf-bec2-17e17ad402c6 2026-03-19 02:33:28,751 - DEBUG - Services list from nova: [, , , ] 2026-03-19 02:33:29,851 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-2) 2026-03-19 02:33:31,154 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5493-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5493-1) 2026-03-19 02:33:31,156 - INFO - ================================================================================ 2026-03-19 02:33:31,156 - INFO - STARTING TEST : test_ecmp_svc_in_network_with_static_route_no_policy 2026-03-19 02:33:31,156 - INFO - TEST DESCRIPTION : Description: Validate service chaining in-network mode datapath having a static route entries of the either virtual networks pointing to the corresponding interfaces of the service instance. We will not configure any policy. Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network mode with 1 instance and left-interface of the service instance sharing the IP and both the left and the right interfaces enabled for static route. 3. Delete the policy. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2026-03-19 02:33:31,832 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.129': '0', '10.20.0.18': '0'}, '10.0.0.240': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2026-03-19 02:33:31,833 - INFO - Initial checks done. Running the testcase now 2026-03-19 02:33:31,833 - INFO - 2026-03-19 02:33:31,833 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-10025220'] 2026-03-19 02:33:32,155 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-10025220'] created succesfully 2026-03-19 02:33:32,495 - DEBUG - Image by name tiny_in_net not found 2026-03-19 02:33:32,495 - DEBUG - Installing image tiny_in_net 2026-03-19 02:33:32,495 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-03-19 02:33:32,495 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-03-19 02:33:32,495 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-03-19 02:33:32,496 - DEBUG - Unzip image 2026-03-19 02:33:32,496 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2026-03-19 02:33:32,510 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found 2026-03-19 02:33:32,511 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-10025220'] 2026-03-19 02:33:32,610 - INFO - Service template: ['default-domain', 'ctest-service_template_1-10025220'] deleted successfully. 2026-03-19 02:33:33,266 - DEBUG - No XMPP flaps were noticed during the test 2026-03-19 02:33:33,266 - INFO - 2026-03-19 02:33:33,266 - INFO - END TEST : test_ecmp_svc_in_network_with_static_route_no_policy : SKIPPED[0:00:02] 2026-03-19 02:33:33,266 - INFO - -------------------------------------------------------------------------------- 2026-03-19 02:33:33,271 - INFO - ================================================================================ 2026-03-19 02:33:33,271 - INFO - STARTING TEST : test_ecmp_svc_v2_transparent_with_3_instance 2026-03-19 02:33:33,271 - INFO - TEST DESCRIPTION : Description: Validate ECMP with version 2 service chaining transparent mode datapath having service instance Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating a service instance in transparent mode with 3 instances. 3.Creating a service chain by applying the service instance as a service in a policy between the VNs. 4.Checking for ping and bidirectional tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1 and vice-versa. Maintainer : ganeshahv@juniper.net 2026-03-19 02:33:33,926 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.129': '0', '10.20.0.18': '0'}, '10.0.0.240': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2026-03-19 02:33:33,926 - INFO - Initial checks done. Running the testcase now 2026-03-19 02:33:33,926 - INFO - 2026-03-19 02:33:33,926 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5493-2', 'an-jenkins-deploy-platform-ansible-os-5493-1']} 2026-03-19 02:33:33,927 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2026-03-19 02:33:34,582 - DEBUG - No XMPP flaps were noticed during the test 2026-03-19 02:33:34,582 - INFO - 2026-03-19 02:33:34,582 - INFO - END TEST : test_ecmp_svc_v2_transparent_with_3_instance : SKIPPED[0:00:01] 2026-03-19 02:33:34,582 - INFO - -------------------------------------------------------------------------------- 2026-03-19 02:33:34,583 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPSanity-71380745-17445798 in state BUILD 2026-03-19 02:33:34,583 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPSanity-71380745-17445798 2026-03-19 02:33:34,615 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-71380745-17445798 has failed to come up 2026-03-19 02:33:34,615 - ERROR - Nova failed to get host of the VM 2026-03-19 02:33:34,615 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-71380745-17445798 has failed to come up 2026-03-19 02:33:34,616 - ERROR - Nova failed to get host of the VM 2026-03-19 02:33:34,689 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPSanity-71380745-74880302 in state BUILD 2026-03-19 02:33:34,689 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPSanity-71380745-74880302 2026-03-19 02:33:34,690 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-71380745-74880302 has failed to come up 2026-03-19 02:33:34,690 - ERROR - Nova failed to get host of the VM 2026-03-19 02:33:34,690 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-71380745-74880302 has failed to come up 2026-03-19 02:33:34,690 - ERROR - Nova failed to get host of the VM 2026-03-19 02:33:34,757 - INFO - Deleting VN ctest-left_ctest-TestECMPSanity-71380745-51034320 2026-03-19 02:33:34,801 - DEBUG - VN a44c02ed-2da0-4023-aaee-fe4eb028f5b6 still in use: Unable to complete operation on network a44c02ed-2da0-4023-aaee-fe4eb028f5b6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2425fb32-d43c-48ac-8121-16500db090a3'] 2026-03-19 02:33:34,801 - WARNING - Deleting VN ctest-left_ctest-TestECMPSanity-71380745-51034320 failed..Will retry 2026-03-19 02:33:37,012 - DEBUG - Response for deleting network () 2026-03-19 02:33:37,012 - INFO - Deleting VN ctest-right_ctest-TestECMPSanity-71380745-60125164 2026-03-19 02:33:37,212 - DEBUG - Response for deleting network () 2026-03-19 02:33:37,212 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPSanity-71380745-71766601 2026-03-19 02:33:37,391 - DEBUG - Response for deleting network () 2026-03-19 02:33:38,251 - INFO - Deleted project: ctest-TestECMPSanity-71380745, ID : c871a91a-a4ae-4139-9139-35fe3eb5fd44