2026-02-26 02:16:49,132 - INFO - Domain Default found not creating 2026-02-26 02:16:49,773 - INFO - Project ctest-TestECMPSanity-41338740 not found, creating it 2026-02-26 02:16:50,371 - INFO - Created Project:ctest-TestECMPSanity-41338740, ID : 0c6f674e-b94c-4c48-bfdb-cf2ad608bf7a 2026-02-26 02:16:53,180 - DEBUG - Response for create_network : {'network': {'id': '5379f5de-0206-4afe-a0ba-f7bc4ea3b97d', 'name': 'ctest-mgmt_ctest-TestECMPSanity-41338740-97789745', 'tenant_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'project_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-41338740', 'ctest-mgmt_ctest-TestECMPSanity-41338740-97789745'], 'port_security_enabled': True, 'description': ''}} 2026-02-26 02:16:53,557 - DEBUG - Response for create_subnet : {'subnet': {'id': '420ecd6f-7178-4bae-bb4d-1daf0e9d5938', 'name': '', 'tenant_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'network_id': '5379f5de-0206-4afe-a0ba-f7bc4ea3b97d', 'ip_version': 4, 'cidr': '81.204.23.64/26', 'allocation_pools': [{'start': '81.204.23.66', 'end': '81.204.23.126'}], 'gateway_ip': '81.204.23.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '81.204.23.66', 'tags': [], 'project_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a'}} 2026-02-26 02:16:53,586 - INFO - Created VN ctest-mgmt_ctest-TestECMPSanity-41338740-97789745 2026-02-26 02:16:53,601 - DEBUG - VN ctest-mgmt_ctest-TestECMPSanity-41338740-97789745 UUID is 5379f5de-0206-4afe-a0ba-f7bc4ea3b97d 2026-02-26 02:16:53,997 - DEBUG - Response for create_network : {'network': {'id': '3dd402d3-a6c9-4497-be32-5c2717ddf412', 'name': 'ctest-left_ctest-TestECMPSanity-41338740-99418439', 'tenant_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'project_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-41338740', 'ctest-left_ctest-TestECMPSanity-41338740-99418439'], 'port_security_enabled': True, 'description': ''}} 2026-02-26 02:16:54,285 - DEBUG - Response for create_subnet : {'subnet': {'id': '03232076-d99d-4b9d-84c9-11fd8c5046a3', 'name': '', 'tenant_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'network_id': '3dd402d3-a6c9-4497-be32-5c2717ddf412', 'ip_version': 4, 'cidr': '41.237.31.192/26', 'allocation_pools': [{'start': '41.237.31.194', 'end': '41.237.31.254'}], 'gateway_ip': '41.237.31.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.237.31.194', 'tags': [], 'project_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a'}} 2026-02-26 02:16:54,314 - INFO - Created VN ctest-left_ctest-TestECMPSanity-41338740-99418439 2026-02-26 02:16:54,326 - DEBUG - VN ctest-left_ctest-TestECMPSanity-41338740-99418439 UUID is 3dd402d3-a6c9-4497-be32-5c2717ddf412 2026-02-26 02:16:54,750 - DEBUG - Response for create_network : {'network': {'id': 'f7bd6d47-f393-4142-81d3-6017d9dbd241', 'name': 'ctest-right_ctest-TestECMPSanity-41338740-97555190', 'tenant_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'project_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-41338740', 'ctest-right_ctest-TestECMPSanity-41338740-97555190'], 'port_security_enabled': True, 'description': ''}} 2026-02-26 02:16:55,012 - DEBUG - Response for create_subnet : {'subnet': {'id': '8eb290ba-debb-4d4a-9fec-8ad88c7ce891', 'name': '', 'tenant_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a', 'network_id': 'f7bd6d47-f393-4142-81d3-6017d9dbd241', 'ip_version': 4, 'cidr': '27.212.72.128/26', 'allocation_pools': [{'start': '27.212.72.130', 'end': '27.212.72.190'}], 'gateway_ip': '27.212.72.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.212.72.130', 'tags': [], 'project_id': '0c6f674eb94c4c48bfdbcf2ad608bf7a'}} 2026-02-26 02:16:55,055 - INFO - Created VN ctest-right_ctest-TestECMPSanity-41338740-97555190 2026-02-26 02:16:55,068 - DEBUG - VN ctest-right_ctest-TestECMPSanity-41338740-97555190 UUID is f7bd6d47-f393-4142-81d3-6017d9dbd241 2026-02-26 02:16:55,247 - DEBUG - Services list from nova: [, , , ] 2026-02-26 02:16:56,499 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5402-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5402-2) 2026-02-26 02:16:58,071 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5402-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5402-1) 2026-02-26 02:16:58,074 - INFO - ================================================================================ 2026-02-26 02:16:58,074 - INFO - STARTING TEST : test_ecmp_svc_in_network_with_static_route_no_policy 2026-02-26 02:16:58,074 - INFO - TEST DESCRIPTION : Description: Validate service chaining in-network mode datapath having a static route entries of the either virtual networks pointing to the corresponding interfaces of the service instance. We will not configure any policy. Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network mode with 1 instance and left-interface of the service instance sharing the IP and both the left and the right interfaces enabled for static route. 3. Delete the policy. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2026-02-26 02:16:58,759 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.129': '0', '10.20.0.254': '0'}, '10.0.0.48': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2026-02-26 02:16:58,759 - INFO - Initial checks done. Running the testcase now 2026-02-26 02:16:58,759 - INFO - 2026-02-26 02:16:58,760 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-89695899'] 2026-02-26 02:16:59,066 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-89695899'] created succesfully 2026-02-26 02:16:59,402 - DEBUG - Image by name tiny_in_net not found 2026-02-26 02:16:59,402 - DEBUG - Installing image tiny_in_net 2026-02-26 02:16:59,402 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-02-26 02:16:59,402 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-02-26 02:16:59,402 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-02-26 02:16:59,402 - DEBUG - Unzip image 2026-02-26 02:16:59,402 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2026-02-26 02:16:59,423 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found 2026-02-26 02:16:59,423 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-89695899'] 2026-02-26 02:16:59,534 - INFO - Service template: ['default-domain', 'ctest-service_template_1-89695899'] deleted successfully. 2026-02-26 02:17:00,242 - DEBUG - No XMPP flaps were noticed during the test 2026-02-26 02:17:00,243 - INFO - 2026-02-26 02:17:00,243 - INFO - END TEST : test_ecmp_svc_in_network_with_static_route_no_policy : SKIPPED[0:00:02] 2026-02-26 02:17:00,243 - INFO - -------------------------------------------------------------------------------- 2026-02-26 02:17:00,249 - INFO - ================================================================================ 2026-02-26 02:17:00,249 - INFO - STARTING TEST : test_ecmp_svc_v2_transparent_with_3_instance 2026-02-26 02:17:00,249 - INFO - TEST DESCRIPTION : Description: Validate ECMP with version 2 service chaining transparent mode datapath having service instance Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating a service instance in transparent mode with 3 instances. 3.Creating a service chain by applying the service instance as a service in a policy between the VNs. 4.Checking for ping and bidirectional tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1 and vice-versa. Maintainer : ganeshahv@juniper.net 2026-02-26 02:17:00,936 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.129': '0', '10.20.0.254': '0'}, '10.0.0.48': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2026-02-26 02:17:00,937 - INFO - Initial checks done. Running the testcase now 2026-02-26 02:17:00,937 - INFO - 2026-02-26 02:17:00,937 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5402-2', 'an-jenkins-deploy-platform-ansible-os-5402-1']} 2026-02-26 02:17:00,937 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2026-02-26 02:17:01,647 - DEBUG - No XMPP flaps were noticed during the test 2026-02-26 02:17:01,647 - INFO - 2026-02-26 02:17:01,648 - INFO - END TEST : test_ecmp_svc_v2_transparent_with_3_instance : SKIPPED[0:00:01] 2026-02-26 02:17:01,648 - INFO - -------------------------------------------------------------------------------- 2026-02-26 02:17:01,650 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPSanity-41338740-95031847 in state BUILD 2026-02-26 02:17:01,650 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPSanity-41338740-95031847 2026-02-26 02:17:01,681 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-41338740-95031847 has failed to come up 2026-02-26 02:17:01,681 - ERROR - Nova failed to get host of the VM 2026-02-26 02:17:01,681 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-41338740-95031847 has failed to come up 2026-02-26 02:17:01,682 - ERROR - Nova failed to get host of the VM 2026-02-26 02:17:01,764 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPSanity-41338740-99358548 in state BUILD 2026-02-26 02:17:01,765 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPSanity-41338740-99358548 2026-02-26 02:17:01,765 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-41338740-99358548 has failed to come up 2026-02-26 02:17:01,765 - ERROR - Nova failed to get host of the VM 2026-02-26 02:17:01,765 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-41338740-99358548 has failed to come up 2026-02-26 02:17:01,765 - ERROR - Nova failed to get host of the VM 2026-02-26 02:17:01,866 - INFO - Deleting VN ctest-left_ctest-TestECMPSanity-41338740-99418439 2026-02-26 02:17:01,956 - DEBUG - VN 3dd402d3-a6c9-4497-be32-5c2717ddf412 still in use: Unable to complete operation on network 3dd402d3-a6c9-4497-be32-5c2717ddf412. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0eaa8cad-5d20-4d3a-b8f9-0669397ac1c0'] 2026-02-26 02:17:01,956 - WARNING - Deleting VN ctest-left_ctest-TestECMPSanity-41338740-99418439 failed..Will retry 2026-02-26 02:17:04,198 - DEBUG - Response for deleting network () 2026-02-26 02:17:04,199 - INFO - Deleting VN ctest-right_ctest-TestECMPSanity-41338740-97555190 2026-02-26 02:17:04,381 - DEBUG - Response for deleting network () 2026-02-26 02:17:04,381 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPSanity-41338740-97789745 2026-02-26 02:17:04,589 - DEBUG - Response for deleting network () 2026-02-26 02:17:05,513 - INFO - Deleted project: ctest-TestECMPSanity-41338740, ID : 0c6f674e-b94c-4c48-bfdb-cf2ad608bf7a