2026-10-05 02:53:34,426 - INFO - Domain Default found not creating 2026-10-05 02:53:34,636 - INFO - Project ctest-TestMultiInlineSVC-01178844 not found, creating it 2026-10-05 02:53:35,275 - INFO - Created Project:ctest-TestMultiInlineSVC-01178844, ID : 162def1d-dbf6-43b3-8f32-968210116adc 2026-10-05 02:53:37,915 - DEBUG - Response for create_network : {'network': {'id': 'd73ebb8a-4265-41d2-91dd-290365110fb0', 'name': 'ctest-mgmt_ctest-TestMultiInlineSVC-01178844-83801528', 'tenant_id': '162def1ddbf643b38f32968210116adc', 'project_id': '162def1ddbf643b38f32968210116adc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVC-01178844', 'ctest-mgmt_ctest-TestMultiInlineSVC-01178844-83801528'], 'port_security_enabled': True, 'description': ''}} 2026-10-05 02:53:38,279 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f96f4464-8434-4d03-b7e1-d1639e17fdd6', 'name': '', 'tenant_id': '162def1ddbf643b38f32968210116adc', 'network_id': 'd73ebb8a-4265-41d2-91dd-290365110fb0', 'ip_version': 4, 'cidr': '122.78.95.128/26', 'allocation_pools': [{'start': '122.78.95.130', 'end': '122.78.95.190'}], 'gateway_ip': '122.78.95.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '122.78.95.130', 'tags': [], 'project_id': '162def1ddbf643b38f32968210116adc'}} 2026-10-05 02:53:38,304 - INFO - Created VN ctest-mgmt_ctest-TestMultiInlineSVC-01178844-83801528 2026-10-05 02:53:38,322 - DEBUG - VN ctest-mgmt_ctest-TestMultiInlineSVC-01178844-83801528 UUID is d73ebb8a-4265-41d2-91dd-290365110fb0 2026-10-05 02:53:38,783 - DEBUG - Response for create_network : {'network': {'id': 'abd33853-a81a-4bfa-9f1b-6413002c1dca', 'name': 'ctest-left_ctest-TestMultiInlineSVC-01178844-19861852', 'tenant_id': '162def1ddbf643b38f32968210116adc', 'project_id': '162def1ddbf643b38f32968210116adc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVC-01178844', 'ctest-left_ctest-TestMultiInlineSVC-01178844-19861852'], 'port_security_enabled': True, 'description': ''}} 2026-10-05 02:53:39,019 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6d3e4da-dc3f-4db6-81c1-5a99193c2cb5', 'name': '', 'tenant_id': '162def1ddbf643b38f32968210116adc', 'network_id': 'abd33853-a81a-4bfa-9f1b-6413002c1dca', 'ip_version': 4, 'cidr': '91.242.153.192/26', 'allocation_pools': [{'start': '91.242.153.194', 'end': '91.242.153.254'}], 'gateway_ip': '91.242.153.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '91.242.153.194', 'tags': [], 'project_id': '162def1ddbf643b38f32968210116adc'}} 2026-10-05 02:53:39,044 - INFO - Created VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 2026-10-05 02:53:39,059 - DEBUG - VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 UUID is abd33853-a81a-4bfa-9f1b-6413002c1dca 2026-10-05 02:53:39,458 - DEBUG - Response for create_network : {'network': {'id': 'be11523a-b99a-4e4c-a8cf-0ace7209e349', 'name': 'ctest-right_ctest-TestMultiInlineSVC-01178844-26160863', 'tenant_id': '162def1ddbf643b38f32968210116adc', 'project_id': '162def1ddbf643b38f32968210116adc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVC-01178844', 'ctest-right_ctest-TestMultiInlineSVC-01178844-26160863'], 'port_security_enabled': True, 'description': ''}} 2026-10-05 02:53:39,798 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dcb83770-7555-4be6-a470-9b6f6c3a6e93', 'name': '', 'tenant_id': '162def1ddbf643b38f32968210116adc', 'network_id': 'be11523a-b99a-4e4c-a8cf-0ace7209e349', 'ip_version': 4, 'cidr': '147.90.143.64/26', 'allocation_pools': [{'start': '147.90.143.66', 'end': '147.90.143.126'}], 'gateway_ip': '147.90.143.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '147.90.143.66', 'tags': [], 'project_id': '162def1ddbf643b38f32968210116adc'}} 2026-10-05 02:53:39,821 - INFO - Created VN ctest-right_ctest-TestMultiInlineSVC-01178844-26160863 2026-10-05 02:53:39,838 - DEBUG - VN ctest-right_ctest-TestMultiInlineSVC-01178844-26160863 UUID is be11523a-b99a-4e4c-a8cf-0ace7209e349 2026-10-05 02:53:40,038 - DEBUG - Services list from nova: [, , , ] 2026-10-05 02:53:40,645 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6343-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6343-1) 2026-10-05 02:53:41,245 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6343-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6343-2) 2026-10-05 02:53:41,247 - INFO - ================================================================================ 2026-10-05 02:53:41,248 - INFO - STARTING TEST : test_svc_fate_sharing_basic 2026-10-05 02:53:41,248 - INFO - TEST DESCRIPTION : Description: Basic test to validate fate sharing in a multi inline service chain with 2 SIs, 1 SVM each. Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating 2 inline service instances SI1 and SI2. 3.Creating a service chain by applying the 2 service instances in a policy between t he VNs. 4.Associate an HC instance with right intf of one of the SVMs 5.Bring down the intf in the step 4 6.Verify that all the re-origined routes(ServiceChain) are deleted from all the RIs of all the SIs 7.Verify the step 6 in both control node and agent 8.Bring up the intf in the step 5 8.Verify that the routes should be re-originated again, and the traffic also starts flowing Pass criteria: Ping/Route deletion/Route addition should be successful. Maintainer : ankitja@juniper.net 2026-10-05 02:53:41,952 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.14': '0', '10.20.0.25': '0'}, '10.0.0.191': {'10.20.0.254': '0', '10.20.0.25': '0'}} with 2026-10-05 02:53:41,952 - INFO - Initial checks done. Running the testcase now 2026-10-05 02:53:41,952 - INFO - 2026-10-05 02:53:41,952 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6343-1', 'an-jenkins-deploy-platform-ansible-os-6343-2']} 2026-10-05 02:53:41,952 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-41581268'] 2026-10-05 02:53:42,275 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-41581268'] created succesfully 2026-10-05 02:53:42,562 - DEBUG - Image by name tiny_in_net not found 2026-10-05 02:53:42,562 - DEBUG - Installing image tiny_in_net 2026-10-05 02:53:42,562 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-10-05 02:53:42,563 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-10-05 02:53:42,563 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz 2026-10-05 02:53:42,563 - DEBUG - Unzip image 2026-10-05 02:53:42,563 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2026-10-05 02:53:42,578 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found 2026-10-05 02:53:42,579 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-41581268'] 2026-10-05 02:53:42,690 - INFO - Service template: ['default-domain', 'ctest-service_template_1-41581268'] deleted successfully. 2026-10-05 02:53:43,393 - DEBUG - No XMPP flaps were noticed during the test 2026-10-05 02:53:43,393 - INFO -
2026-10-05 02:53:43,393 - INFO - END TEST : test_svc_fate_sharing_basic : SKIPPED[0:00:02]
2026-10-05 02:53:43,393 - INFO - -------------------------------------------------------------------------------- 2026-10-05 02:53:43,396 - INFO - ================================================================================ 2026-10-05 02:53:43,396 - INFO - STARTING TEST : test_three_stage_v2_SC 2026-10-05 02:53:43,396 - INFO - TEST DESCRIPTION : Description: Validate multi-Inline SVC version 2. Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating 3 service instances. 3.Creating a service chain by applying the 3 service instances in a policy between t he VNs. 4.There should be no traffic loss. Pass criteria: Ping between the VMs should be successful. Maintainer : ganeshahv@juniper.net 2026-10-05 02:53:44,098 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.14': '0', '10.20.0.25': '0'}, '10.0.0.191': {'10.20.0.254': '0', '10.20.0.25': '0'}} with 2026-10-05 02:53:44,098 - INFO - Initial checks done. Running the testcase now 2026-10-05 02:53:44,098 - INFO - 2026-10-05 02:53:44,098 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6343-1', 'an-jenkins-deploy-platform-ansible-os-6343-2']} 2026-10-05 02:53:44,098 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2026-10-05 02:53:44,829 - DEBUG - No XMPP flaps were noticed during the test 2026-10-05 02:53:44,829 - INFO -
2026-10-05 02:53:44,829 - INFO - END TEST : test_three_stage_v2_SC : SKIPPED[0:00:01]
2026-10-05 02:53:44,829 - INFO - -------------------------------------------------------------------------------- 2026-10-05 02:53:44,833 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestMultiInlineSVC-01178844-10927236 in state BUILD 2026-10-05 02:53:44,833 - INFO - Deleting VM ctest-right_vm_ctest-TestMultiInlineSVC-01178844-10927236 2026-10-05 02:53:44,921 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVC-01178844-10927236 has failed to come up 2026-10-05 02:53:44,921 - ERROR - Nova failed to get host of the VM 2026-10-05 02:53:44,921 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVC-01178844-10927236 has failed to come up 2026-10-05 02:53:44,921 - ERROR - Nova failed to get host of the VM 2026-10-05 02:53:45,093 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestMultiInlineSVC-01178844-45989418 in state BUILD 2026-10-05 02:53:45,093 - INFO - Deleting VM ctest-left_vm_ctest-TestMultiInlineSVC-01178844-45989418 2026-10-05 02:53:45,093 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVC-01178844-45989418 has failed to come up 2026-10-05 02:53:45,093 - ERROR - Nova failed to get host of the VM 2026-10-05 02:53:45,093 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVC-01178844-45989418 has failed to come up 2026-10-05 02:53:45,093 - ERROR - Nova failed to get host of the VM 2026-10-05 02:53:45,207 - INFO - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 2026-10-05 02:53:45,285 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-91c06871-9d0f-4dad-a8d5-99e4aa1e0d15'] 2026-10-05 02:53:45,285 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:47,329 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-63ad78fa-5c71-4e65-a8f1-b038962c92f3'] 2026-10-05 02:53:47,330 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:49,376 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-cc9b6997-3b39-43de-bd31-e40674e6da45'] 2026-10-05 02:53:49,376 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:51,421 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-63c1a467-e797-4bdb-b8f9-a1dfee89b10e'] 2026-10-05 02:53:51,422 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:53,470 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c14dff41-a5f7-43ed-a76d-5eeca9f34a44'] 2026-10-05 02:53:53,471 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:55,516 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-372ae0bb-0515-4eb0-82a8-a6c3cc01875f'] 2026-10-05 02:53:55,516 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:57,562 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-04b7d8b1-2dde-4e43-9d59-6ada7843aae0'] 2026-10-05 02:53:57,563 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:53:59,611 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-82d2f652-eadb-44b2-8663-de08e9c62a57'] 2026-10-05 02:53:59,611 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:54:01,687 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-44efa10f-eaff-4ca7-aebd-e0bc5763ae75'] 2026-10-05 02:54:01,687 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:54:03,732 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7e2a52a5-336a-41d9-b5ef-fefa242baf00'] 2026-10-05 02:54:03,732 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:54:05,781 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b651ebf1-e5bd-4f84-9776-1bd996984ecc'] 2026-10-05 02:54:05,781 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:54:07,828 - DEBUG - VN abd33853-a81a-4bfa-9f1b-6413002c1dca still in use: Unable to complete operation on network abd33853-a81a-4bfa-9f1b-6413002c1dca. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e0d33578-cc8d-42e5-8a73-f27097a71b11'] 2026-10-05 02:54:07,828 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-01178844-19861852 failed..Will retry 2026-10-05 02:54:10,061 - DEBUG - Response for deleting network () 2026-10-05 02:54:10,061 - INFO - Deleting VN ctest-right_ctest-TestMultiInlineSVC-01178844-26160863 2026-10-05 02:54:10,122 - DEBUG - VN be11523a-b99a-4e4c-a8cf-0ace7209e349 still in use: Unable to complete operation on network be11523a-b99a-4e4c-a8cf-0ace7209e349. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-651ad6dd-7fb3-40ea-980a-b680d3232b6f'] 2026-10-05 02:54:10,122 - WARNING - Deleting VN ctest-right_ctest-TestMultiInlineSVC-01178844-26160863 failed..Will retry 2026-10-05 02:54:12,315 - DEBUG - Response for deleting network () 2026-10-05 02:54:12,315 - INFO - Deleting VN ctest-mgmt_ctest-TestMultiInlineSVC-01178844-83801528 2026-10-05 02:54:12,529 - DEBUG - Response for deleting network () 2026-10-05 02:54:13,468 - INFO - Deleted project: ctest-TestMultiInlineSVC-01178844, ID : 162def1d-dbf6-43b3-8f32-968210116adc