2025-09-18 02:03:07,586 - INFO - Domain Default found not creating 2025-09-18 02:03:07,751 - INFO - Project ctest-TestMultiInlineSVC-74935913 not found, creating it 2025-09-18 02:03:08,304 - INFO - Created Project:ctest-TestMultiInlineSVC-74935913, ID : 3480e8d0-551e-434d-9abf-9faf395f5a1a 2025-09-18 02:03:10,693 - DEBUG - Response for create_network : {'network': {'id': '9e3bf91b-7179-489e-bfce-6057670dbd0a', 'name': 'ctest-mgmt_ctest-TestMultiInlineSVC-74935913-26578826', 'tenant_id': '3480e8d0551e434d9abf9faf395f5a1a', 'project_id': '3480e8d0551e434d9abf9faf395f5a1a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVC-74935913', 'ctest-mgmt_ctest-TestMultiInlineSVC-74935913-26578826'], 'port_security_enabled': True, 'description': ''}} 2025-09-18 02:03:10,984 - DEBUG - Response for create_subnet : {'subnet': {'id': '74c9d744-4cd5-4fc5-9036-8aa02b0a52db', 'name': '', 'tenant_id': '3480e8d0551e434d9abf9faf395f5a1a', 'network_id': '9e3bf91b-7179-489e-bfce-6057670dbd0a', 'ip_version': 4, 'cidr': '9.159.71.128/26', 'allocation_pools': [{'start': '9.159.71.130', 'end': '9.159.71.190'}], 'gateway_ip': '9.159.71.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '9.159.71.130', 'tags': [], 'project_id': '3480e8d0551e434d9abf9faf395f5a1a'}} 2025-09-18 02:03:11,027 - INFO - Created VN ctest-mgmt_ctest-TestMultiInlineSVC-74935913-26578826 2025-09-18 02:03:11,040 - DEBUG - VN ctest-mgmt_ctest-TestMultiInlineSVC-74935913-26578826 UUID is 9e3bf91b-7179-489e-bfce-6057670dbd0a 2025-09-18 02:03:11,437 - DEBUG - Response for create_network : {'network': {'id': '9fa0f3e0-f646-4cea-98b4-3e0ab95bd81e', 'name': 'ctest-left_ctest-TestMultiInlineSVC-74935913-28293017', 'tenant_id': '3480e8d0551e434d9abf9faf395f5a1a', 'project_id': '3480e8d0551e434d9abf9faf395f5a1a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVC-74935913', 'ctest-left_ctest-TestMultiInlineSVC-74935913-28293017'], 'port_security_enabled': True, 'description': ''}} 2025-09-18 02:03:11,677 - DEBUG - Response for create_subnet : {'subnet': {'id': '684fc008-b69c-4b2e-96ff-259085162999', 'name': '', 'tenant_id': '3480e8d0551e434d9abf9faf395f5a1a', 'network_id': '9fa0f3e0-f646-4cea-98b4-3e0ab95bd81e', 'ip_version': 4, 'cidr': '136.225.34.128/26', 'allocation_pools': [{'start': '136.225.34.130', 'end': '136.225.34.190'}], 'gateway_ip': '136.225.34.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.225.34.130', 'tags': [], 'project_id': '3480e8d0551e434d9abf9faf395f5a1a'}} 2025-09-18 02:03:11,710 - INFO - Created VN ctest-left_ctest-TestMultiInlineSVC-74935913-28293017 2025-09-18 02:03:11,724 - DEBUG - VN ctest-left_ctest-TestMultiInlineSVC-74935913-28293017 UUID is 9fa0f3e0-f646-4cea-98b4-3e0ab95bd81e 2025-09-18 02:03:12,091 - DEBUG - Response for create_network : {'network': {'id': '534dd658-d4f8-438d-b57e-5a67938bca39', 'name': 'ctest-right_ctest-TestMultiInlineSVC-74935913-19320437', 'tenant_id': '3480e8d0551e434d9abf9faf395f5a1a', 'project_id': '3480e8d0551e434d9abf9faf395f5a1a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVC-74935913', 'ctest-right_ctest-TestMultiInlineSVC-74935913-19320437'], 'port_security_enabled': True, 'description': ''}} 2025-09-18 02:03:12,332 - DEBUG - Response for create_subnet : {'subnet': {'id': '1c358678-c93d-439d-af20-5a125e367dee', 'name': '', 'tenant_id': '3480e8d0551e434d9abf9faf395f5a1a', 'network_id': '534dd658-d4f8-438d-b57e-5a67938bca39', 'ip_version': 4, 'cidr': '130.169.182.192/26', 'allocation_pools': [{'start': '130.169.182.194', 'end': '130.169.182.254'}], 'gateway_ip': '130.169.182.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '130.169.182.194', 'tags': [], 'project_id': '3480e8d0551e434d9abf9faf395f5a1a'}} 2025-09-18 02:03:12,362 - INFO - Created VN ctest-right_ctest-TestMultiInlineSVC-74935913-19320437 2025-09-18 02:03:12,378 - DEBUG - VN ctest-right_ctest-TestMultiInlineSVC-74935913-19320437 UUID is 534dd658-d4f8-438d-b57e-5a67938bca39 2025-09-18 02:03:12,544 - DEBUG - Services list from nova: [, , , ] 2025-09-18 02:03:13,754 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4130-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4130-1) 2025-09-18 02:03:15,327 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4130-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4130-2) 2025-09-18 02:03:15,329 - INFO - ================================================================================ 2025-09-18 02:03:15,329 - INFO - STARTING TEST : test_svc_fate_sharing_basic 2025-09-18 02:03:15,329 - INFO - TEST DESCRIPTION : Description: Basic test to validate fate sharing in a multi inline service chain with 2 SIs, 1 SVM each. Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating 2 inline service instances SI1 and SI2. 3.Creating a service chain by applying the 2 service instances in a policy between t he VNs. 4.Associate an HC instance with right intf of one of the SVMs 5.Bring down the intf in the step 4 6.Verify that all the re-origined routes(ServiceChain) are deleted from all the RIs of all the SIs 7.Verify the step 6 in both control node and agent 8.Bring up the intf in the step 5 8.Verify that the routes should be re-originated again, and the traffic also starts flowing Pass criteria: Ping/Route deletion/Route addition should be successful. Maintainer : ankitja@juniper.net 2025-09-18 02:03:16,008 - DEBUG - Nothing to compare xmpp stats {'10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-18 02:03:16,008 - INFO - Initial checks done. Running the testcase now 2025-09-18 02:03:16,011 - INFO - 2025-09-18 02:03:16,013 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4130-1', 'an-jenkins-deploy-platform-ansible-os-4130-2']} 2025-09-18 02:03:16,014 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-76168169'] 2025-09-18 02:03:16,329 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-76168169'] created succesfully 2025-09-18 02:03:16,655 - DEBUG - Image by name tiny_in_net not found 2025-09-18 02:03:16,655 - DEBUG - Installing image tiny_in_net 2025-09-18 02:03:16,655 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-18 02:03:16,655 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz 2025-09-18 02:03:16,655 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz 2025-09-18 02:03:16,656 - DEBUG - Unzip image 2025-09-18 02:03:16,656 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2025-09-18 02:03:16,674 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found 2025-09-18 02:03:16,674 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-76168169'] 2025-09-18 02:03:16,773 - INFO - Service template: ['default-domain', 'ctest-service_template_1-76168169'] deleted successfully. 2025-09-18 02:03:17,421 - DEBUG - No XMPP flaps were noticed during the test 2025-09-18 02:03:17,422 - INFO - 2025-09-18 02:03:17,422 - INFO - END TEST : test_svc_fate_sharing_basic : SKIPPED[0:00:02] 2025-09-18 02:03:17,422 - INFO - -------------------------------------------------------------------------------- 2025-09-18 02:03:17,426 - INFO - ================================================================================ 2025-09-18 02:03:17,426 - INFO - STARTING TEST : test_three_stage_v2_SC 2025-09-18 02:03:17,426 - INFO - TEST DESCRIPTION : Description: Validate multi-Inline SVC version 2. Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating 3 service instances. 3.Creating a service chain by applying the 3 service instances in a policy between t he VNs. 4.There should be no traffic loss. Pass criteria: Ping between the VMs should be successful. Maintainer : ganeshahv@juniper.net 2025-09-18 02:03:18,071 - DEBUG - Nothing to compare xmpp stats {'10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-18 02:03:18,072 - INFO - Initial checks done. Running the testcase now 2025-09-18 02:03:18,072 - INFO - 2025-09-18 02:03:18,072 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4130-1', 'an-jenkins-deploy-platform-ansible-os-4130-2']} 2025-09-18 02:03:18,072 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2025-09-18 02:03:18,723 - DEBUG - No XMPP flaps were noticed during the test 2025-09-18 02:03:18,723 - INFO - 2025-09-18 02:03:18,723 - INFO - END TEST : test_three_stage_v2_SC : SKIPPED[0:00:01] 2025-09-18 02:03:18,724 - INFO - -------------------------------------------------------------------------------- 2025-09-18 02:03:18,726 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestMultiInlineSVC-74935913-25140835 in state BUILD 2025-09-18 02:03:18,726 - INFO - Deleting VM ctest-right_vm_ctest-TestMultiInlineSVC-74935913-25140835 2025-09-18 02:03:18,762 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVC-74935913-25140835 has failed to come up 2025-09-18 02:03:18,762 - ERROR - Nova failed to get host of the VM 2025-09-18 02:03:18,762 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVC-74935913-25140835 has failed to come up 2025-09-18 02:03:18,762 - ERROR - Nova failed to get host of the VM 2025-09-18 02:03:18,862 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestMultiInlineSVC-74935913-27442792 in state BUILD 2025-09-18 02:03:18,863 - INFO - Deleting VM ctest-left_vm_ctest-TestMultiInlineSVC-74935913-27442792 2025-09-18 02:03:18,863 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVC-74935913-27442792 has failed to come up 2025-09-18 02:03:18,863 - ERROR - Nova failed to get host of the VM 2025-09-18 02:03:18,863 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVC-74935913-27442792 has failed to come up 2025-09-18 02:03:18,864 - ERROR - Nova failed to get host of the VM 2025-09-18 02:03:18,951 - INFO - Deleting VN ctest-left_ctest-TestMultiInlineSVC-74935913-28293017 2025-09-18 02:03:18,995 - DEBUG - VN 9fa0f3e0-f646-4cea-98b4-3e0ab95bd81e still in use: Unable to complete operation on network 9fa0f3e0-f646-4cea-98b4-3e0ab95bd81e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1a204ca9-2ed9-41d4-9ae1-2dc55f39b436'] 2025-09-18 02:03:18,995 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVC-74935913-28293017 failed..Will retry 2025-09-18 02:03:21,172 - DEBUG - Response for deleting network () 2025-09-18 02:03:21,172 - INFO - Deleting VN ctest-right_ctest-TestMultiInlineSVC-74935913-19320437 2025-09-18 02:03:21,234 - DEBUG - VN 534dd658-d4f8-438d-b57e-5a67938bca39 still in use: Unable to complete operation on network 534dd658-d4f8-438d-b57e-5a67938bca39. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8d70eca3-d24d-4de3-a4e0-b572b1d752fc'] 2025-09-18 02:03:21,234 - WARNING - Deleting VN ctest-right_ctest-TestMultiInlineSVC-74935913-19320437 failed..Will retry 2025-09-18 02:03:23,280 - DEBUG - VN 534dd658-d4f8-438d-b57e-5a67938bca39 still in use: Unable to complete operation on network 534dd658-d4f8-438d-b57e-5a67938bca39. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-19005fdd-60b0-4547-80dd-53858ff66b44'] 2025-09-18 02:03:23,280 - WARNING - Deleting VN ctest-right_ctest-TestMultiInlineSVC-74935913-19320437 failed..Will retry 2025-09-18 02:03:25,337 - DEBUG - VN 534dd658-d4f8-438d-b57e-5a67938bca39 still in use: Unable to complete operation on network 534dd658-d4f8-438d-b57e-5a67938bca39. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ed32a4e9-8499-4a9f-b522-fcbf6c675210'] 2025-09-18 02:03:25,337 - WARNING - Deleting VN ctest-right_ctest-TestMultiInlineSVC-74935913-19320437 failed..Will retry 2025-09-18 02:03:27,611 - DEBUG - Response for deleting network () 2025-09-18 02:03:27,611 - INFO - Deleting VN ctest-mgmt_ctest-TestMultiInlineSVC-74935913-26578826 2025-09-18 02:03:27,883 - DEBUG - Response for deleting network () 2025-09-18 02:03:28,756 - INFO - Deleted project: ctest-TestMultiInlineSVC-74935913, ID : 3480e8d0-551e-434d-9abf-9faf395f5a1a