2025-08-18 02:15:52,004 - INFO - Domain Default found not creating
2025-08-18 02:15:52,143 - INFO - Project ctest-TestMultiInlineSVCIPv6-49876662 not found, creating it
2025-08-18 02:15:52,645 - INFO - Created Project:ctest-TestMultiInlineSVCIPv6-49876662, ID : dc08fa17-f247-427e-8db8-a48331cd1add
2025-08-18 02:15:54,640 - DEBUG - Response for create_network : {'network': {'id': '45f17c02-6a88-4de6-a686-d2e3b532d90c', 'name': 'ctest-mgmt_ctest-TestMultiInlineSVCIPv6-49876662-41394194', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'project_id': 'dc08fa17f247427e8db8a48331cd1add', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVCIPv6-49876662', 'ctest-mgmt_ctest-TestMultiInlineSVCIPv6-49876662-41394194'], 'port_security_enabled': True, 'description': ''}}
2025-08-18 02:15:54,910 - DEBUG - Response for create_subnet : {'subnet': {'id': '53e88c77-602b-4b9e-aea5-66012414eebf', 'name': '', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'network_id': '45f17c02-6a88-4de6-a686-d2e3b532d90c', 'ip_version': 6, 'cidr': '2e00:b316:632e:439a:4107:d226::/96', 'allocation_pools': [{'start': '2e00:b316:632e:439a:4107:d226:0:2', 'end': '2e00:b316:632e:439a:4107:d226:ffff:fffe'}], 'gateway_ip': '2e00:b316:632e:439a:4107:d226:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2e00:b316:632e:439a:4107:d226:0:2', 'tags': [], 'project_id': 'dc08fa17f247427e8db8a48331cd1add'}}
2025-08-18 02:15:55,146 - DEBUG - Response for create_subnet : {'subnet': {'id': '157487f0-3f34-49f2-80ad-c186342af6e4', 'name': '', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'network_id': '45f17c02-6a88-4de6-a686-d2e3b532d90c', 'ip_version': 4, 'cidr': '191.73.56.128/26', 'allocation_pools': [{'start': '191.73.56.130', 'end': '191.73.56.190'}], 'gateway_ip': '191.73.56.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.73.56.130', 'tags': [], 'project_id': 'dc08fa17f247427e8db8a48331cd1add'}}
2025-08-18 02:15:55,172 - INFO - Created VN ctest-mgmt_ctest-TestMultiInlineSVCIPv6-49876662-41394194
2025-08-18 02:15:55,186 - DEBUG - VN ctest-mgmt_ctest-TestMultiInlineSVCIPv6-49876662-41394194 UUID is 45f17c02-6a88-4de6-a686-d2e3b532d90c
2025-08-18 02:15:55,539 - DEBUG - Response for create_network : {'network': {'id': 'e168f4ca-727f-45d0-b1df-0a2975d7e86b', 'name': 'ctest-left_ctest-TestMultiInlineSVCIPv6-49876662-89366209', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'project_id': 'dc08fa17f247427e8db8a48331cd1add', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVCIPv6-49876662', 'ctest-left_ctest-TestMultiInlineSVCIPv6-49876662-89366209'], 'port_security_enabled': True, 'description': ''}}
2025-08-18 02:15:55,797 - DEBUG - Response for create_subnet : {'subnet': {'id': '645dfc2d-02dc-4902-95e1-8fe5ecbf652f', 'name': '', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'network_id': 'e168f4ca-727f-45d0-b1df-0a2975d7e86b', 'ip_version': 6, 'cidr': '3174:5c6:78de:e202:4353:d7e7::/96', 'allocation_pools': [{'start': '3174:5c6:78de:e202:4353:d7e7:0:2', 'end': '3174:5c6:78de:e202:4353:d7e7:ffff:fffe'}], 'gateway_ip': '3174:5c6:78de:e202:4353:d7e7:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3174:5c6:78de:e202:4353:d7e7:0:2', 'tags': [], 'project_id': 'dc08fa17f247427e8db8a48331cd1add'}}
2025-08-18 02:15:56,011 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f84624f7-23e2-4f3f-b79a-806e5c732345', 'name': '', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'network_id': 'e168f4ca-727f-45d0-b1df-0a2975d7e86b', 'ip_version': 4, 'cidr': '18.157.159.64/26', 'allocation_pools': [{'start': '18.157.159.66', 'end': '18.157.159.126'}], 'gateway_ip': '18.157.159.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '18.157.159.66', 'tags': [], 'project_id': 'dc08fa17f247427e8db8a48331cd1add'}}
2025-08-18 02:15:56,038 - INFO - Created VN ctest-left_ctest-TestMultiInlineSVCIPv6-49876662-89366209
2025-08-18 02:15:56,052 - DEBUG - VN ctest-left_ctest-TestMultiInlineSVCIPv6-49876662-89366209 UUID is e168f4ca-727f-45d0-b1df-0a2975d7e86b
2025-08-18 02:15:56,382 - DEBUG - Response for create_network : {'network': {'id': '911f67d3-66ca-451d-8b12-7e2296539101', 'name': 'ctest-right_ctest-TestMultiInlineSVCIPv6-49876662-99617395', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'project_id': 'dc08fa17f247427e8db8a48331cd1add', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMultiInlineSVCIPv6-49876662', 'ctest-right_ctest-TestMultiInlineSVCIPv6-49876662-99617395'], 'port_security_enabled': True, 'description': ''}}
2025-08-18 02:15:56,617 - DEBUG - Response for create_subnet : {'subnet': {'id': '581ffaf0-a4fb-48d2-a57f-6b1d94ca5bc5', 'name': '', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'network_id': '911f67d3-66ca-451d-8b12-7e2296539101', 'ip_version': 6, 'cidr': '3043:68ba:1c3c:10d7:893a:4de4::/96', 'allocation_pools': [{'start': '3043:68ba:1c3c:10d7:893a:4de4:0:2', 'end': '3043:68ba:1c3c:10d7:893a:4de4:ffff:fffe'}], 'gateway_ip': '3043:68ba:1c3c:10d7:893a:4de4:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3043:68ba:1c3c:10d7:893a:4de4:0:2', 'tags': [], 'project_id': 'dc08fa17f247427e8db8a48331cd1add'}}
2025-08-18 02:15:56,874 - DEBUG - Response for create_subnet : {'subnet': {'id': '6991ba20-cc52-4121-9aee-a188065477df', 'name': '', 'tenant_id': 'dc08fa17f247427e8db8a48331cd1add', 'network_id': '911f67d3-66ca-451d-8b12-7e2296539101', 'ip_version': 4, 'cidr': '179.147.3.192/26', 'allocation_pools': [{'start': '179.147.3.194', 'end': '179.147.3.254'}], 'gateway_ip': '179.147.3.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '179.147.3.194', 'tags': [], 'project_id': 'dc08fa17f247427e8db8a48331cd1add'}}
2025-08-18 02:15:56,902 - INFO - Created VN ctest-right_ctest-TestMultiInlineSVCIPv6-49876662-99617395
2025-08-18 02:15:56,920 - DEBUG - VN ctest-right_ctest-TestMultiInlineSVCIPv6-49876662-99617395 UUID is 911f67d3-66ca-451d-8b12-7e2296539101
2025-08-18 02:15:57,103 - DEBUG - Services list from nova: [, , , ]
2025-08-18 02:15:58,084 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3870-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3870-1)
2025-08-18 02:15:59,308 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3870-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3870-2)
2025-08-18 02:15:59,310 - INFO - ================================================================================
2025-08-18 02:15:59,310 - INFO - STARTING TEST : test_svc_fate_sharing_basic
2025-08-18 02:15:59,945 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.41': {'10.20.0.129': '0', '10.20.0.25': '0'}} with
2025-08-18 02:15:59,946 - INFO - Initial checks done. Running the testcase now
2025-08-18 02:15:59,946 - INFO -
2025-08-18 02:15:59,946 - INFO - ================================================================================
2025-08-18 02:15:59,946 - INFO - STARTING TEST : test_svc_fate_sharing_basic
2025-08-18 02:15:59,947 - INFO - TEST DESCRIPTION :
Description: Basic test to validate fate sharing in a multi inline service chain with 2 SIs, 1 SVM each.
Test steps:
1.Creating vm's - vm1 and vm2 in networks vn1 and vn2.
2.Creating 2 inline service instances SI1 and SI2.
3.Creating a service chain by applying the 2 service instances in a policy between t
he VNs.
4.Associate an HC instance with right intf of one of the SVMs
5.Bring down the intf in the step 4
6.Verify that all the re-origined routes(ServiceChain) are deleted from all the RIs of all the SIs
7.Verify the step 6 in both control node and agent
8.Bring up the intf in the step 5
8.Verify that the routes should be re-originated again, and the traffic also starts flowing
Pass criteria: Ping/Route deletion/Route addition should be successful.
Maintainer : ankitja@juniper.net
2025-08-18 02:16:00,610 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.41': {'10.20.0.129': '0', '10.20.0.25': '0'}} with
2025-08-18 02:16:00,610 - INFO - Initial checks done. Running the testcase now
2025-08-18 02:16:00,610 - INFO -
2025-08-18 02:16:00,610 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3870-1', 'an-jenkins-deploy-platform-ansible-os-3870-2']}
2025-08-18 02:16:00,610 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-80957611']
2025-08-18 02:16:00,923 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-80957611'] created succesfully
2025-08-18 02:16:01,205 - DEBUG - Image by name tiny_in_net not found
2025-08-18 02:16:01,206 - DEBUG - Installing image tiny_in_net
2025-08-18 02:16:01,206 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-08-18 02:16:01,206 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz
2025-08-18 02:16:01,206 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz
2025-08-18 02:16:01,206 - DEBUG - Unzip image
2025-08-18 02:16:01,206 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz
2025-08-18 02:16:01,219 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found
2025-08-18 02:16:01,220 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-80957611']
2025-08-18 02:16:01,318 - INFO - Service template: ['default-domain', 'ctest-service_template_1-80957611'] deleted successfully.
2025-08-18 02:16:01,959 - DEBUG - No XMPP flaps were noticed during the test
2025-08-18 02:16:01,960 - INFO -
2025-08-18 02:16:01,960 - INFO - END TEST : test_svc_fate_sharing_basic : SKIPPED[0:00:02]
2025-08-18 02:16:01,960 - INFO - --------------------------------------------------------------------------------
2025-08-18 02:16:01,960 - INFO - image /contrail-test/images/tinycore-in-network.qcow2 is not found
2025-08-18 02:16:02,595 - DEBUG - No XMPP flaps were noticed during the test
2025-08-18 02:16:02,595 - INFO -
2025-08-18 02:16:02,595 - INFO - END TEST : test_svc_fate_sharing_basic : SKIPPED[0:00:03]
2025-08-18 02:16:02,595 - INFO - --------------------------------------------------------------------------------
2025-08-18 02:16:02,598 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestMultiInlineSVCIPv6-49876662-00807331 in state BUILD
2025-08-18 02:16:02,598 - INFO - Deleting VM ctest-right_vm_ctest-TestMultiInlineSVCIPv6-49876662-00807331
2025-08-18 02:16:02,632 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVCIPv6-49876662-00807331 has failed to come up
2025-08-18 02:16:02,632 - ERROR - Nova failed to get host of the VM
2025-08-18 02:16:02,632 - ERROR - VM ctest-right_vm_ctest-TestMultiInlineSVCIPv6-49876662-00807331 has failed to come up
2025-08-18 02:16:02,632 - ERROR - Nova failed to get host of the VM
2025-08-18 02:16:02,726 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestMultiInlineSVCIPv6-49876662-11588497 in state BUILD
2025-08-18 02:16:02,726 - INFO - Deleting VM ctest-left_vm_ctest-TestMultiInlineSVCIPv6-49876662-11588497
2025-08-18 02:16:02,727 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVCIPv6-49876662-11588497 has failed to come up
2025-08-18 02:16:02,727 - ERROR - Nova failed to get host of the VM
2025-08-18 02:16:02,727 - ERROR - VM ctest-left_vm_ctest-TestMultiInlineSVCIPv6-49876662-11588497 has failed to come up
2025-08-18 02:16:02,727 - ERROR - Nova failed to get host of the VM
2025-08-18 02:16:02,800 - INFO - Deleting VN ctest-left_ctest-TestMultiInlineSVCIPv6-49876662-89366209
2025-08-18 02:16:02,857 - DEBUG - VN e168f4ca-727f-45d0-b1df-0a2975d7e86b still in use: Unable to complete operation on network e168f4ca-727f-45d0-b1df-0a2975d7e86b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-85c93ec9-8f0c-46c5-9f81-6fbf98ee3518']
2025-08-18 02:16:02,858 - WARNING - Deleting VN ctest-left_ctest-TestMultiInlineSVCIPv6-49876662-89366209 failed..Will retry
2025-08-18 02:16:05,279 - DEBUG - Response for deleting network ()
2025-08-18 02:16:05,280 - INFO - Deleting VN ctest-right_ctest-TestMultiInlineSVCIPv6-49876662-99617395
2025-08-18 02:16:05,479 - DEBUG - Response for deleting network ()
2025-08-18 02:16:05,479 - INFO - Deleting VN ctest-mgmt_ctest-TestMultiInlineSVCIPv6-49876662-41394194
2025-08-18 02:16:05,662 - DEBUG - Response for deleting network ()
2025-08-18 02:16:06,995 - INFO - Deleted project: ctest-TestMultiInlineSVCIPv6-49876662, ID : dc08fa17-f247-427e-8db8-a48331cd1add