2026-01-22 16:10:02,197 - INFO - Domain Default found not creating
2026-01-22 16:10:02,401 - INFO - Project ctest-FloatingipBasicTestSanity-66062209 not found, creating it
2026-01-22 16:10:03,175 - INFO - Created Project:ctest-FloatingipBasicTestSanity-66062209, ID : b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:04,813 - INFO - Using existing project ['default-domain', 'admin'](3c9fb882-698c-4036-882e-515c6bc2da96)
2026-01-22 16:10:05,598 - INFO - Adding rules to the default security group in Project admin
2026-01-22 16:10:05,985 - INFO - ================================================================================
2026-01-22 16:10:05,985 - INFO - STARTING TEST : test_floating_ip
2026-01-22 16:10:05,985 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN.
2026-01-22 16:10:06,662 - WARNING - Test is running with cores: {'10.0.0.65': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-5062-3.1769096738']}
2026-01-22 16:10:06,675 - DEBUG - Nothing to compare xmpp stats {'10.0.0.130': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.73': {'10.20.0.5': '0', '10.20.0.252': '0'}} with
2026-01-22 16:10:06,675 - INFO - Initial checks done. Running the testcase now
2026-01-22 16:10:06,675 - INFO -
2026-01-22 16:10:06,698 - DEBUG - Services list from nova: [, , , ]
2026-01-22 16:10:06,699 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5062-2', 'an-jenkins-deploy-platform-ansible-os-5062-1']}
2026-01-22 16:10:07,535 - DEBUG - Response for create_network : {'network': {'id': '2528d20d-87fe-4748-bff1-8b0501fc0214', 'name': 'ctest-fvn-49455590', 'tenant_id': 'b215814882434065ba0ea5eff7b7d6ce', 'project_id': 'b215814882434065ba0ea5eff7b7d6ce', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-66062209', 'ctest-fvn-49455590'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 16:10:07,905 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e0b78406-adf3-4d29-addc-89fd8c5c2268', 'name': '', 'tenant_id': 'b215814882434065ba0ea5eff7b7d6ce', 'network_id': '2528d20d-87fe-4748-bff1-8b0501fc0214', 'ip_version': 4, 'cidr': '3.121.74.192/26', 'allocation_pools': [{'start': '3.121.74.194', 'end': '3.121.74.254'}], 'gateway_ip': '3.121.74.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3.121.74.194', 'tags': [], 'project_id': 'b215814882434065ba0ea5eff7b7d6ce'}}
2026-01-22 16:10:07,940 - INFO - Created VN ctest-fvn-49455590
2026-01-22 16:10:07,954 - DEBUG - VN ctest-fvn-49455590 UUID is 2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,042 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:08,347 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:08,377 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:08,395 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:08,534 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,548 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,559 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2c27a026-f6d3-42d3-bef5-5f4d721660d6
2026-01-22 16:10:08,571 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2c27a026-f6d3-42d3-bef5-5f4d721660d6
2026-01-22 16:10:08,579 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/421450f0-6cb9-447a-af7e-ce6b17bd4e77
2026-01-22 16:10:08,587 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 16:10:08,587 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,596 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2c27a026-f6d3-42d3-bef5-5f4d721660d6
2026-01-22 16:10:08,614 - INFO - Verified VN network id 6 for VN 2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,614 - INFO - Verifications in API Server for VN ctest-fvn-49455590 passed
2026-01-22 16:10:08,614 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,625 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2c27a026-f6d3-42d3-bef5-5f4d721660d6
2026-01-22 16:10:08,641 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2c27a026-f6d3-42d3-bef5-5f4d721660d6
2026-01-22 16:10:08,648 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/421450f0-6cb9-447a-af7e-ce6b17bd4e77
2026-01-22 16:10:08,661 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-66062209', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2677620934029756232', 'uuid-lslong': '13830988784255894036'}, 'enable': 'true', 'created': '2026-01-22T16:10:07', 'last-modified': '2026-01-22T16:10:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.827862'}
2026-01-22 16:10:08,666 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 16:10:08,673 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-66062209', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2677620934029756232', 'uuid-lslong': '13830988784255894036'}, 'enable': 'true', 'created': '2026-01-22T16:10:07', 'last-modified': '2026-01-22T16:10:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.830622'}
2026-01-22 16:10:08,680 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 16:10:08,687 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-66062209', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2677620934029756232', 'uuid-lslong': '13830988784255894036'}, 'enable': 'true', 'created': '2026-01-22T16:10:07', 'last-modified': '2026-01-22T16:10:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.849465'}
2026-01-22 16:10:08,694 - DEBUG - Route Targets: ['target:64512:8000005']
2026-01-22 16:10:08,694 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-49455590 passed
2026-01-22 16:10:08,694 - DEBUG - ====Verifying policy data for ctest-fvn-49455590 in API_Server ======
2026-01-22 16:10:08,694 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:08,703 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:08,719 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:08,861 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:08,875 - DEBUG - =>VN ctest-fvn-49455590 has no policy to be verified
2026-01-22 16:10:08,875 - DEBUG - Verifying the vn in opserver
2026-01-22 16:10:08,875 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590 virtual network link through opserver 10.0.0.23
2026-01-22 16:10:08,875 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-01-22 16:10:09,174 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-01-22 16:10:09,235 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590?flat'}
2026-01-22 16:10:09,235 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590 virtual network link through opserver 10.0.0.240
2026-01-22 16:10:09,235 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-01-22 16:10:09,527 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-01-22 16:10:09,614 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590?flat'}
2026-01-22 16:10:09,614 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590 virtual network link through opserver 10.0.0.65
2026-01-22 16:10:09,614 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks
2026-01-22 16:10:09,911 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks
2026-01-22 16:10:09,983 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590?flat'}
2026-01-22 16:10:09,983 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590 is found in opserver
2026-01-22 16:10:10,016 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 16:10:10,031 - DEBUG - VRF ids for VN ctest-fvn-49455590: {}
2026-01-22 16:10:10,398 - DEBUG - Response for create_network : {'network': {'id': '21973455-7fc6-48d2-9806-cb4c9d00894b', 'name': 'ctest-vn1-54151740', 'tenant_id': 'b215814882434065ba0ea5eff7b7d6ce', 'project_id': 'b215814882434065ba0ea5eff7b7d6ce', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-66062209', 'ctest-vn1-54151740'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 16:10:10,735 - DEBUG - Response for create_subnet : {'subnet': {'id': '0acc28cb-53af-49a0-af65-34023c1b3228', 'name': '', 'tenant_id': 'b215814882434065ba0ea5eff7b7d6ce', 'network_id': '21973455-7fc6-48d2-9806-cb4c9d00894b', 'ip_version': 4, 'cidr': '148.231.118.128/26', 'allocation_pools': [{'start': '148.231.118.130', 'end': '148.231.118.190'}], 'gateway_ip': '148.231.118.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '148.231.118.130', 'tags': [], 'project_id': 'b215814882434065ba0ea5eff7b7d6ce'}}
2026-01-22 16:10:10,763 - INFO - Created VN ctest-vn1-54151740
2026-01-22 16:10:10,776 - DEBUG - VN ctest-vn1-54151740 UUID is 21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:10,855 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:10,861 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:10,873 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:10,992 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:11,007 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:11,020 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d1eb8041-7931-485c-a8da-0dba09dfe92c
2026-01-22 16:10:11,033 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d1eb8041-7931-485c-a8da-0dba09dfe92c
2026-01-22 16:10:11,042 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/61a98dd4-540b-42d8-85da-42258a98a66e
2026-01-22 16:10:11,050 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 16:10:11,050 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:11,061 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d1eb8041-7931-485c-a8da-0dba09dfe92c
2026-01-22 16:10:11,079 - INFO - Verified VN network id 7 for VN 21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:11,079 - INFO - Verifications in API Server for VN ctest-vn1-54151740 passed
2026-01-22 16:10:11,079 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:11,091 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d1eb8041-7931-485c-a8da-0dba09dfe92c
2026-01-22 16:10:11,100 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d1eb8041-7931-485c-a8da-0dba09dfe92c
2026-01-22 16:10:11,108 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/61a98dd4-540b-42d8-85da-42258a98a66e
2026-01-22 16:10:11,121 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-66062209', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2420460866555496658', 'uuid-lslong': '10954666673537321291'}, 'enable': 'true', 'created': '2026-01-22T16:10:10', 'last-modified': '2026-01-22T16:10:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.469436'}
2026-01-22 16:10:11,128 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 16:10:11,133 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-66062209', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2420460866555496658', 'uuid-lslong': '10954666673537321291'}, 'enable': 'true', 'created': '2026-01-22T16:10:10', 'last-modified': '2026-01-22T16:10:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495399'}
2026-01-22 16:10:11,140 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 16:10:11,145 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-66062209', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2420460866555496658', 'uuid-lslong': '10954666673537321291'}, 'enable': 'true', 'created': '2026-01-22T16:10:10', 'last-modified': '2026-01-22T16:10:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.512899'}
2026-01-22 16:10:11,152 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 16:10:11,152 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-54151740 passed
2026-01-22 16:10:11,152 - DEBUG - ====Verifying policy data for ctest-vn1-54151740 in API_Server ======
2026-01-22 16:10:11,152 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:11,158 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:11,172 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:11,300 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/21973455-7fc6-48d2-9806-cb4c9d00894b
2026-01-22 16:10:11,316 - DEBUG - =>VN ctest-vn1-54151740 has no policy to be verified
2026-01-22 16:10:11,316 - DEBUG - Verifying the vn in opserver
2026-01-22 16:10:11,316 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740 virtual network link through opserver 10.0.0.23
2026-01-22 16:10:11,316 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-01-22 16:10:11,384 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740?flat'}
2026-01-22 16:10:11,384 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740 virtual network link through opserver 10.0.0.240
2026-01-22 16:10:11,384 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-01-22 16:10:11,453 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740?flat'}
2026-01-22 16:10:11,453 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740 virtual network link through opserver 10.0.0.65
2026-01-22 16:10:11,453 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks
2026-01-22 16:10:11,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740?flat'}
2026-01-22 16:10:11,511 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740 is found in opserver
2026-01-22 16:10:11,530 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 16:10:11,539 - DEBUG - VRF ids for VN ctest-vn1-54151740: {}
2026-01-22 16:10:12,589 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5062-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5062-2)
2026-01-22 16:10:14,250 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5062-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5062-1)
2026-01-22 16:10:14,433 - INFO - Creating Floating IP pool ctest-some-pool-79634381 in API Server
2026-01-22 16:10:14,631 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:14,640 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:14,654 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:14,800 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:14,818 - DEBUG - Requesting: http://10.0.0.23:8082/floating-ip-pool/b1e75965-7e1f-4120-a55e-3e37e12cf6d1
2026-01-22 16:10:14,830 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:14,838 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:14,852 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:14,986 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2528d20d-87fe-4748-bff1-8b0501fc0214
2026-01-22 16:10:15,007 - DEBUG - FIP Pool ctest-some-pool-79634381 found in API Server
2026-01-22 16:10:15,007 - INFO - Verification for FIP pool ctest-some-pool-79634381 in API Server passed
2026-01-22 16:10:15,024 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-79634381 information
2026-01-22 16:10:15,039 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-79634381 information
2026-01-22 16:10:15,048 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-79634381 information
2026-01-22 16:10:15,048 - INFO - Verification for FIP pool ctest-some-pool-79634381 in Control-node passed
2026-01-22 16:10:15,048 - INFO - Waiting for VM ctest-vn1_vm1_name-38029591 to be up..
2026-01-22 16:10:15,185 - DEBUG - VM is in ACTIVE state now
2026-01-22 16:10:15,185 - INFO - VM name : ctest-vn1_vm1_name-38029591
2026-01-22 16:10:15,377 - DEBUG - VM ctest-vn1_vm1_name-38029591 ID is fde3fb91-9bbe-45a2-9223-54d3cd477d9d
2026-01-22 16:10:15,414 - DEBUG - VM ctest-vn1_vm1_name-38029591 launched on Node an-jenkins-deploy-platform-ansible-os-5062-2
2026-01-22 16:10:15,554 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/fde3fb91-9bbe-45a2-9223-54d3cd477d9d
2026-01-22 16:10:15,856 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/fde3fb91-9bbe-45a2-9223-54d3cd477d9d
2026-01-22 16:10:15,895 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/b2b0b5a2-e2ec-40ca-bfa4-99c88f2ce01f
2026-01-22 16:10:19,101 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2026-01-22 16:10:19,101 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-38029591 failed!
2026-01-22 16:10:19,125 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740 is 148.231.118.129 and allocation pool is NOT set
2026-01-22 16:10:23,158 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-01-22 16:10:23,158 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-38029591 failed!
2026-01-22 16:10:23,177 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-vn1-54151740 is 148.231.118.129 and allocation pool is NOT set
2026-01-22 16:10:25,202 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.71 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.07 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.066/3.387/5.709/2.321 ms')
2026-01-22 16:10:25,202 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-38029591 passed
2026-01-22 16:10:25,328 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 16:10:25,328 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-38029591, IP 148.231.118.131, Port 22
2026-01-22 16:10:25,401 - DEBUG - VM ctest-vn1_vm1_name-38029591 is ready for SSH connections
2026-01-22 16:10:25,592 - DEBUG - Created Floating IP : ('3.121.74.196', 'c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803')
2026-01-22 16:10:25,592 - DEBUG - Associating FIP 3.121.74.196 to fde3fb91-9bbe-45a2-9223-54d3cd477d9d
2026-01-22 16:10:25,627 - DEBUG - Associating FIP ID c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803 with Port ID b2b0b5a2-e2ec-40ca-bfa4-99c88f2ce01f
2026-01-22 16:10:25,739 - INFO - Waiting for VM ctest-fvn_vm1_name-85946406 to be up..
2026-01-22 16:10:25,836 - DEBUG - VM is in ACTIVE state now
2026-01-22 16:10:25,836 - INFO - VM name : ctest-fvn_vm1_name-85946406
2026-01-22 16:10:25,928 - DEBUG - VM ctest-fvn_vm1_name-85946406 ID is 3622bc2b-5138-4d58-9fe8-7a8480538fbd
2026-01-22 16:10:25,929 - DEBUG - VM ctest-fvn_vm1_name-85946406 launched on Node an-jenkins-deploy-platform-ansible-os-5062-1
2026-01-22 16:10:26,033 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/3622bc2b-5138-4d58-9fe8-7a8480538fbd
2026-01-22 16:10:26,049 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/af4090c5-80a5-4929-bc55-c25fc8cbad6b
2026-01-22 16:10:27,222 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.80 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.803/4.862/7.921/3.059 ms')
2026-01-22 16:10:27,222 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-85946406 passed
2026-01-22 16:10:27,341 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 16:10:27,341 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-85946406, IP 3.121.74.195, Port 22
2026-01-22 16:10:27,354 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-01-22 16:10:27,442 - DEBUG - VM ctest-fvn_vm1_name-85946406 is NOT ready for SSH connections, VM status: ACTIVE
2026-01-22 16:10:32,443 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 16:10:32,443 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-85946406, IP 3.121.74.195, Port 22
2026-01-22 16:10:32,512 - DEBUG - VM ctest-fvn_vm1_name-85946406 is ready for SSH connections
2026-01-22 16:10:32,714 - INFO - Route for FIP 3.121.74.196 is fine on Control-node 10.0.0.65
2026-01-22 16:10:32,723 - INFO - Route for FIP 3.121.74.196 is fine on Control-node 10.0.0.23
2026-01-22 16:10:32,733 - INFO - Route for FIP 3.121.74.196 is fine on Control-node 10.0.0.240
2026-01-22 16:10:32,734 - INFO - FIP 3.121.74.196 verification for passed on all Control-nodes
2026-01-22 16:10:32,734 - INFO - FIP ID c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803(3.121.74.196) validation in Control node passed
2026-01-22 16:10:32,754 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.19', 'dip': '10.20.0.241', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:fd:e8:cb'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '22', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.249', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590'], 'unresolved': 'false', 'sg_list': ['8000003'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-01-22 16:10:32,755 - DEBUG - Route for FIP IP 3.121.74.196 is present in agent 10.0.0.130
2026-01-22 16:10:32,755 - DEBUG - FIP 3.121.74.196 verification for VM ctest-vn1_vm1_name-38029591 in Agent 10.0.0.130 passed
2026-01-22 16:10:32,773 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '16', 'valid': 'true', 'policy': 'enabled', 'itf': 'tapb2b0b5a2-e2', 'mac': ['2:b2:b0:b5:a2:e2'], 'mcast': 'disabled', 'nh_index': '30', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.5', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-66062209:ctest-fvn-49455590'], 'unresolved': 'false', 'sg_list': ['8000003'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-01-22 16:10:32,773 - DEBUG - Route for FIP IP 3.121.74.196 is present in agent 10.0.0.73
2026-01-22 16:10:32,773 - DEBUG - FIP 3.121.74.196 verification for VM ctest-vn1_vm1_name-38029591 in Agent 10.0.0.73 passed
2026-01-22 16:10:32,773 - INFO - FIP ID c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803(3.121.74.196) validation in agents passed
2026-01-22 16:10:32,773 - DEBUG - Requesting: http://10.0.0.23:8082/floating-ip/c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803
2026-01-22 16:10:32,781 - DEBUG - FIP c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803 is present in API server
2026-01-22 16:10:32,781 - INFO - FIP ID c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803(3.121.74.196) validation in API Server passed
2026-01-22 16:10:32,781 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 16:10:32,781 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 3.121.74.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2026-01-22 16:10:32,782 - DEBUG - ping -s 56 -c 3 -W 1 3.121.74.195
2026-01-22 16:10:35,709 - DEBUG - PING 3.121.74.195 (3.121.74.195): 56 data bytes
64 bytes from 3.121.74.195: seq=0 ttl=64 time=9.333 ms
64 bytes from 3.121.74.195: seq=1 ttl=64 time=1.159 ms
64 bytes from 3.121.74.195: seq=2 ttl=64 time=1.488 ms
--- 3.121.74.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.159/3.993/9.333 ms
2026-01-22 16:10:35,709 - INFO - Ping to IP 3.121.74.195 from VM ctest-vn1_vm1_name-38029591 passed
2026-01-22 16:10:35,710 - DEBUG - Disassociating port from FIP ID : c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803
2026-01-22 16:10:35,808 - DEBUG - Deleting FIP ID c2cd8ab8-4d9c-40e3-a9a1-3536a9eec803
2026-01-22 16:10:35,929 - INFO - Deleting the FIP pool ctest-some-pool-79634381
2026-01-22 16:10:36,062 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-79634381 information
2026-01-22 16:10:36,067 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-79634381 information
2026-01-22 16:10:36,073 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-79634381 information
2026-01-22 16:10:36,073 - INFO - Deleting VM ctest-fvn_vm1_name-85946406
2026-01-22 16:10:36,143 - INFO - Deleting VM ctest-vn1_vm1_name-38029591
2026-01-22 16:10:36,213 - INFO - Deleting VN ctest-vn1-54151740
2026-01-22 16:10:36,265 - DEBUG - VN 21973455-7fc6-48d2-9806-cb4c9d00894b still in use: Unable to complete operation on network 21973455-7fc6-48d2-9806-cb4c9d00894b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-aff5b625-1ec5-4a4d-b355-4ec846150ff6']
2026-01-22 16:10:36,265 - WARNING - Deleting VN ctest-vn1-54151740 failed..Will retry
2026-01-22 16:10:38,480 - DEBUG - Response for deleting network ()
2026-01-22 16:10:38,480 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d1eb8041-7931-485c-a8da-0dba09dfe92c
2026-01-22 16:10:38,488 - DEBUG - Response Code: 404
2026-01-22 16:10:38,488 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:38,495 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:38,517 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:38,626 - INFO - Validated that VN ctest-vn1-54151740 is not found in API Server
2026-01-22 16:10:38,644 - DEBUG - VN ctest-vn1-54151740 is not present in Agent 10.0.0.130
2026-01-22 16:10:38,657 - DEBUG - VN ctest-vn1-54151740 is not present in Agent 10.0.0.73
2026-01-22 16:10:38,657 - INFO - Validated that VN ctest-vn1-54151740 is not in any agent
2026-01-22 16:10:38,702 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-54151740 info
2026-01-22 16:10:38,702 - INFO - Deleting VN ctest-fvn-49455590
2026-01-22 16:10:38,929 - DEBUG - Response for deleting network ()
2026-01-22 16:10:38,930 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/2c27a026-f6d3-42d3-bef5-5f4d721660d6
2026-01-22 16:10:38,941 - DEBUG - Response Code: 404
2026-01-22 16:10:38,941 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-01-22 16:10:38,957 - DEBUG - Requesting: http://10.0.0.23:8082/domain/801ea07a-2288-434f-a602-075a9d2169e6
2026-01-22 16:10:39,011 - DEBUG - Requesting: http://10.0.0.23:8082/project/b2158148-8243-4065-ba0e-a5eff7b7d6ce
2026-01-22 16:10:39,113 - INFO - Validated that VN ctest-fvn-49455590 is not found in API Server
2026-01-22 16:10:39,128 - DEBUG - VN ctest-fvn-49455590 is not present in Agent 10.0.0.130
2026-01-22 16:10:39,141 - DEBUG - VN ctest-fvn-49455590 is not present in Agent 10.0.0.73
2026-01-22 16:10:39,141 - INFO - Validated that VN ctest-fvn-49455590 is not in any agent
2026-01-22 16:10:39,175 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-49455590 info
2026-01-22 16:10:40,507 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 16:10:40,507 - INFO - END TEST : test_floating_ip : PASSED[0:00:35]
2026-01-22 16:10:40,507 - INFO - --------------------------------------------------------------------------------
2026-01-22 16:10:41,344 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-66062209, ID : b2158148-8243-4065-ba0e-a5eff7b7d6ce