2026-06-08 06:17:11,995 - INFO - Domain Default found not creating
2026-06-08 06:17:12,184 - INFO - Project ctest-FloatingipBasicTestSanity-29186402 not found, creating it
2026-06-08 06:17:12,923 - INFO - Created Project:ctest-FloatingipBasicTestSanity-29186402, ID : dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:14,562 - INFO - Using existing project ['default-domain', 'admin'](ad30f36f-3e83-4afd-8753-d35a6418e318)
2026-06-08 06:17:15,472 - INFO - Adding rules to the default security group in Project admin
2026-06-08 06:17:15,813 - INFO - ================================================================================
2026-06-08 06:17:15,813 - INFO - STARTING TEST : test_floating_ip
2026-06-08 06:17:15,813 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN.
2026-06-08 06:17:16,459 - WARNING - Test is running with cores: {'10.0.0.38': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-5902-1.1780898019'], '10.0.0.33': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-5902-3.1780898019']}
2026-06-08 06:17:16,472 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.14': '0', '10.20.0.254': '0'}, '10.0.0.22': {'10.20.0.254': '0', '10.20.0.17': '0'}} with
2026-06-08 06:17:16,472 - INFO - Initial checks done. Running the testcase now
2026-06-08 06:17:16,472 - INFO -
2026-06-08 06:17:16,501 - DEBUG - Services list from nova: [, , , ]
2026-06-08 06:17:16,501 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5902-2', 'an-jenkins-deploy-platform-ansible-os-5902-1']}
2026-06-08 06:17:17,391 - DEBUG - Response for create_network : {'network': {'id': '582f3ad8-1f0d-43c7-b2db-67c757b87e54', 'name': 'ctest-fvn-87366598', 'tenant_id': 'dd02ca22cc7f473b9b1abda8a8d27263', 'project_id': 'dd02ca22cc7f473b9b1abda8a8d27263', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-29186402', 'ctest-fvn-87366598'], 'port_security_enabled': True, 'description': ''}}
2026-06-08 06:17:17,686 - DEBUG - Response for create_subnet : {'subnet': {'id': '3bca8110-2ca5-45b1-90cf-d839eb497d53', 'name': '', 'tenant_id': 'dd02ca22cc7f473b9b1abda8a8d27263', 'network_id': '582f3ad8-1f0d-43c7-b2db-67c757b87e54', 'ip_version': 4, 'cidr': '40.134.48.0/26', 'allocation_pools': [{'start': '40.134.48.2', 'end': '40.134.48.62'}], 'gateway_ip': '40.134.48.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '40.134.48.2', 'tags': [], 'project_id': 'dd02ca22cc7f473b9b1abda8a8d27263'}}
2026-06-08 06:17:17,717 - INFO - Created VN ctest-fvn-87366598
2026-06-08 06:17:17,730 - DEBUG - VN ctest-fvn-87366598 UUID is 582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:17,817 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:18,085 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:18,122 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:18,138 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:18,262 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:18,276 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:18,287 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b816a447-075d-4a77-be54-c19ed034b383
2026-06-08 06:17:18,303 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b816a447-075d-4a77-be54-c19ed034b383
2026-06-08 06:17:18,313 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f7463308-1ffc-4b6f-ba7c-aadf466eefd5
2026-06-08 06:17:18,321 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-08 06:17:18,322 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:18,335 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b816a447-075d-4a77-be54-c19ed034b383
2026-06-08 06:17:18,353 - INFO - Verified VN network id 6 for VN 582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:18,353 - INFO - Verifications in API Server for VN ctest-fvn-87366598 passed
2026-06-08 06:17:18,353 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:18,364 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b816a447-075d-4a77-be54-c19ed034b383
2026-06-08 06:17:18,376 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b816a447-075d-4a77-be54-c19ed034b383
2026-06-08 06:17:18,385 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/f7463308-1ffc-4b6f-ba7c-aadf466eefd5
2026-06-08 06:17:18,403 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-29186402', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6354362299151369159', 'uuid-lslong': '12888008864518667860'}, 'enable': 'true', 'created': '2026-06-08T06:17:17', 'last-modified': '2026-06-08T06:17:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.791141'}
2026-06-08 06:17:18,412 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-08 06:17:18,418 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-29186402', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6354362299151369159', 'uuid-lslong': '12888008864518667860'}, 'enable': 'true', 'created': '2026-06-08T06:17:17', 'last-modified': '2026-06-08T06:17:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.803456'}
2026-06-08 06:17:18,425 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-08 06:17:18,430 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-29186402', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6354362299151369159', 'uuid-lslong': '12888008864518667860'}, 'enable': 'true', 'created': '2026-06-08T06:17:17', 'last-modified': '2026-06-08T06:17:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.820353'}
2026-06-08 06:17:18,436 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-08 06:17:18,437 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-87366598 passed
2026-06-08 06:17:18,437 - DEBUG - ====Verifying policy data for ctest-fvn-87366598 in API_Server ======
2026-06-08 06:17:18,437 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:18,445 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:18,457 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:18,569 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:18,584 - DEBUG - =>VN ctest-fvn-87366598 has no policy to be verified
2026-06-08 06:17:18,584 - DEBUG - Verifying the vn in opserver
2026-06-08 06:17:18,584 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598 virtual network link through opserver 10.0.0.38
2026-06-08 06:17:18,584 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-06-08 06:17:18,866 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-06-08 06:17:18,942 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598?flat'}
2026-06-08 06:17:18,942 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598 virtual network link through opserver 10.0.0.50
2026-06-08 06:17:18,942 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-06-08 06:17:19,206 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-06-08 06:17:19,291 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598?flat'}
2026-06-08 06:17:19,291 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598 virtual network link through opserver 10.0.0.33
2026-06-08 06:17:19,292 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-06-08 06:17:19,564 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-06-08 06:17:19,638 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598?flat'}
2026-06-08 06:17:19,638 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598 is found in opserver
2026-06-08 06:17:19,663 - DEBUG - Do not have enough data to verify VN in agent
2026-06-08 06:17:19,675 - DEBUG - VRF ids for VN ctest-fvn-87366598: {}
2026-06-08 06:17:20,042 - DEBUG - Response for create_network : {'network': {'id': 'e7327064-6d34-4c5b-ad50-2a25615eb4fa', 'name': 'ctest-vn1-05354041', 'tenant_id': 'dd02ca22cc7f473b9b1abda8a8d27263', 'project_id': 'dd02ca22cc7f473b9b1abda8a8d27263', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-29186402', 'ctest-vn1-05354041'], 'port_security_enabled': True, 'description': ''}}
2026-06-08 06:17:20,388 - DEBUG - Response for create_subnet : {'subnet': {'id': '3f0a1170-6753-41fa-9545-fa00f4cf0ca9', 'name': '', 'tenant_id': 'dd02ca22cc7f473b9b1abda8a8d27263', 'network_id': 'e7327064-6d34-4c5b-ad50-2a25615eb4fa', 'ip_version': 4, 'cidr': '209.164.169.64/26', 'allocation_pools': [{'start': '209.164.169.66', 'end': '209.164.169.126'}], 'gateway_ip': '209.164.169.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '209.164.169.66', 'tags': [], 'project_id': 'dd02ca22cc7f473b9b1abda8a8d27263'}}
2026-06-08 06:17:20,417 - INFO - Created VN ctest-vn1-05354041
2026-06-08 06:17:20,430 - DEBUG - VN ctest-vn1-05354041 UUID is e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:20,523 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:20,532 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:20,544 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:20,665 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:20,685 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:20,702 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/60b610d1-f770-4701-8e16-336e12bd1f3f
2026-06-08 06:17:20,713 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/60b610d1-f770-4701-8e16-336e12bd1f3f
2026-06-08 06:17:20,722 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/936c9e8b-ad02-4201-af0c-cd46d6383f69
2026-06-08 06:17:20,731 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-08 06:17:20,732 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:20,744 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/60b610d1-f770-4701-8e16-336e12bd1f3f
2026-06-08 06:17:20,763 - INFO - Verified VN network id 7 for VN e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:20,763 - INFO - Verifications in API Server for VN ctest-vn1-05354041 passed
2026-06-08 06:17:20,763 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:20,778 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/60b610d1-f770-4701-8e16-336e12bd1f3f
2026-06-08 06:17:20,787 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/60b610d1-f770-4701-8e16-336e12bd1f3f
2026-06-08 06:17:20,796 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/936c9e8b-ad02-4201-af0c-cd46d6383f69
2026-06-08 06:17:20,811 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-29186402', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16659501548228070491', 'uuid-lslong': '12488528106734138618'}, 'enable': 'true', 'created': '2026-06-08T06:17:19', 'last-modified': '2026-06-08T06:17:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.514814'}
2026-06-08 06:17:20,822 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-08 06:17:20,829 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-29186402', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16659501548228070491', 'uuid-lslong': '12488528106734138618'}, 'enable': 'true', 'created': '2026-06-08T06:17:19', 'last-modified': '2026-06-08T06:17:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.534038'}
2026-06-08 06:17:20,841 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-08 06:17:20,852 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-29186402', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16659501548228070491', 'uuid-lslong': '12488528106734138618'}, 'enable': 'true', 'created': '2026-06-08T06:17:19', 'last-modified': '2026-06-08T06:17:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.552955'}
2026-06-08 06:17:20,860 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-08 06:17:20,860 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-05354041 passed
2026-06-08 06:17:20,860 - DEBUG - ====Verifying policy data for ctest-vn1-05354041 in API_Server ======
2026-06-08 06:17:20,860 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:20,870 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:20,885 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:20,993 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e7327064-6d34-4c5b-ad50-2a25615eb4fa
2026-06-08 06:17:21,003 - DEBUG - =>VN ctest-vn1-05354041 has no policy to be verified
2026-06-08 06:17:21,003 - DEBUG - Verifying the vn in opserver
2026-06-08 06:17:21,003 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041 virtual network link through opserver 10.0.0.38
2026-06-08 06:17:21,004 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-06-08 06:17:21,155 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041?flat'}
2026-06-08 06:17:21,156 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041 virtual network link through opserver 10.0.0.50
2026-06-08 06:17:21,156 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-06-08 06:17:21,217 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041?flat'}
2026-06-08 06:17:21,217 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041 virtual network link through opserver 10.0.0.33
2026-06-08 06:17:21,217 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-06-08 06:17:21,285 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041?flat'}
2026-06-08 06:17:21,285 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041 is found in opserver
2026-06-08 06:17:21,311 - DEBUG - Do not have enough data to verify VN in agent
2026-06-08 06:17:21,324 - DEBUG - VRF ids for VN ctest-vn1-05354041: {}
2026-06-08 06:17:22,457 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5902-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5902-2)
2026-06-08 06:17:24,022 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5902-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5902-1)
2026-06-08 06:17:24,233 - INFO - Creating Floating IP pool ctest-some-pool-27180938 in API Server
2026-06-08 06:17:24,444 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:24,452 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:24,467 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:24,575 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:24,592 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip-pool/44b4d1e1-0f21-4cad-8681-af78415242c3
2026-06-08 06:17:24,600 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:24,608 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:24,627 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:24,763 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/582f3ad8-1f0d-43c7-b2db-67c757b87e54
2026-06-08 06:17:24,787 - DEBUG - FIP Pool ctest-some-pool-27180938 found in API Server
2026-06-08 06:17:24,787 - INFO - Verification for FIP pool ctest-some-pool-27180938 in API Server passed
2026-06-08 06:17:24,819 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-27180938 information
2026-06-08 06:17:24,824 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-27180938 information
2026-06-08 06:17:24,829 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-27180938 information
2026-06-08 06:17:24,829 - INFO - Verification for FIP pool ctest-some-pool-27180938 in Control-node passed
2026-06-08 06:17:24,830 - INFO - Waiting for VM ctest-vn1_vm1_name-32482979 to be up..
2026-06-08 06:17:24,943 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-08 06:17:30,049 - DEBUG - VM is in ACTIVE state now
2026-06-08 06:17:30,049 - INFO - VM name : ctest-vn1_vm1_name-32482979
2026-06-08 06:17:30,169 - DEBUG - VM ctest-vn1_vm1_name-32482979 ID is e1341b4b-4aac-4416-83a2-cce8748fcd7c
2026-06-08 06:17:30,245 - DEBUG - VM ctest-vn1_vm1_name-32482979 launched on Node an-jenkins-deploy-platform-ansible-os-5902-2
2026-06-08 06:17:30,359 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/e1341b4b-4aac-4416-83a2-cce8748fcd7c
2026-06-08 06:17:30,640 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/e1341b4b-4aac-4416-83a2-cce8748fcd7c
2026-06-08 06:17:30,682 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/c090a51a-7087-4376-86e3-5c2087f195ac
2026-06-08 06:17:33,818 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2026-06-08 06:17:33,818 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-32482979 failed!
2026-06-08 06:17:33,836 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-vn1-05354041 is 209.164.169.65 and allocation pool is NOT set
2026-06-08 06:17:35,857 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.486 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.486/1.730/2.975/1.244 ms')
2026-06-08 06:17:35,858 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-32482979 passed
2026-06-08 06:17:35,936 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 06:17:35,936 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-32482979, IP 209.164.169.67, Port 22
2026-06-08 06:17:36,010 - DEBUG - VM ctest-vn1_vm1_name-32482979 is ready for SSH connections
2026-06-08 06:17:36,241 - DEBUG - Created Floating IP : ('40.134.48.4', '226850c5-6df9-4e73-b5be-fcc4b68d3e67')
2026-06-08 06:17:36,242 - DEBUG - Associating FIP 40.134.48.4 to e1341b4b-4aac-4416-83a2-cce8748fcd7c
2026-06-08 06:17:36,280 - DEBUG - Associating FIP ID 226850c5-6df9-4e73-b5be-fcc4b68d3e67 with Port ID c090a51a-7087-4376-86e3-5c2087f195ac
2026-06-08 06:17:36,411 - INFO - Waiting for VM ctest-fvn_vm1_name-43341363 to be up..
2026-06-08 06:17:36,518 - DEBUG - VM is in ACTIVE state now
2026-06-08 06:17:36,518 - INFO - VM name : ctest-fvn_vm1_name-43341363
2026-06-08 06:17:36,620 - DEBUG - VM ctest-fvn_vm1_name-43341363 ID is e6cb19a8-86cc-4259-9596-9c85027bacf3
2026-06-08 06:17:36,620 - DEBUG - VM ctest-fvn_vm1_name-43341363 launched on Node an-jenkins-deploy-platform-ansible-os-5902-1
2026-06-08 06:17:36,740 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/e6cb19a8-86cc-4259-9596-9c85027bacf3
2026-06-08 06:17:36,754 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/fab860c9-fe78-4cbf-9e65-090c92c74bd9
2026-06-08 06:17:39,884 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms')
2026-06-08 06:17:39,884 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-43341363 failed!
2026-06-08 06:17:39,901 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598 is 40.134.48.1 and allocation pool is NOT set
2026-06-08 06:17:41,929 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.53 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.592 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.592/2.058/3.525/1.466 ms')
2026-06-08 06:17:41,929 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-43341363 passed
2026-06-08 06:17:42,007 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 06:17:42,008 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-43341363, IP 40.134.48.3, Port 22
2026-06-08 06:17:42,082 - DEBUG - VM ctest-fvn_vm1_name-43341363 is ready for SSH connections
2026-06-08 06:17:42,260 - INFO - Route for FIP 40.134.48.4 is fine on Control-node 10.0.0.50
2026-06-08 06:17:42,269 - INFO - Route for FIP 40.134.48.4 is fine on Control-node 10.0.0.38
2026-06-08 06:17:42,279 - INFO - Route for FIP 40.134.48.4 is fine on Control-node 10.0.0.33
2026-06-08 06:17:42,279 - INFO - FIP 40.134.48.4 verification for passed on all Control-nodes
2026-06-08 06:17:42,279 - INFO - FIP ID 226850c5-6df9-4e73-b5be-fcc4b68d3e67(40.134.48.4) validation in Control node passed
2026-06-08 06:17:42,298 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.25', 'dip': '10.20.0.193', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:ab:6c:bf'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '22', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.14', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-06-08 06:17:42,298 - DEBUG - Route for FIP IP 40.134.48.4 is present in agent 10.0.0.249
2026-06-08 06:17:42,298 - DEBUG - FIP 40.134.48.4 verification for VM ctest-vn1_vm1_name-32482979 in Agent 10.0.0.249 passed
2026-06-08 06:17:42,320 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '16', 'valid': 'true', 'policy': 'enabled', 'itf': 'tapc090a51a-70', 'mac': ['2:c0:90:a5:1a:70'], 'mcast': 'disabled', 'nh_index': '30', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.17', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-29186402:ctest-fvn-87366598'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-06-08 06:17:42,320 - DEBUG - Route for FIP IP 40.134.48.4 is present in agent 10.0.0.22
2026-06-08 06:17:42,320 - DEBUG - FIP 40.134.48.4 verification for VM ctest-vn1_vm1_name-32482979 in Agent 10.0.0.22 passed
2026-06-08 06:17:42,320 - INFO - FIP ID 226850c5-6df9-4e73-b5be-fcc4b68d3e67(40.134.48.4) validation in agents passed
2026-06-08 06:17:42,320 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip/226850c5-6df9-4e73-b5be-fcc4b68d3e67
2026-06-08 06:17:42,332 - DEBUG - FIP 226850c5-6df9-4e73-b5be-fcc4b68d3e67 is present in API server
2026-06-08 06:17:42,332 - INFO - FIP ID 226850c5-6df9-4e73-b5be-fcc4b68d3e67(40.134.48.4) validation in API Server passed
2026-06-08 06:17:42,332 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-08 06:17:42,332 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 40.134.48.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-08 06:17:42,332 - DEBUG - ping -s 56 -c 3 -W 1 40.134.48.3
2026-06-08 06:17:45,277 - DEBUG - PING 40.134.48.3 (40.134.48.3): 56 data bytes
64 bytes from 40.134.48.3: seq=0 ttl=64 time=10.246 ms
64 bytes from 40.134.48.3: seq=1 ttl=64 time=1.614 ms
64 bytes from 40.134.48.3: seq=2 ttl=64 time=1.784 ms
--- 40.134.48.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.614/4.548/10.246 ms
2026-06-08 06:17:45,277 - INFO - Ping to IP 40.134.48.3 from VM ctest-vn1_vm1_name-32482979 passed
2026-06-08 06:17:45,277 - DEBUG - Disassociating port from FIP ID : 226850c5-6df9-4e73-b5be-fcc4b68d3e67
2026-06-08 06:17:45,387 - DEBUG - Deleting FIP ID 226850c5-6df9-4e73-b5be-fcc4b68d3e67
2026-06-08 06:17:45,520 - INFO - Deleting the FIP pool ctest-some-pool-27180938
2026-06-08 06:17:45,670 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-27180938 information
2026-06-08 06:17:45,678 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-27180938 information
2026-06-08 06:17:45,683 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-27180938 information
2026-06-08 06:17:45,684 - INFO - Deleting VM ctest-fvn_vm1_name-43341363
2026-06-08 06:17:45,760 - INFO - Deleting VM ctest-vn1_vm1_name-32482979
2026-06-08 06:17:45,829 - INFO - Deleting VN ctest-vn1-05354041
2026-06-08 06:17:45,881 - DEBUG - VN e7327064-6d34-4c5b-ad50-2a25615eb4fa still in use: Unable to complete operation on network e7327064-6d34-4c5b-ad50-2a25615eb4fa. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-4d5657bc-2fcd-4c72-b078-056a501f099e']
2026-06-08 06:17:45,882 - WARNING - Deleting VN ctest-vn1-05354041 failed..Will retry
2026-06-08 06:17:48,092 - DEBUG - Response for deleting network ()
2026-06-08 06:17:48,092 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/60b610d1-f770-4701-8e16-336e12bd1f3f
2026-06-08 06:17:48,101 - DEBUG - Response Code: 404
2026-06-08 06:17:48,101 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:48,118 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:48,149 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:48,275 - INFO - Validated that VN ctest-vn1-05354041 is not found in API Server
2026-06-08 06:17:48,287 - DEBUG - VN ctest-vn1-05354041 is not present in Agent 10.0.0.249
2026-06-08 06:17:48,300 - DEBUG - VN ctest-vn1-05354041 is not present in Agent 10.0.0.22
2026-06-08 06:17:48,300 - INFO - Validated that VN ctest-vn1-05354041 is not in any agent
2026-06-08 06:17:48,358 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-05354041 info
2026-06-08 06:17:48,358 - INFO - Deleting VN ctest-fvn-87366598
2026-06-08 06:17:48,578 - DEBUG - Response for deleting network ()
2026-06-08 06:17:48,578 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b816a447-075d-4a77-be54-c19ed034b383
2026-06-08 06:17:48,591 - DEBUG - Response Code: 404
2026-06-08 06:17:48,591 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-08 06:17:48,600 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ff885fe6-2413-4985-853a-0c3bd0a6a9a3
2026-06-08 06:17:48,618 - DEBUG - Requesting: http://10.0.0.38:8082/project/dd02ca22-cc7f-473b-9b1a-bda8a8d27263
2026-06-08 06:17:48,759 - INFO - Validated that VN ctest-fvn-87366598 is not found in API Server
2026-06-08 06:17:48,770 - DEBUG - VN ctest-fvn-87366598 is not present in Agent 10.0.0.249
2026-06-08 06:17:48,780 - DEBUG - VN ctest-fvn-87366598 is not present in Agent 10.0.0.22
2026-06-08 06:17:48,780 - INFO - Validated that VN ctest-fvn-87366598 is not in any agent
2026-06-08 06:17:48,811 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-87366598 info
2026-06-08 06:17:50,097 - DEBUG - No XMPP flaps were noticed during the test
2026-06-08 06:17:50,097 - INFO - END TEST : test_floating_ip : PASSED[0:00:35]
2026-06-08 06:17:50,097 - INFO - --------------------------------------------------------------------------------
2026-06-08 06:17:50,880 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-29186402, ID : dd02ca22-cc7f-473b-9b1a-bda8a8d27263