2026-06-22 05:53:35,713 - INFO - Domain Default found not creating
2026-06-22 05:53:35,857 - INFO - Project ctest-FloatingipBasicTestSanity-41102345 not found, creating it
2026-06-22 05:53:36,444 - INFO - Created Project:ctest-FloatingipBasicTestSanity-41102345, ID : 66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:38,068 - INFO - Using existing project ['default-domain', 'admin'](2274b19e-52cc-4ffd-8aed-0a680ff5edf2)
2026-06-22 05:53:38,833 - INFO - Adding rules to the default security group in Project admin
2026-06-22 05:53:39,202 - INFO - ================================================================================
2026-06-22 05:53:39,202 - INFO - STARTING TEST : test_floating_ip
2026-06-22 05:53:39,202 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN.
2026-06-22 05:53:39,847 - WARNING - Test is running with cores: {'10.0.0.50': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-6019-2.1782106310']}
2026-06-22 05:53:39,860 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.14': '0', '10.20.0.254': '0'}, '10.0.0.22': {'10.20.0.14': '0', '10.20.0.17': '0'}} with
2026-06-22 05:53:39,861 - INFO - Initial checks done. Running the testcase now
2026-06-22 05:53:39,861 - INFO -
2026-06-22 05:53:39,896 - DEBUG - Services list from nova: [, , , ]
2026-06-22 05:53:39,896 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6019-1', 'an-jenkins-deploy-platform-ansible-os-6019-2']}
2026-06-22 05:53:40,698 - DEBUG - Response for create_network : {'network': {'id': '2ccaf8d5-c0c2-4c18-8aa8-546504321f40', 'name': 'ctest-fvn-63259532', 'tenant_id': '66286a0daa334bee9024c64e28d5a131', 'project_id': '66286a0daa334bee9024c64e28d5a131', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-41102345', 'ctest-fvn-63259532'], 'port_security_enabled': True, 'description': ''}}
2026-06-22 05:53:41,014 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6889743-6f46-418a-8e79-df5b36447e57', 'name': '', 'tenant_id': '66286a0daa334bee9024c64e28d5a131', 'network_id': '2ccaf8d5-c0c2-4c18-8aa8-546504321f40', 'ip_version': 4, 'cidr': '11.212.196.64/26', 'allocation_pools': [{'start': '11.212.196.66', 'end': '11.212.196.126'}], 'gateway_ip': '11.212.196.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.212.196.66', 'tags': [], 'project_id': '66286a0daa334bee9024c64e28d5a131'}}
2026-06-22 05:53:41,038 - INFO - Created VN ctest-fvn-63259532
2026-06-22 05:53:41,055 - DEBUG - VN ctest-fvn-63259532 UUID is 2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,120 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:41,442 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:41,471 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:53:41,488 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:41,588 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,617 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,637 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9977e71e-3dbd-4588-91e3-b6ad66c4abc9
2026-06-22 05:53:41,647 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9977e71e-3dbd-4588-91e3-b6ad66c4abc9
2026-06-22 05:53:41,654 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/a4ade4dd-5421-43af-ab44-01d25fb0ef21
2026-06-22 05:53:41,664 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 05:53:41,664 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,674 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9977e71e-3dbd-4588-91e3-b6ad66c4abc9
2026-06-22 05:53:41,695 - INFO - Verified VN network id 6 for VN 2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,695 - INFO - Verifications in API Server for VN ctest-fvn-63259532 passed
2026-06-22 05:53:41,695 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,704 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9977e71e-3dbd-4588-91e3-b6ad66c4abc9
2026-06-22 05:53:41,712 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9977e71e-3dbd-4588-91e3-b6ad66c4abc9
2026-06-22 05:53:41,718 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/a4ade4dd-5421-43af-ab44-01d25fb0ef21
2026-06-22 05:53:41,729 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-41102345', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3227665679910063128', 'uuid-lslong': '9991328566160269120'}, 'enable': 'true', 'created': '2026-06-22T05:53:40', 'last-modified': '2026-06-22T05:53:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.790498'}
2026-06-22 05:53:41,736 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 05:53:41,741 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-41102345', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3227665679910063128', 'uuid-lslong': '9991328566160269120'}, 'enable': 'true', 'created': '2026-06-22T05:53:40', 'last-modified': '2026-06-22T05:53:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.789108'}
2026-06-22 05:53:41,746 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 05:53:41,751 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-41102345', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3227665679910063128', 'uuid-lslong': '9991328566160269120'}, 'enable': 'true', 'created': '2026-06-22T05:53:40', 'last-modified': '2026-06-22T05:53:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.803771'}
2026-06-22 05:53:41,756 - DEBUG - Route Targets: ['target:64512:8000004']
2026-06-22 05:53:41,756 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-63259532 passed
2026-06-22 05:53:41,756 - DEBUG - ====Verifying policy data for ctest-fvn-63259532 in API_Server ======
2026-06-22 05:53:41,757 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:41,763 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:53:41,774 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:41,879 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:41,894 - DEBUG - =>VN ctest-fvn-63259532 has no policy to be verified
2026-06-22 05:53:41,894 - DEBUG - Verifying the vn in opserver
2026-06-22 05:53:41,894 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532 virtual network link through opserver 10.0.0.38
2026-06-22 05:53:41,894 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-06-22 05:53:42,240 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-06-22 05:53:42,299 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532?flat'}
2026-06-22 05:53:42,299 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532 virtual network link through opserver 10.0.0.50
2026-06-22 05:53:42,299 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-06-22 05:53:42,619 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-06-22 05:53:42,673 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532?flat'}
2026-06-22 05:53:42,673 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532 virtual network link through opserver 10.0.0.33
2026-06-22 05:53:42,673 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-06-22 05:53:42,998 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-06-22 05:53:43,068 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532?flat'}
2026-06-22 05:53:43,068 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532 is found in opserver
2026-06-22 05:53:43,088 - DEBUG - Do not have enough data to verify VN in agent
2026-06-22 05:53:43,100 - DEBUG - VRF ids for VN ctest-fvn-63259532: {}
2026-06-22 05:53:43,470 - DEBUG - Response for create_network : {'network': {'id': '75274e15-6ce2-4c79-a95a-151154ab91c8', 'name': 'ctest-vn1-22346836', 'tenant_id': '66286a0daa334bee9024c64e28d5a131', 'project_id': '66286a0daa334bee9024c64e28d5a131', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-41102345', 'ctest-vn1-22346836'], 'port_security_enabled': True, 'description': ''}}
2026-06-22 05:53:43,780 - DEBUG - Response for create_subnet : {'subnet': {'id': '90574c58-7e50-4001-bc39-d7627de7c40f', 'name': '', 'tenant_id': '66286a0daa334bee9024c64e28d5a131', 'network_id': '75274e15-6ce2-4c79-a95a-151154ab91c8', 'ip_version': 4, 'cidr': '171.75.133.64/26', 'allocation_pools': [{'start': '171.75.133.66', 'end': '171.75.133.126'}], 'gateway_ip': '171.75.133.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '171.75.133.66', 'tags': [], 'project_id': '66286a0daa334bee9024c64e28d5a131'}}
2026-06-22 05:53:43,824 - INFO - Created VN ctest-vn1-22346836
2026-06-22 05:53:43,840 - DEBUG - VN ctest-vn1-22346836 UUID is 75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:43,931 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:43,940 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:53:43,953 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:44,073 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:44,093 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:44,104 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f05dd765-66ed-4c59-b2a1-70b4f077b32e
2026-06-22 05:53:44,117 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f05dd765-66ed-4c59-b2a1-70b4f077b32e
2026-06-22 05:53:44,129 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/3ffad521-4319-481b-a28c-15f11c01de99
2026-06-22 05:53:44,140 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-22 05:53:44,140 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:44,152 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f05dd765-66ed-4c59-b2a1-70b4f077b32e
2026-06-22 05:53:44,171 - INFO - Verified VN network id 7 for VN 75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:44,172 - INFO - Verifications in API Server for VN ctest-vn1-22346836 passed
2026-06-22 05:53:44,172 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:44,185 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f05dd765-66ed-4c59-b2a1-70b4f077b32e
2026-06-22 05:53:44,196 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f05dd765-66ed-4c59-b2a1-70b4f077b32e
2026-06-22 05:53:44,205 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/3ffad521-4319-481b-a28c-15f11c01de99
2026-06-22 05:53:44,224 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-41102345', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8441801880457333881', 'uuid-lslong': '12203089304492937672'}, 'enable': 'true', 'created': '2026-06-22T05:53:43', 'last-modified': '2026-06-22T05:53:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506057'}
2026-06-22 05:53:44,232 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-22 05:53:44,239 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-41102345', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8441801880457333881', 'uuid-lslong': '12203089304492937672'}, 'enable': 'true', 'created': '2026-06-22T05:53:43', 'last-modified': '2026-06-22T05:53:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527419'}
2026-06-22 05:53:44,247 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-22 05:53:44,253 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-41102345', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8441801880457333881', 'uuid-lslong': '12203089304492937672'}, 'enable': 'true', 'created': '2026-06-22T05:53:43', 'last-modified': '2026-06-22T05:53:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.531545'}
2026-06-22 05:53:44,261 - DEBUG - Route Targets: ['target:64512:8000005']
2026-06-22 05:53:44,261 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-22346836 passed
2026-06-22 05:53:44,261 - DEBUG - ====Verifying policy data for ctest-vn1-22346836 in API_Server ======
2026-06-22 05:53:44,261 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:44,270 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:53:44,285 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:44,421 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/75274e15-6ce2-4c79-a95a-151154ab91c8
2026-06-22 05:53:44,434 - DEBUG - =>VN ctest-vn1-22346836 has no policy to be verified
2026-06-22 05:53:44,434 - DEBUG - Verifying the vn in opserver
2026-06-22 05:53:44,434 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836 virtual network link through opserver 10.0.0.38
2026-06-22 05:53:44,434 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-06-22 05:53:44,494 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836?flat'}
2026-06-22 05:53:44,494 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836 virtual network link through opserver 10.0.0.50
2026-06-22 05:53:44,494 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-06-22 05:53:44,546 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836?flat'}
2026-06-22 05:53:44,546 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836 virtual network link through opserver 10.0.0.33
2026-06-22 05:53:44,546 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-06-22 05:53:44,597 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836?flat'}
2026-06-22 05:53:44,597 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836 is found in opserver
2026-06-22 05:53:44,619 - DEBUG - Do not have enough data to verify VN in agent
2026-06-22 05:53:44,629 - DEBUG - VRF ids for VN ctest-vn1-22346836: {}
2026-06-22 05:53:45,727 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6019-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6019-1)
2026-06-22 05:53:46,842 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6019-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6019-2)
2026-06-22 05:53:47,036 - INFO - Creating Floating IP pool ctest-some-pool-57208479 in API Server
2026-06-22 05:53:47,208 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:47,214 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:53:47,237 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:47,370 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:47,383 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip-pool/1a15d281-6d31-4488-a078-ff9f8d1e5bcf
2026-06-22 05:53:47,392 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:53:47,399 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:53:47,411 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:53:47,528 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ccaf8d5-c0c2-4c18-8aa8-546504321f40
2026-06-22 05:53:47,539 - DEBUG - FIP Pool ctest-some-pool-57208479 found in API Server
2026-06-22 05:53:47,539 - INFO - Verification for FIP pool ctest-some-pool-57208479 in API Server passed
2026-06-22 05:53:47,553 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-57208479 information
2026-06-22 05:53:47,559 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-57208479 information
2026-06-22 05:53:47,566 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-57208479 information
2026-06-22 05:53:47,567 - INFO - Verification for FIP pool ctest-some-pool-57208479 in Control-node passed
2026-06-22 05:53:47,567 - INFO - Waiting for VM ctest-vn1_vm1_name-85983188 to be up..
2026-06-22 05:53:47,619 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 05:53:52,703 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-06-22 05:53:57,787 - DEBUG - VM is in ACTIVE state now
2026-06-22 05:53:57,787 - INFO - VM name : ctest-vn1_vm1_name-85983188
2026-06-22 05:53:57,878 - DEBUG - VM ctest-vn1_vm1_name-85983188 ID is 65d570c4-6dbc-4550-a6f0-d088d5d08506
2026-06-22 05:53:57,905 - DEBUG - VM ctest-vn1_vm1_name-85983188 launched on Node an-jenkins-deploy-platform-ansible-os-6019-1
2026-06-22 05:53:57,999 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/65d570c4-6dbc-4550-a6f0-d088d5d08506
2026-06-22 05:53:58,317 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/65d570c4-6dbc-4550-a6f0-d088d5d08506
2026-06-22 05:53:58,346 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/1d83121f-a9a9-42f2-b1af-4263ab159fc9
2026-06-22 05:54:01,501 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1036ms')
2026-06-22 05:54:01,501 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-85983188 failed!
2026-06-22 05:54:01,519 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-vn1-22346836 is 171.75.133.65 and allocation pool is NOT set
2026-06-22 05:54:03,542 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.38 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.521 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.521/2.449/4.377/1.928 ms')
2026-06-22 05:54:03,542 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-85983188 passed
2026-06-22 05:54:03,623 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 05:54:03,623 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-85983188, IP 171.75.133.67, Port 22
2026-06-22 05:54:03,694 - DEBUG - VM ctest-vn1_vm1_name-85983188 is ready for SSH connections
2026-06-22 05:54:03,897 - DEBUG - Created Floating IP : ('11.212.196.68', '67d84588-7c1b-457e-969c-4f9f46ae5eb7')
2026-06-22 05:54:03,897 - DEBUG - Associating FIP 11.212.196.68 to 65d570c4-6dbc-4550-a6f0-d088d5d08506
2026-06-22 05:54:03,943 - DEBUG - Associating FIP ID 67d84588-7c1b-457e-969c-4f9f46ae5eb7 with Port ID 1d83121f-a9a9-42f2-b1af-4263ab159fc9
2026-06-22 05:54:04,045 - INFO - Waiting for VM ctest-fvn_vm1_name-45893037 to be up..
2026-06-22 05:54:04,133 - DEBUG - VM is in ACTIVE state now
2026-06-22 05:54:04,133 - INFO - VM name : ctest-fvn_vm1_name-45893037
2026-06-22 05:54:04,217 - DEBUG - VM ctest-fvn_vm1_name-45893037 ID is d5d414b7-c6a1-45cc-b424-11c030aec6ee
2026-06-22 05:54:04,217 - DEBUG - VM ctest-fvn_vm1_name-45893037 launched on Node an-jenkins-deploy-platform-ansible-os-6019-2
2026-06-22 05:54:04,289 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/d5d414b7-c6a1-45cc-b424-11c030aec6ee
2026-06-22 05:54:04,308 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/a6e5a818-88f2-443f-b9d7-e030c2706cda
2026-06-22 05:54:07,431 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2026-06-22 05:54:07,431 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-45893037 failed!
2026-06-22 05:54:07,451 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532 is 11.212.196.65 and allocation pool is NOT set
2026-06-22 05:54:09,475 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.25 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.449 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.449/2.351/4.254/1.902 ms')
2026-06-22 05:54:09,475 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-45893037 passed
2026-06-22 05:54:09,545 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 05:54:09,545 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-45893037, IP 11.212.196.67, Port 22
2026-06-22 05:54:09,620 - DEBUG - VM ctest-fvn_vm1_name-45893037 is ready for SSH connections
2026-06-22 05:54:09,785 - INFO - Route for FIP 11.212.196.68 is fine on Control-node 10.0.0.33
2026-06-22 05:54:09,793 - INFO - Route for FIP 11.212.196.68 is fine on Control-node 10.0.0.38
2026-06-22 05:54:09,800 - INFO - Route for FIP 11.212.196.68 is fine on Control-node 10.0.0.50
2026-06-22 05:54:09,800 - INFO - FIP 11.212.196.68 verification for passed on all Control-nodes
2026-06-22 05:54:09,801 - INFO - FIP ID 67d84588-7c1b-457e-969c-4f9f46ae5eb7(11.212.196.68) validation in Control node passed
2026-06-22 05:54:09,823 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '14', 'valid': 'true', 'policy': 'enabled', 'itf': 'tap1d83121f-a9', 'mac': ['2:1d:83:12:1f:a9'], 'mcast': 'disabled', 'nh_index': '31', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.14', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-06-22 05:54:09,823 - DEBUG - Route for FIP IP 11.212.196.68 is present in agent 10.0.0.249
2026-06-22 05:54:09,823 - DEBUG - FIP 11.212.196.68 verification for VM ctest-vn1_vm1_name-85983188 in Agent 10.0.0.249 passed
2026-06-22 05:54:09,844 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.193', 'dip': '10.20.0.25', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:47:b5:53'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '22', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.14', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-41102345:ctest-fvn-63259532'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-06-22 05:54:09,844 - DEBUG - Route for FIP IP 11.212.196.68 is present in agent 10.0.0.22
2026-06-22 05:54:09,844 - DEBUG - FIP 11.212.196.68 verification for VM ctest-vn1_vm1_name-85983188 in Agent 10.0.0.22 passed
2026-06-22 05:54:09,844 - INFO - FIP ID 67d84588-7c1b-457e-969c-4f9f46ae5eb7(11.212.196.68) validation in agents passed
2026-06-22 05:54:09,844 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip/67d84588-7c1b-457e-969c-4f9f46ae5eb7
2026-06-22 05:54:09,855 - DEBUG - FIP 67d84588-7c1b-457e-969c-4f9f46ae5eb7 is present in API server
2026-06-22 05:54:09,855 - INFO - FIP ID 67d84588-7c1b-457e-969c-4f9f46ae5eb7(11.212.196.68) validation in API Server passed
2026-06-22 05:54:09,855 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 05:54:09,855 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 11.212.196.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.249, gateway password: c0ntrail123
2026-06-22 05:54:09,855 - DEBUG - ping -s 56 -c 3 -W 1 11.212.196.67
2026-06-22 05:54:12,723 - DEBUG - PING 11.212.196.67 (11.212.196.67): 56 data bytes
64 bytes from 11.212.196.67: seq=0 ttl=64 time=9.737 ms
64 bytes from 11.212.196.67: seq=1 ttl=64 time=1.510 ms
64 bytes from 11.212.196.67: seq=2 ttl=64 time=1.512 ms
--- 11.212.196.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.510/4.253/9.737 ms
2026-06-22 05:54:12,723 - INFO - Ping to IP 11.212.196.67 from VM ctest-vn1_vm1_name-85983188 passed
2026-06-22 05:54:12,723 - DEBUG - Disassociating port from FIP ID : 67d84588-7c1b-457e-969c-4f9f46ae5eb7
2026-06-22 05:54:12,818 - DEBUG - Deleting FIP ID 67d84588-7c1b-457e-969c-4f9f46ae5eb7
2026-06-22 05:54:12,947 - INFO - Deleting the FIP pool ctest-some-pool-57208479
2026-06-22 05:54:13,109 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-57208479 information
2026-06-22 05:54:13,114 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-57208479 information
2026-06-22 05:54:13,119 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-57208479 information
2026-06-22 05:54:13,119 - INFO - Deleting VM ctest-fvn_vm1_name-45893037
2026-06-22 05:54:13,182 - INFO - Deleting VM ctest-vn1_vm1_name-85983188
2026-06-22 05:54:13,250 - INFO - Deleting VN ctest-vn1-22346836
2026-06-22 05:54:13,291 - DEBUG - VN 75274e15-6ce2-4c79-a95a-151154ab91c8 still in use: Unable to complete operation on network 75274e15-6ce2-4c79-a95a-151154ab91c8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-620f6575-0f62-4f0d-8a27-83600388ddcb']
2026-06-22 05:54:13,291 - WARNING - Deleting VN ctest-vn1-22346836 failed..Will retry
2026-06-22 05:54:15,384 - DEBUG - VN 75274e15-6ce2-4c79-a95a-151154ab91c8 still in use: Unable to complete operation on network 75274e15-6ce2-4c79-a95a-151154ab91c8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-c95986fd-db30-44ef-b591-e6428e909336']
2026-06-22 05:54:15,384 - WARNING - Deleting VN ctest-vn1-22346836 failed..Will retry
2026-06-22 05:54:17,572 - DEBUG - Response for deleting network ()
2026-06-22 05:54:17,572 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f05dd765-66ed-4c59-b2a1-70b4f077b32e
2026-06-22 05:54:17,578 - DEBUG - Response Code: 404
2026-06-22 05:54:17,578 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:54:17,584 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:54:17,597 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:54:17,722 - INFO - Validated that VN ctest-vn1-22346836 is not found in API Server
2026-06-22 05:54:17,731 - DEBUG - VN ctest-vn1-22346836 is not present in Agent 10.0.0.249
2026-06-22 05:54:17,741 - DEBUG - VN ctest-vn1-22346836 is not present in Agent 10.0.0.22
2026-06-22 05:54:17,741 - INFO - Validated that VN ctest-vn1-22346836 is not in any agent
2026-06-22 05:54:17,770 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-22346836 info
2026-06-22 05:54:17,770 - INFO - Deleting VN ctest-fvn-63259532
2026-06-22 05:54:17,951 - DEBUG - Response for deleting network ()
2026-06-22 05:54:17,951 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9977e71e-3dbd-4588-91e3-b6ad66c4abc9
2026-06-22 05:54:17,957 - DEBUG - Response Code: 404
2026-06-22 05:54:17,957 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-06-22 05:54:17,963 - DEBUG - Requesting: http://10.0.0.38:8082/domain/60eaa01a-5eb5-4d13-b4b0-03e5337f378e
2026-06-22 05:54:17,977 - DEBUG - Requesting: http://10.0.0.38:8082/project/66286a0d-aa33-4bee-9024-c64e28d5a131
2026-06-22 05:54:18,078 - INFO - Validated that VN ctest-fvn-63259532 is not found in API Server
2026-06-22 05:54:18,089 - DEBUG - VN ctest-fvn-63259532 is not present in Agent 10.0.0.249
2026-06-22 05:54:18,099 - DEBUG - VN ctest-fvn-63259532 is not present in Agent 10.0.0.22
2026-06-22 05:54:18,099 - INFO - Validated that VN ctest-fvn-63259532 is not in any agent
2026-06-22 05:54:18,141 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-63259532 info
2026-06-22 05:54:19,415 - DEBUG - No XMPP flaps were noticed during the test
2026-06-22 05:54:19,415 - INFO - END TEST : test_floating_ip : PASSED[0:00:40]
2026-06-22 05:54:19,415 - INFO - --------------------------------------------------------------------------------
2026-06-22 05:54:20,279 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-41102345, ID : 66286a0d-aa33-4bee-9024-c64e28d5a131