2026-03-19 06:12:47,821 - INFO - Domain Default found not creating
2026-03-19 06:12:48,009 - INFO - Project ctest-FloatingipBasicTestSanity-70385639 not found, creating it
2026-03-19 06:12:48,658 - INFO - Created Project:ctest-FloatingipBasicTestSanity-70385639, ID : bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:12:50,377 - INFO - Using existing project ['default-domain', 'admin'](8eb0032c-b3be-40b7-9886-589a72215f96)
2026-03-19 06:12:51,213 - INFO - Adding rules to the default security group in Project admin
2026-03-19 06:12:51,568 - INFO - ================================================================================
2026-03-19 06:12:51,569 - INFO - STARTING TEST : test_floating_ip
2026-03-19 06:12:51,569 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN.
2026-03-19 06:12:52,247 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.14': '0', '10.20.0.254': '0'}, '10.0.0.22': {'10.20.0.254': '0', '10.20.0.17': '0'}} with
2026-03-19 06:12:52,248 - INFO - Initial checks done. Running the testcase now
2026-03-19 06:12:52,248 - INFO -
2026-03-19 06:12:52,280 - DEBUG - Services list from nova: [, , , ]
2026-03-19 06:12:52,280 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5495-2', 'an-jenkins-deploy-platform-ansible-os-5495-1']}
2026-03-19 06:12:53,137 - DEBUG - Response for create_network : {'network': {'id': '0d56b6ac-6941-4c55-84fb-afff2d1c4ef7', 'name': 'ctest-fvn-77771409', 'tenant_id': 'bdab330f7b2c480eb984502bc3b17c98', 'project_id': 'bdab330f7b2c480eb984502bc3b17c98', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-70385639', 'ctest-fvn-77771409'], 'port_security_enabled': True, 'description': ''}}
2026-03-19 06:12:53,465 - DEBUG - Response for create_subnet : {'subnet': {'id': '2ef28259-6e8d-491d-926c-ef5968ae9f08', 'name': '', 'tenant_id': 'bdab330f7b2c480eb984502bc3b17c98', 'network_id': '0d56b6ac-6941-4c55-84fb-afff2d1c4ef7', 'ip_version': 4, 'cidr': '159.112.21.192/26', 'allocation_pools': [{'start': '159.112.21.194', 'end': '159.112.21.254'}], 'gateway_ip': '159.112.21.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '159.112.21.194', 'tags': [], 'project_id': 'bdab330f7b2c480eb984502bc3b17c98'}}
2026-03-19 06:12:53,494 - INFO - Created VN ctest-fvn-77771409
2026-03-19 06:12:53,509 - DEBUG - VN ctest-fvn-77771409 UUID is 0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:53,611 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:12:53,916 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:12:53,949 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:12:53,969 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:12:54,093 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:54,109 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:54,121 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/738dea04-70fe-4245-83ff-150bf0c04d5c
2026-03-19 06:12:54,132 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/738dea04-70fe-4245-83ff-150bf0c04d5c
2026-03-19 06:12:54,140 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/b5c728f5-be55-441d-90f2-dcabd34b7c71
2026-03-19 06:12:54,148 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-19 06:12:54,148 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:54,158 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/738dea04-70fe-4245-83ff-150bf0c04d5c
2026-03-19 06:12:54,179 - INFO - Verified VN network id 6 for VN 0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:54,179 - INFO - Verifications in API Server for VN ctest-fvn-77771409 passed
2026-03-19 06:12:54,179 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:54,190 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/738dea04-70fe-4245-83ff-150bf0c04d5c
2026-03-19 06:12:54,200 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/738dea04-70fe-4245-83ff-150bf0c04d5c
2026-03-19 06:12:54,210 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/b5c728f5-be55-441d-90f2-dcabd34b7c71
2026-03-19 06:12:54,224 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-70385639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '961156422106696789', 'uuid-lslong': '9582446142669213431'}, 'enable': 'true', 'created': '2026-03-19T06:12:53', 'last-modified': '2026-03-19T06:12:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.828927'}
2026-03-19 06:12:54,234 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-19 06:12:54,241 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-70385639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '961156422106696789', 'uuid-lslong': '9582446142669213431'}, 'enable': 'true', 'created': '2026-03-19T06:12:53', 'last-modified': '2026-03-19T06:12:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.845019'}
2026-03-19 06:12:54,252 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-19 06:12:54,259 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-70385639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '961156422106696789', 'uuid-lslong': '9582446142669213431'}, 'enable': 'true', 'created': '2026-03-19T06:12:53', 'last-modified': '2026-03-19T06:12:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.873871'}
2026-03-19 06:12:54,267 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-19 06:12:54,268 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-77771409 passed
2026-03-19 06:12:54,268 - DEBUG - ====Verifying policy data for ctest-fvn-77771409 in API_Server ======
2026-03-19 06:12:54,268 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:12:54,276 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:12:54,290 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:12:54,410 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:12:54,422 - DEBUG - =>VN ctest-fvn-77771409 has no policy to be verified
2026-03-19 06:12:54,422 - DEBUG - Verifying the vn in opserver
2026-03-19 06:12:54,422 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409 virtual network link through opserver 10.0.0.38
2026-03-19 06:12:54,422 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-03-19 06:12:54,722 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-03-19 06:12:54,789 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409?flat'}
2026-03-19 06:12:54,789 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409 virtual network link through opserver 10.0.0.50
2026-03-19 06:12:54,789 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-03-19 06:12:55,090 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-03-19 06:12:55,170 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409?flat'}
2026-03-19 06:12:55,170 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409 virtual network link through opserver 10.0.0.33
2026-03-19 06:12:55,170 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-03-19 06:12:55,473 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-03-19 06:12:55,539 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409?flat'}
2026-03-19 06:12:55,540 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409 is found in opserver
2026-03-19 06:12:55,565 - DEBUG - Do not have enough data to verify VN in agent
2026-03-19 06:12:55,576 - DEBUG - VRF ids for VN ctest-fvn-77771409: {}
2026-03-19 06:12:56,025 - DEBUG - Response for create_network : {'network': {'id': '9220903d-d08b-4d72-844b-b8f1cfff06b3', 'name': 'ctest-vn1-81882196', 'tenant_id': 'bdab330f7b2c480eb984502bc3b17c98', 'project_id': 'bdab330f7b2c480eb984502bc3b17c98', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-70385639', 'ctest-vn1-81882196'], 'port_security_enabled': True, 'description': ''}}
2026-03-19 06:12:56,355 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ca0da53e-70ae-48b1-8f82-4053e6a8843c', 'name': '', 'tenant_id': 'bdab330f7b2c480eb984502bc3b17c98', 'network_id': '9220903d-d08b-4d72-844b-b8f1cfff06b3', 'ip_version': 4, 'cidr': '16.53.133.128/26', 'allocation_pools': [{'start': '16.53.133.130', 'end': '16.53.133.190'}], 'gateway_ip': '16.53.133.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '16.53.133.130', 'tags': [], 'project_id': 'bdab330f7b2c480eb984502bc3b17c98'}}
2026-03-19 06:12:56,390 - INFO - Created VN ctest-vn1-81882196
2026-03-19 06:12:56,408 - DEBUG - VN ctest-vn1-81882196 UUID is 9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,498 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:12:56,507 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:12:56,520 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:12:56,640 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,659 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,674 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1e807fd-a155-4918-987f-fc002242f878
2026-03-19 06:12:56,685 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1e807fd-a155-4918-987f-fc002242f878
2026-03-19 06:12:56,695 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/90ea0ee2-dcd3-4222-9dd8-b3868544029b
2026-03-19 06:12:56,704 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-19 06:12:56,704 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,714 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1e807fd-a155-4918-987f-fc002242f878
2026-03-19 06:12:56,736 - INFO - Verified VN network id 7 for VN 9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,736 - INFO - Verifications in API Server for VN ctest-vn1-81882196 passed
2026-03-19 06:12:56,736 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,751 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1e807fd-a155-4918-987f-fc002242f878
2026-03-19 06:12:56,761 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1e807fd-a155-4918-987f-fc002242f878
2026-03-19 06:12:56,773 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/90ea0ee2-dcd3-4222-9dd8-b3868544029b
2026-03-19 06:12:56,792 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-70385639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10529574523958414706', 'uuid-lslong': '9532916384976012979'}, 'enable': 'true', 'created': '2026-03-19T06:12:55', 'last-modified': '2026-03-19T06:12:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.519539'}
2026-03-19 06:12:56,800 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-19 06:12:56,813 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-70385639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10529574523958414706', 'uuid-lslong': '9532916384976012979'}, 'enable': 'true', 'created': '2026-03-19T06:12:55', 'last-modified': '2026-03-19T06:12:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.539362'}
2026-03-19 06:12:56,820 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-19 06:12:56,827 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-70385639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10529574523958414706', 'uuid-lslong': '9532916384976012979'}, 'enable': 'true', 'created': '2026-03-19T06:12:55', 'last-modified': '2026-03-19T06:12:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.552801'}
2026-03-19 06:12:56,834 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-19 06:12:56,834 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-81882196 passed
2026-03-19 06:12:56,834 - DEBUG - ====Verifying policy data for ctest-vn1-81882196 in API_Server ======
2026-03-19 06:12:56,834 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:12:56,842 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:12:56,858 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:12:56,980 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9220903d-d08b-4d72-844b-b8f1cfff06b3
2026-03-19 06:12:56,990 - DEBUG - =>VN ctest-vn1-81882196 has no policy to be verified
2026-03-19 06:12:56,990 - DEBUG - Verifying the vn in opserver
2026-03-19 06:12:56,990 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196 virtual network link through opserver 10.0.0.38
2026-03-19 06:12:56,991 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-03-19 06:12:57,062 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196?flat'}
2026-03-19 06:12:57,062 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196 virtual network link through opserver 10.0.0.50
2026-03-19 06:12:57,062 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-03-19 06:12:57,135 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196?flat'}
2026-03-19 06:12:57,136 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196 virtual network link through opserver 10.0.0.33
2026-03-19 06:12:57,136 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-03-19 06:12:57,214 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196?flat'}
2026-03-19 06:12:57,214 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196 is found in opserver
2026-03-19 06:12:57,245 - DEBUG - Do not have enough data to verify VN in agent
2026-03-19 06:12:57,260 - DEBUG - VRF ids for VN ctest-vn1-81882196: {}
2026-03-19 06:12:58,426 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5495-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5495-2)
2026-03-19 06:13:00,188 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5495-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5495-1)
2026-03-19 06:13:00,370 - INFO - Creating Floating IP pool ctest-some-pool-28914825 in API Server
2026-03-19 06:13:00,596 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:13:00,610 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:13:00,631 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:13:00,770 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:13:00,809 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip-pool/b877539a-c0e0-415e-a620-5c688e5448bd
2026-03-19 06:13:00,827 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:13:00,838 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:13:00,861 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:13:00,976 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d56b6ac-6941-4c55-84fb-afff2d1c4ef7
2026-03-19 06:13:01,000 - DEBUG - FIP Pool ctest-some-pool-28914825 found in API Server
2026-03-19 06:13:01,001 - INFO - Verification for FIP pool ctest-some-pool-28914825 in API Server passed
2026-03-19 06:13:01,025 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-28914825 information
2026-03-19 06:13:01,032 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-28914825 information
2026-03-19 06:13:01,040 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-28914825 information
2026-03-19 06:13:01,040 - INFO - Verification for FIP pool ctest-some-pool-28914825 in Control-node passed
2026-03-19 06:13:01,040 - INFO - Waiting for VM ctest-vn1_vm1_name-42012180 to be up..
2026-03-19 06:13:01,161 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-19 06:13:06,329 - DEBUG - VM is in ACTIVE state now
2026-03-19 06:13:06,329 - INFO - VM name : ctest-vn1_vm1_name-42012180
2026-03-19 06:13:06,456 - DEBUG - VM ctest-vn1_vm1_name-42012180 ID is 8cee0ecb-4103-4620-84b1-d30cbcf9d3a2
2026-03-19 06:13:06,493 - DEBUG - VM ctest-vn1_vm1_name-42012180 launched on Node an-jenkins-deploy-platform-ansible-os-5495-2
2026-03-19 06:13:06,619 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cee0ecb-4103-4620-84b1-d30cbcf9d3a2
2026-03-19 06:13:06,944 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cee0ecb-4103-4620-84b1-d30cbcf9d3a2
2026-03-19 06:13:06,986 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/475e9dfd-a9db-4324-b31f-b5b39f6ebd0c
2026-03-19 06:13:10,200 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms')
2026-03-19 06:13:10,200 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-42012180 failed!
2026-03-19 06:13:10,223 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-vn1-81882196 is 16.53.133.129 and allocation pool is NOT set
2026-03-19 06:13:12,245 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.505 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.505/2.242/3.979/1.737 ms')
2026-03-19 06:13:12,245 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-42012180 passed
2026-03-19 06:13:12,368 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 06:13:12,368 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-42012180, IP 16.53.133.131, Port 22
2026-03-19 06:13:12,397 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-19 06:13:12,538 - DEBUG - VM ctest-vn1_vm1_name-42012180 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-19 06:13:17,539 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 06:13:17,539 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-42012180, IP 16.53.133.131, Port 22
2026-03-19 06:13:17,627 - DEBUG - VM ctest-vn1_vm1_name-42012180 is ready for SSH connections
2026-03-19 06:13:17,873 - DEBUG - Created Floating IP : ('159.112.21.196', '06bc18ac-5cc7-4a2a-9487-a3286fb93fac')
2026-03-19 06:13:17,873 - DEBUG - Associating FIP 159.112.21.196 to 8cee0ecb-4103-4620-84b1-d30cbcf9d3a2
2026-03-19 06:13:17,917 - DEBUG - Associating FIP ID 06bc18ac-5cc7-4a2a-9487-a3286fb93fac with Port ID 475e9dfd-a9db-4324-b31f-b5b39f6ebd0c
2026-03-19 06:13:18,028 - INFO - Waiting for VM ctest-fvn_vm1_name-72228640 to be up..
2026-03-19 06:13:18,147 - DEBUG - VM is in ACTIVE state now
2026-03-19 06:13:18,147 - INFO - VM name : ctest-fvn_vm1_name-72228640
2026-03-19 06:13:18,245 - DEBUG - VM ctest-fvn_vm1_name-72228640 ID is 9984fd98-240a-4228-8ab7-5fb1446d51b4
2026-03-19 06:13:18,245 - DEBUG - VM ctest-fvn_vm1_name-72228640 launched on Node an-jenkins-deploy-platform-ansible-os-5495-1
2026-03-19 06:13:18,347 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/9984fd98-240a-4228-8ab7-5fb1446d51b4
2026-03-19 06:13:18,359 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/d8b796a6-7a68-44c3-b432-64ac22a7b122
2026-03-19 06:13:19,532 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.03 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.445 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.445/2.736/5.028/2.291 ms')
2026-03-19 06:13:19,533 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-72228640 passed
2026-03-19 06:13:19,656 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 06:13:19,656 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-72228640, IP 159.112.21.195, Port 22
2026-03-19 06:13:19,741 - DEBUG - VM ctest-fvn_vm1_name-72228640 is ready for SSH connections
2026-03-19 06:13:19,930 - INFO - Route for FIP 159.112.21.196 is fine on Control-node 10.0.0.33
2026-03-19 06:13:19,941 - INFO - Route for FIP 159.112.21.196 is fine on Control-node 10.0.0.50
2026-03-19 06:13:19,949 - INFO - Route for FIP 159.112.21.196 is fine on Control-node 10.0.0.38
2026-03-19 06:13:19,949 - INFO - FIP 159.112.21.196 verification for passed on all Control-nodes
2026-03-19 06:13:19,950 - INFO - FIP ID 06bc18ac-5cc7-4a2a-9487-a3286fb93fac(159.112.21.196) validation in Control node passed
2026-03-19 06:13:19,973 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.25', 'dip': '10.20.0.193', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:d2:c1:7c'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '25', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.14', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409'], 'unresolved': 'false', 'sg_list': ['8000003'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-03-19 06:13:19,973 - DEBUG - Route for FIP IP 159.112.21.196 is present in agent 10.0.0.249
2026-03-19 06:13:19,973 - DEBUG - FIP 159.112.21.196 verification for VM ctest-vn1_vm1_name-42012180 in Agent 10.0.0.249 passed
2026-03-19 06:13:19,994 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '14', 'valid': 'true', 'policy': 'enabled', 'itf': 'tap475e9dfd-a9', 'mac': ['2:47:5e:9d:fd:a9'], 'mcast': 'disabled', 'nh_index': '31', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.17', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-70385639:ctest-fvn-77771409'], 'unresolved': 'false', 'sg_list': ['8000003'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-03-19 06:13:19,994 - DEBUG - Route for FIP IP 159.112.21.196 is present in agent 10.0.0.22
2026-03-19 06:13:19,994 - DEBUG - FIP 159.112.21.196 verification for VM ctest-vn1_vm1_name-42012180 in Agent 10.0.0.22 passed
2026-03-19 06:13:19,994 - INFO - FIP ID 06bc18ac-5cc7-4a2a-9487-a3286fb93fac(159.112.21.196) validation in agents passed
2026-03-19 06:13:19,994 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip/06bc18ac-5cc7-4a2a-9487-a3286fb93fac
2026-03-19 06:13:20,007 - DEBUG - FIP 06bc18ac-5cc7-4a2a-9487-a3286fb93fac is present in API server
2026-03-19 06:13:20,007 - INFO - FIP ID 06bc18ac-5cc7-4a2a-9487-a3286fb93fac(159.112.21.196) validation in API Server passed
2026-03-19 06:13:20,007 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-19 06:13:20,007 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 159.112.21.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-03-19 06:13:20,007 - DEBUG - ping -s 56 -c 3 -W 1 159.112.21.195
2026-03-19 06:13:23,051 - DEBUG - PING 159.112.21.195 (159.112.21.195): 56 data bytes
64 bytes from 159.112.21.195: seq=0 ttl=64 time=8.032 ms
64 bytes from 159.112.21.195: seq=1 ttl=64 time=1.330 ms
64 bytes from 159.112.21.195: seq=2 ttl=64 time=2.192 ms
--- 159.112.21.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.330/3.851/8.032 ms
2026-03-19 06:13:23,051 - INFO - Ping to IP 159.112.21.195 from VM ctest-vn1_vm1_name-42012180 passed
2026-03-19 06:13:23,051 - DEBUG - Disassociating port from FIP ID : 06bc18ac-5cc7-4a2a-9487-a3286fb93fac
2026-03-19 06:13:23,166 - DEBUG - Deleting FIP ID 06bc18ac-5cc7-4a2a-9487-a3286fb93fac
2026-03-19 06:13:23,288 - INFO - Deleting the FIP pool ctest-some-pool-28914825
2026-03-19 06:13:23,423 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-28914825 information
2026-03-19 06:13:23,429 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-28914825 information
2026-03-19 06:13:23,435 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-28914825 information
2026-03-19 06:13:23,435 - INFO - Deleting VM ctest-fvn_vm1_name-72228640
2026-03-19 06:13:23,525 - INFO - Deleting VM ctest-vn1_vm1_name-42012180
2026-03-19 06:13:23,618 - INFO - Deleting VN ctest-vn1-81882196
2026-03-19 06:13:23,673 - DEBUG - VN 9220903d-d08b-4d72-844b-b8f1cfff06b3 still in use: Unable to complete operation on network 9220903d-d08b-4d72-844b-b8f1cfff06b3. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-638b2dfe-4f85-4942-ae40-5877a5b70f3c']
2026-03-19 06:13:23,673 - WARNING - Deleting VN ctest-vn1-81882196 failed..Will retry
2026-03-19 06:13:25,863 - DEBUG - Response for deleting network ()
2026-03-19 06:13:25,864 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1e807fd-a155-4918-987f-fc002242f878
2026-03-19 06:13:25,872 - DEBUG - Response Code: 404
2026-03-19 06:13:25,872 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:13:25,881 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:13:25,949 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:13:26,057 - INFO - Validated that VN ctest-vn1-81882196 is not found in API Server
2026-03-19 06:13:26,071 - DEBUG - VN ctest-vn1-81882196 is not present in Agent 10.0.0.249
2026-03-19 06:13:26,083 - DEBUG - VN ctest-vn1-81882196 is not present in Agent 10.0.0.22
2026-03-19 06:13:26,083 - INFO - Validated that VN ctest-vn1-81882196 is not in any agent
2026-03-19 06:13:26,120 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-81882196 info
2026-03-19 06:13:26,121 - INFO - Deleting VN ctest-fvn-77771409
2026-03-19 06:13:26,363 - DEBUG - Response for deleting network ()
2026-03-19 06:13:26,364 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/738dea04-70fe-4245-83ff-150bf0c04d5c
2026-03-19 06:13:26,372 - DEBUG - Response Code: 404
2026-03-19 06:13:26,372 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-03-19 06:13:26,378 - DEBUG - Requesting: http://10.0.0.38:8082/domain/2f64fd01-c025-4a27-8d93-5364b6aae213
2026-03-19 06:13:26,392 - DEBUG - Requesting: http://10.0.0.38:8082/project/bdab330f-7b2c-480e-b984-502bc3b17c98
2026-03-19 06:13:26,501 - INFO - Validated that VN ctest-fvn-77771409 is not found in API Server
2026-03-19 06:13:26,520 - DEBUG - VN ctest-fvn-77771409 is not present in Agent 10.0.0.249
2026-03-19 06:13:26,540 - DEBUG - VN ctest-fvn-77771409 is not present in Agent 10.0.0.22
2026-03-19 06:13:26,540 - INFO - Validated that VN ctest-fvn-77771409 is not in any agent
2026-03-19 06:13:26,578 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-77771409 info
2026-03-19 06:13:27,877 - DEBUG - No XMPP flaps were noticed during the test
2026-03-19 06:13:27,877 - INFO - END TEST : test_floating_ip : PASSED[0:00:36]
2026-03-19 06:13:27,878 - INFO - --------------------------------------------------------------------------------
2026-03-19 06:13:28,737 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-70385639, ID : bdab330f-7b2c-480e-b984-502bc3b17c98