2025-10-16 16:35:17,433 - INFO - Domain Default found not creating 2025-10-16 16:35:17,622 - INFO - Project ctest-FloatingipBasicTestSanity-31437469 not found, creating it 2025-10-16 16:35:18,143 - INFO - Created Project:ctest-FloatingipBasicTestSanity-31437469, ID : 4694c19a-df62-4e8d-a30e-c9b8c08b8669 2025-10-16 16:35:19,774 - INFO - Using existing project ['default-domain', 'admin'](ae9bdf26-11c0-4b68-9f32-15ebd586711c) 2025-10-16 16:35:20,619 - INFO - Adding rules to the default security group in Project admin 2025-10-16 16:35:20,977 - INFO - ================================================================================ 2025-10-16 16:35:20,977 - INFO - STARTING TEST : test_floating_ip 2025-10-16 16:35:20,977 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN. 2025-10-16 16:35:21,122 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.17': '0'}} with 2025-10-16 16:35:21,122 - INFO - Initial checks done. Running the testcase now 2025-10-16 16:35:21,122 - INFO - 2025-10-16 16:35:21,150 - DEBUG - Services list from nova: [, , ] 2025-10-16 16:35:21,150 - DEBUG - Hosts: {'nova': ['cn-jenkins-deploy-platform-ansible-os-4347-1']} 2025-10-16 16:35:21,906 - DEBUG - Response for create_network : {'network': {'id': '2b183da7-059a-4401-9b4b-8153f66deccd', 'name': 'ctest-fvn-31502687', 'tenant_id': '4694c19adf624e8da30ec9b8c08b8669', 'project_id': '4694c19adf624e8da30ec9b8c08b8669', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-31437469', 'ctest-fvn-31502687'], 'port_security_enabled': True, 'description': ''}} 2025-10-16 16:35:22,118 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c54d540e-4f78-42c8-9bfa-215157aeef9a', 'name': '', 'tenant_id': '4694c19adf624e8da30ec9b8c08b8669', 'network_id': '2b183da7-059a-4401-9b4b-8153f66deccd', 'ip_version': 4, 'cidr': '13.241.245.128/26', 'allocation_pools': [{'start': '13.241.245.130', 'end': '13.241.245.190'}], 'gateway_ip': '13.241.245.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.241.245.130', 'tags': [], 'project_id': '4694c19adf624e8da30ec9b8c08b8669'}} 2025-10-16 16:35:22,143 - INFO - Created VN ctest-fvn-31502687 2025-10-16 16:35:22,199 - DEBUG - VN ctest-fvn-31502687 UUID is 2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:22,335 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-10-16 16:35:22,642 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-10-16 16:35:22,678 - DEBUG - Requesting: http://10.0.0.141:8082/domain/1668739b-5fe2-4541-997a-8b143dd79dd2 2025-10-16 16:35:22,696 - DEBUG - Requesting: http://10.0.0.141:8082/project/4694c19a-df62-4e8d-a30e-c9b8c08b8669 2025-10-16 16:35:22,779 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:22,795 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:22,807 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b9eb790f-86d1-4230-a473-696f37b6f414 2025-10-16 16:35:22,816 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b9eb790f-86d1-4230-a473-696f37b6f414 2025-10-16 16:35:22,825 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/9583971f-d425-4022-ace8-909472373216 2025-10-16 16:35:22,834 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 16:35:22,834 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:22,845 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b9eb790f-86d1-4230-a473-696f37b6f414 2025-10-16 16:35:22,864 - INFO - Verified VN network id 6 for VN 2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:22,864 - INFO - Verifications in API Server for VN ctest-fvn-31502687 passed 2025-10-16 16:35:22,864 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:22,876 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b9eb790f-86d1-4230-a473-696f37b6f414 2025-10-16 16:35:22,886 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b9eb790f-86d1-4230-a473-696f37b6f414 2025-10-16 16:35:22,897 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/9583971f-d425-4022-ace8-909472373216 2025-10-16 16:35:22,915 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-31437469:ctest-fvn-31502687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-31437469', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3105299730634785793', 'uuid-lslong': '11190179896748797133'}, 'enable': 'true', 'created': '2025-10-16T16:35:21', 'last-modified': '2025-10-16T16:35:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.840535'} 2025-10-16 16:35:22,924 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-16 16:35:22,925 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-31502687 passed 2025-10-16 16:35:22,925 - DEBUG - ====Verifying policy data for ctest-fvn-31502687 in API_Server ====== 2025-10-16 16:35:22,925 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-10-16 16:35:22,934 - DEBUG - Requesting: http://10.0.0.141:8082/domain/1668739b-5fe2-4541-997a-8b143dd79dd2 2025-10-16 16:35:22,947 - DEBUG - Requesting: http://10.0.0.141:8082/project/4694c19a-df62-4e8d-a30e-c9b8c08b8669 2025-10-16 16:35:23,032 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/2b183da7-059a-4401-9b4b-8153f66deccd 2025-10-16 16:35:23,047 - DEBUG - =>VN ctest-fvn-31502687 has no policy to be verified 2025-10-16 16:35:23,047 - DEBUG - Verifying the vn in opserver 2025-10-16 16:35:23,047 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-31437469:ctest-fvn-31502687 virtual network link through opserver 10.0.0.141 2025-10-16 16:35:23,047 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-10-16 16:35:23,347 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2025-10-16 16:35:23,440 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-31437469:ctest-fvn-31502687', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-31437469:ctest-fvn-31502687?flat'} 2025-10-16 16:35:23,440 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-31437469:ctest-fvn-31502687 is found in opserver 2025-10-16 16:35:23,455 - DEBUG - Do not have enough data to verify VN in agent 2025-10-16 16:35:23,463 - DEBUG - VRF ids for VN ctest-fvn-31502687: {} 2025-10-16 16:35:23,694 - ERROR - Some exception while doing Neutron net-list Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present net_rsp = self.obj.list_networks(**query_dict)['networks'] File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks return self.list('networks', self.networks_path, retrieve_all, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list for r in self._pagination(collection, path, **params): File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination res = self.get(path, params=params) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get return self.retry_request("GET", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a'] 2025-10-16 16:35:23,695 - ERROR - Got exception as "The server has either erred or is incapable of performing the requested operation.

\n\n\n\nNeutron server returns request_ids: ['req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a']" while creating ctest-vn1-01547114 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present net_rsp = self.obj.list_networks(**query_dict)['networks'] File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks return self.list('networks', self.networks_path, retrieve_all, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list for r in self._pagination(collection, path, **params): File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination res = self.get(path, params=params) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get return self.retry_request("GET", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a'] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/fixtures/vn_test.py", line 295, in _create_vn_orch self.obj = self.orchestrator.get_vn_obj_if_present(self.vn_name, File "/contrail-test/fixtures/openstack.py", line 184, in get_vn_obj_if_present return self.quantum_h.get_vn_obj_if_present(vn_name, **kwargs) File "/contrail-test/fixtures/quantum_test.py", line 282, in get_vn_obj_if_present raise NetworkClientException(message=str(e)) quantum_test.NetworkClientException: "The server has either erred or is incapable of performing the requested operation.

\n\n\n\nNeutron server returns request_ids: ['req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a']" 2025-10-16 16:35:23,701 - INFO - Deleting VN ctest-fvn-31502687 2025-10-16 16:35:23,870 - DEBUG - Response for deleting network () 2025-10-16 16:35:23,871 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b9eb790f-86d1-4230-a473-696f37b6f414 2025-10-16 16:35:23,879 - DEBUG - Response Code: 404 2025-10-16 16:35:23,879 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2025-10-16 16:35:23,889 - DEBUG - Requesting: http://10.0.0.141:8082/domain/1668739b-5fe2-4541-997a-8b143dd79dd2 2025-10-16 16:35:23,950 - DEBUG - Requesting: http://10.0.0.141:8082/project/4694c19a-df62-4e8d-a30e-c9b8c08b8669 2025-10-16 16:35:24,032 - INFO - Validated that VN ctest-fvn-31502687 is not found in API Server 2025-10-16 16:35:24,043 - DEBUG - VN ctest-fvn-31502687 is not present in Agent 10.0.0.141 2025-10-16 16:35:24,043 - INFO - Validated that VN ctest-fvn-31502687 is not in any agent 2025-10-16 16:35:24,061 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-31502687 info 2025-10-16 16:35:24,200 - ERROR - NetworkClientException Python 3.9.21: /usr/bin/python3 Thu Oct 16 16:35:23 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/floatingip/test_floatingip_basic.py in test_floating_ip(self=) 58 assert fvn_fixture.verify_on_setup() 59 60 vn1_fixture = self.useFixture( 61 VNFixture( 62 project_name=self.inputs.project_name, vn1_fixture undefined self = self.useFixture = > global VNFixture = project_name undefined self.inputs = self.inputs.project_name = 'ctest-FloatingipBasicTestSanity-31437469' connections undefined self.connections = inputs undefined vn_name undefined vn1_name = 'ctest-vn1-01547114' subnets undefined vn1_subnets = ['121.82.13.192/26'] orch undefined self.orchestrator = /usr/local/lib/python3.9/site-packages/testtools/testcase.py in useFixture(self=, fixture=) 754 # Gather_details worked, so raise the exception setUp 755 # encountered. 756 reraise(*exc_info) 757 else: 758 self.addCleanup(fixture.cleanUp) global reraise = exc_info = (, NetworkClientException(), ) /usr/local/lib/python3.9/site-packages/testtools/_compat3x.py in reraise(exc_class=, exc_obj=NetworkClientException(), exc_tb=, _marker=) 13 14 def reraise(exc_class, exc_obj, exc_tb, _marker=object()): 15 """Re-raise an exception received from sys.exc_info() or similar.""" 16 raise exc_obj.with_traceback(exc_tb) 17 exc_obj = NetworkClientException() exc_obj.with_traceback = exc_tb = /usr/local/lib/python3.9/site-packages/testtools/testcase.py in useFixture(self=, fixture=) 729 """ 730 try: 731 fixture.setUp() 732 except MultipleExceptions as e: 733 if (fixtures is not None and fixture = fixture.setUp = > /contrail-test/fixtures/vn_test.py in setUp(self=) 437 def setUp(self): 438 super(VNFixture, self).setUp() 439 self.create() 440 441 def create(self): self = self.create = > /contrail-test/fixtures/vn_test.py in create(self=) 450 self._create_vn_api(self.vn_name, self.project_obj) 451 else: 452 self._create_vn_orch() 453 if not self.obj: 454 self.logger.debug('VN %s not present' % (self.vn_name)) self = self._create_vn_orch = > /contrail-test/fixtures/vn_test.py in _create_vn_orch(self=) 335 if '503' in str(e) or '504' in str(e): 336 return False 337 raise NetworkClientException(message=str(e)) 338 339 def get_vn_list_in_project(self, project_uuid): global NetworkClientException = message undefined builtinstr = e undefined NetworkClientException: '"The server has either erred or is incapable of performing the requested operation.

\\n\\n\\n\\nNeutron server returns request_ids: [\'req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a\']"' __cause__ = None __class__ = __context__ = NetworkClientException() __delattr__ = __dict__ = {'_error_string': '"The server has either erred or is incapable of ...ds: [\'req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a\']"', 'message': '"The server has either erred or is incapable of ...ds: [\'req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a\']"', 'request_ids': None, 'status_code': 0} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'quantum_test' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _error_string = '"The server has either erred or is incapable of ...ds: [\'req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a\']"' args = () message = '"The server has either erred or is incapable of ...ds: [\'req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a\']"' req_ids_msg = 'Neutron server returns request_ids: %s' request_ids = None status_code = 0 with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present net_rsp = self.obj.list_networks(**query_dict)['networks'] File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks return self.list('networks', self.networks_path, retrieve_all, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list for r in self._pagination(collection, path, **params): File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination res = self.get(path, params=params) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get return self.retry_request("GET", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a'] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/fixtures/vn_test.py", line 295, in _create_vn_orch self.obj = self.orchestrator.get_vn_obj_if_present(self.vn_name, File "/contrail-test/fixtures/openstack.py", line 184, in get_vn_obj_if_present return self.quantum_h.get_vn_obj_if_present(vn_name, **kwargs) File "/contrail-test/fixtures/quantum_test.py", line 282, in get_vn_obj_if_present raise NetworkClientException(message=str(e)) quantum_test.NetworkClientException: "The server has either erred or is incapable of performing the requested operation.

\n\n\n\nNeutron server returns request_ids: ['req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a']" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/floatingip/test_floatingip_basic.py", line 60, in test_floating_ip vn1_fixture = self.useFixture( File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 756, in useFixture reraise(*exc_info) File "/usr/local/lib/python3.9/site-packages/testtools/_compat3x.py", line 16, in reraise raise exc_obj.with_traceback(exc_tb) File "/usr/local/lib/python3.9/site-packages/testtools/testcase.py", line 731, in useFixture fixture.setUp() File "/contrail-test/fixtures/vn_test.py", line 439, in setUp self.create() File "/contrail-test/fixtures/vn_test.py", line 452, in create self._create_vn_orch() File "/contrail-test/fixtures/vn_test.py", line 337, in _create_vn_orch raise NetworkClientException(message=str(e)) quantum_test.NetworkClientException: '"The server has either erred or is incapable of performing the requested operation.

\\n\\n\\n\\nNeutron server returns request_ids: [\'req-9fd50df1-a2ac-438e-a5fe-c27c68f36c9a\']"' 2025-10-16 16:35:24,208 - DEBUG - No XMPP flaps were noticed during the test 2025-10-16 16:35:24,208 - INFO -
2025-10-16 16:35:24,208 - INFO - END TEST : test_floating_ip : FAILED[0:00:04]
2025-10-16 16:35:24,208 - INFO - -------------------------------------------------------------------------------- 2025-10-16 16:35:24,928 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-31437469, ID : 4694c19a-df62-4e8d-a30e-c9b8c08b8669