2026-10-21 11:57:16,996 - INFO - Domain Default found not creating
2026-10-21 11:57:17,193 - INFO - Project ctest-TestCRUD-30147743 not found, creating it
2026-10-21 11:57:17,723 - INFO - Created Project:ctest-TestCRUD-30147743, ID : 34f8cf43-9dd4-4b4e-b248-718c3d3190e5
2026-10-21 11:57:19,559 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg1-10530100']
2026-10-21 11:57:20,541 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg2-62189124']
2026-10-21 11:57:21,678 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg1-76773354']
2026-10-21 11:57:22,472 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg2-29575350']
2026-10-21 11:57:23,248 - INFO - ================================================================================
2026-10-21 11:57:23,248 - INFO - STARTING TEST : test_network_tags_crud
2026-10-21 11:57:23,248 - INFO - TEST DESCRIPTION : Tag CRUD on a network: set/list/append/show/delete/delete-all/
filter. Regression guard for OpenSDN-io/community#124.
2026-10-21 11:57:23,519 - DEBUG - Nothing to compare xmpp stats {'10.0.0.185': {'10.20.0.17': '0'}} with
2026-10-21 11:57:23,519 - INFO - Initial checks done. Running the testcase now
2026-10-21 11:57:23,519 - INFO -
2026-10-21 11:57:23,623 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg2-29575350']
2026-10-21 11:57:23,704 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg1-76773354']
2026-10-21 11:57:23,781 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg2-62189124']
2026-10-21 11:57:23,844 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg1-10530100']
2026-10-21 11:57:24,180 - ERROR - InternalServerError
Python 3.9.25: /usr/bin/python3
Wed Oct 21 11:57:23 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/neutron/test_crud.py in test_network_tags_crud(self=)
601
602 # set (replace-all)
603 c.replace_tag('networks', net_id, {'tags': ['a', 'b']})
604 assert tags() == {'a', 'b'}, 'replace_tag did not persist'
605
c =
c.replace_tag = >
net_id = 'f3d5c7d6-c970-4a64-8fe4-9f5111d4710b'
/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in replace_tag(self=, resource_type='networks', resource_id='f3d5c7d6-c970-4a64-8fe4-9f5111d4710b', body={'tags': ['a', 'b']}, **_params={})
2096 def replace_tag(self, resource_type, resource_id, body, **_params):
2097 """Replace tags on the resource."""
2098 return self.put(self.tags_path % (resource_type, resource_id), body)
2099
2100 def remove_tag(self, resource_type, resource_id, tag, **_params):
self =
self.put = >
self.tags_path = '/%s/%s/tags'
resource_type = 'networks'
resource_id = 'f3d5c7d6-c970-4a64-8fe4-9f5111d4710b'
body = {'tags': ['a', 'b']}
/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in put(self=, action='/networks/f3d5c7d6-c970-4a64-8fe4-9f5111d4710b/tags', body={'tags': ['a', 'b']}, headers=None, params=None)
360
361 def put(self, action, body=None, headers=None, params=None):
362 return self.retry_request("PUT", action, body=body,
363 headers=headers, params=params)
364
self =
self.retry_request = >
action = '/networks/f3d5c7d6-c970-4a64-8fe4-9f5111d4710b/tags'
body = {'tags': ['a', 'b']}
headers = None
params = None
/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in retry_request(self=, method='PUT', action='/networks/f3d5c7d6-c970-4a64-8fe4-9f5111d4710b/tags', body={'tags': ['a', 'b']}, headers=None, params=None)
328 for i in range(max_attempts):
329 try:
330 return self.do_request(method, action, body=body,
331 headers=headers, params=params)
332 except (exceptions.ConnectionFailed, ksa_exc.ConnectionError):
self =
self.do_request = >
method = 'PUT'
action = '/networks/f3d5c7d6-c970-4a64-8fe4-9f5111d4710b/tags'
body = {'tags': ['a', 'b']}
headers = None
params = None
/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in do_request(self=, method='PUT', action='/v2.0/networks/f3d5c7d6-c970-4a64-8fe4-9f5111d4710b/tags', body='{"tags": ["a", "b"]}', headers=None, params=None)
292 if not replybody:
293 replybody = resp.reason
294 self._handle_fault_response(status_code, replybody, resp)
295
296 def get_auth_info(self):
self =
self._handle_fault_response = >
status_code = 500
replybody = '{"NeutronError": {"type": "HTTPInternalServerErr...r while processing your request.", "detail": ""}}'
resp =
/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in _handle_fault_response(self=, status_code=500, response_body='{"NeutronError": {"type": "HTTPInternalServerErr...r while processing your request.", "detail": ""}}', resp=)
267 error_body = self._convert_into_with_meta(des_error_body, resp)
268 # Raise the appropriate exception
269 exception_handler_v20(status_code, error_body)
270
271 def do_request(self, method, action, body=None, headers=None, params=None):
global exception_handler_v20 =
status_code = 500
error_body = {'NeutronError': {'type': 'HTTPInternalServerErr...r while processing your request.', 'detail': ''}}
/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in exception_handler_v20(status_code=500, error_content={'NeutronError': {'type': 'HTTPInternalServerErr...r while processing your request.', 'detail': ''}})
89 client_exc = exceptions.NeutronClientException
90
91 raise client_exc(message=error_message,
92 status_code=status_code,
93 request_ids=request_ids)
client_exc =
message undefined
error_message = 'Request Failed: internal server error while processing your request.'
status_code = 500
request_ids = ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']
InternalServerError: Request Failed: internal server error while processing your request.
Neutron server returns request_ids: ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {'_error_string': "Request Failed: internal server error while proc...ids: ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']", 'message': "Request Failed: internal server error while proc...ids: ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']", 'request_ids': ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8'], 'status_code': 500}
__dir__ =
__doc__ = None
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__module__ = 'neutronclient.common.exceptions'
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
__weakref__ = None
_error_string = "Request Failed: internal server error while proc...ids: ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']"
args = ()
message = "Request Failed: internal server error while proc...ids: ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']"
req_ids_msg = 'Neutron server returns request_ids: %s'
request_ids = ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']
status_code = 500
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/neutron/test_crud.py", line 603, in test_network_tags_crud
c.replace_tag('networks', net_id, {'tags': ['a', 'b']})
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 2098, in replace_tag
return self.put(self.tags_path % (resource_type, resource_id), body)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 362, in put
return self.retry_request("PUT", action, body=body,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request
return self.do_request(method, action, body=body,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20
raise client_exc(message=error_message,
neutronclient.common.exceptions.InternalServerError: Request Failed: internal server error while processing your request.
Neutron server returns request_ids: ['req-c1d54a60-9319-49f5-b6bb-b71cc409c4d8']
2026-10-21 11:57:24,187 - DEBUG - No XMPP flaps were noticed during the test
2026-10-21 11:57:24,187 - INFO -
2026-10-21 11:57:24,187 - INFO - END TEST : test_network_tags_crud : FAILED[0:00:01]
2026-10-21 11:57:24,187 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:24,196 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg1-05347028']
2026-10-21 11:57:24,971 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg2-63041659']
2026-10-21 11:57:25,675 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg1-42458733']
2026-10-21 11:57:26,415 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg2-54597559']
2026-10-21 11:57:27,103 - INFO - ================================================================================
2026-10-21 11:57:27,103 - INFO - STARTING TEST : test_router_crud
2026-10-21 11:57:27,375 - DEBUG - Nothing to compare xmpp stats {'10.0.0.185': {'10.20.0.17': '0'}} with
2026-10-21 11:57:27,375 - INFO - Initial checks done. Running the testcase now
2026-10-21 11:57:27,375 - INFO -
2026-10-21 11:57:27,376 - INFO - Router create Request {'router': {'name': 'name-65121780'}}
2026-10-21 11:57:27,462 - INFO - Router create Response : {'router': {'id': '8cce63c9-912a-4d22-80c4-d92fc7799b0f', 'name': 'name-65121780', 'tenant_id': '633bafab24fe4b8c81e831b068176796', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-65121780'], 'description': '', 'project_id': '633bafab24fe4b8c81e831b068176796'}}
2026-10-21 11:57:27,462 - INFO - Router create PASSED ,Body : {'router': {'name': 'name-65121780'}}
2026-10-21 11:57:27,478 - INFO - Attribute id is created
2026-10-21 11:57:27,478 - INFO - Attribute name is created
2026-10-21 11:57:27,479 - INFO - Attribute admin_state_up is created
2026-10-21 11:57:27,479 - INFO - Attribute status is created
2026-10-21 11:57:27,479 - INFO - Attribute tenant_id is created
2026-10-21 11:57:28,117 - INFO - Router show with fields ['name', 'admin_state_up', 'status', 'tenant_id'] passed
2026-10-21 11:57:28,118 - INFO - Router Update request {'router': {'name': 'name-29865564'}}
2026-10-21 11:57:28,158 - INFO - Router Update request PASSED,Body : {'router': {'name': 'name-29865564'}}
2026-10-21 11:57:28,158 - INFO - Response : {'router': {'id': '8cce63c9-912a-4d22-80c4-d92fc7799b0f', 'name': 'name-29865564', 'tenant_id': '633bafab24fe4b8c81e831b068176796', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-65121780'], 'description': '', 'project_id': '633bafab24fe4b8c81e831b068176796'}}
2026-10-21 11:57:28,159 - INFO - Updation of Router 8cce63c9-912a-4d22-80c4-d92fc7799b0f with body {'router': {'name': 'name-29865564'}} passed
2026-10-21 11:57:28,159 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:28,159 - INFO - Router Update request {'router': {'admin_state_up': 'False'}}
2026-10-21 11:57:28,207 - INFO - Router Update request PASSED,Body : {'router': {'admin_state_up': 'False'}}
2026-10-21 11:57:28,207 - INFO - Response : {'router': {'id': '8cce63c9-912a-4d22-80c4-d92fc7799b0f', 'name': 'name-29865564', 'tenant_id': '633bafab24fe4b8c81e831b068176796', 'admin_state_up': False, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-65121780'], 'description': '', 'project_id': '633bafab24fe4b8c81e831b068176796'}}
2026-10-21 11:57:28,207 - INFO - Updation of Router 8cce63c9-912a-4d22-80c4-d92fc7799b0f with body {'router': {'admin_state_up': 'False'}} passed
2026-10-21 11:57:28,207 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:28,207 - INFO - Deleting router 8cce63c9-912a-4d22-80c4-d92fc7799b0f
2026-10-21 11:57:28,271 - ERROR - Result of delete router 8cce63c9-912a-4d22-80c4-d92fc7799b0f: ()
2026-10-21 11:57:28,271 - INFO - ================================================================================
2026-10-21 11:57:28,272 - INFO - Router create Request {'router': {'admin_state_up': 'True', 'name': 'name-95749650'}}
2026-10-21 11:57:28,356 - INFO - Router create Response : {'router': {'id': 'b554b9fe-b295-470e-bdd3-80d3b114be8f', 'name': 'name-95749650', 'tenant_id': '633bafab24fe4b8c81e831b068176796', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-95749650'], 'description': '', 'project_id': '633bafab24fe4b8c81e831b068176796'}}
2026-10-21 11:57:28,356 - INFO - Router create PASSED ,Body : {'router': {'admin_state_up': 'True', 'name': 'name-95749650'}}
2026-10-21 11:57:28,372 - INFO - Attribute id is created
2026-10-21 11:57:28,372 - INFO - Attribute name is created
2026-10-21 11:57:28,372 - INFO - Attribute admin_state_up is created
2026-10-21 11:57:28,372 - INFO - Attribute status is created
2026-10-21 11:57:28,372 - INFO - Attribute tenant_id is created
2026-10-21 11:57:28,839 - INFO - Router show with fields ['name', 'admin_state_up', 'status', 'tenant_id'] passed
2026-10-21 11:57:28,840 - INFO - Router Update request {'router': {'name': 'name-47150460'}}
2026-10-21 11:57:28,888 - INFO - Router Update request PASSED,Body : {'router': {'name': 'name-47150460'}}
2026-10-21 11:57:28,888 - INFO - Response : {'router': {'id': 'b554b9fe-b295-470e-bdd3-80d3b114be8f', 'name': 'name-47150460', 'tenant_id': '633bafab24fe4b8c81e831b068176796', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-95749650'], 'description': '', 'project_id': '633bafab24fe4b8c81e831b068176796'}}
2026-10-21 11:57:28,888 - INFO - Updation of Router b554b9fe-b295-470e-bdd3-80d3b114be8f with body {'router': {'name': 'name-47150460'}} passed
2026-10-21 11:57:28,888 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:28,888 - INFO - Router Update request {'router': {'admin_state_up': 'True'}}
2026-10-21 11:57:28,935 - INFO - Router Update request PASSED,Body : {'router': {'admin_state_up': 'True'}}
2026-10-21 11:57:28,935 - INFO - Response : {'router': {'id': 'b554b9fe-b295-470e-bdd3-80d3b114be8f', 'name': 'name-47150460', 'tenant_id': '633bafab24fe4b8c81e831b068176796', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-95749650'], 'description': '', 'project_id': '633bafab24fe4b8c81e831b068176796'}}
2026-10-21 11:57:28,936 - INFO - Updation of Router b554b9fe-b295-470e-bdd3-80d3b114be8f with body {'router': {'admin_state_up': 'True'}} passed
2026-10-21 11:57:28,936 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:28,936 - INFO - Deleting router b554b9fe-b295-470e-bdd3-80d3b114be8f
2026-10-21 11:57:29,015 - ERROR - Result of delete router b554b9fe-b295-470e-bdd3-80d3b114be8f: ()
2026-10-21 11:57:29,015 - INFO - ================================================================================
2026-10-21 11:57:29,015 - INFO - Router create Request {'router': {'tenant_id': '34f8cf43-9dd4-4b4e-b248-718c3d3190e5', 'name': 'name-29379232'}}
2026-10-21 11:57:29,085 - INFO - Router create Response : {'router': {'id': '50b2b4a2-b887-4013-9ed5-8a78f79286b2', 'name': 'name-29379232', 'tenant_id': '34f8cf439dd44b4eb248718c3d3190e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'ctest-TestCRUD-30147743', 'name-29379232'], 'description': '', 'project_id': '34f8cf439dd44b4eb248718c3d3190e5'}}
2026-10-21 11:57:29,085 - INFO - Router create PASSED ,Body : {'router': {'tenant_id': '34f8cf43-9dd4-4b4e-b248-718c3d3190e5', 'name': 'name-29379232'}}
2026-10-21 11:57:29,100 - INFO - Attribute id is created
2026-10-21 11:57:29,100 - INFO - Attribute name is created
2026-10-21 11:57:29,100 - INFO - Attribute admin_state_up is created
2026-10-21 11:57:29,100 - INFO - Attribute status is created
2026-10-21 11:57:29,100 - INFO - Attribute tenant_id is created
2026-10-21 11:57:29,515 - INFO - Router show with fields ['name', 'admin_state_up', 'status', 'tenant_id'] passed
2026-10-21 11:57:29,516 - INFO - Router Update request {'router': {'name': 'name-95151931'}}
2026-10-21 11:57:29,555 - INFO - Router Update request PASSED,Body : {'router': {'name': 'name-95151931'}}
2026-10-21 11:57:29,555 - INFO - Response : {'router': {'id': '50b2b4a2-b887-4013-9ed5-8a78f79286b2', 'name': 'name-95151931', 'tenant_id': '34f8cf439dd44b4eb248718c3d3190e5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'ctest-TestCRUD-30147743', 'name-29379232'], 'description': '', 'project_id': '34f8cf439dd44b4eb248718c3d3190e5'}}
2026-10-21 11:57:29,555 - INFO - Updation of Router 50b2b4a2-b887-4013-9ed5-8a78f79286b2 with body {'router': {'name': 'name-95151931'}} passed
2026-10-21 11:57:29,555 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:29,555 - INFO - Router Update request {'router': {'admin_state_up': 'False'}}
2026-10-21 11:57:29,599 - INFO - Router Update request PASSED,Body : {'router': {'admin_state_up': 'False'}}
2026-10-21 11:57:29,600 - INFO - Response : {'router': {'id': '50b2b4a2-b887-4013-9ed5-8a78f79286b2', 'name': 'name-95151931', 'tenant_id': '34f8cf439dd44b4eb248718c3d3190e5', 'admin_state_up': False, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'ctest-TestCRUD-30147743', 'name-29379232'], 'description': '', 'project_id': '34f8cf439dd44b4eb248718c3d3190e5'}}
2026-10-21 11:57:29,600 - INFO - Updation of Router 50b2b4a2-b887-4013-9ed5-8a78f79286b2 with body {'router': {'admin_state_up': 'False'}} passed
2026-10-21 11:57:29,600 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:29,600 - INFO - Deleting router 50b2b4a2-b887-4013-9ed5-8a78f79286b2
2026-10-21 11:57:29,671 - ERROR - Result of delete router 50b2b4a2-b887-4013-9ed5-8a78f79286b2: ()
2026-10-21 11:57:29,671 - INFO - ================================================================================
2026-10-21 11:57:29,671 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg2-54597559']
2026-10-21 11:57:29,738 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-30147743', 'ctest-proj-sg1-42458733']
2026-10-21 11:57:29,815 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg2-63041659']
2026-10-21 11:57:29,891 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg1-05347028']
2026-10-21 11:57:30,262 - DEBUG - No XMPP flaps were noticed during the test
2026-10-21 11:57:30,262 - INFO - END TEST : test_router_crud : PASSED[0:00:03]
2026-10-21 11:57:30,262 - INFO - --------------------------------------------------------------------------------
2026-10-21 11:57:31,085 - INFO - Deleted project: ctest-TestCRUD-30147743, ID : 34f8cf43-9dd4-4b4e-b248-718c3d3190e5