2025-10-16 16:36:53,619 - INFO - Domain Default found not creating
2025-10-16 16:36:53,795 - INFO - Project ctest-TestSvcRegr-16515975 not found, creating it
2025-10-16 16:36:54,290 - INFO - Created Project:ctest-TestSvcRegr-16515975, ID : 3e3ef73d-d6c5-433e-a995-837d9fe8d12a
2025-10-16 16:36:55,804 - INFO - ================================================================================
2025-10-16 16:36:55,804 - INFO - STARTING TEST : test_svc_in_network_datapath
2025-10-16 16:36:56,064 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.17': '0'}} with
2025-10-16 16:36:56,064 - INFO - Initial checks done. Running the testcase now
2025-10-16 16:36:56,064 - INFO -
2025-10-16 16:36:56,617 - DEBUG - Response for create_network : {'network': {'id': 'f58063ce-f955-4738-b468-74d47279ac96', 'name': 'ctest-mgmt_vn-24156998', 'tenant_id': '3e3ef73dd6c5433ea995837d9fe8d12a', 'project_id': '3e3ef73dd6c5433ea995837d9fe8d12a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-16515975', 'ctest-mgmt_vn-24156998'], 'port_security_enabled': True, 'description': ''}}
2025-10-16 16:36:56,841 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b71696dc-cb66-4e78-b6be-a3035a949eeb', 'name': '', 'tenant_id': '3e3ef73dd6c5433ea995837d9fe8d12a', 'network_id': 'f58063ce-f955-4738-b468-74d47279ac96', 'ip_version': 4, 'cidr': '90.198.183.128/26', 'allocation_pools': [{'start': '90.198.183.130', 'end': '90.198.183.190'}], 'gateway_ip': '90.198.183.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '90.198.183.130', 'tags': [], 'project_id': '3e3ef73dd6c5433ea995837d9fe8d12a'}}
2025-10-16 16:36:56,859 - INFO - Created VN ctest-mgmt_vn-24156998
2025-10-16 16:36:56,911 - DEBUG - VN ctest-mgmt_vn-24156998 UUID is f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,019 - DEBUG - Requesting: http://10.0.0.141:8082/domains
2025-10-16 16:36:57,309 - DEBUG - Requesting: http://10.0.0.141:8082/domains
2025-10-16 16:36:57,339 - DEBUG - Requesting: http://10.0.0.141:8082/domain/1668739b-5fe2-4541-997a-8b143dd79dd2
2025-10-16 16:36:57,352 - DEBUG - Requesting: http://10.0.0.141:8082/project/3e3ef73d-d6c5-433e-a995-837d9fe8d12a
2025-10-16 16:36:57,452 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,467 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,481 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/7a0a0df7-361c-490a-b1b1-cdd27f171e7f
2025-10-16 16:36:57,490 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/7a0a0df7-361c-490a-b1b1-cdd27f171e7f
2025-10-16 16:36:57,499 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/14098584-d7fa-478d-b57a-e82d793a70a6
2025-10-16 16:36:57,507 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-16 16:36:57,507 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,518 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/7a0a0df7-361c-490a-b1b1-cdd27f171e7f
2025-10-16 16:36:57,532 - INFO - Verified VN network id 12 for VN f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,532 - INFO - Verifications in API Server for VN ctest-mgmt_vn-24156998 passed
2025-10-16 16:36:57,532 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,541 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/7a0a0df7-361c-490a-b1b1-cdd27f171e7f
2025-10-16 16:36:57,548 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/7a0a0df7-361c-490a-b1b1-cdd27f171e7f
2025-10-16 16:36:57,557 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/14098584-d7fa-478d-b57a-e82d793a70a6
2025-10-16 16:36:57,572 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-16515975:ctest-mgmt_vn-24156998', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-16515975', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17690249076908836664', 'uuid-lslong': '12999768780207402134'}, 'enable': 'true', 'created': '2025-10-16T16:36:56', 'last-modified': '2025-10-16T16:36:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.758815'}
2025-10-16 16:36:57,579 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-16 16:36:57,579 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-24156998 passed
2025-10-16 16:36:57,579 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-24156998 in API_Server ======
2025-10-16 16:36:57,579 - DEBUG - Requesting: http://10.0.0.141:8082/domains
2025-10-16 16:36:57,587 - DEBUG - Requesting: http://10.0.0.141:8082/domain/1668739b-5fe2-4541-997a-8b143dd79dd2
2025-10-16 16:36:57,600 - DEBUG - Requesting: http://10.0.0.141:8082/project/3e3ef73d-d6c5-433e-a995-837d9fe8d12a
2025-10-16 16:36:57,681 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/f58063ce-f955-4738-b468-74d47279ac96
2025-10-16 16:36:57,693 - DEBUG - =>VN ctest-mgmt_vn-24156998 has no policy to be verified
2025-10-16 16:36:57,693 - DEBUG - Verifying the vn in opserver
2025-10-16 16:36:57,693 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-16515975:ctest-mgmt_vn-24156998 virtual network link through opserver 10.0.0.141
2025-10-16 16:36:57,693 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-10-16 16:36:57,992 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-10-16 16:36:58,061 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-16515975:ctest-mgmt_vn-24156998', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-16515975:ctest-mgmt_vn-24156998?flat'}
2025-10-16 16:36:58,061 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-16515975:ctest-mgmt_vn-24156998 is found in opserver
2025-10-16 16:36:58,072 - DEBUG - Do not have enough data to verify VN in agent
2025-10-16 16:36:58,077 - DEBUG - VRF ids for VN ctest-mgmt_vn-24156998: {}
2025-10-16 16:36:58,204 - ERROR - Some exception while doing Neutron net-list
Traceback (most recent call last):
File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present
net_rsp = self.obj.list_networks(**query_dict)['networks']
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks
return self.list('networks', self.networks_path, retrieve_all,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list
for r in self._pagination(collection, path, **params):
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination
res = self.get(path, params=params)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get
return self.retry_request("GET", action, body=body,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request
return self.do_request(method, action, body=body,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20
raise client_exc(message=error_message,
neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.
Neutron server returns request_ids: ['req-5afc65c7-698f-42b6-8875-5ff4b939f020']
2025-10-16 16:36:58,205 - ERROR - Got exception as "The server has either erred or is incapable of performing the requested operation.
\n\n\n\nNeutron server returns request_ids: ['req-5afc65c7-698f-42b6-8875-5ff4b939f020']" while creating ctest-left_vn-92246168
Traceback (most recent call last):
File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present
net_rsp = self.obj.list_networks(**query_dict)['networks']
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks
return self.list('networks', self.networks_path, retrieve_all,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list
for r in self._pagination(collection, path, **params):
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination
res = self.get(path, params=params)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get
return self.retry_request("GET", action, body=body,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request
return self.do_request(method, action, body=body,
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20
raise client_exc(message=error_message,
neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.
Neutron server returns request_ids: ['req-5afc65c7-698f-42b6-8875-5ff4b939f020']
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/contrail-test/fixtures/vn_test.py", line 295, in _create_vn_orch
self.obj = self.orchestrator.get_vn_obj_if_present(self.vn_name,
File "/contrail-test/fixtures/openstack.py", line 184, in get_vn_obj_if_present
return self.quantum_h.get_vn_obj_if_present(vn_name, **kwargs)
File "/contrail-test/fixtures/quantum_test.py", line 282, in get_vn_obj_if_present
raise NetworkClientException(message=str(e))
quantum_test.NetworkClientException: "The server has either erred or is incapable of performing the requested operation.
\n\n\n\nNeutron server returns request_ids: ['req-5afc65c7-698f-42b6-8875-5ff4b939f020']"
2025-10-16 16:36:58,210 - INFO - Deleting VN ctest-mgmt_vn-24156998
2025-10-16 16:36:58,334 - DEBUG - Response for deleting network ()
2025-10-16 16:36:58,335 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/7a0a0df7-361c-490a-b1b1-cdd27f171e7f
2025-10-16 16:36:58,341 - DEBUG - Response Code: 404
2025-10-16 16:36:58,341 - DEBUG - Requesting: http://10.0.0.141:8082/domains
2025-10-16 16:36:58,348 - DEBUG - Requesting: http://10.0.0.141:8082/domain/1668739b-5fe2-4541-997a-8b143dd79dd2
2025-10-16 16:36:58,406 - DEBUG - Requesting: http://10.0.0.141:8082/project/3e3ef73d-d6c5-433e-a995-837d9fe8d12a
2025-10-16 16:36:58,482 - INFO - Validated that VN ctest-mgmt_vn-24156998 is not found in API Server
2025-10-16 16:36:58,495 - DEBUG - VN ctest-mgmt_vn-24156998 is not present in Agent 10.0.0.141
2025-10-16 16:36:58,495 - INFO - Validated that VN ctest-mgmt_vn-24156998 is not in any agent
2025-10-16 16:36:58,513 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-24156998 info
2025-10-16 16:36:58,771 - ERROR - NetworkClientException
Python 3.9.21: /usr/bin/python3
Thu Oct 16 16:36:58 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/svc_firewall/test_svc_fw.py in test_svc_in_network_datapath(self=)
23 @preposttest_wrapper
24 def test_svc_in_network_datapath(self):
25 return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network',
26 create_svms=True)
27
self =
self.verify_svc_chain = >
svc_img_name undefined
service_mode undefined
create_svms undefined
/contrail-test/common/servicechain/verify.py in verify_svc_chain(self=, *args=(), **kwargs={'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'})
318 def verify_svc_chain(self, *args, **kwargs):
319 svc_chain_info = kwargs.get('svc_chain_info')
320 ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
321 proto = kwargs.get('proto', 'any')
322 left_vn_fq_name = ret_dict.get('left_vn_fixture').vn_fq_name
ret_dict undefined
svc_chain_info = None
self =
self.config_svc_chain = >
args = ()
kwargs = {'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'}
/contrail-test/common/servicechain/config.py in config_svc_chain(self=, service_mode='in-network', service_type='firewall', max_inst=1, proto='any', svc_chain_type='parallel', src_ports=[0, 65535], dst_ports=[0, 65535], svc_img_name='cirros_in_net', st_version=2, mgmt_vn_name='ctest-mgmt_vn-24156998', mgmt_vn_subnets=['90.198.183.128/26'], mgmt_vn_fixture=, left_vn_name=None, left_vn_subnets=[], left_vn_fixture=None, right_vn_name=None, right_vn_subnets=[], right_vn_fixture=None, left_lr_child_vn_fixture=None, right_lr_child_vn_fixture=None, left_vm_name=None, left_vm_fixture=None, right_vm_name=None, right_vm_fixture=None, image_name='cirros', policy_fixture=None, st_fixture=None, si_fixture=None, port_tuples_props=None, static_route=None, svm_fixtures=[], create_svms=True, evpn=False, modify_rules=False, policy_action='pass', hosts=[], **kwargs={})
450 left_vn_subnets,
451 left_vn_fixture,
452 left_vn_fq_name) = self._get_vn_for_config(left_vn_name,
453 left_vn_subnets,
454 left_vn_fixture,
left_vn_fq_name undefined
self =
self._get_vn_for_config = >
left_vn_name = None
/contrail-test/common/servicechain/config.py in _get_vn_for_config(self=, vn_name='ctest-left_vn-92246168', vn_subnets=['3.237.119.0/26'], vn_fixture=None, vn_name_prefix='left_vn', **kwargs={})
355 vn_subnets = vn_subnets or \
356 [get_random_cidr(af=self.inputs.get_af())]
357 vn_fixture = vn_fixture or self.config_vn(vn_name, vn_subnets, **kwargs)
358 vn_fq_name = vn_fixture.vn_fq_name
359 return (vn_name, vn_subnets, vn_fixture, vn_fq_name)
vn_fixture = None
self =
self.config_vn = >
vn_name = 'ctest-left_vn-92246168'
vn_subnets = ['3.237.119.0/26']
kwargs = {}
/contrail-test/common/servicechain/config.py in config_vn(self=, vn_name='ctest-left_vn-92246168', vn_net=['3.237.119.0/26'], **kwargs={})
134
135 def config_vn(self, vn_name, vn_net, **kwargs):
136 vn_fixture = self.useFixture(VNFixture(
137 project_name=self.inputs.project_name, connections=self.connections,
138 vn_name=vn_name, inputs=self.inputs, subnets=vn_net, **kwargs))
vn_fixture undefined
self =
self.useFixture = >
global VNFixture =
project_name undefined
self.inputs =
self.inputs.project_name = 'ctest-TestSvcRegr-16515975'
connections undefined
self.connections =
vn_name = 'ctest-left_vn-92246168'
inputs undefined
subnets undefined
vn_net = ['3.237.119.0/26']
kwargs = {}
/usr/local/lib/python3.9/site-packages/testtools/testcase.py in useFixture(self=, fixture=)
754 # Gather_details worked, so raise the exception setUp
755 # encountered.
756 reraise(*exc_info)
757 else:
758 self.addCleanup(fixture.cleanUp)
global reraise =
exc_info = (, NetworkClientException(), )
/usr/local/lib/python3.9/site-packages/testtools/_compat3x.py in reraise(exc_class=, exc_obj=NetworkClientException(), exc_tb=, _marker=