2025-08-24 07:44:19,089 - INFO - Domain Default found not creating 2025-08-24 07:44:19,239 - INFO - Project ctest-TestBasicPolicyIpv4v6-68112378 not found, creating it 2025-08-24 07:44:19,734 - INFO - Created Project:ctest-TestBasicPolicyIpv4v6-68112378, ID : 31f7dd29-2871-48c3-b5b4-19c0db5989ad 2025-08-24 07:44:21,115 - INFO - ================================================================================ 2025-08-24 07:44:21,116 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-08-24 07:44:21,116 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-08-24 07:44:21,248 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-08-24 07:44:21,248 - INFO - Initial checks done. Running the testcase now 2025-08-24 07:44:21,248 - INFO - 2025-08-24 07:44:21,792 - DEBUG - Response for create_network : {'network': {'id': 'b29fac08-55bc-40d8-a920-2d4318aa2f72', 'name': 'ctest-vn-08532187', 'tenant_id': '31f7dd29287148c3b5b419c0db5989ad', 'project_id': '31f7dd29287148c3b5b419c0db5989ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-68112378', 'ctest-vn-08532187'], 'port_security_enabled': True, 'description': ''}} 2025-08-24 07:44:21,916 - ERROR - Neutron Exception while creating subnet for vn with id b29fac08-55bc-40d8-a920-2d4318aa2f72 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-8f4857cf-fe43-43ed-97ff-000cf296803d'] 2025-08-24 07:44:22,032 - ERROR - Neutron Exception while creating subnet for vn with id b29fac08-55bc-40d8-a920-2d4318aa2f72 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-92fc7261-86a1-4fb8-9e90-002227e8c1a6'] 2025-08-24 07:44:22,049 - INFO - Created VN ctest-vn-08532187 2025-08-24 07:44:22,100 - DEBUG - VN ctest-vn-08532187 UUID is b29fac08-55bc-40d8-a920-2d4318aa2f72 2025-08-24 07:44:22,419 - DEBUG - Response for create_network : {'network': {'id': 'b0a0c318-96dd-472b-a9b3-0c05f3862642', 'name': 'ctest-vn-10113713', 'tenant_id': '31f7dd29287148c3b5b419c0db5989ad', 'project_id': '31f7dd29287148c3b5b419c0db5989ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-68112378', 'ctest-vn-10113713'], 'port_security_enabled': True, 'description': ''}} 2025-08-24 07:44:22,588 - ERROR - Neutron Exception while creating subnet for vn with id b0a0c318-96dd-472b-a9b3-0c05f3862642 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-f0ae67f2-dd8a-4cd3-b7dc-5e1129070743'] 2025-08-24 07:44:22,709 - ERROR - Neutron Exception while creating subnet for vn with id b0a0c318-96dd-472b-a9b3-0c05f3862642 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-8466f6cb-0f91-4682-9597-544f4625cbb2'] 2025-08-24 07:44:22,725 - INFO - Created VN ctest-vn-10113713 2025-08-24 07:44:22,780 - DEBUG - VN ctest-vn-10113713 UUID is b0a0c318-96dd-472b-a9b3-0c05f3862642 2025-08-24 07:44:22,908 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-68112378:ctest-vn-08532187, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-68112378:ctest-vn-10113713, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-68112378:ctest-vn-08532187, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-68112378:ctest-vn-10113713, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-24 07:44:23,238 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'b29fac08-55bc-40d8-a920-2d4318aa2f72', 'name': 'ctest-vn-08532187', 'tenant_id': '31f7dd29287148c3b5b419c0db5989ad', 'project_id': '31f7dd29287148c3b5b419c0db5989ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-68112378', 'ctest-vn-08532187'], 'policys': [['default-domain', 'ctest-TestBasicPolicyIpv4v6-68112378', 'ctest-policy-allow-all-31017793']], 'port_security_enabled': True, 'description': ''}} 2025-08-24 07:44:23,481 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'b0a0c318-96dd-472b-a9b3-0c05f3862642', 'name': 'ctest-vn-10113713', 'tenant_id': '31f7dd29287148c3b5b419c0db5989ad', 'project_id': '31f7dd29287148c3b5b419c0db5989ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-68112378', 'ctest-vn-10113713'], 'policys': [['default-domain', 'ctest-TestBasicPolicyIpv4v6-68112378', 'ctest-policy-allow-all-31017793']], 'port_security_enabled': True, 'description': ''}} 2025-08-24 07:44:23,648 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-24 07:44:23,948 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-08-24 07:44:23,974 - DEBUG - Requesting: http://10.0.0.254:8082/domain/1310f3c6-22a8-49c4-8a87-a032ff68bb5b 2025-08-24 07:44:23,987 - DEBUG - Requesting: http://10.0.0.254:8082/project/31f7dd29-2871-48c3-b5b4-19c0db5989ad 2025-08-24 07:44:24,070 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b29fac08-55bc-40d8-a920-2d4318aa2f72 2025-08-24 07:44:24,430 - INFO - Deleted policy ctest-policy-allow-all-31017793 2025-08-24 07:44:24,430 - INFO - Deleting VN ctest-vn-10113713 2025-08-24 07:44:24,520 - DEBUG - Response for deleting network () 2025-08-24 07:44:24,520 - INFO - Deleting VN ctest-vn-08532187 2025-08-24 07:44:24,598 - DEBUG - Response for deleting network () 2025-08-24 07:44:24,720 - ERROR - KeyError Python 3.6.8: /usr/bin/python3 Sun Aug 24 07:44:24 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_basic.py in test_basic_policy_allow_deny(self=) 109 policy_fixture = self.setup_policy_between_vns(vn1_fixture, 110 vn2_fixture, rules) 111 assert vn1_fixture.verify_on_setup() 112 assert vn2_fixture.verify_on_setup() 113 vn1_fixture = vn1_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 574 def verify_on_setup(self): 575 result = True 576 if not self.verify_vn_in_api_server(): 577 result = result and False 578 self.logger.error( self = self.verify_vn_in_api_server = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_api_server(self=) 638 639 subnets = list() 640 for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: 641 subnets.extend(ipam['attr']['ipam_subnets']) 642 for vn_subnet in self.vn_subnets: ipam undefined self = self.api_s_vn_obj = {'virtual-network': {'uuid': 'b29fac08-55bc-40d8...2/project/31f7dd29-2871-48c3-b5b4-19c0db5989ad'}} KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Mapping key not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('network_ipam_refs',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_basic.py", line 111, in test_basic_policy_allow_deny assert vn1_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 576, in verify_on_setup if not self.verify_vn_in_api_server(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 640, in verify_vn_in_api_server for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: KeyError: 'network_ipam_refs' 2025-08-24 07:44:24,727 - DEBUG - No XMPP flaps were noticed during the test 2025-08-24 07:44:24,727 - INFO -
2025-08-24 07:44:24,727 - INFO - END TEST : test_basic_policy_allow_deny : FAILED[0:00:03]
2025-08-24 07:44:24,727 - INFO - -------------------------------------------------------------------------------- 2025-08-24 07:44:25,401 - INFO - Deleted project: ctest-TestBasicPolicyIpv4v6-68112378, ID : 31f7dd29-2871-48c3-b5b4-19c0db5989ad