2025-08-27 14:16:11,601 - INFO - Domain Default found not creating 2025-08-27 14:16:11,741 - INFO - Project ctest-TestBasicPolicyIpv4v6-81339210 not found, creating it 2025-08-27 14:16:12,169 - INFO - Created Project:ctest-TestBasicPolicyIpv4v6-81339210, ID : b0ced9a9-0a21-4774-ad65-2b761f4af8a1 2025-08-27 14:16:13,569 - INFO - ================================================================================ 2025-08-27 14:16:13,569 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-08-27 14:16:13,569 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-08-27 14:16:13,693 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.254': '0'}} with 2025-08-27 14:16:13,693 - INFO - Initial checks done. Running the testcase now 2025-08-27 14:16:13,693 - INFO - 2025-08-27 14:16:14,214 - DEBUG - Response for create_network : {'network': {'id': '2ab290ed-26df-44e2-a827-daa5c61e429f', 'name': 'ctest-vn-53683669', 'tenant_id': 'b0ced9a90a214774ad652b761f4af8a1', 'project_id': 'b0ced9a90a214774ad652b761f4af8a1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-81339210', 'ctest-vn-53683669'], 'port_security_enabled': True, 'description': ''}} 2025-08-27 14:16:14,331 - ERROR - Neutron Exception while creating subnet for vn with id 2ab290ed-26df-44e2-a827-daa5c61e429f Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 358, in post return self.do_request("POST", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-a4057865-9b7e-4f58-aeeb-adecd7404b57'] 2025-08-27 14:16:14,436 - ERROR - Neutron Exception while creating subnet for vn with id 2ab290ed-26df-44e2-a827-daa5c61e429f Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 358, in post return self.do_request("POST", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-a91174de-1a63-49af-b1d8-e52947d1132d'] 2025-08-27 14:16:14,451 - INFO - Created VN ctest-vn-53683669 2025-08-27 14:16:14,503 - DEBUG - VN ctest-vn-53683669 UUID is 2ab290ed-26df-44e2-a827-daa5c61e429f 2025-08-27 14:16:14,787 - DEBUG - Response for create_network : {'network': {'id': '86c6bf93-5b37-4d6e-9537-39e260354b6a', 'name': 'ctest-vn-46050818', 'tenant_id': 'b0ced9a90a214774ad652b761f4af8a1', 'project_id': 'b0ced9a90a214774ad652b761f4af8a1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-81339210', 'ctest-vn-46050818'], 'port_security_enabled': True, 'description': ''}} 2025-08-27 14:16:14,913 - ERROR - Neutron Exception while creating subnet for vn with id 86c6bf93-5b37-4d6e-9537-39e260354b6a Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 358, in post return self.do_request("POST", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-31bfc15d-355b-4822-a144-fe3dd9c7c38c'] 2025-08-27 14:16:15,022 - ERROR - Neutron Exception while creating subnet for vn with id 86c6bf93-5b37-4d6e-9537-39e260354b6a Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 358, in post return self.do_request("POST", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-bed56c63-db55-47ea-8751-625256059a49'] 2025-08-27 14:16:15,037 - INFO - Created VN ctest-vn-46050818 2025-08-27 14:16:15,087 - DEBUG - VN ctest-vn-46050818 UUID is 86c6bf93-5b37-4d6e-9537-39e260354b6a 2025-08-27 14:16:15,211 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-81339210:ctest-vn-53683669, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-81339210:ctest-vn-46050818, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-81339210:ctest-vn-53683669, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-81339210:ctest-vn-46050818, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-27 14:16:15,532 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '2ab290ed-26df-44e2-a827-daa5c61e429f', 'name': 'ctest-vn-53683669', 'tenant_id': 'b0ced9a90a214774ad652b761f4af8a1', 'project_id': 'b0ced9a90a214774ad652b761f4af8a1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-81339210', 'ctest-vn-53683669'], 'policys': [['default-domain', 'ctest-TestBasicPolicyIpv4v6-81339210', 'ctest-policy-allow-all-10064163']], 'port_security_enabled': True, 'description': ''}} 2025-08-27 14:16:15,795 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '86c6bf93-5b37-4d6e-9537-39e260354b6a', 'name': 'ctest-vn-46050818', 'tenant_id': 'b0ced9a90a214774ad652b761f4af8a1', 'project_id': 'b0ced9a90a214774ad652b761f4af8a1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-81339210', 'ctest-vn-46050818'], 'policys': [['default-domain', 'ctest-TestBasicPolicyIpv4v6-81339210', 'ctest-policy-allow-all-10064163']], 'port_security_enabled': True, 'description': ''}} 2025-08-27 14:16:15,947 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-27 14:16:16,243 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-27 14:16:16,271 - DEBUG - Requesting: http://10.0.0.38:8082/domain/9130d1c2-5fd5-4a37-8697-96bb219a4e4c 2025-08-27 14:16:16,282 - DEBUG - Requesting: http://10.0.0.38:8082/project/b0ced9a9-0a21-4774-ad65-2b761f4af8a1 2025-08-27 14:16:16,354 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/2ab290ed-26df-44e2-a827-daa5c61e429f 2025-08-27 14:16:16,626 - INFO - Deleted policy ctest-policy-allow-all-10064163 2025-08-27 14:16:16,627 - INFO - Deleting VN ctest-vn-46050818 2025-08-27 14:16:16,699 - DEBUG - Response for deleting network () 2025-08-27 14:16:16,699 - INFO - Deleting VN ctest-vn-53683669 2025-08-27 14:16:16,776 - DEBUG - Response for deleting network () 2025-08-27 14:16:16,899 - ERROR - KeyError Python 3.9.21: /usr/bin/python3 Wed Aug 27 14:16:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_basic.py in test_basic_policy_allow_deny(self=) 109 policy_fixture = self.setup_policy_between_vns(vn1_fixture, 110 vn2_fixture, rules) 111 assert vn1_fixture.verify_on_setup() 112 assert vn2_fixture.verify_on_setup() 113 vn1_fixture = vn1_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 574 def verify_on_setup(self): 575 result = True 576 if not self.verify_vn_in_api_server(): 577 result = result and False 578 self.logger.error( self = self.verify_vn_in_api_server = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_api_server(self=) 638 639 subnets = list() 640 for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: 641 subnets.extend(ipam['attr']['ipam_subnets']) 642 for vn_subnet in self.vn_subnets: ipam undefined self = self.api_s_vn_obj = {'virtual-network': {'uuid': '2ab290ed-26df-44e2...2/project/b0ced9a9-0a21-4774-ad65-2b761f4af8a1'}} KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Mapping key not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('network_ipam_refs',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_basic.py", line 111, in test_basic_policy_allow_deny assert vn1_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 576, in verify_on_setup if not self.verify_vn_in_api_server(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 640, in verify_vn_in_api_server for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: KeyError: 'network_ipam_refs' 2025-08-27 14:16:16,905 - DEBUG - No XMPP flaps were noticed during the test 2025-08-27 14:16:16,905 - INFO -
2025-08-27 14:16:16,905 - INFO - END TEST : test_basic_policy_allow_deny : FAILED[0:00:03]
2025-08-27 14:16:16,905 - INFO - -------------------------------------------------------------------------------- 2025-08-27 14:16:17,558 - INFO - Deleted project: ctest-TestBasicPolicyIpv4v6-81339210, ID : b0ced9a9-0a21-4774-ad65-2b761f4af8a1