2025-08-27 14:16:17,719 - INFO - Domain Default found not creating 2025-08-27 14:16:17,857 - INFO - Project ctest-TestBasicPolicyNegativeIpv4v6-82966066 not found, creating it 2025-08-27 14:16:18,286 - INFO - Created Project:ctest-TestBasicPolicyNegativeIpv4v6-82966066, ID : 0bdc11c1-2cde-4d40-905b-8869aef61e0d 2025-08-27 14:16:19,668 - INFO - ================================================================================ 2025-08-27 14:16:19,668 - INFO - STARTING TEST : test_remove_policy_with_ref 2025-08-27 14:16:19,793 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.254': '0'}} with 2025-08-27 14:16:19,793 - INFO - Initial checks done. Running the testcase now 2025-08-27 14:16:19,793 - INFO - 2025-08-27 14:16:19,793 - INFO - ================================================================================ 2025-08-27 14:16:19,794 - INFO - STARTING TEST : test_remove_policy_with_ref 2025-08-27 14:16:19,794 - INFO - TEST DESCRIPTION : This tests the following scenarios. 1. Test to validate that policy removal will fail when it referenced with VN. 2. validate vn_policy data in api-s against quantum-vn data, when created and unbind policy from VN thru quantum APIs. 3. validate policy data in api-s against quantum-policy data, when created and deleted thru quantum APIs. 2025-08-27 14:16:19,954 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.254': '0'}} with 2025-08-27 14:16:19,954 - INFO - Initial checks done. Running the testcase now 2025-08-27 14:16:19,954 - INFO - 2025-08-27 14:16:20,299 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyNegativeIpv4v6-82966066:ctest-vn4-47337847, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyNegativeIpv4v6-82966066:ctest-vn4-47337847, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyNegativeIpv4v6-82966066:ctest-vn4-47337847, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyNegativeIpv4v6-82966066:ctest-vn4-47337847, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-27 14:16:20,811 - DEBUG - Response for create_network : {'network': {'id': '05a9a2a7-bf73-4a64-bfa9-fb44c9cb7f23', 'name': 'ctest-vn4-47337847', 'tenant_id': '0bdc11c12cde4d40905b8869aef61e0d', 'project_id': '0bdc11c12cde4d40905b8869aef61e0d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyNegativeIpv4v6-82966066', 'ctest-vn4-47337847'], 'port_security_enabled': True, 'description': ''}} 2025-08-27 14:16:20,960 - ERROR - Neutron Exception while creating subnet for vn with id 05a9a2a7-bf73-4a64-bfa9-fb44c9cb7f23 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 358, in post return self.do_request("POST", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-582cb838-52a1-41f7-a2e6-445b464f36c1'] 2025-08-27 14:16:21,074 - ERROR - Neutron Exception while creating subnet for vn with id 05a9a2a7-bf73-4a64-bfa9-fb44c9cb7f23 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 358, in post return self.do_request("POST", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-3be3fa6b-c4cc-46ae-9287-36088fef6fe6'] 2025-08-27 14:16:21,090 - INFO - Created VN ctest-vn4-47337847 2025-08-27 14:16:21,143 - DEBUG - VN ctest-vn4-47337847 UUID is 05a9a2a7-bf73-4a64-bfa9-fb44c9cb7f23 2025-08-27 14:16:21,286 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '05a9a2a7-bf73-4a64-bfa9-fb44c9cb7f23', 'name': 'ctest-vn4-47337847', 'tenant_id': '0bdc11c12cde4d40905b8869aef61e0d', 'project_id': '0bdc11c12cde4d40905b8869aef61e0d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyNegativeIpv4v6-82966066', 'ctest-vn4-47337847'], 'policys': [['default-domain', 'ctest-TestBasicPolicyNegativeIpv4v6-82966066', 'ctest-policy1-04787166']], 'port_security_enabled': True, 'description': ''}} 2025-08-27 14:16:21,443 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-27 14:16:21,742 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-27 14:16:21,771 - DEBUG - Requesting: http://10.0.0.38:8082/domain/9130d1c2-5fd5-4a37-8697-96bb219a4e4c 2025-08-27 14:16:21,785 - DEBUG - Requesting: http://10.0.0.38:8082/project/0bdc11c1-2cde-4d40-905b-8869aef61e0d 2025-08-27 14:16:21,863 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/05a9a2a7-bf73-4a64-bfa9-fb44c9cb7f23 2025-08-27 14:16:21,875 - INFO - Deleting VN ctest-vn4-47337847 2025-08-27 14:16:21,980 - DEBUG - Response for deleting network () 2025-08-27 14:16:22,003 - INFO - Deleted policy ctest-policy1-04787166 2025-08-27 14:16:22,127 - ERROR - KeyError Python 3.9.21: /usr/bin/python3 Wed Aug 27 14:16:21 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_basic.py in test_remove_policy_with_ref(self=) 224 vn1_fixture.bind_policies( 225 [policy_fixture.policy_fq_name], vn1_fixture.vn_id) 226 assert vn1_fixture.verify_on_setup() 227 ret = policy_fixture.verify_on_setup() 228 if ret['result'] == False: vn1_fixture = vn1_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 574 def verify_on_setup(self): 575 result = True 576 if not self.verify_vn_in_api_server(): 577 result = result and False 578 self.logger.error( self = self.verify_vn_in_api_server = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_api_server(self=) 638 639 subnets = list() 640 for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: 641 subnets.extend(ipam['attr']['ipam_subnets']) 642 for vn_subnet in self.vn_subnets: ipam undefined self = self.api_s_vn_obj = {'virtual-network': {'uuid': '05a9a2a7-bf73-4a64...2/project/0bdc11c1-2cde-4d40-905b-8869aef61e0d'}} KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Mapping key not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('network_ipam_refs',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_basic.py", line 226, in test_remove_policy_with_ref assert vn1_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 576, in verify_on_setup if not self.verify_vn_in_api_server(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 640, in verify_vn_in_api_server for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: KeyError: 'network_ipam_refs' 2025-08-27 14:16:22,133 - DEBUG - No XMPP flaps were noticed during the test 2025-08-27 14:16:22,134 - INFO - 2025-08-27 14:16:22,134 - INFO - END TEST : test_remove_policy_with_ref : FAILED[0:00:03] 2025-08-27 14:16:22,134 - INFO - -------------------------------------------------------------------------------- 2025-08-27 14:16:22,303 - ERROR - TestFailed Python 3.9.21: /usr/bin/python3 Wed Aug 27 14:16:22 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy.py in test_remove_policy_with_ref(self=) 623 @preposttest_wrapper 624 def test_remove_policy_with_ref(self): 625 super(TestBasicPolicyNegativeIpv4v6, self).test_remove_policy_with_ref() 626 627 class TestBasicPolicyModifyIpv4v6(test_policy_basic.TestBasicPolicyModify): builtinsuper = global TestBasicPolicyNegativeIpv4v6 = self = ).test_remove_policy_with_ref = > /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 174 if 'ci_image' in list(os.environ.keys()): 175 os.environ['stop_execution_flag'] = 'set' 176 raise TestFailed("\n ".join(errmsg)) 177 elif testskip: 178 log.info('') global TestFailed = "\n ".join undefined errmsg = ["Test failed: KeyError\nPython 3.9.21: /usr/bin/py...ork_ipam_refs']:\nKeyError: 'network_ipam_refs'\n\n\n"] TestFailed: Test failed: KeyError Python 3.9.21: /usr/bin/python3 Wed Aug 27 14:16:21 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_basic.py in test_remove_policy_with_ref(self=) 224 vn1_fixture.bind_policies( 225 [policy_fixture.policy_fq_name], vn1_fixture.vn_id) 226 assert vn1_fixture.verify_on_setup() 227 ret = policy_fixture.verify_on_setup() 228 if ret['result'] == False: vn1_fixture = vn1_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 574 def verify_on_setup(self): 575 result = True 576 if not self.verify_vn_in_api_server(): 577 result = result and False 578 self.logger.error( self = self.verify_vn_in_api_server = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_api_server(self=) 638 639 subnets = list() 640 for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: 641 subnets.extend(ipam['attr']['ipam_subnets']) 642 for vn_subnet in self.vn_subnets: ipam undefined self = self.api_s_vn_obj = {'virtual-network': {'uuid': '05a9a2a7-bf73-4a64...2/project/0bdc11c1-2cde-4d40-905b-8869aef61e0d'}} KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Mapping key not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('network_ipam_refs',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_basic.py", line 226, in test_remove_policy_with_ref assert vn1_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 576, in verify_on_setup if not self.verify_vn_in_api_server(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 640, in verify_vn_in_api_server for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'tcutils.cores' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ("Test failed: KeyError\nPython 3.9.21: /usr/bin/py...ork_ipam_refs']:\nKeyError: 'network_ipam_refs'\n\n\n",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy.py", line 625, in test_remove_policy_with_ref super(TestBasicPolicyNegativeIpv4v6, self).test_remove_policy_with_ref() File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper raise TestFailed("\n ".join(errmsg)) tcutils.cores.TestFailed: Test failed: KeyError Python 3.9.21: /usr/bin/python3 Wed Aug 27 14:16:21 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_basic.py in test_remove_policy_with_ref(self=) 224 vn1_fixture.bind_policies( 225 [policy_fixture.policy_fq_name], vn1_fixture.vn_id) 226 assert vn1_fixture.verify_on_setup() 227 ret = policy_fixture.verify_on_setup() 228 if ret['result'] == False: vn1_fixture = vn1_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 574 def verify_on_setup(self): 575 result = True 576 if not self.verify_vn_in_api_server(): 577 result = result and False 578 self.logger.error( self = self.verify_vn_in_api_server = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_api_server(self=) 638 639 subnets = list() 640 for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: 641 subnets.extend(ipam['attr']['ipam_subnets']) 642 for vn_subnet in self.vn_subnets: ipam undefined self = self.api_s_vn_obj = {'virtual-network': {'uuid': '05a9a2a7-bf73-4a64...2/project/0bdc11c1-2cde-4d40-905b-8869aef61e0d'}} KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Mapping key not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('network_ipam_refs',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_basic.py", line 226, in test_remove_policy_with_ref assert vn1_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 576, in verify_on_setup if not self.verify_vn_in_api_server(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 640, in verify_vn_in_api_server for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: KeyError: 'network_ipam_refs' 2025-08-27 14:16:22,309 - DEBUG - No XMPP flaps were noticed during the test 2025-08-27 14:16:22,309 - INFO - 2025-08-27 14:16:22,309 - INFO - END TEST : test_remove_policy_with_ref : FAILED[0:00:03] 2025-08-27 14:16:22,310 - INFO - -------------------------------------------------------------------------------- 2025-08-27 14:16:22,981 - INFO - Deleted project: ctest-TestBasicPolicyNegativeIpv4v6-82966066, ID : 0bdc11c1-2cde-4d40-905b-8869aef61e0d