2025-08-15 10:02:26,947 - INFO - Domain Default found not creating 2025-08-15 10:02:27,080 - INFO - Project ctest-TestBasicPolicy-23101545 not found, creating it 2025-08-15 10:02:27,691 - INFO - Created Project:ctest-TestBasicPolicy-23101545, ID : e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:02:29,107 - INFO - ================================================================================ 2025-08-15 10:02:29,107 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-08-15 10:02:29,107 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-08-15 10:02:30,373 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.14': '0', '10.20.0.254': '0'}, '10.0.0.242': {'10.20.0.254': '0', '10.20.0.25': '1'}} with 2025-08-15 10:02:30,373 - INFO - Initial checks done. Running the testcase now 2025-08-15 10:02:30,373 - INFO - 2025-08-15 10:02:30,987 - DEBUG - Response for create_network : {'network': {'id': 'f2c1c635-02b1-47d8-a858-75a541a45cc8', 'name': 'ctest-vn-67954096', 'tenant_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'project_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-vn-67954096'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:02:31,279 - DEBUG - Response for create_subnet : {'subnet': {'id': '5fc38013-2168-4f80-826c-57732bf0ea53', 'name': '', 'tenant_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'network_id': 'f2c1c635-02b1-47d8-a858-75a541a45cc8', 'ip_version': 4, 'cidr': '137.175.166.192/26', 'allocation_pools': [{'start': '137.175.166.194', 'end': '137.175.166.254'}], 'gateway_ip': '137.175.166.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '137.175.166.194', 'tags': [], 'project_id': 'e069eb0c4d8a4c87aceb5dfb85402f92'}} 2025-08-15 10:02:31,312 - INFO - Created VN ctest-vn-67954096 2025-08-15 10:02:31,327 - DEBUG - VN ctest-vn-67954096 UUID is f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:31,769 - DEBUG - Response for create_network : {'network': {'id': '22536241-1403-46c3-9296-ddd37a7d6be2', 'name': 'ctest-vn-36243518', 'tenant_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'project_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-vn-36243518'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:02:32,047 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b9e189d8-ed55-4ff4-9922-117b6c65a54f', 'name': '', 'tenant_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'network_id': '22536241-1403-46c3-9296-ddd37a7d6be2', 'ip_version': 4, 'cidr': '59.108.43.192/26', 'allocation_pools': [{'start': '59.108.43.194', 'end': '59.108.43.254'}], 'gateway_ip': '59.108.43.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '59.108.43.194', 'tags': [], 'project_id': 'e069eb0c4d8a4c87aceb5dfb85402f92'}} 2025-08-15 10:02:32,070 - INFO - Created VN ctest-vn-36243518 2025-08-15 10:02:32,079 - DEBUG - VN ctest-vn-36243518 UUID is 22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:32,163 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-15 10:02:32,485 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'f2c1c635-02b1-47d8-a858-75a541a45cc8', 'name': 'ctest-vn-67954096', 'tenant_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'project_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['5fc38013-2168-4f80-826c-57732bf0ea53'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-vn-67954096'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-policy-allow-all-97971985']], 'subnet_ipam': [{'subnet_cidr': '137.175.166.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:02:32,676 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '22536241-1403-46c3-9296-ddd37a7d6be2', 'name': 'ctest-vn-36243518', 'tenant_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'project_id': 'e069eb0c4d8a4c87aceb5dfb85402f92', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['b9e189d8-ed55-4ff4-9922-117b6c65a54f'], 'fq_name': ['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-vn-36243518'], 'policys': [['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-policy-allow-all-97971985']], 'subnet_ipam': [{'subnet_cidr': '59.108.43.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:02:32,786 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:02:33,137 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:02:33,162 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:02:33,174 - DEBUG - Requesting: http://10.0.0.50:8082/project/e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:02:33,279 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:33,293 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:33,302 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/13b1ca8b-8d29-4e29-b7eb-849c47a4a79f 2025-08-15 10:02:33,313 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/13b1ca8b-8d29-4e29-b7eb-849c47a4a79f 2025-08-15 10:02:33,320 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/7fb94aaa-96ff-4ee6-8f69-c9a0ff2fde9d 2025-08-15 10:02:33,326 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:02:33,326 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:33,335 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/13b1ca8b-8d29-4e29-b7eb-849c47a4a79f 2025-08-15 10:02:33,351 - INFO - Verified VN network id 15 for VN f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:33,352 - INFO - Verifications in API Server for VN ctest-vn-67954096 passed 2025-08-15 10:02:33,352 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:33,362 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/13b1ca8b-8d29-4e29-b7eb-849c47a4a79f 2025-08-15 10:02:33,370 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/13b1ca8b-8d29-4e29-b7eb-849c47a4a79f 2025-08-15 10:02:33,379 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/7fb94aaa-96ff-4ee6-8f69-c9a0ff2fde9d 2025-08-15 10:02:33,391 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-23101545', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17492480358664456152', 'uuid-lslong': '12130574948953775304'}, 'enable': 'true', 'created': '2025-08-15T10:02:30', 'last-modified': '2025-08-15T10:02:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.940419'} 2025-08-15 10:02:33,400 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:02:33,406 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-23101545', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17492480358664456152', 'uuid-lslong': '12130574948953775304'}, 'enable': 'true', 'created': '2025-08-15T10:02:30', 'last-modified': '2025-08-15T10:02:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.962431'} 2025-08-15 10:02:33,412 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:02:33,417 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-23101545', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17492480358664456152', 'uuid-lslong': '12130574948953775304'}, 'enable': 'true', 'created': '2025-08-15T10:02:30', 'last-modified': '2025-08-15T10:02:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.969395'} 2025-08-15 10:02:33,423 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:02:33,423 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-67954096 passed 2025-08-15 10:02:33,424 - DEBUG - ====Verifying policy data for ctest-vn-67954096 in API_Server ====== 2025-08-15 10:02:33,424 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:02:33,430 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:02:33,440 - DEBUG - Requesting: http://10.0.0.50:8082/project/e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:02:33,530 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/f2c1c635-02b1-47d8-a858-75a541a45cc8 2025-08-15 10:02:33,539 - DEBUG - ==>Verifying data for policy with id: 591a2142-ae1f-44f7-a2ec-a8215a6c3acf, fqn: ['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-policy-allow-all-97971985'] 2025-08-15 10:02:33,539 - INFO - VN ctest-vn-67954096 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-15 10:02:33,539 - DEBUG - Verifying the vn in opserver 2025-08-15 10:02:33,539 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 virtual network link through opserver 10.0.0.50 2025-08-15 10:02:33,539 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:02:33,828 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:02:33,883 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096?flat'} 2025-08-15 10:02:33,883 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 virtual network link through opserver 10.0.0.22 2025-08-15 10:02:33,883 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:02:34,173 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:02:34,224 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096?flat'} 2025-08-15 10:02:34,224 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 virtual network link through opserver 10.0.0.19 2025-08-15 10:02:34,224 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:02:34,513 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:02:34,562 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096?flat'} 2025-08-15 10:02:34,563 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is found in opserver 2025-08-15 10:02:34,583 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:02:34,592 - DEBUG - VRF ids for VN ctest-vn-67954096: {} 2025-08-15 10:02:34,592 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:02:34,597 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:02:34,614 - DEBUG - Requesting: http://10.0.0.50:8082/project/e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:02:34,701 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:34,723 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:34,735 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/72b61bb4-26a9-4a78-9750-254b0d3cea43 2025-08-15 10:02:34,747 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/72b61bb4-26a9-4a78-9750-254b0d3cea43 2025-08-15 10:02:34,793 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/71fee3e4-6c7d-46a5-94d0-fc6b2999fdbb 2025-08-15 10:02:34,804 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:02:34,804 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:34,817 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/72b61bb4-26a9-4a78-9750-254b0d3cea43 2025-08-15 10:02:34,853 - INFO - Verified VN network id 16 for VN 22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:34,853 - INFO - Verifications in API Server for VN ctest-vn-36243518 passed 2025-08-15 10:02:34,853 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:34,889 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/72b61bb4-26a9-4a78-9750-254b0d3cea43 2025-08-15 10:02:34,896 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/72b61bb4-26a9-4a78-9750-254b0d3cea43 2025-08-15 10:02:34,913 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/71fee3e4-6c7d-46a5-94d0-fc6b2999fdbb 2025-08-15 10:02:34,939 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-23101545', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2473428652004689603', 'uuid-lslong': '10562873876406954978'}, 'enable': 'true', 'created': '2025-08-15T10:02:31', 'last-modified': '2025-08-15T10:02:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.290548'} 2025-08-15 10:02:34,945 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:02:34,950 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-23101545', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2473428652004689603', 'uuid-lslong': '10562873876406954978'}, 'enable': 'true', 'created': '2025-08-15T10:02:31', 'last-modified': '2025-08-15T10:02:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.304396'} 2025-08-15 10:02:34,958 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:02:34,965 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicPolicy-23101545', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2473428652004689603', 'uuid-lslong': '10562873876406954978'}, 'enable': 'true', 'created': '2025-08-15T10:02:31', 'last-modified': '2025-08-15T10:02:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.317671'} 2025-08-15 10:02:34,972 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:02:34,972 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-36243518 passed 2025-08-15 10:02:34,972 - DEBUG - ====Verifying policy data for ctest-vn-36243518 in API_Server ====== 2025-08-15 10:02:34,972 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:02:34,993 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:02:35,033 - DEBUG - Requesting: http://10.0.0.50:8082/project/e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:02:35,145 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/22536241-1403-46c3-9296-ddd37a7d6be2 2025-08-15 10:02:35,166 - DEBUG - ==>Verifying data for policy with id: 591a2142-ae1f-44f7-a2ec-a8215a6c3acf, fqn: ['default-domain', 'ctest-TestBasicPolicy-23101545', 'ctest-policy-allow-all-97971985'] 2025-08-15 10:02:35,166 - INFO - VN ctest-vn-36243518 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-15 10:02:35,167 - DEBUG - Verifying the vn in opserver 2025-08-15 10:02:35,167 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518 virtual network link through opserver 10.0.0.50 2025-08-15 10:02:35,167 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:02:35,256 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518?flat'} 2025-08-15 10:02:35,256 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518 virtual network link through opserver 10.0.0.22 2025-08-15 10:02:35,256 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:02:35,303 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518?flat'} 2025-08-15 10:02:35,303 - DEBUG - Verifying the default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518 virtual network link through opserver 10.0.0.19 2025-08-15 10:02:35,303 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:02:35,355 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518?flat'} 2025-08-15 10:02:35,355 - INFO - Validated that VN default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-36243518 is found in opserver 2025-08-15 10:02:35,376 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:02:35,387 - DEBUG - VRF ids for VN ctest-vn-36243518: {} 2025-08-15 10:02:35,436 - DEBUG - Services list from nova: [, , , ] 2025-08-15 10:02:36,370 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3861-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3861-2) 2025-08-15 10:02:37,574 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3861-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3861-1) 2025-08-15 10:02:37,575 - INFO - Waiting for VM ctest-TestBasicPolicy-23101545-10245988 to be up.. 2025-08-15 10:02:37,673 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-15 10:02:42,741 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:02:42,741 - INFO - VM name : ctest-TestBasicPolicy-23101545-10245988 2025-08-15 10:02:42,805 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 ID is 9bf39e8a-e17b-4d16-b454-45c99b2b99ae 2025-08-15 10:02:42,825 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 launched on Node an-jenkins-deploy-platform-ansible-os-3861-2 2025-08-15 10:02:42,888 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/9bf39e8a-e17b-4d16-b454-45c99b2b99ae 2025-08-15 10:02:43,183 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/9bf39e8a-e17b-4d16-b454-45c99b2b99ae 2025-08-15 10:02:43,212 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/722ccf96-2876-4685-81e5-c8cd045748c2 2025-08-15 10:02:46,384 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-15 10:02:46,384 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:02:46,397 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:02:50,485 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-15 10:02:50,485 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:02:50,498 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:02:54,585 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-15 10:02:54,585 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:02:54,599 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:02:58,668 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-15 10:02:58,668 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:02:58,683 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:03:02,770 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-15 10:03:02,770 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:03:02,785 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:03:06,864 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-15 10:03:06,864 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:03:06,879 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:03:10,959 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-15 10:03:10,959 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 failed! 2025-08-15 10:03:10,972 - DEBUG - Gateway for vn default-domain:ctest-TestBasicPolicy-23101545:ctest-vn-67954096 is 137.175.166.193 and allocation pool is NOT set 2025-08-15 10:03:13,030 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.06 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.02 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.024/5.042/8.061/3.018 ms') 2025-08-15 10:03:13,030 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-10245988 passed 2025-08-15 10:03:13,095 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:13,095 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-23101545-10245988, IP 137.175.166.195, Port 22 2025-08-15 10:03:13,160 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:03:13,236 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:03:18,237 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:18,237 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-23101545-10245988, IP 137.175.166.195, Port 22 2025-08-15 10:03:18,304 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:03:18,383 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:03:23,384 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:23,384 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-23101545-10245988, IP 137.175.166.195, Port 22 2025-08-15 10:03:23,457 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:03:23,537 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:03:28,538 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:28,538 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-23101545-10245988, IP 137.175.166.195, Port 22 2025-08-15 10:03:28,605 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:03:28,678 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:03:33,679 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:33,679 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-23101545-10245988, IP 137.175.166.195, Port 22 2025-08-15 10:03:33,845 - DEBUG - VM ctest-TestBasicPolicy-23101545-10245988 is ready for SSH connections 2025-08-15 10:03:33,845 - INFO - Waiting for VM ctest-TestBasicPolicy-23101545-05705282 to be up.. 2025-08-15 10:03:33,924 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:03:33,924 - INFO - VM name : ctest-TestBasicPolicy-23101545-05705282 2025-08-15 10:03:33,987 - DEBUG - VM ctest-TestBasicPolicy-23101545-05705282 ID is ca715af1-147c-46a8-b092-4970b1a3ba48 2025-08-15 10:03:33,987 - DEBUG - VM ctest-TestBasicPolicy-23101545-05705282 launched on Node an-jenkins-deploy-platform-ansible-os-3861-1 2025-08-15 10:03:34,082 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/ca715af1-147c-46a8-b092-4970b1a3ba48 2025-08-15 10:03:34,091 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/30d4fbc2-79df-4ac9-aea6-fa91caad237a 2025-08-15 10:03:35,248 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.67 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.82 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.820/4.243/6.667/2.423 ms') 2025-08-15 10:03:35,248 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicPolicy-23101545-05705282 passed 2025-08-15 10:03:35,311 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:35,311 - DEBUG - Waiting to SSH to VM ctest-TestBasicPolicy-23101545-05705282, IP 59.108.43.195, Port 22 2025-08-15 10:03:35,486 - DEBUG - VM ctest-TestBasicPolicy-23101545-05705282 is ready for SSH connections 2025-08-15 10:03:35,486 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:35,486 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 59.108.43.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-15 10:03:35,486 - DEBUG - ping -s 56 -c 3 -W 1 59.108.43.195 2025-08-15 10:03:54,218 - DEBUG - PING 59.108.43.195 (59.108.43.195) 56(84) bytes of data. 64 bytes from 59.108.43.195: icmp_req=1 ttl=63 time=7.40 ms 64 bytes from 59.108.43.195: icmp_req=2 ttl=63 time=2.47 ms 64 bytes from 59.108.43.195: icmp_req=3 ttl=63 time=2.13 ms --- 59.108.43.195 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 2.131/4.002/7.405/2.410 ms 2025-08-15 10:03:54,218 - INFO - Ping to IP 59.108.43.195 from VM ctest-TestBasicPolicy-23101545-10245988 passed 2025-08-15 10:03:54,423 - DEBUG - Policy Update Response {"network-policy": {"uuid": "591a2142-ae1f-44f7-a2ec-a8215a6c3acf", "href": "http://10.0.0.19:8082/network-policy/591a2142-ae1f-44f7-a2ec-a8215a6c3acf"}} 2025-08-15 10:03:54,423 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:03:54,424 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 59.108.43.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-15 10:03:54,424 - DEBUG - ping -s 56 -c 3 -W 1 59.108.43.195 2025-08-15 10:03:57,865 - DEBUG - PING 59.108.43.195 (59.108.43.195) 56(84) bytes of data. 64 bytes from 59.108.43.195: icmp_req=1 ttl=63 time=5.80 ms --- 59.108.43.195 ping statistics --- 3 packets transmitted, 1 received, 66% packet loss, time 2002ms rtt min/avg/max/mdev = 5.805/5.805/5.805/0.000 ms 2025-08-15 10:03:57,865 - WARNING - Ping to IP 59.108.43.195 from VM ctest-TestBasicPolicy-23101545-10245988 failed 2025-08-15 10:03:57,865 - INFO - Deleting VM ctest-TestBasicPolicy-23101545-05705282 2025-08-15 10:03:57,924 - INFO - Deleting VM ctest-TestBasicPolicy-23101545-10245988 2025-08-15 10:03:58,277 - INFO - Deleted policy ctest-policy-allow-all-97971985 2025-08-15 10:03:58,279 - INFO - Deleting VN ctest-vn-36243518 2025-08-15 10:03:58,322 - DEBUG - VN 22536241-1403-46c3-9296-ddd37a7d6be2 still in use: Unable to complete operation on network 22536241-1403-46c3-9296-ddd37a7d6be2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-bfa40400-ea00-44ed-986e-d0da4dcf5708'] 2025-08-15 10:03:58,322 - WARNING - Deleting VN ctest-vn-36243518 failed..Will retry 2025-08-15 10:04:00,459 - DEBUG - Response for deleting network () 2025-08-15 10:04:00,459 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/72b61bb4-26a9-4a78-9750-254b0d3cea43 2025-08-15 10:04:00,464 - DEBUG - Response Code: 404 2025-08-15 10:04:00,464 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:04:00,477 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:04:00,492 - DEBUG - Requesting: http://10.0.0.50:8082/project/e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:04:00,575 - INFO - Validated that VN ctest-vn-36243518 is not found in API Server 2025-08-15 10:04:00,585 - DEBUG - VN ctest-vn-36243518 is not present in Agent 10.0.0.241 2025-08-15 10:04:00,594 - DEBUG - VN ctest-vn-36243518 is not present in Agent 10.0.0.242 2025-08-15 10:04:00,594 - INFO - Validated that VN ctest-vn-36243518 is not in any agent 2025-08-15 10:04:00,621 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-36243518 info 2025-08-15 10:04:00,622 - INFO - Deleting VN ctest-vn-67954096 2025-08-15 10:04:00,765 - DEBUG - Response for deleting network () 2025-08-15 10:04:00,766 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/13b1ca8b-8d29-4e29-b7eb-849c47a4a79f 2025-08-15 10:04:00,770 - DEBUG - Response Code: 404 2025-08-15 10:04:00,770 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:04:00,783 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:04:00,848 - DEBUG - Requesting: http://10.0.0.50:8082/project/e069eb0c-4d8a-4c87-aceb-5dfb85402f92 2025-08-15 10:04:00,935 - INFO - Validated that VN ctest-vn-67954096 is not found in API Server 2025-08-15 10:04:00,946 - DEBUG - VN ctest-vn-67954096 is not present in Agent 10.0.0.241 2025-08-15 10:04:00,956 - DEBUG - VN ctest-vn-67954096 is not present in Agent 10.0.0.242 2025-08-15 10:04:00,956 - INFO - Validated that VN ctest-vn-67954096 is not in any agent 2025-08-15 10:04:00,983 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-67954096 info 2025-08-15 10:04:02,255 - DEBUG - No XMPP flaps were noticed during the test
2025-08-15 10:04:02,255 - INFO - END TEST : test_basic_policy_allow_deny : PASSED[0:01:33]
2025-08-15 10:04:02,255 - INFO - -------------------------------------------------------------------------------- 2025-08-15 10:04:02,967 - INFO - Deleted project: ctest-TestBasicPolicy-23101545, ID : e069eb0c-4d8a-4c87-aceb-5dfb85402f92