2025-08-14 02:30:15,013 - INFO - Domain Default found not creating 2025-08-14 02:30:15,178 - INFO - Project ctest-TestPolicyAclIpv4v6-51944652 not found, creating it 2025-08-14 02:30:15,819 - INFO - Created Project:ctest-TestPolicyAclIpv4v6-51944652, ID : 8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:17,255 - INFO - ================================================================================ 2025-08-14 02:30:17,255 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-08-14 02:30:18,532 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with 2025-08-14 02:30:18,533 - INFO - Initial checks done. Running the testcase now 2025-08-14 02:30:18,533 - INFO - 2025-08-14 02:30:18,533 - INFO - ================================================================================ 2025-08-14 02:30:18,533 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-08-14 02:30:18,534 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-08-14 02:30:19,792 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with 2025-08-14 02:30:19,792 - INFO - Initial checks done. Running the testcase now 2025-08-14 02:30:19,792 - INFO - 2025-08-14 02:30:21,072 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:21,361 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:21,390 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:21,405 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:21,512 - DEBUG - Requesting: http://10.0.0.38:8082/network-ipam/587f071e-9c36-4a7d-9aaf-35062ed6fcab 2025-08-14 02:30:21,521 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-08-14 02:30:21,529 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6376823425431128701', 'uuid-lslong': '11146185903437184171'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.140631'} 2025-08-14 02:30:21,538 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6376823425431128701', 'uuid-lslong': '11146185903437184171'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.147923'} 2025-08-14 02:30:21,544 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6376823425431128701', 'uuid-lslong': '11146185903437184171'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.152412'} 2025-08-14 02:30:21,545 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-08-14 02:30:21,545 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:21,551 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:21,564 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:21,657 - DEBUG - Requesting: http://10.0.0.38:8082/network-ipam/4108672f-88b3-4ae3-b4e9-701bf3dfd5e5 2025-08-14 02:30:21,666 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-08-14 02:30:21,672 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4686108866133576419', 'uuid-lslong': '13036073861758572005'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.946651'} 2025-08-14 02:30:21,679 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4686108866133576419', 'uuid-lslong': '13036073861758572005'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.954784'} 2025-08-14 02:30:21,685 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4686108866133576419', 'uuid-lslong': '13036073861758572005'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.964880'} 2025-08-14 02:30:21,685 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-08-14 02:30:21,685 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:21,692 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:21,705 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:21,808 - DEBUG - Requesting: http://10.0.0.38:8082/network-ipam/d4c7771c-fa62-4c0f-9349-77fc1c0b2199 2025-08-14 02:30:21,818 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-08-14 02:30:21,825 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15332354422749678607', 'uuid-lslong': '10613145921561239961'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.777566'} 2025-08-14 02:30:21,833 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15332354422749678607', 'uuid-lslong': '10613145921561239961'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.785184'} 2025-08-14 02:30:21,840 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15332354422749678607', 'uuid-lslong': '10613145921561239961'}, 'enable': 'true', 'created': '2025-08-14T02:30:20', 'last-modified': '2025-08-14T02:30:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.785978'} 2025-08-14 02:30:21,840 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-08-14 02:30:22,153 - DEBUG - Response for create_network : {'network': {'id': 'bbf5513d-c45e-4fae-9b18-1dd3c58e5838', 'name': 'ctest-VN1-73214095', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'project_id': '8baff5c6719447d5bfc0cfa0049138ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-VN1-73214095'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 02:30:22,399 - DEBUG - Response for create_subnet : {'subnet': {'id': '47381222-eba0-45d3-b458-86dad44f4a60', 'name': '', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'network_id': 'bbf5513d-c45e-4fae-9b18-1dd3c58e5838', 'ip_version': 4, 'cidr': '201.53.228.64/26', 'allocation_pools': [{'start': '201.53.228.66', 'end': '201.53.228.126'}], 'gateway_ip': '201.53.228.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '201.53.228.66', 'tags': [], 'project_id': '8baff5c6719447d5bfc0cfa0049138ad'}} 2025-08-14 02:30:22,601 - DEBUG - Response for create_subnet : {'subnet': {'id': '0fdf7732-5367-4135-b2e1-13284d47d1ff', 'name': '', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'network_id': 'bbf5513d-c45e-4fae-9b18-1dd3c58e5838', 'ip_version': 6, 'cidr': '246f:df0a:11cc:b06d:b00b:bf4f::/96', 'allocation_pools': [{'start': '246f:df0a:11cc:b06d:b00b:bf4f:0:2', 'end': '246f:df0a:11cc:b06d:b00b:bf4f:ffff:fffe'}], 'gateway_ip': '246f:df0a:11cc:b06d:b00b:bf4f:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '246f:df0a:11cc:b06d:b00b:bf4f:0:2', 'tags': [], 'project_id': '8baff5c6719447d5bfc0cfa0049138ad'}} 2025-08-14 02:30:22,627 - INFO - Created VN ctest-VN1-73214095 2025-08-14 02:30:22,639 - DEBUG - VN ctest-VN1-73214095 UUID is bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:22,816 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095(bbf5513d-c45e-4fae-9b18-1dd3c58e5838) with subnets ['201.53.228.64/26', '246f:df0a:11cc:b06d:b00b:bf4f::/96'] 2025-08-14 02:30:23,120 - DEBUG - Response for create_network : {'network': {'id': 'ba122f5f-73d0-4f35-9882-338b2bdc7b88', 'name': 'ctest-VN2-66889365', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'project_id': '8baff5c6719447d5bfc0cfa0049138ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-VN2-66889365'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 02:30:23,371 - DEBUG - Response for create_subnet : {'subnet': {'id': 'da627d37-c789-489f-a26b-3fdf8d57ef3d', 'name': '', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'network_id': 'ba122f5f-73d0-4f35-9882-338b2bdc7b88', 'ip_version': 4, 'cidr': '30.63.109.64/26', 'allocation_pools': [{'start': '30.63.109.66', 'end': '30.63.109.126'}], 'gateway_ip': '30.63.109.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.63.109.66', 'tags': [], 'project_id': '8baff5c6719447d5bfc0cfa0049138ad'}} 2025-08-14 02:30:23,624 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fee07c38-5fcf-4c09-839f-19de054508ec', 'name': '', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'network_id': 'ba122f5f-73d0-4f35-9882-338b2bdc7b88', 'ip_version': 6, 'cidr': '3eae:2ac0:2e8b:8e6:261a:e3d2::/96', 'allocation_pools': [{'start': '3eae:2ac0:2e8b:8e6:261a:e3d2:0:2', 'end': '3eae:2ac0:2e8b:8e6:261a:e3d2:ffff:fffe'}], 'gateway_ip': '3eae:2ac0:2e8b:8e6:261a:e3d2:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3eae:2ac0:2e8b:8e6:261a:e3d2:0:2', 'tags': [], 'project_id': '8baff5c6719447d5bfc0cfa0049138ad'}} 2025-08-14 02:30:23,649 - INFO - Created VN ctest-VN2-66889365 2025-08-14 02:30:23,662 - DEBUG - VN ctest-VN2-66889365 UUID is ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:24,060 - DEBUG - Response for create_network : {'network': {'id': '9d45d582-cc36-46cb-bd1b-2978efa3ebc4', 'name': 'ctest-VN3-31489156', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'project_id': '8baff5c6719447d5bfc0cfa0049138ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-VN3-31489156'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 02:30:24,339 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b29dc174-f1de-43f9-8bc2-51bc61975da2', 'name': '', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'network_id': '9d45d582-cc36-46cb-bd1b-2978efa3ebc4', 'ip_version': 4, 'cidr': '196.189.101.64/26', 'allocation_pools': [{'start': '196.189.101.66', 'end': '196.189.101.126'}], 'gateway_ip': '196.189.101.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '196.189.101.66', 'tags': [], 'project_id': '8baff5c6719447d5bfc0cfa0049138ad'}} 2025-08-14 02:30:24,568 - DEBUG - Response for create_subnet : {'subnet': {'id': '4144761a-a7f2-47c6-b589-432430283bcb', 'name': '', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'network_id': '9d45d582-cc36-46cb-bd1b-2978efa3ebc4', 'ip_version': 6, 'cidr': '2266:fcc4:fee3:8e23:94d9:c054::/96', 'allocation_pools': [{'start': '2266:fcc4:fee3:8e23:94d9:c054:0:2', 'end': '2266:fcc4:fee3:8e23:94d9:c054:ffff:fffe'}], 'gateway_ip': '2266:fcc4:fee3:8e23:94d9:c054:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2266:fcc4:fee3:8e23:94d9:c054:0:2', 'tags': [], 'project_id': '8baff5c6719447d5bfc0cfa0049138ad'}} 2025-08-14 02:30:24,591 - INFO - Created VN ctest-VN3-31489156 2025-08-14 02:30:24,603 - DEBUG - VN ctest-VN3-31489156 UUID is 9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:24,729 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:24,736 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:24,748 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:24,844 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:24,859 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:24,873 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9e6b9520-e41c-4f0d-a687-b8de3806c3f9 2025-08-14 02:30:24,882 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9e6b9520-e41c-4f0d-a687-b8de3806c3f9 2025-08-14 02:30:24,890 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/01f7829b-d3eb-4ebf-881f-6d095d61a656 2025-08-14 02:30:24,898 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 02:30:24,898 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:24,912 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9e6b9520-e41c-4f0d-a687-b8de3806c3f9 2025-08-14 02:30:24,928 - INFO - Verified VN network id 13 for VN bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:24,929 - INFO - Verifications in API Server for VN ctest-VN1-73214095 passed 2025-08-14 02:30:24,929 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:24,939 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9e6b9520-e41c-4f0d-a687-b8de3806c3f9 2025-08-14 02:30:24,948 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9e6b9520-e41c-4f0d-a687-b8de3806c3f9 2025-08-14 02:30:24,955 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/01f7829b-d3eb-4ebf-881f-6d095d61a656 2025-08-14 02:30:24,971 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13543820780116004782', 'uuid-lslong': '11175715270709631032'}, 'enable': 'true', 'created': '2025-08-14T02:30:22', 'last-modified': '2025-08-14T02:30:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.413897'} 2025-08-14 02:30:24,979 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 02:30:24,984 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13543820780116004782', 'uuid-lslong': '11175715270709631032'}, 'enable': 'true', 'created': '2025-08-14T02:30:22', 'last-modified': '2025-08-14T02:30:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.427255'} 2025-08-14 02:30:24,991 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 02:30:24,999 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13543820780116004782', 'uuid-lslong': '11175715270709631032'}, 'enable': 'true', 'created': '2025-08-14T02:30:22', 'last-modified': '2025-08-14T02:30:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.434464'} 2025-08-14 02:30:25,006 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 02:30:25,006 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-73214095 passed 2025-08-14 02:30:25,007 - DEBUG - ====Verifying policy data for ctest-VN1-73214095 in API_Server ====== 2025-08-14 02:30:25,007 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:25,016 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:25,028 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:25,127 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:25,140 - DEBUG - =>VN ctest-VN1-73214095 has no policy to be verified 2025-08-14 02:30:25,140 - DEBUG - Verifying the vn in opserver 2025-08-14 02:30:25,140 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 virtual network link through opserver 10.0.0.38 2025-08-14 02:30:25,140 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 02:30:25,442 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 02:30:25,499 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095?flat'} 2025-08-14 02:30:25,499 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 virtual network link through opserver 10.0.0.27 2025-08-14 02:30:25,499 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 02:30:25,790 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 02:30:25,850 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095?flat'} 2025-08-14 02:30:25,850 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 virtual network link through opserver 10.0.0.23 2025-08-14 02:30:25,850 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 02:30:26,140 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 02:30:26,196 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095?flat'} 2025-08-14 02:30:26,196 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is found in opserver 2025-08-14 02:30:26,218 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 02:30:26,227 - DEBUG - VRF ids for VN ctest-VN1-73214095: {} 2025-08-14 02:30:26,227 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:26,234 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:26,246 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:26,331 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:26,349 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:26,360 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/94772abf-c26e-4c1e-9a39-37cec6841038 2025-08-14 02:30:26,367 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/94772abf-c26e-4c1e-9a39-37cec6841038 2025-08-14 02:30:26,375 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/483b948b-cd17-4c06-a7e4-f2868f7a6b6b 2025-08-14 02:30:26,384 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 02:30:26,384 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:26,396 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/94772abf-c26e-4c1e-9a39-37cec6841038 2025-08-14 02:30:26,413 - INFO - Verified VN network id 14 for VN ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:26,413 - INFO - Verifications in API Server for VN ctest-VN2-66889365 passed 2025-08-14 02:30:26,414 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:26,424 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/94772abf-c26e-4c1e-9a39-37cec6841038 2025-08-14 02:30:26,434 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/94772abf-c26e-4c1e-9a39-37cec6841038 2025-08-14 02:30:26,446 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/483b948b-cd17-4c06-a7e4-f2868f7a6b6b 2025-08-14 02:30:26,461 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13407831127646818101', 'uuid-lslong': '10989402713566772104'}, 'enable': 'true', 'created': '2025-08-14T02:30:23', 'last-modified': '2025-08-14T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.917179'} 2025-08-14 02:30:26,470 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 02:30:26,475 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13407831127646818101', 'uuid-lslong': '10989402713566772104'}, 'enable': 'true', 'created': '2025-08-14T02:30:23', 'last-modified': '2025-08-14T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.932585'} 2025-08-14 02:30:26,482 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 02:30:26,488 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13407831127646818101', 'uuid-lslong': '10989402713566772104'}, 'enable': 'true', 'created': '2025-08-14T02:30:23', 'last-modified': '2025-08-14T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.948530'} 2025-08-14 02:30:26,495 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 02:30:26,495 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-66889365 passed 2025-08-14 02:30:26,495 - DEBUG - ====Verifying policy data for ctest-VN2-66889365 in API_Server ====== 2025-08-14 02:30:26,495 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:26,502 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:26,515 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:26,610 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:26,623 - DEBUG - =>VN ctest-VN2-66889365 has no policy to be verified 2025-08-14 02:30:26,623 - DEBUG - Verifying the vn in opserver 2025-08-14 02:30:26,623 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 virtual network link through opserver 10.0.0.38 2025-08-14 02:30:26,623 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 02:30:26,675 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365?flat'} 2025-08-14 02:30:26,675 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 virtual network link through opserver 10.0.0.27 2025-08-14 02:30:26,675 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 02:30:26,737 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365?flat'} 2025-08-14 02:30:26,737 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 virtual network link through opserver 10.0.0.23 2025-08-14 02:30:26,737 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 02:30:26,791 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365?flat'} 2025-08-14 02:30:26,791 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 is found in opserver 2025-08-14 02:30:26,814 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 02:30:26,825 - DEBUG - VRF ids for VN ctest-VN2-66889365: {} 2025-08-14 02:30:26,825 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:26,832 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:26,846 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:26,948 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:26,963 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:26,979 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9c5914a0-811c-477c-b67c-98cba0b5abe8 2025-08-14 02:30:26,990 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9c5914a0-811c-477c-b67c-98cba0b5abe8 2025-08-14 02:30:27,000 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/27413878-e5c6-4502-bfea-0ad439c0927f 2025-08-14 02:30:27,013 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 02:30:27,013 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:27,030 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9c5914a0-811c-477c-b67c-98cba0b5abe8 2025-08-14 02:30:27,050 - INFO - Verified VN network id 15 for VN 9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:27,051 - INFO - Verifications in API Server for VN ctest-VN3-31489156 passed 2025-08-14 02:30:27,051 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:27,064 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9c5914a0-811c-477c-b67c-98cba0b5abe8 2025-08-14 02:30:27,074 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9c5914a0-811c-477c-b67c-98cba0b5abe8 2025-08-14 02:30:27,089 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/27413878-e5c6-4502-bfea-0ad439c0927f 2025-08-14 02:30:27,102 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11332698795096295115', 'uuid-lslong': '13626530696932879300'}, 'enable': 'true', 'created': '2025-08-14T02:30:24', 'last-modified': '2025-08-14T02:30:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.604323'} 2025-08-14 02:30:27,109 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 02:30:27,116 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11332698795096295115', 'uuid-lslong': '13626530696932879300'}, 'enable': 'true', 'created': '2025-08-14T02:30:24', 'last-modified': '2025-08-14T02:30:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.618265'} 2025-08-14 02:30:27,129 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 02:30:27,135 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-51944652', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11332698795096295115', 'uuid-lslong': '13626530696932879300'}, 'enable': 'true', 'created': '2025-08-14T02:30:24', 'last-modified': '2025-08-14T02:30:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.642394'} 2025-08-14 02:30:27,140 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 02:30:27,141 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-31489156 passed 2025-08-14 02:30:27,141 - DEBUG - ====Verifying policy data for ctest-VN3-31489156 in API_Server ====== 2025-08-14 02:30:27,141 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:27,148 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:27,162 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:27,247 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/9d45d582-cc36-46cb-bd1b-2978efa3ebc4 2025-08-14 02:30:27,262 - DEBUG - =>VN ctest-VN3-31489156 has no policy to be verified 2025-08-14 02:30:27,262 - DEBUG - Verifying the vn in opserver 2025-08-14 02:30:27,262 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 virtual network link through opserver 10.0.0.38 2025-08-14 02:30:27,262 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 02:30:27,323 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156?flat'} 2025-08-14 02:30:27,323 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 virtual network link through opserver 10.0.0.27 2025-08-14 02:30:27,323 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 02:30:27,376 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156?flat'} 2025-08-14 02:30:27,377 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 virtual network link through opserver 10.0.0.23 2025-08-14 02:30:27,377 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 02:30:27,453 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156?flat'} 2025-08-14 02:30:27,453 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 is found in opserver 2025-08-14 02:30:27,483 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 02:30:27,495 - DEBUG - VRF ids for VN ctest-VN3-31489156: {} 2025-08-14 02:30:27,504 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-14 02:30:27,799 - DEBUG - No source network defined 2025-08-14 02:30:27,800 - DEBUG - No source network defined 2025-08-14 02:30:27,800 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-policy13-28669688, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-policy13-28669688, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-14 02:30:28,080 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-14 02:30:28,313 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:28,320 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:28,333 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:28,439 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:30:28,450 - DEBUG - Setup step: Associating the policy to VN' 2025-08-14 02:30:28,614 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'bbf5513d-c45e-4fae-9b18-1dd3c58e5838', 'name': 'ctest-VN1-73214095', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'project_id': '8baff5c6719447d5bfc0cfa0049138ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['47381222-eba0-45d3-b458-86dad44f4a60', '0fdf7732-5367-4135-b2e1-13284d47d1ff'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-VN1-73214095'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy12-10543478'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy13-28669688']], 'subnet_ipam': [{'subnet_cidr': '201.53.228.64/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ipam1']}, {'subnet_cidr': '246f:df0a:11cc:b06d:b00b:bf4f::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ipam1']}], 'port_security_enabled': True, 'description': ''}} 2025-08-14 02:30:28,791 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy12-10543478'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy13-28669688']] to ctest-VN1-73214095 2025-08-14 02:30:28,791 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:30:28,801 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:30:28,813 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:30:28,907 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:30:28,929 - DEBUG - Setup step: Associating the policy to VN' 2025-08-14 02:30:29,071 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'ba122f5f-73d0-4f35-9882-338b2bdc7b88', 'name': 'ctest-VN2-66889365', 'tenant_id': '8baff5c6719447d5bfc0cfa0049138ad', 'project_id': '8baff5c6719447d5bfc0cfa0049138ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['da627d37-c789-489f-a26b-3fdf8d57ef3d', 'fee07c38-5fcf-4c09-839f-19de054508ec'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-VN2-66889365'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy21-45299424']], 'subnet_ipam': [{'subnet_cidr': '30.63.109.64/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ipam2']}, {'subnet_cidr': '3eae:2ac0:2e8b:8e6:261a:e3d2::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-08-14 02:30:29,169 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy21-45299424']] to ctest-VN2-66889365 2025-08-14 02:30:29,283 - DEBUG - Services list from nova: [, , , ] 2025-08-14 02:30:30,392 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 02:30:31,879 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1) 2025-08-14 02:30:33,259 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 02:30:33,352 - DEBUG - VM is in ACTIVE state now 2025-08-14 02:30:33,352 - INFO - VM name : ctest-VM11-82459966 2025-08-14 02:30:33,434 - DEBUG - VM ctest-VM11-82459966 ID is 321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:30:33,510 - DEBUG - VM is in ACTIVE state now 2025-08-14 02:30:33,542 - DEBUG - VM ctest-VM11-82459966 launched on Node an-jenkins-deploy-platform-ansible-os-3851-2 2025-08-14 02:30:33,675 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:30:34,193 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:30:34,230 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:30:34,239 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9 2025-08-14 02:30:34,251 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:30:34,259 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9 2025-08-14 02:30:34,269 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/30dda16f-38ca-4351-81b3-5593abe2b419 2025-08-14 02:30:34,278 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/d0c6932a-5756-4111-a1bf-a635c6c006f8 2025-08-14 02:30:34,287 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:30:34,287 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:30:34,296 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9 2025-08-14 02:30:34,307 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/30dda16f-38ca-4351-81b3-5593abe2b419 2025-08-14 02:30:34,316 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/d0c6932a-5756-4111-a1bf-a635c6c006f8 2025-08-14 02:30:34,324 - INFO - VM ctest-VM11-82459966 verfication in all API Servers passed 2025-08-14 02:30:34,343 - DEBUG - VM ctest-VM11-82459966 Tap interface: {'index': '3', 'name': 'tapc28aa94f-8f', 'uuid': 'c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095:ctest-VN1-73214095', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'vm_uuid': '321322be-2be2-42af-adfa-ff181815b674', 'vm_name': 'ctest-VM11-82459966', 'ip_addr': '201.53.228.67', 'mac_addr': '02:c2:8a:a9:4f:8f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9', 'sg_uuid_list': ['8b486ba9-5afa-4a76-868a-f4f404950c54'], 'static_route_list': None, 'vm_project_uuid': '8baff5c6-7194-47d5-bfc0-cfa0049138ad', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '246f:df0a:11cc:b06d:b00b:bf4f:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-14 02:30:34,343 - DEBUG - Agent 10.0.0.130 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095:ctest-VN1-73214095 2025-08-14 02:30:34,349 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095:ctest-VN1-73214095', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-14 02:30:34,454 - DEBUG - VM ctest-VM11-82459966 : Tap interface tapc28aa94f-8f is set to Active 2025-08-14 02:30:34,454 - DEBUG - Tap interface tapc28aa94f-8f detail : {'index': '3', 'name': 'tapc28aa94f-8f', 'uuid': 'c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095:ctest-VN1-73214095', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'vm_uuid': '321322be-2be2-42af-adfa-ff181815b674', 'vm_name': 'ctest-VM11-82459966', 'ip_addr': '201.53.228.67', 'mac_addr': '02:c2:8a:a9:4f:8f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9', 'sg_uuid_list': ['8b486ba9-5afa-4a76-868a-f4f404950c54'], 'static_route_list': None, 'vm_project_uuid': '8baff5c6-7194-47d5-bfc0-cfa0049138ad', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '246f:df0a:11cc:b06d:b00b:bf4f:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-14 02:30:34,574 - DEBUG - Starting Layer 2 verification in Agent 2025-08-14 02:30:34,611 - DEBUG - Layer 2 path is seen for VM MAC 02:c2:8a:a9:4f:8f in agent 10.0.0.130 2025-08-14 02:30:34,611 - DEBUG - Active layer 2 route in agent is present for VMI tapc28aa94f-8f 2025-08-14 02:30:34,611 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-14 02:30:34,631 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is found in Agent of node 10.0.0.130 2025-08-14 02:30:34,813 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is consistent in agent 10.0.0.130 2025-08-14 02:30:34,813 - DEBUG - Route for VM IP ['201.53.228.67', '246f:df0a:11cc:b06d:b00b:bf4f:0:3'] is consistent in agent 10.0.0.130 2025-08-14 02:30:34,813 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 verification for VM ctest-VM11-82459966 in Agent 10.0.0.130 passed 2025-08-14 02:30:34,889 - DEBUG - Starting all layer 2 verification in agent 10.0.0.130 2025-08-14 02:30:34,912 - DEBUG - Route for VM MAC 02:c2:8a:a9:4f:8f is consistent in agent 10.0.0.130 2025-08-14 02:30:38,096 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-14 02:30:38,096 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:30:38,111 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:30:38,111 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:30:42,186 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-14 02:30:42,187 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:30:42,202 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:30:42,202 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:30:46,285 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 02:30:46,285 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:30:46,303 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:30:46,303 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:30:50,380 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-14 02:30:50,381 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:30:50,399 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:30:50,399 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:30:54,482 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-14 02:30:54,482 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:30:54,497 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:30:54,497 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:30:58,568 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-14 02:30:58,568 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:30:58,582 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:30:58,583 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:31:02,668 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-14 02:31:02,669 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:31:02,687 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:31:02,687 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:31:06,766 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-14 02:31:06,767 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:31:06,781 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:31:06,782 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:31:10,864 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-14 02:31:10,864 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 failed! 2025-08-14 02:31:10,881 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 201.53.228.65 and allocation pool is NOT set 2025-08-14 02:31:10,881 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 is 246f:df0a:11cc:b06d:b00b:bf4f:0:1 and allocation pool is NOT set 2025-08-14 02:31:12,946 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=14.2 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.64 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.641/8.436/14.232/5.795 ms') 2025-08-14 02:31:12,946 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 passed 2025-08-14 02:31:12,946 - INFO - VM ctest-VM11-82459966 verifications in Compute nodes passed 2025-08-14 02:31:13,216 - DEBUG - Validated VM route 201.53.228.67 in vrouter of 10.0.0.130 2025-08-14 02:31:13,221 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-14 02:31:13,221 - INFO - Validated routes of VM ctest-VM11-82459966 in all vrouters 2025-08-14 02:31:13,685 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-08-14 02:31:13,818 - DEBUG - Layer2 route found for VM MAC 02:c2:8a:a9:4f:8f in Control-node 10.0.0.27 2025-08-14 02:31:13,818 - DEBUG - L2 Label for VM ctest-VM11-82459966 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29 2025-08-14 02:31:13,937 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.27, not supported 2025-08-14 02:31:13,938 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node 2025-08-14 02:31:14,073 - DEBUG - Layer2 route found for VM MAC 02:c2:8a:a9:4f:8f in Control-node 10.0.0.23 2025-08-14 02:31:14,073 - DEBUG - L2 Label for VM ctest-VM11-82459966 same between Control-node 10.0.0.23 and Agent, Expected: 29, Seen: 29 2025-08-14 02:31:14,190 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.23, not supported 2025-08-14 02:31:14,190 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-08-14 02:31:14,321 - DEBUG - Layer2 route found for VM MAC 02:c2:8a:a9:4f:8f in Control-node 10.0.0.38 2025-08-14 02:31:14,322 - DEBUG - L2 Label for VM ctest-VM11-82459966 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2025-08-14 02:31:14,437 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.38, not supported 2025-08-14 02:31:14,437 - INFO - Verification in Control-nodes for VM ctest-VM11-82459966 passed 2025-08-14 02:31:14,437 - DEBUG - Verifying the vm in opserver 2025-08-14 02:31:14,437 - DEBUG - Verifying in collector 10.0.0.23 ... 2025-08-14 02:31:14,437 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/321322be-2be2-42af-adfa-ff181815b674?flat 2025-08-14 02:31:14,457 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9?flat 2025-08-14 02:31:14,479 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9?flat 2025-08-14 02:31:14,500 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9?flat 2025-08-14 02:31:14,527 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/321322be-2be2-42af-adfa-ff181815b674?flat 2025-08-14 02:31:14,546 - DEBUG - Verifying vm in vn uve 2025-08-14 02:31:14,547 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9?flat 2025-08-14 02:31:14,569 - DEBUG - VM uve shows interface as {'rx_vlan': 65535, 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095', 'port_mirror_enabled': False, 'fixed_ip6_list': ['246f:df0a:11cc:b06d:b00b:bf4f:0:3'], 'label': 25, 'is_health_check_active': True, 'mac_address': '02:c2:8a:a9:4f:8f', 'ip4_active': True, 'fixed_ip4_list': ['201.53.228.67'], 'uuid': 'c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9', 'l2_active': True, 'ip6_active': True, 'tx_vlan': 65535, 'vm_name': 'ctest-VM11-82459966', 'ip6_address': '246f:df0a:11cc:b06d:b00b:bf4f:0:3', 'gateway': '201.53.228.65', '__T': 1755138640132739, 'active': True, 'vhostuser_mode': 0, 'ip_address': '201.53.228.67', 'vn_uuid': 'bbf5513d-c45e-4fae-9b18-1dd3c58e5838', 'vm_uuid': '321322be-2be2-42af-adfa-ff181815b674', 'admin_state': True} 2025-08-14 02:31:14,569 - DEBUG - VM uve shows ip address as ['201.53.228.67', '246f:df0a:11cc:b06d:b00b:bf4f:0:3'] 2025-08-14 02:31:14,569 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 2025-08-14 02:31:14,569 - INFO - Verifying through opserver in 10.0.0.38 2025-08-14 02:31:14,569 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095?flat 2025-08-14 02:31:14,596 - DEBUG - expected vm list 321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:31:14,596 - DEBUG - Extracted vm list ['321322be-2be2-42af-adfa-ff181815b674'] 2025-08-14 02:31:14,596 - INFO - VM 321322be-2be2-42af-adfa-ff181815b674 is present in default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 2025-08-14 02:31:14,596 - DEBUG - Verifying vm in vrouter uve 2025-08-14 02:31:14,596 - DEBUG - Getting info from collector 10.0.0.23.. 2025-08-14 02:31:14,596 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/321322be-2be2-42af-adfa-ff181815b674?flat 2025-08-14 02:31:14,617 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3851-2'] 2025-08-14 02:31:14,617 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:14,661 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:31:14,699 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:14,699 - DEBUG - Validated that VM ctest-VM11-82459966 is in Vrouter an-jenkins-deploy-platform-ansible-os-3851-2 UVE 2025-08-14 02:31:14,699 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-14 02:31:14,707 - DEBUG - Expected tap interface of VM uuid 321322be-2be2-42af-adfa-ff181815b674 is default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9 2025-08-14 02:31:14,707 - DEBUG - Expected VN of VM uuid 321322be-2be2-42af-adfa-ff181815b674 is default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 2025-08-14 02:31:14,707 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:14,748 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:31:14,785 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:14,785 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-51944652:c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9 of vm 321322be-2be2-42af-adfa-ff181815b674 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:14,785 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 of vm 321322be-2be2-42af-adfa-ff181815b674 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:14,785 - DEBUG - Verifying the 321322be-2be2-42af-adfa-ff181815b674 virtual network link through opserver 10.0.0.38 2025-08-14 02:31:14,785 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-14 02:31:14,798 - DEBUG - VM link and name as {'name': '321322be-2be2-42af-adfa-ff181815b674', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/321322be-2be2-42af-adfa-ff181815b674?flat'} 2025-08-14 02:31:14,798 - DEBUG - Verifying the 321322be-2be2-42af-adfa-ff181815b674 virtual network link through opserver 10.0.0.27 2025-08-14 02:31:14,798 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-14 02:31:14,810 - DEBUG - VM link and name as {'name': '321322be-2be2-42af-adfa-ff181815b674', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/321322be-2be2-42af-adfa-ff181815b674?flat'} 2025-08-14 02:31:14,810 - DEBUG - Verifying the 321322be-2be2-42af-adfa-ff181815b674 virtual network link through opserver 10.0.0.23 2025-08-14 02:31:14,810 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-08-14 02:31:14,834 - DEBUG - VM link and name as {'name': '321322be-2be2-42af-adfa-ff181815b674', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/321322be-2be2-42af-adfa-ff181815b674?flat'} 2025-08-14 02:31:14,834 - INFO - VM ctest-VM11-82459966 validations in Opserver passed 2025-08-14 02:31:14,940 - DEBUG - VM is in ACTIVE state now 2025-08-14 02:31:14,940 - INFO - VM name : ctest-VM21-54951797 2025-08-14 02:31:15,025 - DEBUG - VM ctest-VM21-54951797 ID is e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:15,100 - DEBUG - VM is in ACTIVE state now 2025-08-14 02:31:15,100 - DEBUG - VM ctest-VM21-54951797 launched on Node an-jenkins-deploy-platform-ansible-os-3851-1 2025-08-14 02:31:15,173 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:15,185 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:15,193 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09 2025-08-14 02:31:15,205 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:15,214 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09 2025-08-14 02:31:15,225 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/906a436d-c9da-4d62-adcd-d77f82c27bf0 2025-08-14 02:31:15,236 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/b24f9bb4-cd15-42c0-b098-96fa1c857ea2 2025-08-14 02:31:15,246 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:31:15,246 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:15,255 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09 2025-08-14 02:31:15,266 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/906a436d-c9da-4d62-adcd-d77f82c27bf0 2025-08-14 02:31:15,276 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/b24f9bb4-cd15-42c0-b098-96fa1c857ea2 2025-08-14 02:31:15,287 - INFO - VM ctest-VM21-54951797 verfication in all API Servers passed 2025-08-14 02:31:15,306 - DEBUG - VM ctest-VM21-54951797 Tap interface: {'index': '3', 'name': 'tapc94e302d-8d', 'uuid': 'c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365:ctest-VN2-66889365', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'vm_uuid': 'e78a5b0c-908e-485a-af66-6cef88b8eaed', 'vm_name': 'ctest-VM21-54951797', 'ip_addr': '30.63.109.67', 'mac_addr': '02:c9:4e:30:2d:8d', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '44', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09', 'sg_uuid_list': ['8b486ba9-5afa-4a76-868a-f4f404950c54'], 'static_route_list': None, 'vm_project_uuid': '8baff5c6-7194-47d5-bfc0-cfa0049138ad', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '3eae:2ac0:2e8b:8e6:261a:e3d2:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-14 02:31:15,306 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365:ctest-VN2-66889365 2025-08-14 02:31:15,313 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365:ctest-VN2-66889365', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.18:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-14 02:31:15,410 - DEBUG - VM ctest-VM21-54951797 : Tap interface tapc94e302d-8d is set to Active 2025-08-14 02:31:15,410 - DEBUG - Tap interface tapc94e302d-8d detail : {'index': '3', 'name': 'tapc94e302d-8d', 'uuid': 'c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365:ctest-VN2-66889365', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'vm_uuid': 'e78a5b0c-908e-485a-af66-6cef88b8eaed', 'vm_name': 'ctest-VM21-54951797', 'ip_addr': '30.63.109.67', 'mac_addr': '02:c9:4e:30:2d:8d', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '44', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09', 'sg_uuid_list': ['8b486ba9-5afa-4a76-868a-f4f404950c54'], 'static_route_list': None, 'vm_project_uuid': '8baff5c6-7194-47d5-bfc0-cfa0049138ad', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '3eae:2ac0:2e8b:8e6:261a:e3d2:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-14 02:31:15,525 - DEBUG - Starting Layer 2 verification in Agent 2025-08-14 02:31:15,540 - DEBUG - Layer 2 path is seen for VM MAC 02:c9:4e:30:2d:8d in agent 10.0.0.65 2025-08-14 02:31:15,540 - DEBUG - Active layer 2 route in agent is present for VMI tapc94e302d-8d 2025-08-14 02:31:15,540 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-14 02:31:15,548 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 is found in Agent of node 10.0.0.65 2025-08-14 02:31:15,698 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 is consistent in agent 10.0.0.65 2025-08-14 02:31:15,698 - DEBUG - Route for VM IP ['3eae:2ac0:2e8b:8e6:261a:e3d2:0:3', '30.63.109.67'] is consistent in agent 10.0.0.65 2025-08-14 02:31:15,698 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 verification for VM ctest-VM21-54951797 in Agent 10.0.0.65 passed 2025-08-14 02:31:15,813 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-08-14 02:31:15,827 - DEBUG - Route for VM MAC 02:c9:4e:30:2d:8d is consistent in agent 10.0.0.65 2025-08-14 02:31:17,102 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.47 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=82.9 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 4.467/43.684/82.901/39.217 ms') 2025-08-14 02:31:17,102 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-54951797 passed 2025-08-14 02:31:17,102 - INFO - VM ctest-VM21-54951797 verifications in Compute nodes passed 2025-08-14 02:31:17,350 - DEBUG - Validated VM route 30.63.109.67 in vrouter of 10.0.0.65 2025-08-14 02:31:17,356 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-14 02:31:17,356 - INFO - Validated routes of VM ctest-VM21-54951797 in all vrouters 2025-08-14 02:31:17,824 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-08-14 02:31:17,942 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.27, not supported 2025-08-14 02:31:18,073 - DEBUG - Layer2 route found for VM MAC 02:c9:4e:30:2d:8d in Control-node 10.0.0.27 2025-08-14 02:31:18,073 - DEBUG - L2 Label for VM ctest-VM21-54951797 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29 2025-08-14 02:31:18,073 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node 2025-08-14 02:31:18,184 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.23, not supported 2025-08-14 02:31:18,310 - DEBUG - Layer2 route found for VM MAC 02:c9:4e:30:2d:8d in Control-node 10.0.0.23 2025-08-14 02:31:18,310 - DEBUG - L2 Label for VM ctest-VM21-54951797 same between Control-node 10.0.0.23 and Agent, Expected: 29, Seen: 29 2025-08-14 02:31:18,310 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-08-14 02:31:18,426 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.38, not supported 2025-08-14 02:31:18,554 - DEBUG - Layer2 route found for VM MAC 02:c9:4e:30:2d:8d in Control-node 10.0.0.38 2025-08-14 02:31:18,554 - DEBUG - L2 Label for VM ctest-VM21-54951797 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2025-08-14 02:31:18,555 - INFO - Verification in Control-nodes for VM ctest-VM21-54951797 passed 2025-08-14 02:31:18,555 - DEBUG - Verifying the vm in opserver 2025-08-14 02:31:18,555 - DEBUG - Verifying in collector 10.0.0.23 ... 2025-08-14 02:31:18,555 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed?flat 2025-08-14 02:31:18,572 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09?flat 2025-08-14 02:31:18,596 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09?flat 2025-08-14 02:31:18,619 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09?flat 2025-08-14 02:31:18,645 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed?flat 2025-08-14 02:31:18,676 - DEBUG - Verifying vm in vn uve 2025-08-14 02:31:18,677 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09?flat 2025-08-14 02:31:18,704 - DEBUG - VM uve shows interface as {'uuid': 'c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09', 'ip6_address': '3eae:2ac0:2e8b:8e6:261a:e3d2:0:3', 'active': True, 'ip4_active': True, 'fixed_ip4_list': ['30.63.109.67'], 'ip_address': '30.63.109.67', 'vm_name': 'ctest-VM21-54951797', 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365', 'l2_active': True, 'admin_state': True, 'port_mirror_enabled': False, 'fixed_ip6_list': ['3eae:2ac0:2e8b:8e6:261a:e3d2:0:3'], '__T': 1755138641967729, 'label': 25, 'vhostuser_mode': 0, 'tx_vlan': 65535, 'vm_uuid': 'e78a5b0c-908e-485a-af66-6cef88b8eaed', 'rx_vlan': 65535, 'ip6_active': True, 'vn_uuid': 'ba122f5f-73d0-4f35-9882-338b2bdc7b88', 'mac_address': '02:c9:4e:30:2d:8d', 'gateway': '30.63.109.65', 'is_health_check_active': True} 2025-08-14 02:31:18,704 - DEBUG - VM uve shows ip address as ['30.63.109.67', '3eae:2ac0:2e8b:8e6:261a:e3d2:0:3'] 2025-08-14 02:31:18,704 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 2025-08-14 02:31:18,704 - INFO - Verifying through opserver in 10.0.0.38 2025-08-14 02:31:18,704 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365?flat 2025-08-14 02:31:18,736 - DEBUG - expected vm list e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:18,736 - DEBUG - Extracted vm list ['e78a5b0c-908e-485a-af66-6cef88b8eaed'] 2025-08-14 02:31:18,736 - INFO - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is present in default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 2025-08-14 02:31:18,737 - DEBUG - Verifying vm in vrouter uve 2025-08-14 02:31:18,737 - DEBUG - Getting info from collector 10.0.0.23.. 2025-08-14 02:31:18,737 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed?flat 2025-08-14 02:31:18,755 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3851-1'] 2025-08-14 02:31:18,755 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:18,801 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:31:18,843 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:31:18,843 - DEBUG - Validated that VM ctest-VM21-54951797 is in Vrouter an-jenkins-deploy-platform-ansible-os-3851-1 UVE 2025-08-14 02:31:18,843 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-14 02:31:18,860 - DEBUG - Expected tap interface of VM uuid e78a5b0c-908e-485a-af66-6cef88b8eaed is default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09 2025-08-14 02:31:18,860 - DEBUG - Expected VN of VM uuid e78a5b0c-908e-485a-af66-6cef88b8eaed is default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 2025-08-14 02:31:18,860 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:18,905 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:31:18,942 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:31:18,942 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-51944652:c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09 of vm e78a5b0c-908e-485a-af66-6cef88b8eaed is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:31:18,942 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 of vm e78a5b0c-908e-485a-af66-6cef88b8eaed is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:31:18,942 - DEBUG - Verifying the e78a5b0c-908e-485a-af66-6cef88b8eaed virtual network link through opserver 10.0.0.38 2025-08-14 02:31:18,943 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-14 02:31:18,955 - DEBUG - VM link and name as {'name': 'e78a5b0c-908e-485a-af66-6cef88b8eaed', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed?flat'} 2025-08-14 02:31:18,955 - DEBUG - Verifying the e78a5b0c-908e-485a-af66-6cef88b8eaed virtual network link through opserver 10.0.0.27 2025-08-14 02:31:18,955 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-14 02:31:18,970 - DEBUG - VM link and name as {'name': 'e78a5b0c-908e-485a-af66-6cef88b8eaed', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed?flat'} 2025-08-14 02:31:18,970 - DEBUG - Verifying the e78a5b0c-908e-485a-af66-6cef88b8eaed virtual network link through opserver 10.0.0.23 2025-08-14 02:31:18,970 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-08-14 02:31:18,982 - DEBUG - VM link and name as {'name': 'e78a5b0c-908e-485a-af66-6cef88b8eaed', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed?flat'} 2025-08-14 02:31:18,982 - INFO - VM ctest-VM21-54951797 validations in Opserver passed 2025-08-14 02:31:19,063 - DEBUG - VM is in ACTIVE state now 2025-08-14 02:31:19,063 - INFO - VM name : ctest-VM31-26766365 2025-08-14 02:31:19,139 - DEBUG - VM ctest-VM31-26766365 ID is c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:19,212 - DEBUG - VM is in ACTIVE state now 2025-08-14 02:31:19,212 - DEBUG - VM ctest-VM31-26766365 launched on Node an-jenkins-deploy-platform-ansible-os-3851-2 2025-08-14 02:31:19,285 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:19,295 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:19,304 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/0de6c092-62f6-421c-8ce9-6e215b60b09c 2025-08-14 02:31:19,315 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:19,323 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/0de6c092-62f6-421c-8ce9-6e215b60b09c 2025-08-14 02:31:19,334 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/f0abd49b-5759-4e84-9706-0791ff5417af 2025-08-14 02:31:19,345 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/f795d6b7-1b8e-4f4d-91ce-6aa984f36c24 2025-08-14 02:31:19,355 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:31:19,355 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:19,363 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/0de6c092-62f6-421c-8ce9-6e215b60b09c 2025-08-14 02:31:19,373 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/f0abd49b-5759-4e84-9706-0791ff5417af 2025-08-14 02:31:19,382 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/f795d6b7-1b8e-4f4d-91ce-6aa984f36c24 2025-08-14 02:31:19,390 - INFO - VM ctest-VM31-26766365 verfication in all API Servers passed 2025-08-14 02:31:19,415 - DEBUG - VM ctest-VM31-26766365 Tap interface: {'index': '4', 'name': 'tap0de6c092-62', 'uuid': '0de6c092-62f6-421c-8ce9-6e215b60b09c', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156:ctest-VN3-31489156', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'vm_uuid': 'c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7', 'vm_name': 'ctest-VM31-26766365', 'ip_addr': '196.189.101.67', 'mac_addr': '02:0d:e6:c0:92:62', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c', 'sg_uuid_list': ['8b486ba9-5afa-4a76-868a-f4f404950c54'], 'static_route_list': None, 'vm_project_uuid': '8baff5c6-7194-47d5-bfc0-cfa0049138ad', 'admin_state': 'Enabled', 'flow_key_idx': '38', 'allowed_address_pair_list': None, 'ip6_addr': '2266:fcc4:fee3:8e23:94d9:c054:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-14 02:31:19,415 - DEBUG - Agent 10.0.0.130 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156:ctest-VN3-31489156 2025-08-14 02:31:19,422 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156:ctest-VN3-31489156', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'table_label': '-1', 'vxlan_id': '15', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.192:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-14 02:31:19,517 - DEBUG - VM ctest-VM31-26766365 : Tap interface tap0de6c092-62 is set to Active 2025-08-14 02:31:19,517 - DEBUG - Tap interface tap0de6c092-62 detail : {'index': '4', 'name': 'tap0de6c092-62', 'uuid': '0de6c092-62f6-421c-8ce9-6e215b60b09c', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156:ctest-VN3-31489156', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'vm_uuid': 'c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7', 'vm_name': 'ctest-VM31-26766365', 'ip_addr': '196.189.101.67', 'mac_addr': '02:0d:e6:c0:92:62', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c', 'sg_uuid_list': ['8b486ba9-5afa-4a76-868a-f4f404950c54'], 'static_route_list': None, 'vm_project_uuid': '8baff5c6-7194-47d5-bfc0-cfa0049138ad', 'admin_state': 'Enabled', 'flow_key_idx': '38', 'allowed_address_pair_list': None, 'ip6_addr': '2266:fcc4:fee3:8e23:94d9:c054:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-14 02:31:19,630 - DEBUG - Starting Layer 2 verification in Agent 2025-08-14 02:31:19,644 - DEBUG - Layer 2 path is seen for VM MAC 02:0d:e6:c0:92:62 in agent 10.0.0.130 2025-08-14 02:31:19,644 - DEBUG - Active layer 2 route in agent is present for VMI tap0de6c092-62 2025-08-14 02:31:19,644 - DEBUG - L2 label(36) matches bw route table and interface table 2025-08-14 02:31:19,663 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 is found in Agent of node 10.0.0.130 2025-08-14 02:31:19,762 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 is consistent in agent 10.0.0.130 2025-08-14 02:31:19,762 - DEBUG - Route for VM IP ['196.189.101.67', '2266:fcc4:fee3:8e23:94d9:c054:0:3'] is consistent in agent 10.0.0.130 2025-08-14 02:31:19,762 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 verification for VM ctest-VM31-26766365 in Agent 10.0.0.130 passed 2025-08-14 02:31:19,882 - DEBUG - Starting all layer 2 verification in agent 10.0.0.130 2025-08-14 02:31:19,895 - DEBUG - Route for VM MAC 02:0d:e6:c0:92:62 is consistent in agent 10.0.0.130 2025-08-14 02:31:21,085 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=10.1 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.07 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.065/6.595/10.125/3.530 ms') 2025-08-14 02:31:21,085 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-26766365 passed 2025-08-14 02:31:21,085 - INFO - VM ctest-VM31-26766365 verifications in Compute nodes passed 2025-08-14 02:31:21,324 - DEBUG - Validated VM route 196.189.101.67 in vrouter of 10.0.0.130 2025-08-14 02:31:21,327 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-14 02:31:21,327 - INFO - Validated routes of VM ctest-VM31-26766365 in all vrouters 2025-08-14 02:31:21,865 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-08-14 02:31:21,994 - DEBUG - Layer2 route found for VM MAC 02:0d:e6:c0:92:62 in Control-node 10.0.0.27 2025-08-14 02:31:21,994 - DEBUG - L2 Label for VM ctest-VM31-26766365 same between Control-node 10.0.0.27 and Agent, Expected: 36, Seen: 36 2025-08-14 02:31:22,113 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.27, not supported 2025-08-14 02:31:22,113 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-08-14 02:31:22,237 - DEBUG - Layer2 route found for VM MAC 02:0d:e6:c0:92:62 in Control-node 10.0.0.38 2025-08-14 02:31:22,237 - DEBUG - L2 Label for VM ctest-VM31-26766365 same between Control-node 10.0.0.38 and Agent, Expected: 36, Seen: 36 2025-08-14 02:31:22,349 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.38, not supported 2025-08-14 02:31:22,350 - INFO - Verification in Control-nodes for VM ctest-VM31-26766365 passed 2025-08-14 02:31:22,350 - DEBUG - Verifying the vm in opserver 2025-08-14 02:31:22,350 - DEBUG - Verifying in collector 10.0.0.23 ... 2025-08-14 02:31:22,350 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7?flat 2025-08-14 02:31:22,368 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c?flat 2025-08-14 02:31:22,389 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c?flat 2025-08-14 02:31:22,410 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c?flat 2025-08-14 02:31:22,433 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7?flat 2025-08-14 02:31:22,452 - DEBUG - Verifying vm in vn uve 2025-08-14 02:31:22,452 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c?flat 2025-08-14 02:31:22,474 - DEBUG - VM uve shows interface as {'rx_vlan': 65535, 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156', 'port_mirror_enabled': False, 'fixed_ip6_list': ['2266:fcc4:fee3:8e23:94d9:c054:0:3'], 'label': 32, 'is_health_check_active': True, 'mac_address': '02:0d:e6:c0:92:62', 'ip4_active': True, 'fixed_ip4_list': ['196.189.101.67'], 'uuid': '0de6c092-62f6-421c-8ce9-6e215b60b09c', 'l2_active': True, 'ip6_active': True, 'tx_vlan': 65535, 'vm_name': 'ctest-VM31-26766365', 'ip6_address': '2266:fcc4:fee3:8e23:94d9:c054:0:3', 'gateway': '196.189.101.65', '__T': 1755138640132712, 'active': True, 'vhostuser_mode': 0, 'ip_address': '196.189.101.67', 'vn_uuid': '9d45d582-cc36-46cb-bd1b-2978efa3ebc4', 'vm_uuid': 'c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7', 'admin_state': True} 2025-08-14 02:31:22,474 - DEBUG - VM uve shows ip address as ['196.189.101.67', '2266:fcc4:fee3:8e23:94d9:c054:0:3'] 2025-08-14 02:31:22,474 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 2025-08-14 02:31:22,474 - INFO - Verifying through opserver in 10.0.0.38 2025-08-14 02:31:22,474 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156?flat 2025-08-14 02:31:22,497 - DEBUG - expected vm list c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:22,497 - DEBUG - Extracted vm list ['c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7'] 2025-08-14 02:31:22,497 - INFO - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is present in default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 2025-08-14 02:31:22,497 - DEBUG - Verifying vm in vrouter uve 2025-08-14 02:31:22,497 - DEBUG - Getting info from collector 10.0.0.23.. 2025-08-14 02:31:22,497 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7?flat 2025-08-14 02:31:22,515 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3851-2'] 2025-08-14 02:31:22,515 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:22,556 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:31:22,594 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:22,594 - DEBUG - Validated that VM ctest-VM31-26766365 is in Vrouter an-jenkins-deploy-platform-ansible-os-3851-2 UVE 2025-08-14 02:31:22,594 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-14 02:31:22,602 - DEBUG - Expected tap interface of VM uuid c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c 2025-08-14 02:31:22,602 - DEBUG - Expected VN of VM uuid c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 2025-08-14 02:31:22,602 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:22,644 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:31:22,697 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:22,697 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-51944652:0de6c092-62f6-421c-8ce9-6e215b60b09c of vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:22,697 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 of vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:31:22,697 - DEBUG - Verifying the c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 virtual network link through opserver 10.0.0.38 2025-08-14 02:31:22,697 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-14 02:31:22,710 - DEBUG - VM link and name as {'name': 'c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7?flat'} 2025-08-14 02:31:22,711 - DEBUG - Verifying the c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 virtual network link through opserver 10.0.0.27 2025-08-14 02:31:22,711 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-14 02:31:22,726 - DEBUG - VM link and name as {'name': 'c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7?flat'} 2025-08-14 02:31:22,726 - DEBUG - Verifying the c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 virtual network link through opserver 10.0.0.23 2025-08-14 02:31:22,726 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-08-14 02:31:22,739 - DEBUG - VM link and name as {'name': 'c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7?flat'} 2025-08-14 02:31:22,739 - INFO - VM ctest-VM31-26766365 validations in Opserver passed 2025-08-14 02:31:22,739 - INFO - Waiting for VM ctest-VM11-82459966 to be up.. 2025-08-14 02:31:22,740 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:22,740 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:31:22,751 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c28aa94f-8f64-4f8c-9a9c-d66f4db3b7e9 2025-08-14 02:31:23,938 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.02 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.612 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.612/1.316/2.020/0.704 ms') 2025-08-14 02:31:23,938 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-82459966 passed 2025-08-14 02:31:24,010 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:24,010 - DEBUG - Waiting to SSH to VM ctest-VM11-82459966, IP 201.53.228.67, Port 22 2025-08-14 02:31:24,077 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 02:31:24,160 - DEBUG - VM ctest-VM11-82459966 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 02:31:29,161 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:29,161 - DEBUG - Waiting to SSH to VM ctest-VM11-82459966, IP 201.53.228.67, Port 22 2025-08-14 02:31:29,219 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-14 02:31:29,311 - DEBUG - VM ctest-VM11-82459966 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-14 02:31:34,312 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:34,312 - DEBUG - Waiting to SSH to VM ctest-VM11-82459966, IP 201.53.228.67, Port 22 2025-08-14 02:31:34,470 - DEBUG - VM ctest-VM11-82459966 is ready for SSH connections 2025-08-14 02:31:34,470 - INFO - Waiting for VM ctest-VM21-54951797 to be up.. 2025-08-14 02:31:34,470 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:34,471 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:31:34,480 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c94e302d-8dc8-4ee9-a7f8-1f7ee240eb09 2025-08-14 02:31:35,646 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.00 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.346 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.346/4.172/7.998/3.826 ms') 2025-08-14 02:31:35,647 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-54951797 passed 2025-08-14 02:31:35,722 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:35,722 - DEBUG - Waiting to SSH to VM ctest-VM21-54951797, IP 30.63.109.67, Port 22 2025-08-14 02:31:35,879 - DEBUG - VM ctest-VM21-54951797 is ready for SSH connections 2025-08-14 02:31:35,879 - INFO - Waiting for VM ctest-VM31-26766365 to be up.. 2025-08-14 02:31:35,879 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:35,879 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:35,889 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/0de6c092-62f6-421c-8ce9-6e215b60b09c 2025-08-14 02:31:37,078 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.59 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.02 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.019/4.302/6.586/2.283 ms') 2025-08-14 02:31:37,079 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-26766365 passed 2025-08-14 02:31:37,150 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-14 02:31:37,150 - DEBUG - Waiting to SSH to VM ctest-VM31-26766365, IP 196.189.101.67, Port 22 2025-08-14 02:31:37,316 - DEBUG - VM ctest-VM31-26766365 is ready for SSH connections 2025-08-14 02:31:37,317 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 30.63.109.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 02:31:37,317 - DEBUG - ping -s 56 -c 3 -W 1 30.63.109.67 2025-08-14 02:31:54,923 - DEBUG - PING 30.63.109.67 (30.63.109.67) 56(84) bytes of data. 64 bytes from 30.63.109.67: icmp_req=1 ttl=63 time=5.21 ms 64 bytes from 30.63.109.67: icmp_req=2 ttl=63 time=1.22 ms 64 bytes from 30.63.109.67: icmp_req=3 ttl=63 time=0.902 ms --- 30.63.109.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.902/2.446/5.214/1.961 ms 2025-08-14 02:31:54,923 - INFO - Ping to IP 30.63.109.67 from VM ctest-VM11-82459966 passed 2025-08-14 02:31:54,924 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-08-14 02:31:54,924 - DEBUG - ping6 -s 56 -c 3 -W 1 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3 2025-08-14 02:31:57,387 - DEBUG - PING 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3(3eae:2ac0:2e8b:8e6:261a:e3d2:0:3) 56 data bytes 64 bytes from 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3: icmp_seq=1 ttl=64 time=7.63 ms 64 bytes from 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3: icmp_seq=2 ttl=64 time=1.12 ms 64 bytes from 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3: icmp_seq=3 ttl=64 time=1.17 ms --- 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.121/3.312/7.637/3.058 ms 2025-08-14 02:31:57,387 - INFO - Ping to IP 3eae:2ac0:2e8b:8e6:261a:e3d2:0:3 from VM ctest-VM11-82459966 passed 2025-08-14 02:31:57,387 - INFO - Test with src as policy and dst as any PASSED 2025-08-14 02:31:57,387 - INFO - Deleting VM ctest-VM31-26766365 2025-08-14 02:31:57,449 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:31:57,449 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:57,459 - DEBUG - VM ID c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 of VM ctest-VM31-26766365 is still found in API Server 2025-08-14 02:31:59,459 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:31:59,460 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:59,467 - DEBUG - Response Code: 404 2025-08-14 02:31:59,468 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:59,474 - DEBUG - Response Code: 404 2025-08-14 02:31:59,474 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 2025-08-14 02:31:59,481 - DEBUG - Response Code: 404 2025-08-14 02:31:59,481 - INFO - VM ctest-VM31-26766365 is fully removed in API-Server 2025-08-14 02:31:59,635 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-14 02:31:59,680 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 2025-08-14 02:31:59,692 - DEBUG - Validated that vrouter 10.0.0.130 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 2025-08-14 02:31:59,692 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 2025-08-14 02:31:59,692 - INFO - VM ctest-VM31-26766365 is removed in Compute, and routes are removed in all compute nodes 2025-08-14 02:31:59,931 - INFO - Routes for VM ctest-VM31-26766365 is removed in all control-nodes 2025-08-14 02:31:59,931 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:31:59,974 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:00,012 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:00,012 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:00,012 - DEBUG - interface for vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 deleted from vrouter uve ... 2025-08-14 02:32:00,013 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:03,014 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:03,058 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:03,109 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:03,109 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:03,109 - DEBUG - interface for vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 deleted from vrouter uve ... 2025-08-14 02:32:03,109 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:06,109 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:06,169 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:06,208 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:06,208 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:06,208 - DEBUG - interface for vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 deleted from vrouter uve ... 2025-08-14 02:32:06,208 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:09,208 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:09,250 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:09,288 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:09,288 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:09,288 - DEBUG - interface for vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 deleted from vrouter uve ... 2025-08-14 02:32:09,288 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:12,289 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:12,333 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:12,379 - DEBUG - VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:12,379 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:12,379 - DEBUG - interface for vm c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 deleted from vrouter uve ... 2025-08-14 02:32:12,379 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:12,379 - DEBUG - Validated that VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is removed in Vrouter UVE 2025-08-14 02:32:12,379 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-14 02:32:12,379 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156?flat 2025-08-14 02:32:12,399 - DEBUG - c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 BM not in default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN3-31489156 uve 2025-08-14 02:32:12,399 - DEBUG - Validated that VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is not present in the VN UVE 2025-08-14 02:32:12,399 - DEBUG - Verifying the c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 virtual network link through opserver 10.0.0.38 2025-08-14 02:32:12,399 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-14 02:32:12,412 - INFO - c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 vm uve deleted from opserver 2025-08-14 02:32:12,412 - DEBUG - Verifying the c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 virtual network link through opserver 10.0.0.27 2025-08-14 02:32:12,412 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-14 02:32:12,427 - INFO - c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 vm uve deleted from opserver 2025-08-14 02:32:12,427 - DEBUG - Verifying the c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 virtual network link through opserver 10.0.0.23 2025-08-14 02:32:12,427 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-08-14 02:32:12,442 - INFO - c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 vm uve deleted from opserver 2025-08-14 02:32:12,443 - INFO - Validated that VM c241ef0b-b67f-45f2-bb0b-6c6cd8dac9b7 is removed from Opserver 2025-08-14 02:32:12,443 - INFO - Deleting VM ctest-VM21-54951797 2025-08-14 02:32:12,513 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:32:12,513 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:32:12,522 - DEBUG - VM ID e78a5b0c-908e-485a-af66-6cef88b8eaed of VM ctest-VM21-54951797 is still found in API Server 2025-08-14 02:32:14,523 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:32:14,523 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:32:14,530 - DEBUG - Response Code: 404 2025-08-14 02:32:14,531 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:32:14,538 - DEBUG - Response Code: 404 2025-08-14 02:32:14,538 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e78a5b0c-908e-485a-af66-6cef88b8eaed 2025-08-14 02:32:14,544 - DEBUG - Response Code: 404 2025-08-14 02:32:14,545 - INFO - VM ctest-VM21-54951797 is fully removed in API-Server 2025-08-14 02:32:14,695 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-14 02:32:14,743 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 2025-08-14 02:32:14,754 - DEBUG - Validated that vrouter 10.0.0.130 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 2025-08-14 02:32:14,754 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 2025-08-14 02:32:14,755 - INFO - VM ctest-VM21-54951797 is removed in Compute, and routes are removed in all compute nodes 2025-08-14 02:32:14,999 - INFO - Routes for VM ctest-VM21-54951797 is removed in all control-nodes 2025-08-14 02:32:14,999 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:15,043 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:15,081 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:15,081 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:15,081 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:15,081 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:18,083 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:18,130 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:18,168 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:18,168 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:18,168 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:18,169 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:21,170 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:21,214 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:21,252 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:21,252 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:21,252 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:21,253 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:24,253 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:24,302 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:24,341 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:24,341 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:24,341 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:24,341 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:27,341 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:27,389 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:27,430 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:27,430 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:27,430 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:27,430 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:30,431 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:30,476 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:30,514 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:30,514 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:30,514 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:30,514 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:33,515 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:33,558 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:33,597 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:33,597 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:33,597 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:33,597 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:36,597 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:36,646 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:36,683 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:36,683 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:36,683 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:36,683 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:39,683 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:39,745 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:39,797 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:39,797 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:39,797 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:39,797 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:42,798 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-1:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:42,843 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-1?flat 2025-08-14 02:32:42,882 - DEBUG - VM e78a5b0c-908e-485a-af66-6cef88b8eaed is not present in vrouter an-jenkins-deploy-platform-ansible-os-3851-1 uve 2025-08-14 02:32:42,882 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:42,882 - DEBUG - interface for vm e78a5b0c-908e-485a-af66-6cef88b8eaed deleted from vrouter uve ... 2025-08-14 02:32:42,882 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:42,882 - DEBUG - Validated that VM e78a5b0c-908e-485a-af66-6cef88b8eaed is removed in Vrouter UVE 2025-08-14 02:32:42,882 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-14 02:32:42,882 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365?flat 2025-08-14 02:32:42,904 - DEBUG - e78a5b0c-908e-485a-af66-6cef88b8eaed BM not in default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN2-66889365 uve 2025-08-14 02:32:42,904 - DEBUG - Validated that VM e78a5b0c-908e-485a-af66-6cef88b8eaed is not present in the VN UVE 2025-08-14 02:32:42,904 - DEBUG - Verifying the e78a5b0c-908e-485a-af66-6cef88b8eaed virtual network link through opserver 10.0.0.38 2025-08-14 02:32:42,904 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-14 02:32:42,916 - INFO - e78a5b0c-908e-485a-af66-6cef88b8eaed vm uve deleted from opserver 2025-08-14 02:32:42,916 - DEBUG - Verifying the e78a5b0c-908e-485a-af66-6cef88b8eaed virtual network link through opserver 10.0.0.27 2025-08-14 02:32:42,916 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-14 02:32:42,931 - INFO - e78a5b0c-908e-485a-af66-6cef88b8eaed vm uve deleted from opserver 2025-08-14 02:32:42,931 - DEBUG - Verifying the e78a5b0c-908e-485a-af66-6cef88b8eaed virtual network link through opserver 10.0.0.23 2025-08-14 02:32:42,931 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-08-14 02:32:42,946 - INFO - e78a5b0c-908e-485a-af66-6cef88b8eaed vm uve deleted from opserver 2025-08-14 02:32:42,946 - INFO - Validated that VM e78a5b0c-908e-485a-af66-6cef88b8eaed is removed from Opserver 2025-08-14 02:32:42,946 - INFO - Deleting VM ctest-VM11-82459966 2025-08-14 02:32:43,014 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:32:43,014 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:32:43,024 - DEBUG - VM ID 321322be-2be2-42af-adfa-ff181815b674 of VM ctest-VM11-82459966 is still found in API Server 2025-08-14 02:32:45,025 - DEBUG - Verifying in api server 10.0.0.23 2025-08-14 02:32:45,025 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:32:45,033 - DEBUG - Response Code: 404 2025-08-14 02:32:45,033 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:32:45,040 - DEBUG - Response Code: 404 2025-08-14 02:32:45,040 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:32:45,047 - DEBUG - Response Code: 404 2025-08-14 02:32:45,049 - INFO - VM ctest-VM11-82459966 is fully removed in API-Server 2025-08-14 02:32:45,199 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-14 02:32:45,245 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 2025-08-14 02:32:45,256 - DEBUG - Validated that vrouter 10.0.0.130 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 2025-08-14 02:32:45,256 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 2025-08-14 02:32:45,256 - INFO - VM ctest-VM11-82459966 is removed in Compute, and routes are removed in all compute nodes 2025-08-14 02:32:45,457 - INFO - Routes for VM ctest-VM11-82459966 is removed in all control-nodes 2025-08-14 02:32:45,457 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:45,500 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:45,540 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:45,540 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:45,540 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:32:45,540 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:48,541 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:48,590 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:48,633 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:48,633 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:48,633 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:32:48,633 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:51,634 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:51,675 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:51,715 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:51,715 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:51,715 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:32:51,715 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:54,716 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:54,760 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:54,800 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:54,800 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:54,800 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:32:54,800 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:32:57,801 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:32:57,844 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:32:57,882 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:32:57,882 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:32:57,882 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:32:57,882 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:33:00,883 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:33:00,925 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:33:00,962 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:33:00,962 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:33:00,962 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:33:00,962 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:33:03,963 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:33:04,005 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:33:04,063 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:33:04,063 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:33:04,063 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:33:04,063 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:33:07,063 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:33:07,109 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:33:07,150 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:33:07,151 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:33:07,151 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:33:07,151 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:33:10,151 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3851-2:Compute:contrail-vrouter-agent:0?flat 2025-08-14 02:33:10,212 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3851-2?flat 2025-08-14 02:33:10,266 - DEBUG - VM 321322be-2be2-42af-adfa-ff181815b674 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3851-2 uve 2025-08-14 02:33:10,266 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-14 02:33:10,266 - DEBUG - interface for vm 321322be-2be2-42af-adfa-ff181815b674 deleted from vrouter uve ... 2025-08-14 02:33:10,266 - DEBUG - Deleted interface not in error interface list ... 2025-08-14 02:33:10,266 - DEBUG - Validated that VM 321322be-2be2-42af-adfa-ff181815b674 is removed in Vrouter UVE 2025-08-14 02:33:10,266 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-14 02:33:10,266 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095?flat 2025-08-14 02:33:10,295 - DEBUG - 321322be-2be2-42af-adfa-ff181815b674 BM not in default-domain:ctest-TestPolicyAclIpv4v6-51944652:ctest-VN1-73214095 uve 2025-08-14 02:33:10,295 - DEBUG - Validated that VM 321322be-2be2-42af-adfa-ff181815b674 is not present in the VN UVE 2025-08-14 02:33:10,295 - DEBUG - Verifying the 321322be-2be2-42af-adfa-ff181815b674 virtual network link through opserver 10.0.0.38 2025-08-14 02:33:10,295 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-14 02:33:10,307 - DEBUG - No links retuned for 321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:33:10,307 - INFO - 321322be-2be2-42af-adfa-ff181815b674 vm uve deleted from opserver 2025-08-14 02:33:10,307 - DEBUG - Verifying the 321322be-2be2-42af-adfa-ff181815b674 virtual network link through opserver 10.0.0.27 2025-08-14 02:33:10,307 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-14 02:33:10,323 - DEBUG - No links retuned for 321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:33:10,323 - INFO - 321322be-2be2-42af-adfa-ff181815b674 vm uve deleted from opserver 2025-08-14 02:33:10,323 - DEBUG - Verifying the 321322be-2be2-42af-adfa-ff181815b674 virtual network link through opserver 10.0.0.23 2025-08-14 02:33:10,323 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-08-14 02:33:10,338 - DEBUG - No links retuned for 321322be-2be2-42af-adfa-ff181815b674 2025-08-14 02:33:10,338 - INFO - 321322be-2be2-42af-adfa-ff181815b674 vm uve deleted from opserver 2025-08-14 02:33:10,338 - INFO - Validated that VM 321322be-2be2-42af-adfa-ff181815b674 is removed from Opserver 2025-08-14 02:33:10,338 - DEBUG - Detaching the Policy for VN :ctest-VN2-66889365 2025-08-14 02:33:10,338 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:33:10,345 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:33:10,386 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:33:10,493 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/ba122f5f-73d0-4f35-9882-338b2bdc7b88 2025-08-14 02:33:10,515 - DEBUG - Requesting: http://10.0.0.38:8082/network-policy/1619253a-4ba3-406a-8424-4571b76ba47b 2025-08-14 02:33:10,763 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy21-45299424']] from ctest-VN2-66889365 2025-08-14 02:33:10,763 - DEBUG - Detaching the Policy for VN :ctest-VN1-73214095 2025-08-14 02:33:10,763 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:33:10,770 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:33:10,791 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:33:10,914 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/bbf5513d-c45e-4fae-9b18-1dd3c58e5838 2025-08-14 02:33:10,950 - DEBUG - Requesting: http://10.0.0.38:8082/network-policy/2b107af6-6931-4996-a9b3-bdbd0737c7cc 2025-08-14 02:33:10,962 - DEBUG - Requesting: http://10.0.0.38:8082/network-policy/3a172827-5aaa-4c0e-bc3c-92ebec5b0587 2025-08-14 02:33:11,191 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy12-10543478'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-51944652', 'ctest-policy13-28669688']] from ctest-VN1-73214095 2025-08-14 02:33:11,248 - INFO - Deleted policy ctest-policy21-45299424 2025-08-14 02:33:11,297 - INFO - Deleted policy ctest-policy12-10543478 2025-08-14 02:33:11,348 - INFO - Deleted policy ctest-policy13-28669688 2025-08-14 02:33:11,348 - INFO - Deleting VN ctest-VN3-31489156 2025-08-14 02:33:11,769 - DEBUG - Response for deleting network () 2025-08-14 02:33:11,770 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9c5914a0-811c-477c-b67c-98cba0b5abe8 2025-08-14 02:33:11,796 - DEBUG - Response Code: 404 2025-08-14 02:33:11,796 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:33:11,803 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:33:11,818 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:33:11,939 - INFO - Validated that VN ctest-VN3-31489156 is not found in API Server 2025-08-14 02:33:11,952 - DEBUG - VN ctest-VN3-31489156 is not present in Agent 10.0.0.65 2025-08-14 02:33:11,964 - DEBUG - VN ctest-VN3-31489156 is not present in Agent 10.0.0.130 2025-08-14 02:33:11,964 - INFO - Validated that VN ctest-VN3-31489156 is not in any agent 2025-08-14 02:33:12,003 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-31489156 info 2025-08-14 02:33:12,003 - INFO - Deleting VN ctest-VN2-66889365 2025-08-14 02:33:12,255 - DEBUG - Response for deleting network () 2025-08-14 02:33:12,255 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/94772abf-c26e-4c1e-9a39-37cec6841038 2025-08-14 02:33:12,262 - DEBUG - Response Code: 404 2025-08-14 02:33:12,262 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:33:12,269 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:33:12,283 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:33:12,392 - INFO - Validated that VN ctest-VN2-66889365 is not found in API Server 2025-08-14 02:33:12,404 - DEBUG - VN ctest-VN2-66889365 is not present in Agent 10.0.0.65 2025-08-14 02:33:12,417 - DEBUG - VN ctest-VN2-66889365 is not present in Agent 10.0.0.130 2025-08-14 02:33:12,417 - INFO - Validated that VN ctest-VN2-66889365 is not in any agent 2025-08-14 02:33:12,459 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-66889365 info 2025-08-14 02:33:12,459 - INFO - Deleting VN ctest-VN1-73214095 2025-08-14 02:33:12,677 - DEBUG - Response for deleting network () 2025-08-14 02:33:12,677 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/9e6b9520-e41c-4f0d-a687-b8de3806c3f9 2025-08-14 02:33:12,685 - DEBUG - Response Code: 404 2025-08-14 02:33:12,685 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 02:33:12,692 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 02:33:12,708 - DEBUG - Requesting: http://10.0.0.38:8082/project/8baff5c6-7194-47d5-bfc0-cfa0049138ad 2025-08-14 02:33:12,807 - INFO - Validated that VN ctest-VN1-73214095 is not found in API Server 2025-08-14 02:33:12,821 - DEBUG - VN ctest-VN1-73214095 is not present in Agent 10.0.0.65 2025-08-14 02:33:12,833 - DEBUG - VN ctest-VN1-73214095 is not present in Agent 10.0.0.130 2025-08-14 02:33:12,833 - INFO - Validated that VN ctest-VN1-73214095 is not in any agent 2025-08-14 02:33:12,870 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-73214095 info 2025-08-14 02:33:12,967 - INFO - IPAM: ipam3 is not found in API Server 2025-08-14 02:33:12,993 - INFO - IPAM:ipam3 is not found in control node 2025-08-14 02:33:13,139 - INFO - IPAM: ipam2 is not found in API Server 2025-08-14 02:33:13,165 - INFO - IPAM:ipam2 is not found in control node 2025-08-14 02:33:13,307 - INFO - IPAM: ipam1 is not found in API Server 2025-08-14 02:33:13,337 - INFO - IPAM:ipam1 is not found in control node 2025-08-14 02:33:14,609 - DEBUG - No XMPP flaps were noticed during the test

2025-08-14 02:33:14,609 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:56]

2025-08-14 02:33:14,609 - INFO - -------------------------------------------------------------------------------- 2025-08-14 02:33:15,878 - DEBUG - No XMPP flaps were noticed during the test

2025-08-14 02:33:15,878 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:58]

2025-08-14 02:33:15,879 - INFO - -------------------------------------------------------------------------------- 2025-08-14 02:33:16,681 - INFO - Deleted project: ctest-TestPolicyAclIpv4v6-51944652, ID : 8baff5c6-7194-47d5-bfc0-cfa0049138ad