2025-08-10 21:06:37,469 - INFO - Domain Default found not creating 2025-08-10 21:06:37,612 - INFO - Project ctest-TestPolicyAclIpv4v6-52956328 not found, creating it 2025-08-10 21:06:38,064 - INFO - Created Project:ctest-TestPolicyAclIpv4v6-52956328, ID : b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:39,572 - INFO - ================================================================================ 2025-08-10 21:06:39,572 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-08-10 21:06:40,824 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.50': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-08-10 21:06:40,824 - INFO - Initial checks done. Running the testcase now 2025-08-10 21:06:40,824 - INFO - 2025-08-10 21:06:40,824 - INFO - ================================================================================ 2025-08-10 21:06:40,824 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-08-10 21:06:40,824 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-08-10 21:06:42,103 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.50': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-08-10 21:06:42,103 - INFO - Initial checks done. Running the testcase now 2025-08-10 21:06:42,103 - INFO - 2025-08-10 21:06:43,380 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:43,673 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:43,703 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:43,719 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:43,823 - DEBUG - Requesting: http://10.0.0.48:8082/network-ipam/386450e0-db5e-40a8-8ee9-82fae36bd590 2025-08-10 21:06:43,830 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-08-10 21:06:43,836 - DEBUG - Control-node 10.0.0.48 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4063461690478313640', 'uuid-lslong': '10297906037028279696'}, 'enable': 'true', 'created': '2025-08-10T21:06:42', 'last-modified': '2025-08-10T21:06:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.123004'} 2025-08-10 21:06:43,841 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4063461690478313640', 'uuid-lslong': '10297906037028279696'}, 'enable': 'true', 'created': '2025-08-10T21:06:42', 'last-modified': '2025-08-10T21:06:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.127701'} 2025-08-10 21:06:43,847 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4063461690478313640', 'uuid-lslong': '10297906037028279696'}, 'enable': 'true', 'created': '2025-08-10T21:06:42', 'last-modified': '2025-08-10T21:06:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.131915'} 2025-08-10 21:06:43,847 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-08-10 21:06:43,847 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:43,853 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:43,866 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:43,966 - DEBUG - Requesting: http://10.0.0.48:8082/network-ipam/325f9fb7-82c5-487d-b230-3033d5806d8d 2025-08-10 21:06:43,976 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-08-10 21:06:43,985 - DEBUG - Control-node 10.0.0.48 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629795435205707901', 'uuid-lslong': '12839815536816713101'}, 'enable': 'true', 'created': '2025-08-10T21:06:42', 'last-modified': '2025-08-10T21:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.956089'} 2025-08-10 21:06:43,991 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629795435205707901', 'uuid-lslong': '12839815536816713101'}, 'enable': 'true', 'created': '2025-08-10T21:06:42', 'last-modified': '2025-08-10T21:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.965711'} 2025-08-10 21:06:43,998 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629795435205707901', 'uuid-lslong': '12839815536816713101'}, 'enable': 'true', 'created': '2025-08-10T21:06:42', 'last-modified': '2025-08-10T21:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.969310'} 2025-08-10 21:06:43,998 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-08-10 21:06:43,999 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:44,005 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:44,016 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:44,109 - DEBUG - Requesting: http://10.0.0.48:8082/network-ipam/cbad5c3f-c532-44fb-b7c4-1df76722d17e 2025-08-10 21:06:44,118 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-08-10 21:06:44,124 - DEBUG - Control-node 10.0.0.48 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14676488189631415547', 'uuid-lslong': '13241741752800563582'}, 'enable': 'true', 'created': '2025-08-10T21:06:43', 'last-modified': '2025-08-10T21:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.774870'} 2025-08-10 21:06:44,130 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14676488189631415547', 'uuid-lslong': '13241741752800563582'}, 'enable': 'true', 'created': '2025-08-10T21:06:43', 'last-modified': '2025-08-10T21:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.783870'} 2025-08-10 21:06:44,135 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14676488189631415547', 'uuid-lslong': '13241741752800563582'}, 'enable': 'true', 'created': '2025-08-10T21:06:43', 'last-modified': '2025-08-10T21:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.792566'} 2025-08-10 21:06:44,135 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-08-10 21:06:44,421 - DEBUG - Response for create_network : {'network': {'id': 'c2191247-9530-4762-a220-1e4480c0b930', 'name': 'ctest-VN1-96265496', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-VN1-96265496'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:06:44,676 - DEBUG - Response for create_subnet : {'subnet': {'id': '1ff569bf-9d85-43a3-b3e2-5c552be78183', 'name': '', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'network_id': 'c2191247-9530-4762-a220-1e4480c0b930', 'ip_version': 4, 'cidr': '53.141.183.0/26', 'allocation_pools': [{'start': '53.141.183.2', 'end': '53.141.183.62'}], 'gateway_ip': '53.141.183.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.141.183.2', 'tags': [], 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae'}} 2025-08-10 21:06:44,872 - DEBUG - Response for create_subnet : {'subnet': {'id': '92db155b-77f5-433e-908c-ea6d38006953', 'name': '', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'network_id': 'c2191247-9530-4762-a220-1e4480c0b930', 'ip_version': 6, 'cidr': '22e0:3226:3dcc:61ea:e7d:20f8::/96', 'allocation_pools': [{'start': '22e0:3226:3dcc:61ea:e7d:20f8:0:2', 'end': '22e0:3226:3dcc:61ea:e7d:20f8:ffff:fffe'}], 'gateway_ip': '22e0:3226:3dcc:61ea:e7d:20f8:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22e0:3226:3dcc:61ea:e7d:20f8:0:2', 'tags': [], 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae'}} 2025-08-10 21:06:44,893 - INFO - Created VN ctest-VN1-96265496 2025-08-10 21:06:44,911 - DEBUG - VN ctest-VN1-96265496 UUID is c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:45,068 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496(c2191247-9530-4762-a220-1e4480c0b930) with subnets ['53.141.183.0/26', '22e0:3226:3dcc:61ea:e7d:20f8::/96'] 2025-08-10 21:06:45,342 - DEBUG - Response for create_network : {'network': {'id': '0f39e1c2-a20a-49e8-a216-727b39619d9d', 'name': 'ctest-VN2-16990166', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-VN2-16990166'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:06:45,579 - DEBUG - Response for create_subnet : {'subnet': {'id': '4ee302cc-6e5c-421b-bc94-6c8445ddc7b6', 'name': '', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'network_id': '0f39e1c2-a20a-49e8-a216-727b39619d9d', 'ip_version': 4, 'cidr': '28.213.96.128/26', 'allocation_pools': [{'start': '28.213.96.130', 'end': '28.213.96.190'}], 'gateway_ip': '28.213.96.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '28.213.96.130', 'tags': [], 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae'}} 2025-08-10 21:06:45,821 - DEBUG - Response for create_subnet : {'subnet': {'id': '24529f7e-df63-4243-b71e-5f0273779a2a', 'name': '', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'network_id': '0f39e1c2-a20a-49e8-a216-727b39619d9d', 'ip_version': 6, 'cidr': '365c:de40:d080:8988:9ea2:9757::/96', 'allocation_pools': [{'start': '365c:de40:d080:8988:9ea2:9757:0:2', 'end': '365c:de40:d080:8988:9ea2:9757:ffff:fffe'}], 'gateway_ip': '365c:de40:d080:8988:9ea2:9757:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '365c:de40:d080:8988:9ea2:9757:0:2', 'tags': [], 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae'}} 2025-08-10 21:06:45,844 - INFO - Created VN ctest-VN2-16990166 2025-08-10 21:06:45,854 - DEBUG - VN ctest-VN2-16990166 UUID is 0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:46,172 - DEBUG - Response for create_network : {'network': {'id': '56cc52ae-7975-49ac-ab75-5df31537d49d', 'name': 'ctest-VN3-33994360', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-VN3-33994360'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:06:46,366 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a6c92c9e-cd10-41db-8142-97e64adf20d3', 'name': '', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'network_id': '56cc52ae-7975-49ac-ab75-5df31537d49d', 'ip_version': 4, 'cidr': '40.80.213.0/26', 'allocation_pools': [{'start': '40.80.213.2', 'end': '40.80.213.62'}], 'gateway_ip': '40.80.213.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '40.80.213.2', 'tags': [], 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae'}} 2025-08-10 21:06:46,530 - DEBUG - Response for create_subnet : {'subnet': {'id': '62cd0741-1c49-4304-a692-df4b40e394e4', 'name': '', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'network_id': '56cc52ae-7975-49ac-ab75-5df31537d49d', 'ip_version': 6, 'cidr': '2e2b:50f9:d2f0:46f7:8aa8:3504::/96', 'allocation_pools': [{'start': '2e2b:50f9:d2f0:46f7:8aa8:3504:0:2', 'end': '2e2b:50f9:d2f0:46f7:8aa8:3504:ffff:fffe'}], 'gateway_ip': '2e2b:50f9:d2f0:46f7:8aa8:3504:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2e2b:50f9:d2f0:46f7:8aa8:3504:0:2', 'tags': [], 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae'}} 2025-08-10 21:06:46,552 - INFO - Created VN ctest-VN3-33994360 2025-08-10 21:06:46,563 - DEBUG - VN ctest-VN3-33994360 UUID is 56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:46,641 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:46,646 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:46,657 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:46,746 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:46,758 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:46,767 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/07842cba-ced9-4be4-a99c-203fe3ca8d3b 2025-08-10 21:06:46,776 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/07842cba-ced9-4be4-a99c-203fe3ca8d3b 2025-08-10 21:06:46,782 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/7043517f-e703-4e6c-a6b8-b85b4b60d179 2025-08-10 21:06:46,789 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:06:46,789 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:46,797 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/07842cba-ced9-4be4-a99c-203fe3ca8d3b 2025-08-10 21:06:46,811 - INFO - Verified VN network id 11 for VN c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:46,811 - INFO - Verifications in API Server for VN ctest-VN1-96265496 passed 2025-08-10 21:06:46,812 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:46,821 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/07842cba-ced9-4be4-a99c-203fe3ca8d3b 2025-08-10 21:06:46,826 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/07842cba-ced9-4be4-a99c-203fe3ca8d3b 2025-08-10 21:06:46,832 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/7043517f-e703-4e6c-a6b8-b85b4b60d179 2025-08-10 21:06:46,844 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13986230216430733154', 'uuid-lslong': '11682370712965790000'}, 'enable': 'true', 'created': '2025-08-10T21:06:44', 'last-modified': '2025-08-10T21:06:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.030730'} 2025-08-10 21:06:46,851 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:06:46,856 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13986230216430733154', 'uuid-lslong': '11682370712965790000'}, 'enable': 'true', 'created': '2025-08-10T21:06:44', 'last-modified': '2025-08-10T21:06:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.042333'} 2025-08-10 21:06:46,862 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:06:46,867 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13986230216430733154', 'uuid-lslong': '11682370712965790000'}, 'enable': 'true', 'created': '2025-08-10T21:06:44', 'last-modified': '2025-08-10T21:06:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.056735'} 2025-08-10 21:06:46,873 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:06:46,873 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-96265496 passed 2025-08-10 21:06:46,873 - DEBUG - ====Verifying policy data for ctest-VN1-96265496 in API_Server ====== 2025-08-10 21:06:46,873 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:46,878 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:46,889 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:46,977 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:46,987 - DEBUG - =>VN ctest-VN1-96265496 has no policy to be verified 2025-08-10 21:06:46,987 - DEBUG - Verifying the vn in opserver 2025-08-10 21:06:46,987 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 virtual network link through opserver 10.0.0.48 2025-08-10 21:06:46,987 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:06:47,275 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:06:47,332 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496?flat'} 2025-08-10 21:06:47,332 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 virtual network link through opserver 10.0.0.38 2025-08-10 21:06:47,333 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:06:47,619 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:06:47,668 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496?flat'} 2025-08-10 21:06:47,668 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 virtual network link through opserver 10.0.0.49 2025-08-10 21:06:47,668 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:06:47,951 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:06:47,998 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496?flat'} 2025-08-10 21:06:47,998 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is found in opserver 2025-08-10 21:06:48,019 - DEBUG - Do not have enough data to verify VN in agent 2025-08-10 21:06:48,031 - DEBUG - VRF ids for VN ctest-VN1-96265496: {} 2025-08-10 21:06:48,031 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:48,037 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:48,048 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:48,139 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:48,150 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:48,159 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/7b39a514-5e24-41c2-8b87-cdfd82ea3a13 2025-08-10 21:06:48,165 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/7b39a514-5e24-41c2-8b87-cdfd82ea3a13 2025-08-10 21:06:48,171 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/9a84f2fd-99bd-4d96-813f-5eaf18d75a8e 2025-08-10 21:06:48,178 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 21:06:48,179 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:48,187 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/7b39a514-5e24-41c2-8b87-cdfd82ea3a13 2025-08-10 21:06:48,202 - INFO - Verified VN network id 12 for VN 0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:48,202 - INFO - Verifications in API Server for VN ctest-VN2-16990166 passed 2025-08-10 21:06:48,202 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:48,211 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/7b39a514-5e24-41c2-8b87-cdfd82ea3a13 2025-08-10 21:06:48,217 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/7b39a514-5e24-41c2-8b87-cdfd82ea3a13 2025-08-10 21:06:48,223 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/9a84f2fd-99bd-4d96-813f-5eaf18d75a8e 2025-08-10 21:06:48,234 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1097156210299914728', 'uuid-lslong': '11679648557201202589'}, 'enable': 'true', 'created': '2025-08-10T21:06:45', 'last-modified': '2025-08-10T21:06:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.461759'} 2025-08-10 21:06:48,240 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 21:06:48,245 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1097156210299914728', 'uuid-lslong': '11679648557201202589'}, 'enable': 'true', 'created': '2025-08-10T21:06:45', 'last-modified': '2025-08-10T21:06:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.474171'} 2025-08-10 21:06:48,251 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 21:06:48,256 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1097156210299914728', 'uuid-lslong': '11679648557201202589'}, 'enable': 'true', 'created': '2025-08-10T21:06:45', 'last-modified': '2025-08-10T21:06:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.481444'} 2025-08-10 21:06:48,262 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-10 21:06:48,262 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-16990166 passed 2025-08-10 21:06:48,263 - DEBUG - ====Verifying policy data for ctest-VN2-16990166 in API_Server ====== 2025-08-10 21:06:48,263 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:48,267 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:48,278 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:48,365 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:48,375 - DEBUG - =>VN ctest-VN2-16990166 has no policy to be verified 2025-08-10 21:06:48,375 - DEBUG - Verifying the vn in opserver 2025-08-10 21:06:48,375 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 virtual network link through opserver 10.0.0.48 2025-08-10 21:06:48,375 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:06:48,422 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166?flat'} 2025-08-10 21:06:48,422 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 virtual network link through opserver 10.0.0.38 2025-08-10 21:06:48,422 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:06:48,471 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166?flat'} 2025-08-10 21:06:48,471 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 virtual network link through opserver 10.0.0.49 2025-08-10 21:06:48,471 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:06:48,527 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166?flat'} 2025-08-10 21:06:48,527 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 is found in opserver 2025-08-10 21:06:48,551 - DEBUG - Do not have enough data to verify VN in agent 2025-08-10 21:06:48,561 - DEBUG - VRF ids for VN ctest-VN2-16990166: {} 2025-08-10 21:06:48,561 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:48,566 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:48,578 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:48,665 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:48,681 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:48,690 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b455376b-df3b-4fdb-82b4-3c7dd3ba3a51 2025-08-10 21:06:48,697 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b455376b-df3b-4fdb-82b4-3c7dd3ba3a51 2025-08-10 21:06:48,703 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b011c69d-1ba6-4a13-aa5e-573ce2166e67 2025-08-10 21:06:48,713 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-10 21:06:48,713 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:48,722 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b455376b-df3b-4fdb-82b4-3c7dd3ba3a51 2025-08-10 21:06:48,736 - INFO - Verified VN network id 13 for VN 56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:48,736 - INFO - Verifications in API Server for VN ctest-VN3-33994360 passed 2025-08-10 21:06:48,736 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:48,745 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b455376b-df3b-4fdb-82b4-3c7dd3ba3a51 2025-08-10 21:06:48,751 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b455376b-df3b-4fdb-82b4-3c7dd3ba3a51 2025-08-10 21:06:48,759 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b011c69d-1ba6-4a13-aa5e-573ce2166e67 2025-08-10 21:06:48,770 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6254464891826293164', 'uuid-lslong': '12354884451375240349'}, 'enable': 'true', 'created': '2025-08-10T21:06:46', 'last-modified': '2025-08-10T21:06:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.283116'} 2025-08-10 21:06:48,776 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-10 21:06:48,782 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6254464891826293164', 'uuid-lslong': '12354884451375240349'}, 'enable': 'true', 'created': '2025-08-10T21:06:46', 'last-modified': '2025-08-10T21:06:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.296027'} 2025-08-10 21:06:48,787 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-10 21:06:48,793 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-52956328', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6254464891826293164', 'uuid-lslong': '12354884451375240349'}, 'enable': 'true', 'created': '2025-08-10T21:06:46', 'last-modified': '2025-08-10T21:06:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.305164'} 2025-08-10 21:06:48,799 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-10 21:06:48,800 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-33994360 passed 2025-08-10 21:06:48,800 - DEBUG - ====Verifying policy data for ctest-VN3-33994360 in API_Server ====== 2025-08-10 21:06:48,800 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:48,805 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:48,815 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:48,915 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/56cc52ae-7975-49ac-ab75-5df31537d49d 2025-08-10 21:06:48,924 - DEBUG - =>VN ctest-VN3-33994360 has no policy to be verified 2025-08-10 21:06:48,924 - DEBUG - Verifying the vn in opserver 2025-08-10 21:06:48,925 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 virtual network link through opserver 10.0.0.48 2025-08-10 21:06:48,925 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:06:48,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360?flat'} 2025-08-10 21:06:48,976 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 virtual network link through opserver 10.0.0.38 2025-08-10 21:06:48,976 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:06:49,029 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360?flat'} 2025-08-10 21:06:49,029 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 virtual network link through opserver 10.0.0.49 2025-08-10 21:06:49,029 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:06:49,077 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360?flat'} 2025-08-10 21:06:49,078 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 is found in opserver 2025-08-10 21:06:49,098 - DEBUG - Do not have enough data to verify VN in agent 2025-08-10 21:06:49,108 - DEBUG - VRF ids for VN ctest-VN3-33994360: {} 2025-08-10 21:06:49,113 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 21:06:49,380 - DEBUG - No source network defined 2025-08-10 21:06:49,380 - DEBUG - No source network defined 2025-08-10 21:06:49,380 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-policy13-44791648, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-policy13-44791648, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 21:06:49,644 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-10 21:06:49,848 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:49,854 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:49,865 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:49,958 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:06:49,971 - DEBUG - Setup step: Associating the policy to VN' 2025-08-10 21:06:50,075 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'c2191247-9530-4762-a220-1e4480c0b930', 'name': 'ctest-VN1-96265496', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['1ff569bf-9d85-43a3-b3e2-5c552be78183', '92db155b-77f5-433e-908c-ea6d38006953'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-VN1-96265496'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy12-89151421'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy13-44791648']], 'subnet_ipam': [{'subnet_cidr': '53.141.183.0/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ipam1']}, {'subnet_cidr': '22e0:3226:3dcc:61ea:e7d:20f8::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ipam1']}], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:06:50,223 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy12-89151421'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy13-44791648']] to ctest-VN1-96265496 2025-08-10 21:06:50,223 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:06:50,228 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:06:50,238 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:06:50,322 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:06:50,335 - DEBUG - Setup step: Associating the policy to VN' 2025-08-10 21:06:50,450 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '0f39e1c2-a20a-49e8-a216-727b39619d9d', 'name': 'ctest-VN2-16990166', 'tenant_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'project_id': 'b073d11cee4c46608efd2af4cc9c7eae', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['4ee302cc-6e5c-421b-bc94-6c8445ddc7b6', '24529f7e-df63-4243-b71e-5f0273779a2a'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-VN2-16990166'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy21-38096938']], 'subnet_ipam': [{'subnet_cidr': '28.213.96.128/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ipam2']}, {'subnet_cidr': '365c:de40:d080:8988:9ea2:9757::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:06:50,550 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy21-38096938']] to ctest-VN2-16990166 2025-08-10 21:06:50,650 - DEBUG - Services list from nova: [, , , ] 2025-08-10 21:06:51,779 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-1) 2025-08-10 21:06:53,287 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-2) 2025-08-10 21:06:54,828 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-1) 2025-08-10 21:06:54,914 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:06:54,914 - INFO - VM name : ctest-VM11-28515526 2025-08-10 21:06:54,997 - DEBUG - VM ctest-VM11-28515526 ID is ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:06:55,081 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:06:55,112 - DEBUG - VM ctest-VM11-28515526 launched on Node an-jenkins-deploy-platform-ansible-os-3790-1 2025-08-10 21:06:55,207 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:06:55,751 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:06:55,786 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:06:55,795 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/9bb90316-1fee-438d-8e7c-dfcf06a04f1e 2025-08-10 21:06:55,808 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:06:55,820 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/9bb90316-1fee-438d-8e7c-dfcf06a04f1e 2025-08-10 21:06:55,835 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/817250b5-4fa2-4702-9316-d44e3d199170 2025-08-10 21:06:55,849 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/d1e3cbaf-a7f5-4e33-b6c5-57f938c4fe19 2025-08-10 21:06:55,867 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:06:55,867 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:06:55,874 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/9bb90316-1fee-438d-8e7c-dfcf06a04f1e 2025-08-10 21:06:55,885 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/817250b5-4fa2-4702-9316-d44e3d199170 2025-08-10 21:06:55,894 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/d1e3cbaf-a7f5-4e33-b6c5-57f938c4fe19 2025-08-10 21:06:55,904 - INFO - VM ctest-VM11-28515526 verfication in all API Servers passed 2025-08-10 21:06:55,930 - DEBUG - VM ctest-VM11-28515526 Tap interface: {'index': '3', 'name': 'tap9bb90316-1f', 'uuid': '9bb90316-1fee-438d-8e7c-dfcf06a04f1e', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496:ctest-VN1-96265496', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'vm_uuid': 'ad0060b0-ae9f-4dd3-92fe-21f752b67dc4', 'vm_name': 'ctest-VM11-28515526', 'ip_addr': '53.141.183.3', 'mac_addr': '02:9b:b9:03:16:1f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e', 'sg_uuid_list': ['0c406379-6655-45cf-98b5-5e459acbbd5c'], 'static_route_list': None, 'vm_project_uuid': 'b073d11c-ee4c-4660-8efd-2af4cc9c7eae', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '22e0:3226:3dcc:61ea:e7d:20f8:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:06:55,930 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496:ctest-VN1-96265496 2025-08-10 21:06:55,939 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496:ctest-VN1-96265496', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.193:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-10 21:06:56,093 - DEBUG - VM ctest-VM11-28515526 : Tap interface tap9bb90316-1f is set to Active 2025-08-10 21:06:56,093 - DEBUG - Tap interface tap9bb90316-1f detail : {'index': '3', 'name': 'tap9bb90316-1f', 'uuid': '9bb90316-1fee-438d-8e7c-dfcf06a04f1e', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496:ctest-VN1-96265496', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'vm_uuid': 'ad0060b0-ae9f-4dd3-92fe-21f752b67dc4', 'vm_name': 'ctest-VM11-28515526', 'ip_addr': '53.141.183.3', 'mac_addr': '02:9b:b9:03:16:1f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e', 'sg_uuid_list': ['0c406379-6655-45cf-98b5-5e459acbbd5c'], 'static_route_list': None, 'vm_project_uuid': 'b073d11c-ee4c-4660-8efd-2af4cc9c7eae', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '22e0:3226:3dcc:61ea:e7d:20f8:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:06:56,253 - DEBUG - Starting Layer 2 verification in Agent 2025-08-10 21:06:56,278 - DEBUG - Layer 2 path is seen for VM MAC 02:9b:b9:03:16:1f in agent 10.0.0.254 2025-08-10 21:06:56,278 - DEBUG - Active layer 2 route in agent is present for VMI tap9bb90316-1f 2025-08-10 21:06:56,278 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-10 21:06:56,295 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is found in Agent of node 10.0.0.254 2025-08-10 21:06:56,446 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is consistent in agent 10.0.0.254 2025-08-10 21:06:56,446 - DEBUG - Route for VM IP ['22e0:3226:3dcc:61ea:e7d:20f8:0:3', '53.141.183.3'] is consistent in agent 10.0.0.254 2025-08-10 21:06:56,446 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 verification for VM ctest-VM11-28515526 in Agent 10.0.0.254 passed 2025-08-10 21:06:56,597 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-08-10 21:06:56,619 - DEBUG - Route for VM MAC 02:9b:b9:03:16:1f is consistent in agent 10.0.0.254 2025-08-10 21:06:59,852 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms') 2025-08-10 21:06:59,852 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:06:59,872 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:06:59,872 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:03,939 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-10 21:07:03,940 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:03,954 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:03,954 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:08,044 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-10 21:07:08,044 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:08,058 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:08,058 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:12,139 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-10 21:07:12,140 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:12,153 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:12,154 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:16,236 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-10 21:07:16,236 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:16,249 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:16,249 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:20,328 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-10 21:07:20,328 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:20,343 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:20,343 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:24,427 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-10 21:07:24,427 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:24,440 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:24,440 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:28,520 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-10 21:07:28,521 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:28,533 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:28,533 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:32,620 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-10 21:07:32,620 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 failed! 2025-08-10 21:07:32,637 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 53.141.183.1 and allocation pool is NOT set 2025-08-10 21:07:32,638 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 is 22e0:3226:3dcc:61ea:e7d:20f8:0:1 and allocation pool is NOT set 2025-08-10 21:07:36,709 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=9.12 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1014ms\r\nrtt min/avg/max/mdev = 9.117/9.117/9.117/0.000 ms') 2025-08-10 21:07:36,710 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 passed 2025-08-10 21:07:36,710 - INFO - VM ctest-VM11-28515526 verifications in Compute nodes passed 2025-08-10 21:07:37,008 - DEBUG - Validated VM route 53.141.183.3 in vrouter of 10.0.0.254 2025-08-10 21:07:37,012 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-10 21:07:37,012 - INFO - Validated routes of VM ctest-VM11-28515526 in all vrouters 2025-08-10 21:07:37,502 - DEBUG - Starting all layer2 verification in 10.0.0.48 Control Node 2025-08-10 21:07:37,656 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.48, not supported 2025-08-10 21:07:37,819 - DEBUG - Layer2 route found for VM MAC 02:9b:b9:03:16:1f in Control-node 10.0.0.48 2025-08-10 21:07:37,819 - DEBUG - L2 Label for VM ctest-VM11-28515526 same between Control-node 10.0.0.48 and Agent, Expected: 29, Seen: 29 2025-08-10 21:07:37,819 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-08-10 21:07:37,979 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.49, not supported 2025-08-10 21:07:38,147 - DEBUG - Layer2 route found for VM MAC 02:9b:b9:03:16:1f in Control-node 10.0.0.49 2025-08-10 21:07:38,147 - DEBUG - L2 Label for VM ctest-VM11-28515526 same between Control-node 10.0.0.49 and Agent, Expected: 29, Seen: 29 2025-08-10 21:07:38,147 - INFO - Verification in Control-nodes for VM ctest-VM11-28515526 passed 2025-08-10 21:07:38,147 - DEBUG - Verifying the vm in opserver 2025-08-10 21:07:38,147 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:07:38,147 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4?flat 2025-08-10 21:07:38,162 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e?flat 2025-08-10 21:07:38,180 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e?flat 2025-08-10 21:07:38,199 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e?flat 2025-08-10 21:07:38,215 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4?flat 2025-08-10 21:07:38,228 - DEBUG - Verifying vm in vn uve 2025-08-10 21:07:38,228 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e?flat 2025-08-10 21:07:38,245 - DEBUG - VM uve shows interface as {'gateway': '53.141.183.1', 'vm_name': 'ctest-VM11-28515526', 'vn_uuid': 'c2191247-9530-4762-a220-1e4480c0b930', 'vm_uuid': 'ad0060b0-ae9f-4dd3-92fe-21f752b67dc4', 'is_health_check_active': True, '__T': 1754860021461737, 'port_mirror_enabled': False, 'l2_active': True, 'active': True, 'tx_vlan': 65535, 'rx_vlan': 65535, 'fixed_ip4_list': ['53.141.183.3'], 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496', 'admin_state': True, 'uuid': '9bb90316-1fee-438d-8e7c-dfcf06a04f1e', 'label': 25, 'vhostuser_mode': 0, 'ip6_active': True, 'mac_address': '02:9b:b9:03:16:1f', 'ip4_active': True, 'ip_address': '53.141.183.3', 'fixed_ip6_list': ['22e0:3226:3dcc:61ea:e7d:20f8:0:3'], 'ip6_address': '22e0:3226:3dcc:61ea:e7d:20f8:0:3'} 2025-08-10 21:07:38,245 - DEBUG - VM uve shows ip address as ['53.141.183.3', '22e0:3226:3dcc:61ea:e7d:20f8:0:3'] 2025-08-10 21:07:38,245 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 2025-08-10 21:07:38,245 - INFO - Verifying through opserver in 10.0.0.48 2025-08-10 21:07:38,245 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496?flat 2025-08-10 21:07:38,265 - DEBUG - expected vm list ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:07:38,265 - DEBUG - Extracted vm list ['ad0060b0-ae9f-4dd3-92fe-21f752b67dc4'] 2025-08-10 21:07:38,265 - INFO - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is present in default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 2025-08-10 21:07:38,265 - DEBUG - Verifying vm in vrouter uve 2025-08-10 21:07:38,265 - DEBUG - Getting info from collector 10.0.0.49.. 2025-08-10 21:07:38,265 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4?flat 2025-08-10 21:07:38,278 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3790-1'] 2025-08-10 21:07:38,279 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:07:38,314 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:07:38,344 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:38,344 - DEBUG - Validated that VM ctest-VM11-28515526 is in Vrouter an-jenkins-deploy-platform-ansible-os-3790-1 UVE 2025-08-10 21:07:38,344 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-10 21:07:38,351 - DEBUG - Expected tap interface of VM uuid ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e 2025-08-10 21:07:38,351 - DEBUG - Expected VN of VM uuid ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 2025-08-10 21:07:38,351 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:07:38,387 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:07:38,423 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:38,423 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-52956328:9bb90316-1fee-438d-8e7c-dfcf06a04f1e of vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:38,423 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 of vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:38,423 - DEBUG - Verifying the ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 virtual network link through opserver 10.0.0.48 2025-08-10 21:07:38,424 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:07:38,439 - DEBUG - VM link and name as {'name': 'ad0060b0-ae9f-4dd3-92fe-21f752b67dc4', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4?flat'} 2025-08-10 21:07:38,439 - DEBUG - Verifying the ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 virtual network link through opserver 10.0.0.38 2025-08-10 21:07:38,439 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:07:38,453 - DEBUG - VM link and name as {'name': 'ad0060b0-ae9f-4dd3-92fe-21f752b67dc4', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4?flat'} 2025-08-10 21:07:38,453 - DEBUG - Verifying the ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 virtual network link through opserver 10.0.0.49 2025-08-10 21:07:38,453 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:07:38,463 - DEBUG - VM link and name as {'name': 'ad0060b0-ae9f-4dd3-92fe-21f752b67dc4', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4?flat'} 2025-08-10 21:07:38,463 - INFO - VM ctest-VM11-28515526 validations in Opserver passed 2025-08-10 21:07:38,556 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:07:38,556 - INFO - VM name : ctest-VM21-51719445 2025-08-10 21:07:38,620 - DEBUG - VM ctest-VM21-51719445 ID is e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:38,692 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:07:38,692 - DEBUG - VM ctest-VM21-51719445 launched on Node an-jenkins-deploy-platform-ansible-os-3790-2 2025-08-10 21:07:38,755 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:38,763 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:38,769 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/df804193-0704-47db-bf82-a2be9b30d194 2025-08-10 21:07:38,778 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:38,785 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/df804193-0704-47db-bf82-a2be9b30d194 2025-08-10 21:07:38,794 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/7e1420c9-1e15-4ccb-a940-2c4af4ff61e6 2025-08-10 21:07:38,802 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/fbc1ae09-ff38-4d91-90d5-7fab2fd4d6e6 2025-08-10 21:07:38,810 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:07:38,810 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:38,816 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/df804193-0704-47db-bf82-a2be9b30d194 2025-08-10 21:07:38,824 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/7e1420c9-1e15-4ccb-a940-2c4af4ff61e6 2025-08-10 21:07:38,830 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/fbc1ae09-ff38-4d91-90d5-7fab2fd4d6e6 2025-08-10 21:07:38,837 - INFO - VM ctest-VM21-51719445 verfication in all API Servers passed 2025-08-10 21:07:38,861 - DEBUG - VM ctest-VM21-51719445 Tap interface: {'index': '3', 'name': 'tapdf804193-07', 'uuid': 'df804193-0704-47db-bf82-a2be9b30d194', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166:ctest-VN2-16990166', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'vm_uuid': 'e84e563a-52b3-4b99-8024-4044b97cc839', 'vm_name': 'ctest-VM21-51719445', 'ip_addr': '28.213.96.131', 'mac_addr': '02:df:80:41:93:07', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '44', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194', 'sg_uuid_list': ['0c406379-6655-45cf-98b5-5e459acbbd5c'], 'static_route_list': None, 'vm_project_uuid': 'b073d11c-ee4c-4660-8efd-2af4cc9c7eae', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '365c:de40:d080:8988:9ea2:9757:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:07:38,861 - DEBUG - Agent 10.0.0.50 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166:ctest-VN2-16990166 2025-08-10 21:07:38,868 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166:ctest-VN2-16990166', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-10 21:07:39,045 - DEBUG - VM ctest-VM21-51719445 : Tap interface tapdf804193-07 is set to Active 2025-08-10 21:07:39,045 - DEBUG - Tap interface tapdf804193-07 detail : {'index': '3', 'name': 'tapdf804193-07', 'uuid': 'df804193-0704-47db-bf82-a2be9b30d194', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166:ctest-VN2-16990166', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'vm_uuid': 'e84e563a-52b3-4b99-8024-4044b97cc839', 'vm_name': 'ctest-VM21-51719445', 'ip_addr': '28.213.96.131', 'mac_addr': '02:df:80:41:93:07', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '44', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194', 'sg_uuid_list': ['0c406379-6655-45cf-98b5-5e459acbbd5c'], 'static_route_list': None, 'vm_project_uuid': 'b073d11c-ee4c-4660-8efd-2af4cc9c7eae', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '365c:de40:d080:8988:9ea2:9757:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:07:39,203 - DEBUG - Starting Layer 2 verification in Agent 2025-08-10 21:07:39,219 - DEBUG - Layer 2 path is seen for VM MAC 02:df:80:41:93:07 in agent 10.0.0.50 2025-08-10 21:07:39,219 - DEBUG - Active layer 2 route in agent is present for VMI tapdf804193-07 2025-08-10 21:07:39,219 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-10 21:07:39,232 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 is found in Agent of node 10.0.0.50 2025-08-10 21:07:39,413 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 is consistent in agent 10.0.0.50 2025-08-10 21:07:39,413 - DEBUG - Route for VM IP ['365c:de40:d080:8988:9ea2:9757:0:3', '28.213.96.131'] is consistent in agent 10.0.0.50 2025-08-10 21:07:39,413 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 verification for VM ctest-VM21-51719445 in Agent 10.0.0.50 passed 2025-08-10 21:07:39,564 - DEBUG - Starting all layer 2 verification in agent 10.0.0.50 2025-08-10 21:07:39,576 - DEBUG - Route for VM MAC 02:df:80:41:93:07 is consistent in agent 10.0.0.50 2025-08-10 21:07:40,785 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.02 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.19 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.193/3.106/5.019/1.913 ms') 2025-08-10 21:07:40,785 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-51719445 passed 2025-08-10 21:07:40,785 - INFO - VM ctest-VM21-51719445 verifications in Compute nodes passed 2025-08-10 21:07:41,072 - DEBUG - Validated VM route 28.213.96.131 in vrouter of 10.0.0.50 2025-08-10 21:07:41,076 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-10 21:07:41,076 - INFO - Validated routes of VM ctest-VM21-51719445 in all vrouters 2025-08-10 21:07:41,559 - DEBUG - Starting all layer2 verification in 10.0.0.48 Control Node 2025-08-10 21:07:41,708 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.48, not supported 2025-08-10 21:07:41,876 - DEBUG - Layer2 route found for VM MAC 02:df:80:41:93:07 in Control-node 10.0.0.48 2025-08-10 21:07:41,876 - DEBUG - L2 Label for VM ctest-VM21-51719445 same between Control-node 10.0.0.48 and Agent, Expected: 29, Seen: 29 2025-08-10 21:07:41,876 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-08-10 21:07:42,027 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.49, not supported 2025-08-10 21:07:42,194 - DEBUG - Layer2 route found for VM MAC 02:df:80:41:93:07 in Control-node 10.0.0.49 2025-08-10 21:07:42,194 - DEBUG - L2 Label for VM ctest-VM21-51719445 same between Control-node 10.0.0.49 and Agent, Expected: 29, Seen: 29 2025-08-10 21:07:42,194 - INFO - Verification in Control-nodes for VM ctest-VM21-51719445 passed 2025-08-10 21:07:42,194 - DEBUG - Verifying the vm in opserver 2025-08-10 21:07:42,194 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:07:42,194 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839?flat 2025-08-10 21:07:42,211 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194?flat 2025-08-10 21:07:42,242 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194?flat 2025-08-10 21:07:42,268 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194?flat 2025-08-10 21:07:42,288 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839?flat 2025-08-10 21:07:42,303 - DEBUG - Verifying vm in vn uve 2025-08-10 21:07:42,303 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194?flat 2025-08-10 21:07:42,322 - DEBUG - VM uve shows interface as {'rx_vlan': 65535, 'gateway': '28.213.96.129', '__T': 1754860020501126, 'admin_state': True, 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166', 'fixed_ip4_list': ['28.213.96.131'], 'is_health_check_active': True, 'mac_address': '02:df:80:41:93:07', 'vhostuser_mode': 0, 'uuid': 'df804193-0704-47db-bf82-a2be9b30d194', 'label': 25, 'ip6_address': '365c:de40:d080:8988:9ea2:9757:0:3', 'active': True, 'l2_active': True, 'port_mirror_enabled': False, 'ip6_active': True, 'ip4_active': True, 'tx_vlan': 65535, 'vn_uuid': '0f39e1c2-a20a-49e8-a216-727b39619d9d', 'vm_name': 'ctest-VM21-51719445', 'fixed_ip6_list': ['365c:de40:d080:8988:9ea2:9757:0:3'], 'vm_uuid': 'e84e563a-52b3-4b99-8024-4044b97cc839', 'ip_address': '28.213.96.131'} 2025-08-10 21:07:42,323 - DEBUG - VM uve shows ip address as ['28.213.96.131', '365c:de40:d080:8988:9ea2:9757:0:3'] 2025-08-10 21:07:42,323 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 2025-08-10 21:07:42,323 - INFO - Verifying through opserver in 10.0.0.48 2025-08-10 21:07:42,323 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166?flat 2025-08-10 21:07:42,348 - DEBUG - expected vm list e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:42,348 - DEBUG - Extracted vm list ['e84e563a-52b3-4b99-8024-4044b97cc839'] 2025-08-10 21:07:42,348 - INFO - VM e84e563a-52b3-4b99-8024-4044b97cc839 is present in default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 2025-08-10 21:07:42,348 - DEBUG - Verifying vm in vrouter uve 2025-08-10 21:07:42,348 - DEBUG - Getting info from collector 10.0.0.49.. 2025-08-10 21:07:42,348 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839?flat 2025-08-10 21:07:42,364 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3790-2'] 2025-08-10 21:07:42,364 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:07:42,406 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:07:42,443 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:07:42,443 - DEBUG - Validated that VM ctest-VM21-51719445 is in Vrouter an-jenkins-deploy-platform-ansible-os-3790-2 UVE 2025-08-10 21:07:42,443 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-10 21:07:42,452 - DEBUG - Expected tap interface of VM uuid e84e563a-52b3-4b99-8024-4044b97cc839 is default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194 2025-08-10 21:07:42,452 - DEBUG - Expected VN of VM uuid e84e563a-52b3-4b99-8024-4044b97cc839 is default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 2025-08-10 21:07:42,452 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:07:42,492 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:07:42,527 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:07:42,527 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-52956328:df804193-0704-47db-bf82-a2be9b30d194 of vm e84e563a-52b3-4b99-8024-4044b97cc839 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:07:42,527 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 of vm e84e563a-52b3-4b99-8024-4044b97cc839 is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:07:42,527 - DEBUG - Verifying the e84e563a-52b3-4b99-8024-4044b97cc839 virtual network link through opserver 10.0.0.48 2025-08-10 21:07:42,527 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:07:42,538 - DEBUG - VM link and name as {'name': 'e84e563a-52b3-4b99-8024-4044b97cc839', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839?flat'} 2025-08-10 21:07:42,539 - DEBUG - Verifying the e84e563a-52b3-4b99-8024-4044b97cc839 virtual network link through opserver 10.0.0.38 2025-08-10 21:07:42,539 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:07:42,549 - DEBUG - VM link and name as {'name': 'e84e563a-52b3-4b99-8024-4044b97cc839', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839?flat'} 2025-08-10 21:07:42,549 - DEBUG - Verifying the e84e563a-52b3-4b99-8024-4044b97cc839 virtual network link through opserver 10.0.0.49 2025-08-10 21:07:42,549 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:07:42,560 - DEBUG - VM link and name as {'name': 'e84e563a-52b3-4b99-8024-4044b97cc839', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839?flat'} 2025-08-10 21:07:42,560 - INFO - VM ctest-VM21-51719445 validations in Opserver passed 2025-08-10 21:07:42,631 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:07:42,631 - INFO - VM name : ctest-VM31-38344122 2025-08-10 21:07:42,699 - DEBUG - VM ctest-VM31-38344122 ID is 0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:42,760 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:07:42,760 - DEBUG - VM ctest-VM31-38344122 launched on Node an-jenkins-deploy-platform-ansible-os-3790-1 2025-08-10 21:07:42,848 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:42,858 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:42,865 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/a22c292f-a12a-4143-ac42-ff3d8564b89a 2025-08-10 21:07:42,874 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:42,887 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/a22c292f-a12a-4143-ac42-ff3d8564b89a 2025-08-10 21:07:42,901 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/05a7ebad-efa5-4431-a2a4-61223700bbfe 2025-08-10 21:07:42,910 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/efb553e9-222e-479a-bdc1-c1fd7243c248 2025-08-10 21:07:42,919 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:07:42,919 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:42,926 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/a22c292f-a12a-4143-ac42-ff3d8564b89a 2025-08-10 21:07:42,936 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/05a7ebad-efa5-4431-a2a4-61223700bbfe 2025-08-10 21:07:42,944 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/efb553e9-222e-479a-bdc1-c1fd7243c248 2025-08-10 21:07:42,954 - INFO - VM ctest-VM31-38344122 verfication in all API Servers passed 2025-08-10 21:07:42,979 - DEBUG - VM ctest-VM31-38344122 Tap interface: {'index': '4', 'name': 'tapa22c292f-a1', 'uuid': 'a22c292f-a12a-4143-ac42-ff3d8564b89a', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360:ctest-VN3-33994360', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'vm_uuid': '0a824388-0cd1-49eb-9b2d-1be34968441c', 'vm_name': 'ctest-VM31-38344122', 'ip_addr': '40.80.213.3', 'mac_addr': '02:a2:2c:29:2f:a1', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a', 'sg_uuid_list': ['0c406379-6655-45cf-98b5-5e459acbbd5c'], 'static_route_list': None, 'vm_project_uuid': 'b073d11c-ee4c-4660-8efd-2af4cc9c7eae', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '2e2b:50f9:d2f0:46f7:8aa8:3504:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:07:42,979 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360:ctest-VN3-33994360 2025-08-10 21:07:42,984 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360:ctest-VN3-33994360', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.193:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-10 21:07:43,110 - DEBUG - VM ctest-VM31-38344122 : Tap interface tapa22c292f-a1 is set to Active 2025-08-10 21:07:43,110 - DEBUG - Tap interface tapa22c292f-a1 detail : {'index': '4', 'name': 'tapa22c292f-a1', 'uuid': 'a22c292f-a12a-4143-ac42-ff3d8564b89a', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360:ctest-VN3-33994360', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'vm_uuid': '0a824388-0cd1-49eb-9b2d-1be34968441c', 'vm_name': 'ctest-VM31-38344122', 'ip_addr': '40.80.213.3', 'mac_addr': '02:a2:2c:29:2f:a1', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a', 'sg_uuid_list': ['0c406379-6655-45cf-98b5-5e459acbbd5c'], 'static_route_list': None, 'vm_project_uuid': 'b073d11c-ee4c-4660-8efd-2af4cc9c7eae', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '2e2b:50f9:d2f0:46f7:8aa8:3504:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:07:43,260 - DEBUG - Starting Layer 2 verification in Agent 2025-08-10 21:07:43,272 - DEBUG - Layer 2 path is seen for VM MAC 02:a2:2c:29:2f:a1 in agent 10.0.0.254 2025-08-10 21:07:43,272 - DEBUG - Active layer 2 route in agent is present for VMI tapa22c292f-a1 2025-08-10 21:07:43,272 - DEBUG - L2 label(36) matches bw route table and interface table 2025-08-10 21:07:43,277 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 is found in Agent of node 10.0.0.254 2025-08-10 21:07:43,450 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 is consistent in agent 10.0.0.254 2025-08-10 21:07:43,450 - DEBUG - Route for VM IP ['40.80.213.3', '2e2b:50f9:d2f0:46f7:8aa8:3504:0:3'] is consistent in agent 10.0.0.254 2025-08-10 21:07:43,450 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 verification for VM ctest-VM31-38344122 in Agent 10.0.0.254 passed 2025-08-10 21:07:43,600 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-08-10 21:07:43,617 - DEBUG - Route for VM MAC 02:a2:2c:29:2f:a1 is consistent in agent 10.0.0.254 2025-08-10 21:07:44,837 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.64 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.442 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.442/1.540/2.639/1.098 ms') 2025-08-10 21:07:44,837 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-38344122 passed 2025-08-10 21:07:44,838 - INFO - VM ctest-VM31-38344122 verifications in Compute nodes passed 2025-08-10 21:07:45,119 - DEBUG - Validated VM route 40.80.213.3 in vrouter of 10.0.0.254 2025-08-10 21:07:45,122 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-10 21:07:45,122 - INFO - Validated routes of VM ctest-VM31-38344122 in all vrouters 2025-08-10 21:07:45,703 - DEBUG - Starting all layer2 verification in 10.0.0.48 Control Node 2025-08-10 21:07:45,867 - DEBUG - Layer2 route found for VM MAC 02:a2:2c:29:2f:a1 in Control-node 10.0.0.48 2025-08-10 21:07:45,867 - DEBUG - L2 Label for VM ctest-VM31-38344122 same between Control-node 10.0.0.48 and Agent, Expected: 36, Seen: 36 2025-08-10 21:07:46,020 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.48, not supported 2025-08-10 21:07:46,020 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-08-10 21:07:46,184 - DEBUG - Layer2 route found for VM MAC 02:a2:2c:29:2f:a1 in Control-node 10.0.0.49 2025-08-10 21:07:46,184 - DEBUG - L2 Label for VM ctest-VM31-38344122 same between Control-node 10.0.0.49 and Agent, Expected: 36, Seen: 36 2025-08-10 21:07:46,343 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.49, not supported 2025-08-10 21:07:46,343 - INFO - Verification in Control-nodes for VM ctest-VM31-38344122 passed 2025-08-10 21:07:46,343 - DEBUG - Verifying the vm in opserver 2025-08-10 21:07:46,343 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-08-10 21:07:46,343 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c?flat 2025-08-10 21:07:46,357 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a?flat 2025-08-10 21:07:46,376 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a?flat 2025-08-10 21:07:46,404 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a?flat 2025-08-10 21:07:46,428 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c?flat 2025-08-10 21:07:46,444 - DEBUG - Verifying vm in vn uve 2025-08-10 21:07:46,445 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a?flat 2025-08-10 21:07:46,467 - DEBUG - VM uve shows interface as {'gateway': '40.80.213.1', 'vm_name': 'ctest-VM31-38344122', 'vn_uuid': '56cc52ae-7975-49ac-ab75-5df31537d49d', 'vm_uuid': '0a824388-0cd1-49eb-9b2d-1be34968441c', 'is_health_check_active': True, '__T': 1754860021461762, 'port_mirror_enabled': False, 'l2_active': True, 'active': True, 'tx_vlan': 65535, 'rx_vlan': 65535, 'fixed_ip4_list': ['40.80.213.3'], 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360', 'admin_state': True, 'uuid': 'a22c292f-a12a-4143-ac42-ff3d8564b89a', 'label': 32, 'vhostuser_mode': 0, 'ip6_active': True, 'mac_address': '02:a2:2c:29:2f:a1', 'ip4_active': True, 'ip_address': '40.80.213.3', 'fixed_ip6_list': ['2e2b:50f9:d2f0:46f7:8aa8:3504:0:3'], 'ip6_address': '2e2b:50f9:d2f0:46f7:8aa8:3504:0:3'} 2025-08-10 21:07:46,467 - DEBUG - VM uve shows ip address as ['40.80.213.3', '2e2b:50f9:d2f0:46f7:8aa8:3504:0:3'] 2025-08-10 21:07:46,467 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 2025-08-10 21:07:46,468 - INFO - Verifying through opserver in 10.0.0.48 2025-08-10 21:07:46,468 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360?flat 2025-08-10 21:07:46,492 - DEBUG - expected vm list 0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:46,492 - DEBUG - Extracted vm list ['0a824388-0cd1-49eb-9b2d-1be34968441c'] 2025-08-10 21:07:46,492 - INFO - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is present in default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 2025-08-10 21:07:46,492 - DEBUG - Verifying vm in vrouter uve 2025-08-10 21:07:46,492 - DEBUG - Getting info from collector 10.0.0.49.. 2025-08-10 21:07:46,492 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c?flat 2025-08-10 21:07:46,511 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3790-1'] 2025-08-10 21:07:46,512 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:07:46,561 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:07:46,615 - DEBUG - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:46,615 - DEBUG - Validated that VM ctest-VM31-38344122 is in Vrouter an-jenkins-deploy-platform-ansible-os-3790-1 UVE 2025-08-10 21:07:46,615 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-10 21:07:46,623 - DEBUG - Expected tap interface of VM uuid 0a824388-0cd1-49eb-9b2d-1be34968441c is default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a 2025-08-10 21:07:46,623 - DEBUG - Expected VN of VM uuid 0a824388-0cd1-49eb-9b2d-1be34968441c is default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 2025-08-10 21:07:46,623 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:07:46,664 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:07:46,703 - DEBUG - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:46,703 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-52956328:a22c292f-a12a-4143-ac42-ff3d8564b89a of vm 0a824388-0cd1-49eb-9b2d-1be34968441c is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:46,703 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 of vm 0a824388-0cd1-49eb-9b2d-1be34968441c is present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:07:46,703 - DEBUG - Verifying the 0a824388-0cd1-49eb-9b2d-1be34968441c virtual network link through opserver 10.0.0.48 2025-08-10 21:07:46,703 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:07:46,714 - DEBUG - VM link and name as {'name': '0a824388-0cd1-49eb-9b2d-1be34968441c', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c?flat'} 2025-08-10 21:07:46,714 - DEBUG - Verifying the 0a824388-0cd1-49eb-9b2d-1be34968441c virtual network link through opserver 10.0.0.38 2025-08-10 21:07:46,714 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:07:46,725 - DEBUG - VM link and name as {'name': '0a824388-0cd1-49eb-9b2d-1be34968441c', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c?flat'} 2025-08-10 21:07:46,725 - DEBUG - Verifying the 0a824388-0cd1-49eb-9b2d-1be34968441c virtual network link through opserver 10.0.0.49 2025-08-10 21:07:46,725 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:07:46,735 - DEBUG - VM link and name as {'name': '0a824388-0cd1-49eb-9b2d-1be34968441c', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c?flat'} 2025-08-10 21:07:46,735 - INFO - VM ctest-VM31-38344122 validations in Opserver passed 2025-08-10 21:07:46,735 - INFO - Waiting for VM ctest-VM11-28515526 to be up.. 2025-08-10 21:07:46,735 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:46,735 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:07:46,742 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/9bb90316-1fee-438d-8e7c-dfcf06a04f1e 2025-08-10 21:07:47,944 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.24 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.89 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.887/3.064/4.242/1.177 ms') 2025-08-10 21:07:47,944 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-28515526 passed 2025-08-10 21:07:48,052 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:48,053 - DEBUG - Waiting to SSH to VM ctest-VM11-28515526, IP 53.141.183.3, Port 22 2025-08-10 21:07:48,119 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-10 21:07:48,202 - DEBUG - VM ctest-VM11-28515526 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-10 21:07:53,202 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:53,203 - DEBUG - Waiting to SSH to VM ctest-VM11-28515526, IP 53.141.183.3, Port 22 2025-08-10 21:07:53,267 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-10 21:07:53,349 - DEBUG - VM ctest-VM11-28515526 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-10 21:07:58,350 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:58,350 - DEBUG - Waiting to SSH to VM ctest-VM11-28515526, IP 53.141.183.3, Port 22 2025-08-10 21:07:58,523 - DEBUG - VM ctest-VM11-28515526 is ready for SSH connections 2025-08-10 21:07:58,523 - INFO - Waiting for VM ctest-VM21-51719445 to be up.. 2025-08-10 21:07:58,523 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:58,523 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:07:58,532 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/df804193-0704-47db-bf82-a2be9b30d194 2025-08-10 21:07:59,721 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.51 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.83 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.834/3.671/5.508/1.837 ms') 2025-08-10 21:07:59,721 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-51719445 passed 2025-08-10 21:07:59,831 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:59,832 - DEBUG - Waiting to SSH to VM ctest-VM21-51719445, IP 28.213.96.131, Port 22 2025-08-10 21:07:59,991 - DEBUG - VM ctest-VM21-51719445 is ready for SSH connections 2025-08-10 21:07:59,991 - INFO - Waiting for VM ctest-VM31-38344122 to be up.. 2025-08-10 21:07:59,991 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:07:59,991 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:07:59,999 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/a22c292f-a12a-4143-ac42-ff3d8564b89a 2025-08-10 21:08:01,215 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.92 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.15 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.146/2.531/3.917/1.385 ms') 2025-08-10 21:08:01,215 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-38344122 passed 2025-08-10 21:08:01,325 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-10 21:08:01,325 - DEBUG - Waiting to SSH to VM ctest-VM31-38344122, IP 40.80.213.3, Port 22 2025-08-10 21:08:01,516 - DEBUG - VM ctest-VM31-38344122 is ready for SSH connections 2025-08-10 21:08:01,516 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 28.213.96.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.254, gateway password: c0ntrail123 2025-08-10 21:08:01,516 - DEBUG - ping -s 56 -c 3 -W 1 28.213.96.131 2025-08-10 21:08:17,828 - DEBUG - PING 28.213.96.131 (28.213.96.131) 56(84) bytes of data. 64 bytes from 28.213.96.131: icmp_req=1 ttl=63 time=4.61 ms 64 bytes from 28.213.96.131: icmp_req=2 ttl=63 time=0.883 ms 64 bytes from 28.213.96.131: icmp_req=3 ttl=63 time=0.676 ms --- 28.213.96.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.676/2.058/4.616/1.810 ms 2025-08-10 21:08:17,828 - INFO - Ping to IP 28.213.96.131 from VM ctest-VM11-28515526 passed 2025-08-10 21:08:17,828 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 365c:de40:d080:8988:9ea2:9757:0:3, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.254, gateway password: c0ntrail123 2025-08-10 21:08:17,828 - DEBUG - ping6 -s 56 -c 3 -W 1 365c:de40:d080:8988:9ea2:9757:0:3 2025-08-10 21:08:20,295 - DEBUG - PING 365c:de40:d080:8988:9ea2:9757:0:3(365c:de40:d080:8988:9ea2:9757:0:3) 56 data bytes 64 bytes from 365c:de40:d080:8988:9ea2:9757:0:3: icmp_seq=1 ttl=64 time=6.84 ms 64 bytes from 365c:de40:d080:8988:9ea2:9757:0:3: icmp_seq=2 ttl=64 time=0.856 ms 64 bytes from 365c:de40:d080:8988:9ea2:9757:0:3: icmp_seq=3 ttl=64 time=0.819 ms --- 365c:de40:d080:8988:9ea2:9757:0:3 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.819/2.841/6.848/2.833 ms 2025-08-10 21:08:20,295 - INFO - Ping to IP 365c:de40:d080:8988:9ea2:9757:0:3 from VM ctest-VM11-28515526 passed 2025-08-10 21:08:20,295 - INFO - Test with src as policy and dst as any PASSED 2025-08-10 21:08:20,295 - INFO - Deleting VM ctest-VM31-38344122 2025-08-10 21:08:20,372 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:08:20,372 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:08:20,380 - DEBUG - VM ID 0a824388-0cd1-49eb-9b2d-1be34968441c of VM ctest-VM31-38344122 is still found in API Server 2025-08-10 21:08:22,381 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:08:22,381 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:08:22,390 - DEBUG - Response Code: 404 2025-08-10 21:08:22,390 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:08:22,398 - DEBUG - Response Code: 404 2025-08-10 21:08:22,398 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/0a824388-0cd1-49eb-9b2d-1be34968441c 2025-08-10 21:08:22,403 - DEBUG - Response Code: 404 2025-08-10 21:08:22,403 - INFO - VM ctest-VM31-38344122 is fully removed in API-Server 2025-08-10 21:08:22,560 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-10 21:08:22,604 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 2025-08-10 21:08:22,614 - DEBUG - Validated that vrouter 10.0.0.50 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 2025-08-10 21:08:22,614 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 2025-08-10 21:08:22,614 - INFO - VM ctest-VM31-38344122 is removed in Compute, and routes are removed in all compute nodes 2025-08-10 21:08:22,889 - INFO - Routes for VM ctest-VM31-38344122 is removed in all control-nodes 2025-08-10 21:08:22,889 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:22,926 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:08:22,957 - DEBUG - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:08:22,957 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:22,957 - DEBUG - interface for vm 0a824388-0cd1-49eb-9b2d-1be34968441c deleted from vrouter uve ... 2025-08-10 21:08:22,957 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:25,958 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:25,996 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:08:26,027 - DEBUG - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:08:26,027 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:26,027 - DEBUG - interface for vm 0a824388-0cd1-49eb-9b2d-1be34968441c deleted from vrouter uve ... 2025-08-10 21:08:26,027 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:29,028 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:29,068 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:08:29,099 - DEBUG - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:08:29,099 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:29,099 - DEBUG - interface for vm 0a824388-0cd1-49eb-9b2d-1be34968441c deleted from vrouter uve ... 2025-08-10 21:08:29,099 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:32,099 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:32,140 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:08:32,174 - DEBUG - VM 0a824388-0cd1-49eb-9b2d-1be34968441c is not present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:08:32,174 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:32,174 - DEBUG - interface for vm 0a824388-0cd1-49eb-9b2d-1be34968441c deleted from vrouter uve ... 2025-08-10 21:08:32,174 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:32,174 - DEBUG - Validated that VM 0a824388-0cd1-49eb-9b2d-1be34968441c is removed in Vrouter UVE 2025-08-10 21:08:32,174 - DEBUG - Verifying through opserver in 10.0.0.48 2025-08-10 21:08:32,174 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360?flat 2025-08-10 21:08:32,193 - DEBUG - 0a824388-0cd1-49eb-9b2d-1be34968441c BM not in default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN3-33994360 uve 2025-08-10 21:08:32,193 - DEBUG - Validated that VM 0a824388-0cd1-49eb-9b2d-1be34968441c is not present in the VN UVE 2025-08-10 21:08:32,193 - DEBUG - Verifying the 0a824388-0cd1-49eb-9b2d-1be34968441c virtual network link through opserver 10.0.0.48 2025-08-10 21:08:32,193 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:08:32,215 - INFO - 0a824388-0cd1-49eb-9b2d-1be34968441c vm uve deleted from opserver 2025-08-10 21:08:32,215 - DEBUG - Verifying the 0a824388-0cd1-49eb-9b2d-1be34968441c virtual network link through opserver 10.0.0.38 2025-08-10 21:08:32,215 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:08:32,227 - INFO - 0a824388-0cd1-49eb-9b2d-1be34968441c vm uve deleted from opserver 2025-08-10 21:08:32,227 - DEBUG - Verifying the 0a824388-0cd1-49eb-9b2d-1be34968441c virtual network link through opserver 10.0.0.49 2025-08-10 21:08:32,227 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:08:32,239 - INFO - 0a824388-0cd1-49eb-9b2d-1be34968441c vm uve deleted from opserver 2025-08-10 21:08:32,239 - INFO - Validated that VM 0a824388-0cd1-49eb-9b2d-1be34968441c is removed from Opserver 2025-08-10 21:08:32,239 - INFO - Deleting VM ctest-VM21-51719445 2025-08-10 21:08:32,359 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:08:32,359 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:08:32,368 - DEBUG - VM ID e84e563a-52b3-4b99-8024-4044b97cc839 of VM ctest-VM21-51719445 is still found in API Server 2025-08-10 21:08:34,368 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:08:34,369 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:08:34,376 - DEBUG - Response Code: 404 2025-08-10 21:08:34,376 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:08:34,382 - DEBUG - Response Code: 404 2025-08-10 21:08:34,382 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/e84e563a-52b3-4b99-8024-4044b97cc839 2025-08-10 21:08:34,387 - DEBUG - Response Code: 404 2025-08-10 21:08:34,387 - INFO - VM ctest-VM21-51719445 is fully removed in API-Server 2025-08-10 21:08:34,547 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-10 21:08:34,595 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 2025-08-10 21:08:34,605 - DEBUG - Validated that vrouter 10.0.0.50 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 2025-08-10 21:08:34,605 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 2025-08-10 21:08:34,605 - INFO - VM ctest-VM21-51719445 is removed in Compute, and routes are removed in all compute nodes 2025-08-10 21:08:34,862 - INFO - Routes for VM ctest-VM21-51719445 is removed in all control-nodes 2025-08-10 21:08:34,862 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:34,909 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:34,943 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:34,943 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:34,943 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:34,943 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:37,944 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:37,985 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:38,036 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:38,036 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:38,036 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:38,036 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:41,037 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:41,078 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:41,112 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:41,112 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:41,112 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:41,112 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:44,113 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:44,155 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:44,209 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:44,209 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:44,210 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:44,210 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:47,211 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:47,254 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:47,289 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:47,289 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:47,289 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:47,289 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:50,289 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:50,332 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:50,365 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:50,365 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:50,365 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:50,365 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:53,366 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:53,411 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:53,446 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:53,446 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:53,446 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:53,446 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:56,447 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:56,487 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:56,520 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:56,520 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:56,521 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:56,521 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:08:59,521 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:08:59,561 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:08:59,595 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:08:59,595 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:08:59,595 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:08:59,595 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:02,595 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-2:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:02,637 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-2?flat 2025-08-10 21:09:02,673 - DEBUG - VM e84e563a-52b3-4b99-8024-4044b97cc839 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3790-2 uve 2025-08-10 21:09:02,673 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:02,674 - DEBUG - interface for vm e84e563a-52b3-4b99-8024-4044b97cc839 deleted from vrouter uve ... 2025-08-10 21:09:02,674 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:02,674 - DEBUG - Validated that VM e84e563a-52b3-4b99-8024-4044b97cc839 is removed in Vrouter UVE 2025-08-10 21:09:02,674 - DEBUG - Verifying through opserver in 10.0.0.48 2025-08-10 21:09:02,674 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166?flat 2025-08-10 21:09:02,694 - DEBUG - e84e563a-52b3-4b99-8024-4044b97cc839 BM not in default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN2-16990166 uve 2025-08-10 21:09:02,694 - DEBUG - Validated that VM e84e563a-52b3-4b99-8024-4044b97cc839 is not present in the VN UVE 2025-08-10 21:09:02,694 - DEBUG - Verifying the e84e563a-52b3-4b99-8024-4044b97cc839 virtual network link through opserver 10.0.0.48 2025-08-10 21:09:02,694 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:09:02,705 - INFO - e84e563a-52b3-4b99-8024-4044b97cc839 vm uve deleted from opserver 2025-08-10 21:09:02,705 - DEBUG - Verifying the e84e563a-52b3-4b99-8024-4044b97cc839 virtual network link through opserver 10.0.0.38 2025-08-10 21:09:02,705 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:09:02,719 - INFO - e84e563a-52b3-4b99-8024-4044b97cc839 vm uve deleted from opserver 2025-08-10 21:09:02,719 - DEBUG - Verifying the e84e563a-52b3-4b99-8024-4044b97cc839 virtual network link through opserver 10.0.0.49 2025-08-10 21:09:02,719 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:09:02,730 - INFO - e84e563a-52b3-4b99-8024-4044b97cc839 vm uve deleted from opserver 2025-08-10 21:09:02,730 - INFO - Validated that VM e84e563a-52b3-4b99-8024-4044b97cc839 is removed from Opserver 2025-08-10 21:09:02,730 - INFO - Deleting VM ctest-VM11-28515526 2025-08-10 21:09:02,803 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:09:02,803 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:02,811 - DEBUG - VM ID ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 of VM ctest-VM11-28515526 is still found in API Server 2025-08-10 21:09:04,812 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:09:04,812 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:04,819 - DEBUG - Response Code: 404 2025-08-10 21:09:04,820 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:04,825 - DEBUG - Response Code: 404 2025-08-10 21:09:04,825 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:04,830 - DEBUG - Response Code: 404 2025-08-10 21:09:04,830 - INFO - VM ctest-VM11-28515526 is fully removed in API-Server 2025-08-10 21:09:04,992 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-10 21:09:05,035 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 2025-08-10 21:09:05,045 - DEBUG - Validated that vrouter 10.0.0.50 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 2025-08-10 21:09:05,045 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 2025-08-10 21:09:05,045 - INFO - VM ctest-VM11-28515526 is removed in Compute, and routes are removed in all compute nodes 2025-08-10 21:09:05,269 - INFO - Routes for VM ctest-VM11-28515526 is removed in all control-nodes 2025-08-10 21:09:05,269 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:05,307 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:05,337 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:05,337 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:05,338 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:05,338 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:08,338 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:08,378 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:08,412 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:08,412 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:08,412 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:08,412 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:11,412 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:11,451 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:11,495 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:11,495 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:11,495 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:11,495 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:14,495 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:14,533 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:14,566 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:14,566 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:14,566 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:14,566 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:17,566 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:17,604 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:17,634 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:17,635 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:17,635 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:17,635 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:20,635 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:20,675 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:20,709 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:20,709 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:20,709 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:20,709 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:23,709 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:23,747 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:23,777 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:23,777 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:23,777 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:23,777 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:26,778 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:26,816 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:26,846 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:26,846 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:26,846 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:26,846 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:29,846 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:29,884 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:29,918 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:29,918 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:29,918 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:29,918 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:32,919 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3790-1:Compute:contrail-vrouter-agent:0?flat 2025-08-10 21:09:32,959 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3790-1?flat 2025-08-10 21:09:32,991 - DEBUG - VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3790-1 uve 2025-08-10 21:09:32,991 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-10 21:09:32,991 - DEBUG - interface for vm ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 deleted from vrouter uve ... 2025-08-10 21:09:32,991 - DEBUG - Deleted interface not in error interface list ... 2025-08-10 21:09:32,991 - DEBUG - Validated that VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is removed in Vrouter UVE 2025-08-10 21:09:32,991 - DEBUG - Verifying through opserver in 10.0.0.48 2025-08-10 21:09:32,991 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496?flat 2025-08-10 21:09:33,019 - DEBUG - ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 BM not in default-domain:ctest-TestPolicyAclIpv4v6-52956328:ctest-VN1-96265496 uve 2025-08-10 21:09:33,019 - DEBUG - Validated that VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is not present in the VN UVE 2025-08-10 21:09:33,019 - DEBUG - Verifying the ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 virtual network link through opserver 10.0.0.48 2025-08-10 21:09:33,019 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-machines 2025-08-10 21:09:33,029 - DEBUG - No links retuned for ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:33,029 - INFO - ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 vm uve deleted from opserver 2025-08-10 21:09:33,029 - DEBUG - Verifying the ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 virtual network link through opserver 10.0.0.38 2025-08-10 21:09:33,029 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-10 21:09:33,039 - DEBUG - No links retuned for ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:33,039 - INFO - ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 vm uve deleted from opserver 2025-08-10 21:09:33,040 - DEBUG - Verifying the ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 virtual network link through opserver 10.0.0.49 2025-08-10 21:09:33,040 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-08-10 21:09:33,050 - DEBUG - No links retuned for ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 2025-08-10 21:09:33,050 - INFO - ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 vm uve deleted from opserver 2025-08-10 21:09:33,050 - INFO - Validated that VM ad0060b0-ae9f-4dd3-92fe-21f752b67dc4 is removed from Opserver 2025-08-10 21:09:33,051 - DEBUG - Detaching the Policy for VN :ctest-VN2-16990166 2025-08-10 21:09:33,051 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:09:33,056 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:09:33,093 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:09:33,187 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/0f39e1c2-a20a-49e8-a216-727b39619d9d 2025-08-10 21:09:33,215 - DEBUG - Requesting: http://10.0.0.48:8082/network-policy/756b773a-ff96-4273-a1ee-a2011ec7aab1 2025-08-10 21:09:33,387 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy21-38096938']] from ctest-VN2-16990166 2025-08-10 21:09:33,387 - DEBUG - Detaching the Policy for VN :ctest-VN1-96265496 2025-08-10 21:09:33,387 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:09:33,394 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:09:33,408 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:09:33,509 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/c2191247-9530-4762-a220-1e4480c0b930 2025-08-10 21:09:33,528 - DEBUG - Requesting: http://10.0.0.48:8082/network-policy/cfd86586-caed-4b22-a976-92c8847e191d 2025-08-10 21:09:33,539 - DEBUG - Requesting: http://10.0.0.48:8082/network-policy/0b0fbfcb-0074-42bf-9267-265de9fc17a2 2025-08-10 21:09:33,675 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy12-89151421'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-52956328', 'ctest-policy13-44791648']] from ctest-VN1-96265496 2025-08-10 21:09:33,710 - INFO - Deleted policy ctest-policy21-38096938 2025-08-10 21:09:33,738 - INFO - Deleted policy ctest-policy12-89151421 2025-08-10 21:09:33,772 - INFO - Deleted policy ctest-policy13-44791648 2025-08-10 21:09:33,772 - INFO - Deleting VN ctest-VN3-33994360 2025-08-10 21:09:33,978 - DEBUG - Response for deleting network () 2025-08-10 21:09:33,979 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b455376b-df3b-4fdb-82b4-3c7dd3ba3a51 2025-08-10 21:09:33,986 - DEBUG - Response Code: 404 2025-08-10 21:09:33,986 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:09:33,995 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:09:34,066 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:09:34,152 - INFO - Validated that VN ctest-VN3-33994360 is not found in API Server 2025-08-10 21:09:34,165 - DEBUG - VN ctest-VN3-33994360 is not present in Agent 10.0.0.254 2025-08-10 21:09:34,175 - DEBUG - VN ctest-VN3-33994360 is not present in Agent 10.0.0.50 2025-08-10 21:09:34,175 - INFO - Validated that VN ctest-VN3-33994360 is not in any agent 2025-08-10 21:09:34,203 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-33994360 info 2025-08-10 21:09:34,204 - INFO - Deleting VN ctest-VN2-16990166 2025-08-10 21:09:34,347 - DEBUG - Response for deleting network () 2025-08-10 21:09:34,347 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/7b39a514-5e24-41c2-8b87-cdfd82ea3a13 2025-08-10 21:09:34,354 - DEBUG - Response Code: 404 2025-08-10 21:09:34,354 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:09:34,359 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:09:34,370 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:09:34,456 - INFO - Validated that VN ctest-VN2-16990166 is not found in API Server 2025-08-10 21:09:34,467 - DEBUG - VN ctest-VN2-16990166 is not present in Agent 10.0.0.254 2025-08-10 21:09:34,477 - DEBUG - VN ctest-VN2-16990166 is not present in Agent 10.0.0.50 2025-08-10 21:09:34,477 - INFO - Validated that VN ctest-VN2-16990166 is not in any agent 2025-08-10 21:09:34,507 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-16990166 info 2025-08-10 21:09:34,507 - INFO - Deleting VN ctest-VN1-96265496 2025-08-10 21:09:34,669 - DEBUG - Response for deleting network () 2025-08-10 21:09:34,669 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/07842cba-ced9-4be4-a99c-203fe3ca8d3b 2025-08-10 21:09:34,675 - DEBUG - Response Code: 404 2025-08-10 21:09:34,675 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:09:34,680 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:09:34,732 - DEBUG - Requesting: http://10.0.0.48:8082/project/b073d11c-ee4c-4660-8efd-2af4cc9c7eae 2025-08-10 21:09:34,821 - INFO - Validated that VN ctest-VN1-96265496 is not found in API Server 2025-08-10 21:09:34,832 - DEBUG - VN ctest-VN1-96265496 is not present in Agent 10.0.0.254 2025-08-10 21:09:34,842 - DEBUG - VN ctest-VN1-96265496 is not present in Agent 10.0.0.50 2025-08-10 21:09:34,842 - INFO - Validated that VN ctest-VN1-96265496 is not in any agent 2025-08-10 21:09:34,873 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-96265496 info 2025-08-10 21:09:34,960 - INFO - IPAM: ipam3 is not found in API Server 2025-08-10 21:09:34,984 - INFO - IPAM:ipam3 is not found in control node 2025-08-10 21:09:35,108 - INFO - IPAM: ipam2 is not found in API Server 2025-08-10 21:09:35,129 - INFO - IPAM:ipam2 is not found in control node 2025-08-10 21:09:35,252 - INFO - IPAM: ipam1 is not found in API Server 2025-08-10 21:09:35,271 - INFO - IPAM:ipam1 is not found in control node 2025-08-10 21:09:36,529 - DEBUG - No XMPP flaps were noticed during the test

2025-08-10 21:09:36,529 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:56]

2025-08-10 21:09:36,529 - INFO - -------------------------------------------------------------------------------- 2025-08-10 21:09:37,778 - DEBUG - No XMPP flaps were noticed during the test

2025-08-10 21:09:37,778 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:58]

2025-08-10 21:09:37,778 - INFO - -------------------------------------------------------------------------------- 2025-08-10 21:09:38,572 - INFO - Deleted project: ctest-TestPolicyAclIpv4v6-52956328, ID : b073d11c-ee4c-4660-8efd-2af4cc9c7eae