2025-10-20 02:33:47,945 - INFO - Domain Default found not creating 2025-10-20 02:33:48,145 - INFO - Project ctest-TestPolicyAclIpv4v6-71709334 not found, creating it 2025-10-20 02:33:48,742 - INFO - Created Project:ctest-TestPolicyAclIpv4v6-71709334, ID : fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:50,283 - INFO - ================================================================================ 2025-10-20 02:33:50,283 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-10-20 02:33:51,553 - DEBUG - Nothing to compare xmpp stats {'10.0.0.131': {'10.20.0.25': '0', '10.20.0.193': '0'}, '10.0.0.19': {'10.20.0.193': '0', '10.20.0.14': '0'}} with 2025-10-20 02:33:51,553 - INFO - Initial checks done. Running the testcase now 2025-10-20 02:33:51,553 - INFO - 2025-10-20 02:33:51,553 - INFO - ================================================================================ 2025-10-20 02:33:51,553 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-10-20 02:33:51,553 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-10-20 02:33:52,802 - DEBUG - Nothing to compare xmpp stats {'10.0.0.131': {'10.20.0.25': '0', '10.20.0.193': '0'}, '10.0.0.19': {'10.20.0.193': '0', '10.20.0.14': '0'}} with 2025-10-20 02:33:52,802 - INFO - Initial checks done. Running the testcase now 2025-10-20 02:33:52,802 - INFO - 2025-10-20 02:33:54,089 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:54,380 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:54,410 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:54,423 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:54,521 - DEBUG - Requesting: http://10.0.0.22:8082/network-ipam/fbf95cd4-3577-4d28-b8be-1d37f74d9de2 2025-10-20 02:33:54,528 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-10-20 02:33:54,532 - DEBUG - Control-node 10.0.0.22 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18156645439220698408', 'uuid-lslong': '13312109674763230690'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.124700'} 2025-10-20 02:33:54,538 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18156645439220698408', 'uuid-lslong': '13312109674763230690'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.128673'} 2025-10-20 02:33:54,542 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18156645439220698408', 'uuid-lslong': '13312109674763230690'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.133007'} 2025-10-20 02:33:54,542 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-10-20 02:33:54,543 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:54,548 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:54,559 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:54,650 - DEBUG - Requesting: http://10.0.0.22:8082/network-ipam/b0c7632c-cfcf-433b-9b15-c65ba42b51fb 2025-10-20 02:33:54,658 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-10-20 02:33:54,664 - DEBUG - Control-node 10.0.0.22 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12738259115156915003', 'uuid-lslong': '11175056147288379899'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.929648'} 2025-10-20 02:33:54,669 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12738259115156915003', 'uuid-lslong': '11175056147288379899'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.934857'} 2025-10-20 02:33:54,674 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12738259115156915003', 'uuid-lslong': '11175056147288379899'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.932428'} 2025-10-20 02:33:54,674 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-10-20 02:33:54,674 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:54,680 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:54,690 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:54,784 - DEBUG - Requesting: http://10.0.0.22:8082/network-ipam/7aba3444-af18-4fb6-a68f-8a29487e0183 2025-10-20 02:33:54,793 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-10-20 02:33:54,800 - DEBUG - Control-node 10.0.0.22 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8843438287895416758', 'uuid-lslong': '12001963441880170883'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.737138'} 2025-10-20 02:33:54,806 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8843438287895416758', 'uuid-lslong': '12001963441880170883'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.747087'} 2025-10-20 02:33:54,811 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8843438287895416758', 'uuid-lslong': '12001963441880170883'}, 'enable': 'true', 'created': '2025-10-20T02:33:53', 'last-modified': '2025-10-20T02:33:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.755783'} 2025-10-20 02:33:54,811 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-10-20 02:33:55,144 - DEBUG - Response for create_network : {'network': {'id': 'a68cac58-22e8-40d0-95a2-f945ea90b85f', 'name': 'ctest-VN1-88704990', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-VN1-88704990'], 'port_security_enabled': True, 'description': ''}} 2025-10-20 02:33:55,453 - DEBUG - Response for create_subnet : {'subnet': {'id': '801b4838-2a1c-4944-88a1-b07fe895ccf3', 'name': '', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'network_id': 'a68cac58-22e8-40d0-95a2-f945ea90b85f', 'ip_version': 4, 'cidr': '202.116.169.128/26', 'allocation_pools': [{'start': '202.116.169.130', 'end': '202.116.169.190'}], 'gateway_ip': '202.116.169.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '202.116.169.130', 'tags': [], 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c'}} 2025-10-20 02:33:55,701 - DEBUG - Response for create_subnet : {'subnet': {'id': '2d48fd6d-83ea-45a9-91f9-5d6cfa466766', 'name': '', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'network_id': 'a68cac58-22e8-40d0-95a2-f945ea90b85f', 'ip_version': 6, 'cidr': '3890:65ae:e177:67b4:6c71:4051::/96', 'allocation_pools': [{'start': '3890:65ae:e177:67b4:6c71:4051:0:2', 'end': '3890:65ae:e177:67b4:6c71:4051:ffff:fffe'}], 'gateway_ip': '3890:65ae:e177:67b4:6c71:4051:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3890:65ae:e177:67b4:6c71:4051:0:2', 'tags': [], 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c'}} 2025-10-20 02:33:55,729 - INFO - Created VN ctest-VN1-88704990 2025-10-20 02:33:55,742 - DEBUG - VN ctest-VN1-88704990 UUID is a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:55,905 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990(a68cac58-22e8-40d0-95a2-f945ea90b85f) with subnets ['202.116.169.128/26', '3890:65ae:e177:67b4:6c71:4051::/96'] 2025-10-20 02:33:56,223 - DEBUG - Response for create_network : {'network': {'id': '054187d3-414c-4b80-91fd-ff7d0393835f', 'name': 'ctest-VN2-62110016', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-VN2-62110016'], 'port_security_enabled': True, 'description': ''}} 2025-10-20 02:33:56,437 - DEBUG - Response for create_subnet : {'subnet': {'id': '0abae633-4ef3-4a7d-b1c7-1fcd9cd3d48e', 'name': '', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'network_id': '054187d3-414c-4b80-91fd-ff7d0393835f', 'ip_version': 4, 'cidr': '122.44.101.192/26', 'allocation_pools': [{'start': '122.44.101.194', 'end': '122.44.101.254'}], 'gateway_ip': '122.44.101.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '122.44.101.194', 'tags': [], 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c'}} 2025-10-20 02:33:56,624 - DEBUG - Response for create_subnet : {'subnet': {'id': '1ecbfd23-bc72-4704-955e-dd1ec1238a91', 'name': '', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'network_id': '054187d3-414c-4b80-91fd-ff7d0393835f', 'ip_version': 6, 'cidr': '3bea:776:642a:3d1a:7ee1:81de::/96', 'allocation_pools': [{'start': '3bea:776:642a:3d1a:7ee1:81de:0:2', 'end': '3bea:776:642a:3d1a:7ee1:81de:ffff:fffe'}], 'gateway_ip': '3bea:776:642a:3d1a:7ee1:81de:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3bea:776:642a:3d1a:7ee1:81de:0:2', 'tags': [], 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c'}} 2025-10-20 02:33:56,648 - INFO - Created VN ctest-VN2-62110016 2025-10-20 02:33:56,658 - DEBUG - VN ctest-VN2-62110016 UUID is 054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:57,017 - DEBUG - Response for create_network : {'network': {'id': 'a3fbe20b-659d-498b-9766-499815877277', 'name': 'ctest-VN3-86151669', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-VN3-86151669'], 'port_security_enabled': True, 'description': ''}} 2025-10-20 02:33:57,231 - DEBUG - Response for create_subnet : {'subnet': {'id': '6dd301f8-f079-4e1a-80fc-559e1a8eaaf1', 'name': '', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'network_id': 'a3fbe20b-659d-498b-9766-499815877277', 'ip_version': 4, 'cidr': '204.132.252.192/26', 'allocation_pools': [{'start': '204.132.252.194', 'end': '204.132.252.254'}], 'gateway_ip': '204.132.252.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '204.132.252.194', 'tags': [], 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c'}} 2025-10-20 02:33:57,472 - DEBUG - Response for create_subnet : {'subnet': {'id': '1ae80207-7368-45c9-9d56-1fcbc150024d', 'name': '', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'network_id': 'a3fbe20b-659d-498b-9766-499815877277', 'ip_version': 6, 'cidr': '27be:1ba2:49c0:c78e:b9c8:b5da::/96', 'allocation_pools': [{'start': '27be:1ba2:49c0:c78e:b9c8:b5da:0:2', 'end': '27be:1ba2:49c0:c78e:b9c8:b5da:ffff:fffe'}], 'gateway_ip': '27be:1ba2:49c0:c78e:b9c8:b5da:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27be:1ba2:49c0:c78e:b9c8:b5da:0:2', 'tags': [], 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c'}} 2025-10-20 02:33:57,495 - INFO - Created VN ctest-VN3-86151669 2025-10-20 02:33:57,508 - DEBUG - VN ctest-VN3-86151669 UUID is a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:57,612 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:57,618 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:57,631 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:57,721 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:57,735 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:57,744 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/063549d7-b52e-461d-a133-58a463a55814 2025-10-20 02:33:57,754 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/063549d7-b52e-461d-a133-58a463a55814 2025-10-20 02:33:57,762 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/15392105-5b71-4b02-a8b8-d13c537dc7a4 2025-10-20 02:33:57,769 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-20 02:33:57,769 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:57,779 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/063549d7-b52e-461d-a133-58a463a55814 2025-10-20 02:33:57,795 - INFO - Verified VN network id 11 for VN a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:57,795 - INFO - Verifications in API Server for VN ctest-VN1-88704990 passed 2025-10-20 02:33:57,795 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:57,806 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/063549d7-b52e-461d-a133-58a463a55814 2025-10-20 02:33:57,813 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/063549d7-b52e-461d-a133-58a463a55814 2025-10-20 02:33:57,820 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/15392105-5b71-4b02-a8b8-d13c537dc7a4 2025-10-20 02:33:57,831 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12001156601578275024', 'uuid-lslong': '10782454536561801311'}, 'enable': 'true', 'created': '2025-10-20T02:33:55', 'last-modified': '2025-10-20T02:33:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.194977'} 2025-10-20 02:33:57,836 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-20 02:33:57,842 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12001156601578275024', 'uuid-lslong': '10782454536561801311'}, 'enable': 'true', 'created': '2025-10-20T02:33:55', 'last-modified': '2025-10-20T02:33:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.205930'} 2025-10-20 02:33:57,850 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-20 02:33:57,854 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12001156601578275024', 'uuid-lslong': '10782454536561801311'}, 'enable': 'true', 'created': '2025-10-20T02:33:55', 'last-modified': '2025-10-20T02:33:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.217038'} 2025-10-20 02:33:57,859 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-20 02:33:57,860 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-88704990 passed 2025-10-20 02:33:57,860 - DEBUG - ====Verifying policy data for ctest-VN1-88704990 in API_Server ====== 2025-10-20 02:33:57,860 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:57,866 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:57,886 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:57,975 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:33:57,988 - DEBUG - =>VN ctest-VN1-88704990 has no policy to be verified 2025-10-20 02:33:57,988 - DEBUG - Verifying the vn in opserver 2025-10-20 02:33:57,988 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 virtual network link through opserver 10.0.0.22 2025-10-20 02:33:57,988 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-20 02:33:58,281 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-20 02:33:58,333 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990?flat'} 2025-10-20 02:33:58,334 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 virtual network link through opserver 10.0.0.254 2025-10-20 02:33:58,334 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-20 02:33:58,632 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-20 02:33:58,685 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990?flat'} 2025-10-20 02:33:58,685 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 virtual network link through opserver 10.0.0.27 2025-10-20 02:33:58,685 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-10-20 02:33:58,981 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-10-20 02:33:59,033 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990?flat'} 2025-10-20 02:33:59,033 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is found in opserver 2025-10-20 02:33:59,051 - DEBUG - Do not have enough data to verify VN in agent 2025-10-20 02:33:59,059 - DEBUG - VRF ids for VN ctest-VN1-88704990: {} 2025-10-20 02:33:59,059 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:59,065 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:59,076 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:59,171 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:59,181 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:59,191 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2ac5fd47-c35c-4228-9406-91e14c2fdda8 2025-10-20 02:33:59,197 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2ac5fd47-c35c-4228-9406-91e14c2fdda8 2025-10-20 02:33:59,204 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/cce22c42-955c-4577-90df-fc599d413457 2025-10-20 02:33:59,211 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-20 02:33:59,211 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:59,221 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2ac5fd47-c35c-4228-9406-91e14c2fdda8 2025-10-20 02:33:59,236 - INFO - Verified VN network id 12 for VN 054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:59,237 - INFO - Verifications in API Server for VN ctest-VN2-62110016 passed 2025-10-20 02:33:59,237 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:59,248 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2ac5fd47-c35c-4228-9406-91e14c2fdda8 2025-10-20 02:33:59,256 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2ac5fd47-c35c-4228-9406-91e14c2fdda8 2025-10-20 02:33:59,263 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/cce22c42-955c-4577-90df-fc599d413457 2025-10-20 02:33:59,274 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '378733185079200640', 'uuid-lslong': '10519845217003340639'}, 'enable': 'true', 'created': '2025-10-20T02:33:56', 'last-modified': '2025-10-20T02:33:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.708955'} 2025-10-20 02:33:59,283 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-20 02:33:59,289 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '378733185079200640', 'uuid-lslong': '10519845217003340639'}, 'enable': 'true', 'created': '2025-10-20T02:33:56', 'last-modified': '2025-10-20T02:33:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.722864'} 2025-10-20 02:33:59,294 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-20 02:33:59,300 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '378733185079200640', 'uuid-lslong': '10519845217003340639'}, 'enable': 'true', 'created': '2025-10-20T02:33:56', 'last-modified': '2025-10-20T02:33:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.734822'} 2025-10-20 02:33:59,306 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-20 02:33:59,306 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-62110016 passed 2025-10-20 02:33:59,306 - DEBUG - ====Verifying policy data for ctest-VN2-62110016 in API_Server ====== 2025-10-20 02:33:59,306 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:59,312 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:59,322 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:59,409 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:33:59,418 - DEBUG - =>VN ctest-VN2-62110016 has no policy to be verified 2025-10-20 02:33:59,418 - DEBUG - Verifying the vn in opserver 2025-10-20 02:33:59,418 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 virtual network link through opserver 10.0.0.22 2025-10-20 02:33:59,418 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-20 02:33:59,475 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016?flat'} 2025-10-20 02:33:59,475 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 virtual network link through opserver 10.0.0.254 2025-10-20 02:33:59,475 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-20 02:33:59,530 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016?flat'} 2025-10-20 02:33:59,530 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 virtual network link through opserver 10.0.0.27 2025-10-20 02:33:59,530 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-10-20 02:33:59,582 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016?flat'} 2025-10-20 02:33:59,582 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 is found in opserver 2025-10-20 02:33:59,601 - DEBUG - Do not have enough data to verify VN in agent 2025-10-20 02:33:59,609 - DEBUG - VRF ids for VN ctest-VN2-62110016: {} 2025-10-20 02:33:59,609 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:59,615 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:59,625 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:59,721 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:59,733 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:59,746 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/d26714cb-dec4-4737-be0e-b8d3f8dd3898 2025-10-20 02:33:59,752 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/d26714cb-dec4-4737-be0e-b8d3f8dd3898 2025-10-20 02:33:59,758 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/8d257d93-2457-4ef6-9ea5-5b3fc16e5746 2025-10-20 02:33:59,765 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-20 02:33:59,765 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:59,774 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/d26714cb-dec4-4737-be0e-b8d3f8dd3898 2025-10-20 02:33:59,788 - INFO - Verified VN network id 13 for VN a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:59,789 - INFO - Verifications in API Server for VN ctest-VN3-86151669 passed 2025-10-20 02:33:59,789 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:59,798 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/d26714cb-dec4-4737-be0e-b8d3f8dd3898 2025-10-20 02:33:59,804 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/d26714cb-dec4-4737-be0e-b8d3f8dd3898 2025-10-20 02:33:59,811 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/8d257d93-2457-4ef6-9ea5-5b3fc16e5746 2025-10-20 02:33:59,823 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11816286585913952651', 'uuid-lslong': '10909488064896660087'}, 'enable': 'true', 'created': '2025-10-20T02:33:56', 'last-modified': '2025-10-20T02:33:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.446093'} 2025-10-20 02:33:59,829 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-20 02:33:59,835 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11816286585913952651', 'uuid-lslong': '10909488064896660087'}, 'enable': 'true', 'created': '2025-10-20T02:33:56', 'last-modified': '2025-10-20T02:33:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.457721'} 2025-10-20 02:33:59,841 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-20 02:33:59,846 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-71709334', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11816286585913952651', 'uuid-lslong': '10909488064896660087'}, 'enable': 'true', 'created': '2025-10-20T02:33:56', 'last-modified': '2025-10-20T02:33:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.466965'} 2025-10-20 02:33:59,852 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-20 02:33:59,852 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-86151669 passed 2025-10-20 02:33:59,852 - DEBUG - ====Verifying policy data for ctest-VN3-86151669 in API_Server ====== 2025-10-20 02:33:59,852 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:33:59,858 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:33:59,869 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:33:59,957 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a3fbe20b-659d-498b-9766-499815877277 2025-10-20 02:33:59,967 - DEBUG - =>VN ctest-VN3-86151669 has no policy to be verified 2025-10-20 02:33:59,967 - DEBUG - Verifying the vn in opserver 2025-10-20 02:33:59,967 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 virtual network link through opserver 10.0.0.22 2025-10-20 02:33:59,967 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-20 02:34:00,023 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669?flat'} 2025-10-20 02:34:00,023 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 virtual network link through opserver 10.0.0.254 2025-10-20 02:34:00,023 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-20 02:34:00,077 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669?flat'} 2025-10-20 02:34:00,077 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 virtual network link through opserver 10.0.0.27 2025-10-20 02:34:00,077 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-10-20 02:34:00,134 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669?flat'} 2025-10-20 02:34:00,134 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 is found in opserver 2025-10-20 02:34:00,156 - DEBUG - Do not have enough data to verify VN in agent 2025-10-20 02:34:00,177 - DEBUG - VRF ids for VN ctest-VN3-86151669: {} 2025-10-20 02:34:00,182 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-20 02:34:00,445 - DEBUG - No source network defined 2025-10-20 02:34:00,445 - DEBUG - No source network defined 2025-10-20 02:34:00,445 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-policy13-80593624, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-policy13-80593624, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-20 02:34:00,717 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-20 02:34:00,934 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:34:00,940 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:34:00,951 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:34:01,054 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:34:01,064 - DEBUG - Setup step: Associating the policy to VN' 2025-10-20 02:34:01,179 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'a68cac58-22e8-40d0-95a2-f945ea90b85f', 'name': 'ctest-VN1-88704990', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['801b4838-2a1c-4944-88a1-b07fe895ccf3', '2d48fd6d-83ea-45a9-91f9-5d6cfa466766'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-VN1-88704990'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy12-16760219'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy13-80593624']], 'subnet_ipam': [{'subnet_cidr': '202.116.169.128/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ipam1']}, {'subnet_cidr': '3890:65ae:e177:67b4:6c71:4051::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ipam1']}], 'port_security_enabled': True, 'description': ''}} 2025-10-20 02:34:01,329 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy12-16760219'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy13-80593624']] to ctest-VN1-88704990 2025-10-20 02:34:01,330 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:34:01,337 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:34:01,347 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:34:01,454 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:34:01,464 - DEBUG - Setup step: Associating the policy to VN' 2025-10-20 02:34:01,568 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '054187d3-414c-4b80-91fd-ff7d0393835f', 'name': 'ctest-VN2-62110016', 'tenant_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'project_id': 'fb5fc46452be4a77b4086feca6d8c49c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['0abae633-4ef3-4a7d-b1c7-1fcd9cd3d48e', '1ecbfd23-bc72-4704-955e-dd1ec1238a91'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-VN2-62110016'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy21-48267744']], 'subnet_ipam': [{'subnet_cidr': '122.44.101.192/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ipam2']}, {'subnet_cidr': '3bea:776:642a:3d1a:7ee1:81de::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-10-20 02:34:01,669 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy21-48267744']] to ctest-VN2-62110016 2025-10-20 02:34:01,777 - DEBUG - Services list from nova: [, , , ] 2025-10-20 02:34:02,833 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4370-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4370-2) 2025-10-20 02:34:04,387 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4370-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4370-1) 2025-10-20 02:34:05,792 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4370-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4370-2) 2025-10-20 02:34:05,879 - DEBUG - VM is in ACTIVE state now 2025-10-20 02:34:05,879 - INFO - VM name : ctest-VM11-19636830 2025-10-20 02:34:05,955 - DEBUG - VM ctest-VM11-19636830 ID is 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:06,045 - DEBUG - VM is in ACTIVE state now 2025-10-20 02:34:06,072 - DEBUG - VM ctest-VM11-19636830 launched on Node an-jenkins-deploy-platform-ansible-os-4370-2 2025-10-20 02:34:06,155 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:06,568 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:06,620 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:06,631 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1ebfcb1f-f82e-451e-871d-b4131fa47f13 2025-10-20 02:34:06,643 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:06,662 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1ebfcb1f-f82e-451e-871d-b4131fa47f13 2025-10-20 02:34:06,674 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/2d0d149c-13cf-44f0-b49d-e2a19814c459 2025-10-20 02:34:06,691 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/91c03276-f937-449b-8e35-8b1207267153 2025-10-20 02:34:06,701 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:34:06,702 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:06,710 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1ebfcb1f-f82e-451e-871d-b4131fa47f13 2025-10-20 02:34:06,720 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/2d0d149c-13cf-44f0-b49d-e2a19814c459 2025-10-20 02:34:06,734 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/91c03276-f937-449b-8e35-8b1207267153 2025-10-20 02:34:06,746 - INFO - VM ctest-VM11-19636830 verfication in all API Servers passed 2025-10-20 02:34:06,781 - DEBUG - VM ctest-VM11-19636830 Tap interface: {'index': '3', 'name': 'tap1ebfcb1f-f8', 'uuid': '1ebfcb1f-f82e-451e-871d-b4131fa47f13', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990:ctest-VN1-88704990', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'vm_uuid': '6e53e1d2-6a3c-4732-b693-dabf5a82fcbe', 'vm_name': 'ctest-VM11-19636830', 'ip_addr': '202.116.169.131', 'mac_addr': '02:1e:bf:cb:1f:f8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13', 'sg_uuid_list': ['c21dd1f1-4fdd-4e8f-a106-6d589c79c5e1'], 'static_route_list': None, 'vm_project_uuid': 'fb5fc464-52be-4a77-b408-6feca6d8c49c', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '3890:65ae:e177:67b4:6c71:4051:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-20 02:34:06,781 - DEBUG - Agent 10.0.0.19 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990:ctest-VN1-88704990 2025-10-20 02:34:06,795 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990:ctest-VN1-88704990', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-20 02:34:06,900 - DEBUG - VM ctest-VM11-19636830 : Tap interface tap1ebfcb1f-f8 is set to Active 2025-10-20 02:34:06,900 - DEBUG - Tap interface tap1ebfcb1f-f8 detail : {'index': '3', 'name': 'tap1ebfcb1f-f8', 'uuid': '1ebfcb1f-f82e-451e-871d-b4131fa47f13', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990:ctest-VN1-88704990', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'vm_uuid': '6e53e1d2-6a3c-4732-b693-dabf5a82fcbe', 'vm_name': 'ctest-VM11-19636830', 'ip_addr': '202.116.169.131', 'mac_addr': '02:1e:bf:cb:1f:f8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13', 'sg_uuid_list': ['c21dd1f1-4fdd-4e8f-a106-6d589c79c5e1'], 'static_route_list': None, 'vm_project_uuid': 'fb5fc464-52be-4a77-b408-6feca6d8c49c', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '3890:65ae:e177:67b4:6c71:4051:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-20 02:34:07,013 - DEBUG - Starting Layer 2 verification in Agent 2025-10-20 02:34:07,030 - DEBUG - Layer 2 path is seen for VM MAC 02:1e:bf:cb:1f:f8 in agent 10.0.0.19 2025-10-20 02:34:07,030 - DEBUG - Active layer 2 route in agent is present for VMI tap1ebfcb1f-f8 2025-10-20 02:34:07,030 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-20 02:34:07,044 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is found in Agent of node 10.0.0.19 2025-10-20 02:34:07,144 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is consistent in agent 10.0.0.19 2025-10-20 02:34:07,144 - DEBUG - Route for VM IP ['3890:65ae:e177:67b4:6c71:4051:0:3', '202.116.169.131'] is consistent in agent 10.0.0.19 2025-10-20 02:34:07,144 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 verification for VM ctest-VM11-19636830 in Agent 10.0.0.19 passed 2025-10-20 02:34:07,258 - DEBUG - Starting all layer 2 verification in agent 10.0.0.19 2025-10-20 02:34:07,283 - DEBUG - Route for VM MAC 02:1e:bf:cb:1f:f8 is consistent in agent 10.0.0.19 2025-10-20 02:34:10,465 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-10-20 02:34:10,465 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:10,478 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:10,478 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:14,561 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-20 02:34:14,562 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:14,574 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:14,574 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:18,656 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-20 02:34:18,656 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:18,669 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:18,670 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:22,754 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-10-20 02:34:22,754 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:22,768 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:22,768 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:26,850 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-20 02:34:26,850 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:26,863 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:26,863 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:30,946 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-20 02:34:30,946 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:30,960 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:30,960 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:35,041 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-20 02:34:35,041 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:35,056 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:35,056 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:39,139 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-20 02:34:39,139 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:39,151 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:39,151 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:43,242 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-10-20 02:34:43,242 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 failed! 2025-10-20 02:34:43,256 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 202.116.169.129 and allocation pool is NOT set 2025-10-20 02:34:43,256 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 is 3890:65ae:e177:67b4:6c71:4051:0:1 and allocation pool is NOT set 2025-10-20 02:34:45,316 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.13 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.78 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.780/3.954/5.129/1.174 ms') 2025-10-20 02:34:45,316 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 passed 2025-10-20 02:34:45,316 - INFO - VM ctest-VM11-19636830 verifications in Compute nodes passed 2025-10-20 02:34:45,553 - DEBUG - Validated VM route 202.116.169.131 in vrouter of 10.0.0.19 2025-10-20 02:34:45,559 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-20 02:34:45,560 - INFO - Validated routes of VM ctest-VM11-19636830 in all vrouters 2025-10-20 02:34:45,978 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-20 02:34:46,084 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.254, not supported 2025-10-20 02:34:46,211 - DEBUG - Layer2 route found for VM MAC 02:1e:bf:cb:1f:f8 in Control-node 10.0.0.254 2025-10-20 02:34:46,211 - DEBUG - L2 Label for VM ctest-VM11-19636830 same between Control-node 10.0.0.254 and Agent, Expected: 29, Seen: 29 2025-10-20 02:34:46,211 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-10-20 02:34:46,326 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.27, not supported 2025-10-20 02:34:46,450 - DEBUG - Layer2 route found for VM MAC 02:1e:bf:cb:1f:f8 in Control-node 10.0.0.27 2025-10-20 02:34:46,451 - DEBUG - L2 Label for VM ctest-VM11-19636830 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29 2025-10-20 02:34:46,451 - DEBUG - Starting all layer2 verification in 10.0.0.22 Control Node 2025-10-20 02:34:46,566 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.22, not supported 2025-10-20 02:34:46,685 - DEBUG - Layer2 route found for VM MAC 02:1e:bf:cb:1f:f8 in Control-node 10.0.0.22 2025-10-20 02:34:46,685 - DEBUG - L2 Label for VM ctest-VM11-19636830 same between Control-node 10.0.0.22 and Agent, Expected: 29, Seen: 29 2025-10-20 02:34:46,686 - INFO - Verification in Control-nodes for VM ctest-VM11-19636830 passed 2025-10-20 02:34:46,686 - DEBUG - Verifying the vm in opserver 2025-10-20 02:34:46,686 - DEBUG - Verifying in collector 10.0.0.27 ... 2025-10-20 02:34:46,686 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe?flat 2025-10-20 02:34:46,701 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13?flat 2025-10-20 02:34:46,725 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13?flat 2025-10-20 02:34:46,742 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13?flat 2025-10-20 02:34:46,760 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe?flat 2025-10-20 02:34:46,776 - DEBUG - Verifying vm in vn uve 2025-10-20 02:34:46,776 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13?flat 2025-10-20 02:34:46,795 - DEBUG - VM uve shows interface as {'vm_name': 'ctest-VM11-19636830', 'port_mirror_enabled': False, 'mac_address': '02:1e:bf:cb:1f:f8', 'uuid': '1ebfcb1f-f82e-451e-871d-b4131fa47f13', 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990', 'admin_state': True, 'vn_uuid': 'a68cac58-22e8-40d0-95a2-f945ea90b85f', 'tx_vlan': 65535, 'ip6_address': '3890:65ae:e177:67b4:6c71:4051:0:3', 'ip_address': '202.116.169.131', 'label': 25, 'l2_active': True, 'ip6_active': True, 'vm_uuid': '6e53e1d2-6a3c-4732-b693-dabf5a82fcbe', 'ip4_active': True, 'fixed_ip6_list': ['3890:65ae:e177:67b4:6c71:4051:0:3'], 'fixed_ip4_list': ['202.116.169.131'], 'active': True, '__T': 1760927652042041, 'is_health_check_active': True, 'gateway': '202.116.169.129', 'vhostuser_mode': 0, 'rx_vlan': 65535} 2025-10-20 02:34:46,795 - DEBUG - VM uve shows ip address as ['202.116.169.131', '3890:65ae:e177:67b4:6c71:4051:0:3'] 2025-10-20 02:34:46,795 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 2025-10-20 02:34:46,795 - INFO - Verifying through opserver in 10.0.0.22 2025-10-20 02:34:46,795 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990?flat 2025-10-20 02:34:46,818 - DEBUG - expected vm list 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:46,818 - DEBUG - Extracted vm list ['6e53e1d2-6a3c-4732-b693-dabf5a82fcbe'] 2025-10-20 02:34:46,818 - INFO - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is present in default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 2025-10-20 02:34:46,818 - DEBUG - Verifying vm in vrouter uve 2025-10-20 02:34:46,818 - DEBUG - Getting info from collector 10.0.0.27.. 2025-10-20 02:34:46,818 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe?flat 2025-10-20 02:34:46,832 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4370-2'] 2025-10-20 02:34:46,832 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:34:46,865 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:34:46,894 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:46,895 - DEBUG - Validated that VM ctest-VM11-19636830 is in Vrouter an-jenkins-deploy-platform-ansible-os-4370-2 UVE 2025-10-20 02:34:46,895 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-20 02:34:46,902 - DEBUG - Expected tap interface of VM uuid 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13 2025-10-20 02:34:46,902 - DEBUG - Expected VN of VM uuid 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 2025-10-20 02:34:46,902 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:34:46,936 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:34:46,972 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:46,972 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-71709334:1ebfcb1f-f82e-451e-871d-b4131fa47f13 of vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:46,972 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 of vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:46,972 - DEBUG - Verifying the 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe virtual network link through opserver 10.0.0.22 2025-10-20 02:34:46,972 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-10-20 02:34:46,985 - DEBUG - VM link and name as {'name': '6e53e1d2-6a3c-4732-b693-dabf5a82fcbe', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe?flat'} 2025-10-20 02:34:46,985 - DEBUG - Verifying the 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe virtual network link through opserver 10.0.0.254 2025-10-20 02:34:46,985 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-20 02:34:46,999 - DEBUG - VM link and name as {'name': '6e53e1d2-6a3c-4732-b693-dabf5a82fcbe', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe?flat'} 2025-10-20 02:34:46,999 - DEBUG - Verifying the 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe virtual network link through opserver 10.0.0.27 2025-10-20 02:34:46,999 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-10-20 02:34:47,011 - DEBUG - VM link and name as {'name': '6e53e1d2-6a3c-4732-b693-dabf5a82fcbe', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe?flat'} 2025-10-20 02:34:47,011 - INFO - VM ctest-VM11-19636830 validations in Opserver passed 2025-10-20 02:34:47,128 - DEBUG - VM is in ACTIVE state now 2025-10-20 02:34:47,128 - INFO - VM name : ctest-VM21-02235207 2025-10-20 02:34:47,205 - DEBUG - VM ctest-VM21-02235207 ID is e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:34:47,279 - DEBUG - VM is in ACTIVE state now 2025-10-20 02:34:47,280 - DEBUG - VM ctest-VM21-02235207 launched on Node an-jenkins-deploy-platform-ansible-os-4370-1 2025-10-20 02:34:47,353 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:34:47,363 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:34:47,369 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/0a5dff30-74f1-4c70-878c-d413a0148fdb 2025-10-20 02:34:47,379 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:34:47,385 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/0a5dff30-74f1-4c70-878c-d413a0148fdb 2025-10-20 02:34:47,393 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/3ab2c1f6-b0e2-4f0c-abc7-65cabb61c1cd 2025-10-20 02:34:47,406 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/88b15470-5ec6-4f27-81f1-d808e1ff3461 2025-10-20 02:34:47,415 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:34:47,415 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:34:47,422 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/0a5dff30-74f1-4c70-878c-d413a0148fdb 2025-10-20 02:34:47,431 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/3ab2c1f6-b0e2-4f0c-abc7-65cabb61c1cd 2025-10-20 02:34:47,441 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/88b15470-5ec6-4f27-81f1-d808e1ff3461 2025-10-20 02:34:47,449 - INFO - VM ctest-VM21-02235207 verfication in all API Servers passed 2025-10-20 02:34:47,466 - DEBUG - VM ctest-VM21-02235207 Tap interface: {'index': '3', 'name': 'tap0a5dff30-74', 'uuid': '0a5dff30-74f1-4c70-878c-d413a0148fdb', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016:ctest-VN2-62110016', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'vm_uuid': 'e7b80be4-fcf9-4007-a62d-b60e6069a5bf', 'vm_name': 'ctest-VM21-02235207', 'ip_addr': '122.44.101.195', 'mac_addr': '02:0a:5d:ff:30:74', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '43', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb', 'sg_uuid_list': ['c21dd1f1-4fdd-4e8f-a106-6d589c79c5e1'], 'static_route_list': None, 'vm_project_uuid': 'fb5fc464-52be-4a77-b408-6feca6d8c49c', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '3bea:776:642a:3d1a:7ee1:81de:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-20 02:34:47,466 - DEBUG - Agent 10.0.0.131 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016:ctest-VN2-62110016 2025-10-20 02:34:47,472 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016:ctest-VN2-62110016', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.18:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-20 02:34:47,557 - DEBUG - VM ctest-VM21-02235207 : Tap interface tap0a5dff30-74 is set to Active 2025-10-20 02:34:47,557 - DEBUG - Tap interface tap0a5dff30-74 detail : {'index': '3', 'name': 'tap0a5dff30-74', 'uuid': '0a5dff30-74f1-4c70-878c-d413a0148fdb', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016:ctest-VN2-62110016', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'vm_uuid': 'e7b80be4-fcf9-4007-a62d-b60e6069a5bf', 'vm_name': 'ctest-VM21-02235207', 'ip_addr': '122.44.101.195', 'mac_addr': '02:0a:5d:ff:30:74', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '43', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb', 'sg_uuid_list': ['c21dd1f1-4fdd-4e8f-a106-6d589c79c5e1'], 'static_route_list': None, 'vm_project_uuid': 'fb5fc464-52be-4a77-b408-6feca6d8c49c', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '3bea:776:642a:3d1a:7ee1:81de:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-20 02:34:47,665 - DEBUG - Starting Layer 2 verification in Agent 2025-10-20 02:34:47,678 - DEBUG - Layer 2 path is seen for VM MAC 02:0a:5d:ff:30:74 in agent 10.0.0.131 2025-10-20 02:34:47,678 - DEBUG - Active layer 2 route in agent is present for VMI tap0a5dff30-74 2025-10-20 02:34:47,678 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-20 02:34:47,685 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 is found in Agent of node 10.0.0.131 2025-10-20 02:34:47,826 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 is consistent in agent 10.0.0.131 2025-10-20 02:34:47,826 - DEBUG - Route for VM IP ['122.44.101.195', '3bea:776:642a:3d1a:7ee1:81de:0:3'] is consistent in agent 10.0.0.131 2025-10-20 02:34:47,826 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 verification for VM ctest-VM21-02235207 in Agent 10.0.0.131 passed 2025-10-20 02:34:47,937 - DEBUG - Starting all layer 2 verification in agent 10.0.0.131 2025-10-20 02:34:47,947 - DEBUG - Route for VM MAC 02:0a:5d:ff:30:74 is consistent in agent 10.0.0.131 2025-10-20 02:34:49,135 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.73 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.652 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.652/2.188/3.725/1.536 ms') 2025-10-20 02:34:49,135 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-02235207 passed 2025-10-20 02:34:49,135 - INFO - VM ctest-VM21-02235207 verifications in Compute nodes passed 2025-10-20 02:34:49,365 - DEBUG - Validated VM route 122.44.101.195 in vrouter of 10.0.0.131 2025-10-20 02:34:49,375 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-20 02:34:49,375 - INFO - Validated routes of VM ctest-VM21-02235207 in all vrouters 2025-10-20 02:34:49,816 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-20 02:34:49,946 - DEBUG - Layer2 route found for VM MAC 02:0a:5d:ff:30:74 in Control-node 10.0.0.254 2025-10-20 02:34:49,946 - DEBUG - L2 Label for VM ctest-VM21-02235207 same between Control-node 10.0.0.254 and Agent, Expected: 29, Seen: 29 2025-10-20 02:34:50,054 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.254, not supported 2025-10-20 02:34:50,055 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-10-20 02:34:50,181 - DEBUG - Layer2 route found for VM MAC 02:0a:5d:ff:30:74 in Control-node 10.0.0.27 2025-10-20 02:34:50,181 - DEBUG - L2 Label for VM ctest-VM21-02235207 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29 2025-10-20 02:34:50,294 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.27, not supported 2025-10-20 02:34:50,294 - DEBUG - Starting all layer2 verification in 10.0.0.22 Control Node 2025-10-20 02:34:50,420 - DEBUG - Layer2 route found for VM MAC 02:0a:5d:ff:30:74 in Control-node 10.0.0.22 2025-10-20 02:34:50,421 - DEBUG - L2 Label for VM ctest-VM21-02235207 same between Control-node 10.0.0.22 and Agent, Expected: 29, Seen: 29 2025-10-20 02:34:50,529 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.22, not supported 2025-10-20 02:34:50,529 - INFO - Verification in Control-nodes for VM ctest-VM21-02235207 passed 2025-10-20 02:34:50,529 - DEBUG - Verifying the vm in opserver 2025-10-20 02:34:50,529 - DEBUG - Verifying in collector 10.0.0.27 ... 2025-10-20 02:34:50,529 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf?flat 2025-10-20 02:34:50,545 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb?flat 2025-10-20 02:34:50,565 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb?flat 2025-10-20 02:34:50,583 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb?flat 2025-10-20 02:34:50,601 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf?flat 2025-10-20 02:34:50,617 - DEBUG - Verifying vm in vn uve 2025-10-20 02:34:50,617 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb?flat 2025-10-20 02:34:50,637 - DEBUG - VM uve shows interface as {'ip6_active': True, 'vn_uuid': '054187d3-414c-4b80-91fd-ff7d0393835f', 'ip6_address': '3bea:776:642a:3d1a:7ee1:81de:0:3', 'tx_vlan': 65535, '__T': 1760927652145545, 'port_mirror_enabled': False, 'fixed_ip4_list': ['122.44.101.195'], 'admin_state': True, 'vm_uuid': 'e7b80be4-fcf9-4007-a62d-b60e6069a5bf', 'vm_name': 'ctest-VM21-02235207', 'ip4_active': True, 'l2_active': True, 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016', 'label': 25, 'rx_vlan': 65535, 'is_health_check_active': True, 'mac_address': '02:0a:5d:ff:30:74', 'active': True, 'uuid': '0a5dff30-74f1-4c70-878c-d413a0148fdb', 'gateway': '122.44.101.193', 'fixed_ip6_list': ['3bea:776:642a:3d1a:7ee1:81de:0:3'], 'vhostuser_mode': 0, 'ip_address': '122.44.101.195'} 2025-10-20 02:34:50,637 - DEBUG - VM uve shows ip address as ['122.44.101.195', '3bea:776:642a:3d1a:7ee1:81de:0:3'] 2025-10-20 02:34:50,637 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 2025-10-20 02:34:50,637 - INFO - Verifying through opserver in 10.0.0.22 2025-10-20 02:34:50,637 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016?flat 2025-10-20 02:34:50,658 - DEBUG - expected vm list e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:34:50,658 - DEBUG - Extracted vm list ['e7b80be4-fcf9-4007-a62d-b60e6069a5bf'] 2025-10-20 02:34:50,658 - INFO - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is present in default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 2025-10-20 02:34:50,658 - DEBUG - Verifying vm in vrouter uve 2025-10-20 02:34:50,658 - DEBUG - Getting info from collector 10.0.0.27.. 2025-10-20 02:34:50,658 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf?flat 2025-10-20 02:34:50,674 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4370-1'] 2025-10-20 02:34:50,674 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:34:50,709 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:34:50,736 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:34:50,736 - DEBUG - Validated that VM ctest-VM21-02235207 is in Vrouter an-jenkins-deploy-platform-ansible-os-4370-1 UVE 2025-10-20 02:34:50,736 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-20 02:34:50,743 - DEBUG - Expected tap interface of VM uuid e7b80be4-fcf9-4007-a62d-b60e6069a5bf is default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb 2025-10-20 02:34:50,744 - DEBUG - Expected VN of VM uuid e7b80be4-fcf9-4007-a62d-b60e6069a5bf is default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 2025-10-20 02:34:50,744 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:34:50,776 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:34:50,802 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:34:50,802 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-71709334:0a5dff30-74f1-4c70-878c-d413a0148fdb of vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:34:50,802 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 of vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:34:50,802 - DEBUG - Verifying the e7b80be4-fcf9-4007-a62d-b60e6069a5bf virtual network link through opserver 10.0.0.22 2025-10-20 02:34:50,802 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-10-20 02:34:50,816 - DEBUG - VM link and name as {'name': 'e7b80be4-fcf9-4007-a62d-b60e6069a5bf', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf?flat'} 2025-10-20 02:34:50,816 - DEBUG - Verifying the e7b80be4-fcf9-4007-a62d-b60e6069a5bf virtual network link through opserver 10.0.0.254 2025-10-20 02:34:50,816 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-20 02:34:50,830 - DEBUG - VM link and name as {'name': 'e7b80be4-fcf9-4007-a62d-b60e6069a5bf', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf?flat'} 2025-10-20 02:34:50,831 - DEBUG - Verifying the e7b80be4-fcf9-4007-a62d-b60e6069a5bf virtual network link through opserver 10.0.0.27 2025-10-20 02:34:50,831 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-10-20 02:34:50,842 - DEBUG - VM link and name as {'name': 'e7b80be4-fcf9-4007-a62d-b60e6069a5bf', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf?flat'} 2025-10-20 02:34:50,842 - INFO - VM ctest-VM21-02235207 validations in Opserver passed 2025-10-20 02:34:50,938 - DEBUG - VM is in ACTIVE state now 2025-10-20 02:34:50,938 - INFO - VM name : ctest-VM31-32320342 2025-10-20 02:34:51,031 - DEBUG - VM ctest-VM31-32320342 ID is ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:34:51,110 - DEBUG - VM is in ACTIVE state now 2025-10-20 02:34:51,110 - DEBUG - VM ctest-VM31-32320342 launched on Node an-jenkins-deploy-platform-ansible-os-4370-2 2025-10-20 02:34:51,194 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:34:51,205 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:34:51,212 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/edc51bc4-ff80-414a-85ef-b8eb5148e5d2 2025-10-20 02:34:51,222 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:34:51,231 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/edc51bc4-ff80-414a-85ef-b8eb5148e5d2 2025-10-20 02:34:51,242 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/45b75dfe-70c6-4c51-9f42-fa36a287acf7 2025-10-20 02:34:51,255 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/7e3de6b6-d051-44ec-a001-500a4afaeaee 2025-10-20 02:34:51,265 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:34:51,265 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:34:51,275 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/edc51bc4-ff80-414a-85ef-b8eb5148e5d2 2025-10-20 02:34:51,285 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/45b75dfe-70c6-4c51-9f42-fa36a287acf7 2025-10-20 02:34:51,294 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/7e3de6b6-d051-44ec-a001-500a4afaeaee 2025-10-20 02:34:51,302 - INFO - VM ctest-VM31-32320342 verfication in all API Servers passed 2025-10-20 02:34:51,319 - DEBUG - VM ctest-VM31-32320342 Tap interface: {'index': '4', 'name': 'tapedc51bc4-ff', 'uuid': 'edc51bc4-ff80-414a-85ef-b8eb5148e5d2', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669:ctest-VN3-86151669', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'vm_uuid': 'ea7d7777-ba91-4730-b95b-15a5b26c05ff', 'vm_name': 'ctest-VM31-32320342', 'ip_addr': '204.132.252.195', 'mac_addr': '02:ed:c5:1b:c4:ff', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2', 'sg_uuid_list': ['c21dd1f1-4fdd-4e8f-a106-6d589c79c5e1'], 'static_route_list': None, 'vm_project_uuid': 'fb5fc464-52be-4a77-b408-6feca6d8c49c', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '27be:1ba2:49c0:c78e:b9c8:b5da:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-20 02:34:51,319 - DEBUG - Agent 10.0.0.19 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669:ctest-VN3-86151669 2025-10-20 02:34:51,325 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669:ctest-VN3-86151669', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.192:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-20 02:34:51,412 - DEBUG - VM ctest-VM31-32320342 : Tap interface tapedc51bc4-ff is set to Active 2025-10-20 02:34:51,412 - DEBUG - Tap interface tapedc51bc4-ff detail : {'index': '4', 'name': 'tapedc51bc4-ff', 'uuid': 'edc51bc4-ff80-414a-85ef-b8eb5148e5d2', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669:ctest-VN3-86151669', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'vm_uuid': 'ea7d7777-ba91-4730-b95b-15a5b26c05ff', 'vm_name': 'ctest-VM31-32320342', 'ip_addr': '204.132.252.195', 'mac_addr': '02:ed:c5:1b:c4:ff', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2', 'sg_uuid_list': ['c21dd1f1-4fdd-4e8f-a106-6d589c79c5e1'], 'static_route_list': None, 'vm_project_uuid': 'fb5fc464-52be-4a77-b408-6feca6d8c49c', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '27be:1ba2:49c0:c78e:b9c8:b5da:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-20 02:34:51,522 - DEBUG - Starting Layer 2 verification in Agent 2025-10-20 02:34:51,531 - DEBUG - Layer 2 path is seen for VM MAC 02:ed:c5:1b:c4:ff in agent 10.0.0.19 2025-10-20 02:34:51,532 - DEBUG - Active layer 2 route in agent is present for VMI tapedc51bc4-ff 2025-10-20 02:34:51,532 - DEBUG - L2 label(36) matches bw route table and interface table 2025-10-20 02:34:51,543 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 is found in Agent of node 10.0.0.19 2025-10-20 02:34:51,677 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 is consistent in agent 10.0.0.19 2025-10-20 02:34:51,677 - DEBUG - Route for VM IP ['204.132.252.195', '27be:1ba2:49c0:c78e:b9c8:b5da:0:3'] is consistent in agent 10.0.0.19 2025-10-20 02:34:51,677 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 verification for VM ctest-VM31-32320342 in Agent 10.0.0.19 passed 2025-10-20 02:34:51,789 - DEBUG - Starting all layer 2 verification in agent 10.0.0.19 2025-10-20 02:34:51,798 - DEBUG - Route for VM MAC 02:ed:c5:1b:c4:ff is consistent in agent 10.0.0.19 2025-10-20 02:34:52,973 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=11.7 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.38 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.384/6.561/11.739/5.177 ms') 2025-10-20 02:34:52,974 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-32320342 passed 2025-10-20 02:34:52,974 - INFO - VM ctest-VM31-32320342 verifications in Compute nodes passed 2025-10-20 02:34:53,162 - DEBUG - Validated VM route 204.132.252.195 in vrouter of 10.0.0.19 2025-10-20 02:34:53,167 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-20 02:34:53,167 - INFO - Validated routes of VM ctest-VM31-32320342 in all vrouters 2025-10-20 02:34:53,669 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-20 02:34:53,795 - DEBUG - Layer2 route found for VM MAC 02:ed:c5:1b:c4:ff in Control-node 10.0.0.254 2025-10-20 02:34:53,795 - DEBUG - L2 Label for VM ctest-VM31-32320342 same between Control-node 10.0.0.254 and Agent, Expected: 36, Seen: 36 2025-10-20 02:34:53,909 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.254, not supported 2025-10-20 02:34:53,909 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-10-20 02:34:54,028 - DEBUG - Layer2 route found for VM MAC 02:ed:c5:1b:c4:ff in Control-node 10.0.0.27 2025-10-20 02:34:54,028 - DEBUG - L2 Label for VM ctest-VM31-32320342 same between Control-node 10.0.0.27 and Agent, Expected: 36, Seen: 36 2025-10-20 02:34:54,137 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.27, not supported 2025-10-20 02:34:54,137 - INFO - Verification in Control-nodes for VM ctest-VM31-32320342 passed 2025-10-20 02:34:54,137 - DEBUG - Verifying the vm in opserver 2025-10-20 02:34:54,137 - DEBUG - Verifying in collector 10.0.0.27 ... 2025-10-20 02:34:54,137 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff?flat 2025-10-20 02:34:54,152 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2?flat 2025-10-20 02:34:54,169 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2?flat 2025-10-20 02:34:54,187 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2?flat 2025-10-20 02:34:54,204 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff?flat 2025-10-20 02:34:54,219 - DEBUG - Verifying vm in vn uve 2025-10-20 02:34:54,219 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2?flat 2025-10-20 02:34:54,237 - DEBUG - VM uve shows interface as {'vm_name': 'ctest-VM31-32320342', 'port_mirror_enabled': False, 'mac_address': '02:ed:c5:1b:c4:ff', 'uuid': 'edc51bc4-ff80-414a-85ef-b8eb5148e5d2', 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669', 'admin_state': True, 'vn_uuid': 'a3fbe20b-659d-498b-9766-499815877277', 'tx_vlan': 65535, 'ip6_address': '27be:1ba2:49c0:c78e:b9c8:b5da:0:3', 'ip_address': '204.132.252.195', 'label': 32, 'l2_active': True, 'ip6_active': True, 'vm_uuid': 'ea7d7777-ba91-4730-b95b-15a5b26c05ff', 'ip4_active': True, 'fixed_ip6_list': ['27be:1ba2:49c0:c78e:b9c8:b5da:0:3'], 'fixed_ip4_list': ['204.132.252.195'], 'active': True, '__T': 1760927652042066, 'is_health_check_active': True, 'gateway': '204.132.252.193', 'vhostuser_mode': 0, 'rx_vlan': 65535} 2025-10-20 02:34:54,237 - DEBUG - VM uve shows ip address as ['204.132.252.195', '27be:1ba2:49c0:c78e:b9c8:b5da:0:3'] 2025-10-20 02:34:54,237 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 2025-10-20 02:34:54,238 - INFO - Verifying through opserver in 10.0.0.22 2025-10-20 02:34:54,238 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669?flat 2025-10-20 02:34:54,261 - DEBUG - expected vm list ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:34:54,261 - DEBUG - Extracted vm list ['ea7d7777-ba91-4730-b95b-15a5b26c05ff'] 2025-10-20 02:34:54,261 - INFO - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is present in default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 2025-10-20 02:34:54,261 - DEBUG - Verifying vm in vrouter uve 2025-10-20 02:34:54,261 - DEBUG - Getting info from collector 10.0.0.27.. 2025-10-20 02:34:54,261 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff?flat 2025-10-20 02:34:54,279 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4370-2'] 2025-10-20 02:34:54,279 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:34:54,318 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:34:54,346 - DEBUG - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:54,346 - DEBUG - Validated that VM ctest-VM31-32320342 is in Vrouter an-jenkins-deploy-platform-ansible-os-4370-2 UVE 2025-10-20 02:34:54,346 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-20 02:34:54,358 - DEBUG - Expected tap interface of VM uuid ea7d7777-ba91-4730-b95b-15a5b26c05ff is default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2 2025-10-20 02:34:54,358 - DEBUG - Expected VN of VM uuid ea7d7777-ba91-4730-b95b-15a5b26c05ff is default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 2025-10-20 02:34:54,358 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:34:54,392 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:34:54,428 - DEBUG - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:54,428 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-71709334:edc51bc4-ff80-414a-85ef-b8eb5148e5d2 of vm ea7d7777-ba91-4730-b95b-15a5b26c05ff is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:54,428 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 of vm ea7d7777-ba91-4730-b95b-15a5b26c05ff is present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:34:54,428 - DEBUG - Verifying the ea7d7777-ba91-4730-b95b-15a5b26c05ff virtual network link through opserver 10.0.0.22 2025-10-20 02:34:54,428 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-10-20 02:34:54,443 - DEBUG - VM link and name as {'name': 'ea7d7777-ba91-4730-b95b-15a5b26c05ff', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff?flat'} 2025-10-20 02:34:54,443 - DEBUG - Verifying the ea7d7777-ba91-4730-b95b-15a5b26c05ff virtual network link through opserver 10.0.0.254 2025-10-20 02:34:54,443 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-20 02:34:54,454 - DEBUG - VM link and name as {'name': 'ea7d7777-ba91-4730-b95b-15a5b26c05ff', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff?flat'} 2025-10-20 02:34:54,454 - DEBUG - Verifying the ea7d7777-ba91-4730-b95b-15a5b26c05ff virtual network link through opserver 10.0.0.27 2025-10-20 02:34:54,455 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-10-20 02:34:54,467 - DEBUG - VM link and name as {'name': 'ea7d7777-ba91-4730-b95b-15a5b26c05ff', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff?flat'} 2025-10-20 02:34:54,467 - INFO - VM ctest-VM31-32320342 validations in Opserver passed 2025-10-20 02:34:54,467 - INFO - Waiting for VM ctest-VM11-19636830 to be up.. 2025-10-20 02:34:54,467 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:34:54,468 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:34:54,475 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/1ebfcb1f-f82e-451e-871d-b4131fa47f13 2025-10-20 02:34:55,632 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.96 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.42 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 1.418/3.191/4.964/1.773 ms') 2025-10-20 02:34:55,633 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-19636830 passed 2025-10-20 02:34:55,705 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:34:55,706 - DEBUG - Waiting to SSH to VM ctest-VM11-19636830, IP 202.116.169.131, Port 22 2025-10-20 02:34:55,760 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-20 02:34:55,844 - DEBUG - VM ctest-VM11-19636830 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-20 02:35:00,845 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:35:00,845 - DEBUG - Waiting to SSH to VM ctest-VM11-19636830, IP 202.116.169.131, Port 22 2025-10-20 02:35:00,901 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-20 02:35:01,005 - DEBUG - VM ctest-VM11-19636830 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-20 02:35:06,006 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:35:06,006 - DEBUG - Waiting to SSH to VM ctest-VM11-19636830, IP 202.116.169.131, Port 22 2025-10-20 02:35:06,172 - DEBUG - VM ctest-VM11-19636830 is ready for SSH connections 2025-10-20 02:35:06,172 - INFO - Waiting for VM ctest-VM21-02235207 to be up.. 2025-10-20 02:35:06,172 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:35:06,172 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:35:06,181 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/0a5dff30-74f1-4c70-878c-d413a0148fdb 2025-10-20 02:35:07,372 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.40 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.616 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.616/1.507/2.398/0.891 ms') 2025-10-20 02:35:07,372 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-02235207 passed 2025-10-20 02:35:07,442 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:35:07,442 - DEBUG - Waiting to SSH to VM ctest-VM21-02235207, IP 122.44.101.195, Port 22 2025-10-20 02:35:07,614 - DEBUG - VM ctest-VM21-02235207 is ready for SSH connections 2025-10-20 02:35:07,614 - INFO - Waiting for VM ctest-VM31-32320342 to be up.. 2025-10-20 02:35:07,614 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:35:07,614 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:35:07,622 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/edc51bc4-ff80-414a-85ef-b8eb5148e5d2 2025-10-20 02:35:08,792 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.00 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.495 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.495/1.749/3.003/1.254 ms') 2025-10-20 02:35:08,792 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-32320342 passed 2025-10-20 02:35:08,857 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-20 02:35:08,857 - DEBUG - Waiting to SSH to VM ctest-VM31-32320342, IP 204.132.252.195, Port 22 2025-10-20 02:35:09,035 - DEBUG - VM ctest-VM31-32320342 is ready for SSH connections 2025-10-20 02:35:09,035 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 122.44.101.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-10-20 02:35:09,035 - DEBUG - ping -s 56 -c 3 -W 1 122.44.101.195 2025-10-20 02:35:28,889 - DEBUG - PING 122.44.101.195 (122.44.101.195) 56(84) bytes of data. 64 bytes from 122.44.101.195: icmp_req=1 ttl=63 time=11.6 ms 64 bytes from 122.44.101.195: icmp_req=2 ttl=63 time=2.55 ms 64 bytes from 122.44.101.195: icmp_req=3 ttl=63 time=1.15 ms --- 122.44.101.195 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.152/5.128/11.682/4.669 ms 2025-10-20 02:35:28,889 - INFO - Ping to IP 122.44.101.195 from VM ctest-VM11-19636830 passed 2025-10-20 02:35:28,889 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 3bea:776:642a:3d1a:7ee1:81de:0:3, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123 2025-10-20 02:35:28,890 - DEBUG - ping6 -s 56 -c 3 -W 1 3bea:776:642a:3d1a:7ee1:81de:0:3 2025-10-20 02:35:31,390 - DEBUG - PING 3bea:776:642a:3d1a:7ee1:81de:0:3(3bea:776:642a:3d1a:7ee1:81de:0:3) 56 data bytes 64 bytes from 3bea:776:642a:3d1a:7ee1:81de:0:3: icmp_seq=1 ttl=64 time=8.90 ms 64 bytes from 3bea:776:642a:3d1a:7ee1:81de:0:3: icmp_seq=2 ttl=64 time=2.82 ms 64 bytes from 3bea:776:642a:3d1a:7ee1:81de:0:3: icmp_seq=3 ttl=64 time=1.47 ms --- 3bea:776:642a:3d1a:7ee1:81de:0:3 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.477/4.402/8.907/3.233 ms 2025-10-20 02:35:31,390 - INFO - Ping to IP 3bea:776:642a:3d1a:7ee1:81de:0:3 from VM ctest-VM11-19636830 passed 2025-10-20 02:35:31,390 - INFO - Test with src as policy and dst as any PASSED 2025-10-20 02:35:31,390 - INFO - Deleting VM ctest-VM31-32320342 2025-10-20 02:35:31,458 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:35:31,458 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:35:31,466 - DEBUG - VM ID ea7d7777-ba91-4730-b95b-15a5b26c05ff of VM ctest-VM31-32320342 is still found in API Server 2025-10-20 02:35:33,467 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:35:33,468 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:35:33,474 - DEBUG - Response Code: 404 2025-10-20 02:35:33,474 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:35:33,480 - DEBUG - Response Code: 404 2025-10-20 02:35:33,480 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/ea7d7777-ba91-4730-b95b-15a5b26c05ff 2025-10-20 02:35:33,486 - DEBUG - Response Code: 404 2025-10-20 02:35:33,486 - INFO - VM ctest-VM31-32320342 is fully removed in API-Server 2025-10-20 02:35:33,636 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-20 02:35:33,677 - DEBUG - Validated that vrouter 10.0.0.131 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 2025-10-20 02:35:33,686 - DEBUG - Validated that vrouter 10.0.0.19 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 2025-10-20 02:35:33,686 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 2025-10-20 02:35:33,686 - INFO - VM ctest-VM31-32320342 is removed in Compute, and routes are removed in all compute nodes 2025-10-20 02:35:33,914 - INFO - Routes for VM ctest-VM31-32320342 is removed in all control-nodes 2025-10-20 02:35:33,914 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:33,948 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:35:33,977 - DEBUG - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:35:33,977 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:33,977 - DEBUG - interface for vm ea7d7777-ba91-4730-b95b-15a5b26c05ff deleted from vrouter uve ... 2025-10-20 02:35:33,977 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:36,977 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:37,014 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:35:37,047 - DEBUG - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:35:37,047 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:37,047 - DEBUG - interface for vm ea7d7777-ba91-4730-b95b-15a5b26c05ff deleted from vrouter uve ... 2025-10-20 02:35:37,047 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:40,048 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:40,087 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:35:40,118 - DEBUG - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:35:40,118 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:40,118 - DEBUG - interface for vm ea7d7777-ba91-4730-b95b-15a5b26c05ff deleted from vrouter uve ... 2025-10-20 02:35:40,118 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:43,119 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:43,167 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:35:43,209 - DEBUG - VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is not present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:35:43,209 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:43,209 - DEBUG - interface for vm ea7d7777-ba91-4730-b95b-15a5b26c05ff deleted from vrouter uve ... 2025-10-20 02:35:43,209 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:43,209 - DEBUG - Validated that VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is removed in Vrouter UVE 2025-10-20 02:35:43,209 - DEBUG - Verifying through opserver in 10.0.0.22 2025-10-20 02:35:43,209 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669?flat 2025-10-20 02:35:43,230 - DEBUG - ea7d7777-ba91-4730-b95b-15a5b26c05ff BM not in default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN3-86151669 uve 2025-10-20 02:35:43,230 - DEBUG - Validated that VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is not present in the VN UVE 2025-10-20 02:35:43,231 - DEBUG - Verifying the ea7d7777-ba91-4730-b95b-15a5b26c05ff virtual network link through opserver 10.0.0.22 2025-10-20 02:35:43,231 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-10-20 02:35:43,244 - INFO - ea7d7777-ba91-4730-b95b-15a5b26c05ff vm uve deleted from opserver 2025-10-20 02:35:43,244 - DEBUG - Verifying the ea7d7777-ba91-4730-b95b-15a5b26c05ff virtual network link through opserver 10.0.0.254 2025-10-20 02:35:43,244 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-20 02:35:43,258 - INFO - ea7d7777-ba91-4730-b95b-15a5b26c05ff vm uve deleted from opserver 2025-10-20 02:35:43,258 - DEBUG - Verifying the ea7d7777-ba91-4730-b95b-15a5b26c05ff virtual network link through opserver 10.0.0.27 2025-10-20 02:35:43,258 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-10-20 02:35:43,269 - INFO - ea7d7777-ba91-4730-b95b-15a5b26c05ff vm uve deleted from opserver 2025-10-20 02:35:43,269 - INFO - Validated that VM ea7d7777-ba91-4730-b95b-15a5b26c05ff is removed from Opserver 2025-10-20 02:35:43,270 - INFO - Deleting VM ctest-VM21-02235207 2025-10-20 02:35:43,345 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:35:43,345 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:35:43,353 - DEBUG - VM ID e7b80be4-fcf9-4007-a62d-b60e6069a5bf of VM ctest-VM21-02235207 is still found in API Server 2025-10-20 02:35:45,354 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:35:45,355 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:35:45,361 - DEBUG - Response Code: 404 2025-10-20 02:35:45,362 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:35:45,367 - DEBUG - Response Code: 404 2025-10-20 02:35:45,367 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/e7b80be4-fcf9-4007-a62d-b60e6069a5bf 2025-10-20 02:35:45,373 - DEBUG - Response Code: 404 2025-10-20 02:35:45,373 - INFO - VM ctest-VM21-02235207 is fully removed in API-Server 2025-10-20 02:35:45,529 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-20 02:35:45,578 - DEBUG - Validated that vrouter 10.0.0.131 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 2025-10-20 02:35:45,586 - DEBUG - Validated that vrouter 10.0.0.19 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 2025-10-20 02:35:45,586 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 2025-10-20 02:35:45,586 - INFO - VM ctest-VM21-02235207 is removed in Compute, and routes are removed in all compute nodes 2025-10-20 02:35:45,803 - INFO - Routes for VM ctest-VM21-02235207 is removed in all control-nodes 2025-10-20 02:35:45,803 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:45,838 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:35:45,867 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:35:45,867 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:45,868 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:35:45,868 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:48,868 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:48,900 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:35:48,930 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:35:48,930 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:48,930 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:35:48,930 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:51,931 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:51,965 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:35:51,993 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:35:51,993 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:51,993 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:35:51,993 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:54,994 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:55,025 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:35:55,051 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:35:55,051 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:55,051 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:35:55,051 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:35:58,052 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:35:58,084 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:35:58,112 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:35:58,112 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:35:58,112 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:35:58,112 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:01,113 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:01,145 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:36:01,180 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:36:01,180 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:01,180 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:36:01,180 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:04,181 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:04,212 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:36:04,238 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:36:04,238 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:04,238 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:36:04,238 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:07,239 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:07,274 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:36:07,301 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:36:07,301 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:07,301 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:36:07,301 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:10,302 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:10,331 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:36:10,359 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:36:10,359 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:10,359 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:36:10,359 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:13,360 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-1:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:13,391 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-1?flat 2025-10-20 02:36:13,418 - DEBUG - VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is not present in vrouter an-jenkins-deploy-platform-ansible-os-4370-1 uve 2025-10-20 02:36:13,418 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:13,418 - DEBUG - interface for vm e7b80be4-fcf9-4007-a62d-b60e6069a5bf deleted from vrouter uve ... 2025-10-20 02:36:13,418 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:13,418 - DEBUG - Validated that VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is removed in Vrouter UVE 2025-10-20 02:36:13,418 - DEBUG - Verifying through opserver in 10.0.0.22 2025-10-20 02:36:13,419 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016?flat 2025-10-20 02:36:13,437 - DEBUG - e7b80be4-fcf9-4007-a62d-b60e6069a5bf BM not in default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN2-62110016 uve 2025-10-20 02:36:13,437 - DEBUG - Validated that VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is not present in the VN UVE 2025-10-20 02:36:13,437 - DEBUG - Verifying the e7b80be4-fcf9-4007-a62d-b60e6069a5bf virtual network link through opserver 10.0.0.22 2025-10-20 02:36:13,437 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-10-20 02:36:13,448 - INFO - e7b80be4-fcf9-4007-a62d-b60e6069a5bf vm uve deleted from opserver 2025-10-20 02:36:13,448 - DEBUG - Verifying the e7b80be4-fcf9-4007-a62d-b60e6069a5bf virtual network link through opserver 10.0.0.254 2025-10-20 02:36:13,448 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-20 02:36:13,462 - INFO - e7b80be4-fcf9-4007-a62d-b60e6069a5bf vm uve deleted from opserver 2025-10-20 02:36:13,463 - DEBUG - Verifying the e7b80be4-fcf9-4007-a62d-b60e6069a5bf virtual network link through opserver 10.0.0.27 2025-10-20 02:36:13,463 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-10-20 02:36:13,473 - INFO - e7b80be4-fcf9-4007-a62d-b60e6069a5bf vm uve deleted from opserver 2025-10-20 02:36:13,473 - INFO - Validated that VM e7b80be4-fcf9-4007-a62d-b60e6069a5bf is removed from Opserver 2025-10-20 02:36:13,474 - INFO - Deleting VM ctest-VM11-19636830 2025-10-20 02:36:13,536 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:36:13,536 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:13,545 - DEBUG - VM ID 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe of VM ctest-VM11-19636830 is still found in API Server 2025-10-20 02:36:15,546 - DEBUG - Verifying in api server 10.0.0.27 2025-10-20 02:36:15,546 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:15,552 - DEBUG - Response Code: 404 2025-10-20 02:36:15,553 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:15,558 - DEBUG - Response Code: 404 2025-10-20 02:36:15,558 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:15,564 - DEBUG - Response Code: 404 2025-10-20 02:36:15,564 - INFO - VM ctest-VM11-19636830 is fully removed in API-Server 2025-10-20 02:36:15,717 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-20 02:36:15,755 - DEBUG - Validated that vrouter 10.0.0.131 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 2025-10-20 02:36:15,763 - DEBUG - Validated that vrouter 10.0.0.19 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 2025-10-20 02:36:15,764 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 2025-10-20 02:36:15,764 - INFO - VM ctest-VM11-19636830 is removed in Compute, and routes are removed in all compute nodes 2025-10-20 02:36:15,958 - INFO - Routes for VM ctest-VM11-19636830 is removed in all control-nodes 2025-10-20 02:36:15,959 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:15,991 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:16,022 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:16,022 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:16,022 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:16,022 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:19,023 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:19,057 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:19,088 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:19,088 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:19,088 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:19,089 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:22,090 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:22,124 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:22,152 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:22,152 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:22,152 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:22,152 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:25,152 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:25,188 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:25,227 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:25,227 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:25,227 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:25,227 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:28,228 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:28,264 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:28,296 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:28,296 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:28,296 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:28,296 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:31,296 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:31,331 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:31,360 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:31,360 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:31,360 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:31,360 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:34,360 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:34,392 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:34,421 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:34,421 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:34,421 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:34,421 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:37,422 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:37,456 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:37,484 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:37,484 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:37,485 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:37,485 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:40,485 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:40,519 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:40,550 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is still present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:40,550 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:40,550 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:40,550 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:43,550 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4370-2:Compute:contrail-vrouter-agent:0?flat 2025-10-20 02:36:43,586 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4370-2?flat 2025-10-20 02:36:43,621 - DEBUG - VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is not present in vrouter an-jenkins-deploy-platform-ansible-os-4370-2 uve 2025-10-20 02:36:43,621 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-20 02:36:43,621 - DEBUG - interface for vm 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe deleted from vrouter uve ... 2025-10-20 02:36:43,621 - DEBUG - Deleted interface not in error interface list ... 2025-10-20 02:36:43,621 - DEBUG - Validated that VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is removed in Vrouter UVE 2025-10-20 02:36:43,621 - DEBUG - Verifying through opserver in 10.0.0.22 2025-10-20 02:36:43,621 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990?flat 2025-10-20 02:36:43,641 - DEBUG - 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe BM not in default-domain:ctest-TestPolicyAclIpv4v6-71709334:ctest-VN1-88704990 uve 2025-10-20 02:36:43,641 - DEBUG - Validated that VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is not present in the VN UVE 2025-10-20 02:36:43,641 - DEBUG - Verifying the 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe virtual network link through opserver 10.0.0.22 2025-10-20 02:36:43,641 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-10-20 02:36:43,655 - DEBUG - No links retuned for 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:43,655 - INFO - 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe vm uve deleted from opserver 2025-10-20 02:36:43,655 - DEBUG - Verifying the 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe virtual network link through opserver 10.0.0.254 2025-10-20 02:36:43,655 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-20 02:36:43,667 - DEBUG - No links retuned for 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:43,667 - INFO - 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe vm uve deleted from opserver 2025-10-20 02:36:43,667 - DEBUG - Verifying the 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe virtual network link through opserver 10.0.0.27 2025-10-20 02:36:43,667 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-10-20 02:36:43,681 - DEBUG - No links retuned for 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe 2025-10-20 02:36:43,681 - INFO - 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe vm uve deleted from opserver 2025-10-20 02:36:43,681 - INFO - Validated that VM 6e53e1d2-6a3c-4732-b693-dabf5a82fcbe is removed from Opserver 2025-10-20 02:36:43,681 - DEBUG - Detaching the Policy for VN :ctest-VN2-62110016 2025-10-20 02:36:43,681 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:36:43,686 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:36:43,697 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:36:43,794 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/054187d3-414c-4b80-91fd-ff7d0393835f 2025-10-20 02:36:43,810 - DEBUG - Requesting: http://10.0.0.22:8082/network-policy/1331b03e-df33-4b5e-b5d4-ea8229591218 2025-10-20 02:36:44,016 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy21-48267744']] from ctest-VN2-62110016 2025-10-20 02:36:44,017 - DEBUG - Detaching the Policy for VN :ctest-VN1-88704990 2025-10-20 02:36:44,017 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:36:44,023 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:36:44,045 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:36:44,156 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/a68cac58-22e8-40d0-95a2-f945ea90b85f 2025-10-20 02:36:44,174 - DEBUG - Requesting: http://10.0.0.22:8082/network-policy/35dd4286-2702-4635-9a9b-5f413bd5209d 2025-10-20 02:36:44,182 - DEBUG - Requesting: http://10.0.0.22:8082/network-policy/035192a3-cd86-4254-8c2b-6cb18aa1489d 2025-10-20 02:36:44,352 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy12-16760219'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-71709334', 'ctest-policy13-80593624']] from ctest-VN1-88704990 2025-10-20 02:36:44,390 - INFO - Deleted policy ctest-policy21-48267744 2025-10-20 02:36:44,432 - INFO - Deleted policy ctest-policy12-16760219 2025-10-20 02:36:44,477 - INFO - Deleted policy ctest-policy13-80593624 2025-10-20 02:36:44,477 - INFO - Deleting VN ctest-VN3-86151669 2025-10-20 02:36:44,732 - DEBUG - Response for deleting network () 2025-10-20 02:36:44,732 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/d26714cb-dec4-4737-be0e-b8d3f8dd3898 2025-10-20 02:36:44,741 - DEBUG - Response Code: 404 2025-10-20 02:36:44,742 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:36:44,752 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:36:44,766 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:36:44,855 - INFO - Validated that VN ctest-VN3-86151669 is not found in API Server 2025-10-20 02:36:44,866 - DEBUG - VN ctest-VN3-86151669 is not present in Agent 10.0.0.131 2025-10-20 02:36:44,875 - DEBUG - VN ctest-VN3-86151669 is not present in Agent 10.0.0.19 2025-10-20 02:36:44,875 - INFO - Validated that VN ctest-VN3-86151669 is not in any agent 2025-10-20 02:36:44,905 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-86151669 info 2025-10-20 02:36:44,906 - INFO - Deleting VN ctest-VN2-62110016 2025-10-20 02:36:45,089 - DEBUG - Response for deleting network () 2025-10-20 02:36:45,089 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2ac5fd47-c35c-4228-9406-91e14c2fdda8 2025-10-20 02:36:45,098 - DEBUG - Response Code: 404 2025-10-20 02:36:45,098 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:36:45,103 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:36:45,116 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:36:45,214 - INFO - Validated that VN ctest-VN2-62110016 is not found in API Server 2025-10-20 02:36:45,225 - DEBUG - VN ctest-VN2-62110016 is not present in Agent 10.0.0.131 2025-10-20 02:36:45,234 - DEBUG - VN ctest-VN2-62110016 is not present in Agent 10.0.0.19 2025-10-20 02:36:45,234 - INFO - Validated that VN ctest-VN2-62110016 is not in any agent 2025-10-20 02:36:45,262 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-62110016 info 2025-10-20 02:36:45,263 - INFO - Deleting VN ctest-VN1-88704990 2025-10-20 02:36:45,460 - DEBUG - Response for deleting network () 2025-10-20 02:36:45,461 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/063549d7-b52e-461d-a133-58a463a55814 2025-10-20 02:36:45,471 - DEBUG - Response Code: 404 2025-10-20 02:36:45,471 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-20 02:36:45,476 - DEBUG - Requesting: http://10.0.0.22:8082/domain/9567af48-d216-4b74-bb40-c5fce52cf633 2025-10-20 02:36:45,531 - DEBUG - Requesting: http://10.0.0.22:8082/project/fb5fc464-52be-4a77-b408-6feca6d8c49c 2025-10-20 02:36:45,658 - INFO - Validated that VN ctest-VN1-88704990 is not found in API Server 2025-10-20 02:36:45,679 - DEBUG - VN ctest-VN1-88704990 is not present in Agent 10.0.0.131 2025-10-20 02:36:45,700 - DEBUG - VN ctest-VN1-88704990 is not present in Agent 10.0.0.19 2025-10-20 02:36:45,701 - INFO - Validated that VN ctest-VN1-88704990 is not in any agent 2025-10-20 02:36:45,736 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-88704990 info 2025-10-20 02:36:45,829 - INFO - IPAM: ipam3 is not found in API Server 2025-10-20 02:36:45,849 - INFO - IPAM:ipam3 is not found in control node 2025-10-20 02:36:45,981 - INFO - IPAM: ipam2 is not found in API Server 2025-10-20 02:36:46,000 - INFO - IPAM:ipam2 is not found in control node 2025-10-20 02:36:46,133 - INFO - IPAM: ipam1 is not found in API Server 2025-10-20 02:36:46,152 - INFO - IPAM:ipam1 is not found in control node 2025-10-20 02:36:47,409 - DEBUG - No XMPP flaps were noticed during the test 2025-10-20 02:36:47,409 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:56] 2025-10-20 02:36:47,409 - INFO - -------------------------------------------------------------------------------- 2025-10-20 02:36:48,690 - DEBUG - No XMPP flaps were noticed during the test 2025-10-20 02:36:48,690 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:58] 2025-10-20 02:36:48,690 - INFO - -------------------------------------------------------------------------------- 2025-10-20 02:36:49,461 - INFO - Deleted project: ctest-TestPolicyAclIpv4v6-71709334, ID : fb5fc464-52be-4a77-b408-6feca6d8c49c