2025-10-30 02:40:04,124 - INFO - Domain Default found not creating 2025-10-30 02:40:04,283 - INFO - Project ctest-TestPolicyAcl-89578501 not found, creating it 2025-10-30 02:40:04,879 - INFO - Created Project:ctest-TestPolicyAcl-89578501, ID : e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:06,399 - INFO - ================================================================================ 2025-10-30 02:40:06,399 - INFO - STARTING TEST : test_policy_inheritance_src_vn_dst_pol 2025-10-30 02:40:06,399 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-10-30 02:40:07,698 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.131': '0', '10.20.0.254': '0'}, '10.0.0.65': {'10.20.0.254': '0', '10.20.0.131': '0'}} with 2025-10-30 02:40:07,698 - INFO - Initial checks done. Running the testcase now 2025-10-30 02:40:07,698 - INFO - 2025-10-30 02:40:08,988 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:09,295 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:09,329 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:09,345 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:09,458 - DEBUG - Requesting: http://10.0.0.242:8082/network-ipam/6a1df9e0-6c91-4516-8af7-1b64b2ebafbe 2025-10-30 02:40:09,466 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-10-30 02:40:09,473 - DEBUG - Control-node 10.0.0.242 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7646542484634420502', 'uuid-lslong': '10013502415794057150'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.185168'} 2025-10-30 02:40:09,479 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7646542484634420502', 'uuid-lslong': '10013502415794057150'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.188831'} 2025-10-30 02:40:09,486 - DEBUG - Control-node 10.0.0.240 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7646542484634420502', 'uuid-lslong': '10013502415794057150'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.198241'} 2025-10-30 02:40:09,486 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-10-30 02:40:09,486 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:09,495 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:09,507 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:09,608 - DEBUG - Requesting: http://10.0.0.242:8082/network-ipam/c4d6d3f8-ddf4-42b1-b731-a34362247ff0 2025-10-30 02:40:09,619 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-10-30 02:40:09,625 - DEBUG - Control-node 10.0.0.242 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14183757142279078577', 'uuid-lslong': '13200511492604329968'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.011105'} 2025-10-30 02:40:09,630 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14183757142279078577', 'uuid-lslong': '13200511492604329968'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.016885'} 2025-10-30 02:40:09,637 - DEBUG - Control-node 10.0.0.240 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14183757142279078577', 'uuid-lslong': '13200511492604329968'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.023810'} 2025-10-30 02:40:09,638 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-10-30 02:40:09,638 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:09,644 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:09,656 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:09,763 - DEBUG - Requesting: http://10.0.0.242:8082/network-ipam/ef88d70e-ad4e-4784-b71c-802bc73f66e4 2025-10-30 02:40:09,772 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-10-30 02:40:09,779 - DEBUG - Control-node 10.0.0.242 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17260282029934528388', 'uuid-lslong': '13194561933803480804'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.824441'} 2025-10-30 02:40:09,785 - DEBUG - Control-node 10.0.0.254 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17260282029934528388', 'uuid-lslong': '13194561933803480804'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.830214'} 2025-10-30 02:40:09,792 - DEBUG - Control-node 10.0.0.240 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-89578501:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17260282029934528388', 'uuid-lslong': '13194561933803480804'}, 'enable': 'true', 'created': '2025-10-30T02:40:08', 'last-modified': '2025-10-30T02:40:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.837095'} 2025-10-30 02:40:09,792 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-10-30 02:40:10,149 - DEBUG - Response for create_network : {'network': {'id': '7d55fb1f-0003-4d3d-ab43-68109ea6ad62', 'name': 'ctest-VN1-73262095', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'project_id': 'e5762e07d0514deb8071c031e34ad976', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-VN1-73262095'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 02:40:10,351 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c8d64d91-0ee4-413e-9add-6e2bac3df09b', 'name': '', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'network_id': '7d55fb1f-0003-4d3d-ab43-68109ea6ad62', 'ip_version': 4, 'cidr': '38.182.138.128/26', 'allocation_pools': [{'start': '38.182.138.130', 'end': '38.182.138.190'}], 'gateway_ip': '38.182.138.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '38.182.138.130', 'tags': [], 'project_id': 'e5762e07d0514deb8071c031e34ad976'}} 2025-10-30 02:40:10,372 - INFO - Created VN ctest-VN1-73262095 2025-10-30 02:40:10,390 - DEBUG - VN ctest-VN1-73262095 UUID is 7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:10,541 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095(7d55fb1f-0003-4d3d-ab43-68109ea6ad62) with subnets ['38.182.138.128/26'] 2025-10-30 02:40:10,865 - DEBUG - Response for create_network : {'network': {'id': 'cb0f82ef-ef94-4944-b6bc-6891680978b3', 'name': 'ctest-VN2-45003015', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'project_id': 'e5762e07d0514deb8071c031e34ad976', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-VN2-45003015'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 02:40:11,126 - DEBUG - Response for create_subnet : {'subnet': {'id': '23c3a833-4eca-4045-bd43-9ef74cb13633', 'name': '', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'network_id': 'cb0f82ef-ef94-4944-b6bc-6891680978b3', 'ip_version': 4, 'cidr': '34.162.8.64/26', 'allocation_pools': [{'start': '34.162.8.66', 'end': '34.162.8.126'}], 'gateway_ip': '34.162.8.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '34.162.8.66', 'tags': [], 'project_id': 'e5762e07d0514deb8071c031e34ad976'}} 2025-10-30 02:40:11,149 - INFO - Created VN ctest-VN2-45003015 2025-10-30 02:40:11,162 - DEBUG - VN ctest-VN2-45003015 UUID is cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:11,539 - DEBUG - Response for create_network : {'network': {'id': '7ef5fbc6-f99b-4e20-a637-be5b7bafaba0', 'name': 'ctest-VN3-07325992', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'project_id': 'e5762e07d0514deb8071c031e34ad976', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-VN3-07325992'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 02:40:11,788 - DEBUG - Response for create_subnet : {'subnet': {'id': '7dd5c6e8-18ad-4728-8ba4-dee100e9c6fb', 'name': '', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'network_id': '7ef5fbc6-f99b-4e20-a637-be5b7bafaba0', 'ip_version': 4, 'cidr': '220.187.136.64/26', 'allocation_pools': [{'start': '220.187.136.66', 'end': '220.187.136.126'}], 'gateway_ip': '220.187.136.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.187.136.66', 'tags': [], 'project_id': 'e5762e07d0514deb8071c031e34ad976'}} 2025-10-30 02:40:11,814 - INFO - Created VN ctest-VN3-07325992 2025-10-30 02:40:11,829 - DEBUG - VN ctest-VN3-07325992 UUID is 7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:11,902 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:11,909 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:11,920 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:12,023 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:12,038 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:12,048 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/7a7c2893-6b5a-4d3b-bb70-7d1955a4ca08 2025-10-30 02:40:12,057 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/7a7c2893-6b5a-4d3b-bb70-7d1955a4ca08 2025-10-30 02:40:12,064 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/801d4d3c-1ff0-44a7-96ff-fded84b15e4a 2025-10-30 02:40:12,071 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 02:40:12,071 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:12,080 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/7a7c2893-6b5a-4d3b-bb70-7d1955a4ca08 2025-10-30 02:40:12,098 - INFO - Verified VN network id 13 for VN 7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:12,098 - INFO - Verifications in API Server for VN ctest-VN1-73262095 passed 2025-10-30 02:40:12,098 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:12,112 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/7a7c2893-6b5a-4d3b-bb70-7d1955a4ca08 2025-10-30 02:40:12,120 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/7a7c2893-6b5a-4d3b-bb70-7d1955a4ca08 2025-10-30 02:40:12,127 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/801d4d3c-1ff0-44a7-96ff-fded84b15e4a 2025-10-30 02:40:12,140 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9031400738324172093', 'uuid-lslong': '12340821824515779938'}, 'enable': 'true', 'created': '2025-10-30T02:40:10', 'last-modified': '2025-10-30T02:40:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.839166'} 2025-10-30 02:40:12,146 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 02:40:12,151 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9031400738324172093', 'uuid-lslong': '12340821824515779938'}, 'enable': 'true', 'created': '2025-10-30T02:40:10', 'last-modified': '2025-10-30T02:40:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.847528'} 2025-10-30 02:40:12,157 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 02:40:12,163 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9031400738324172093', 'uuid-lslong': '12340821824515779938'}, 'enable': 'true', 'created': '2025-10-30T02:40:10', 'last-modified': '2025-10-30T02:40:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.862038'} 2025-10-30 02:40:12,169 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 02:40:12,169 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-73262095 passed 2025-10-30 02:40:12,169 - DEBUG - ====Verifying policy data for ctest-VN1-73262095 in API_Server ====== 2025-10-30 02:40:12,170 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:12,176 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:12,188 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:12,290 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:12,306 - DEBUG - =>VN ctest-VN1-73262095 has no policy to be verified 2025-10-30 02:40:12,306 - DEBUG - Verifying the vn in opserver 2025-10-30 02:40:12,306 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 virtual network link through opserver 10.0.0.242 2025-10-30 02:40:12,306 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2025-10-30 02:40:12,608 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2025-10-30 02:40:12,664 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095?flat'} 2025-10-30 02:40:12,664 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 virtual network link through opserver 10.0.0.254 2025-10-30 02:40:12,664 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 02:40:12,956 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 02:40:13,020 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095?flat'} 2025-10-30 02:40:13,020 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 virtual network link through opserver 10.0.0.240 2025-10-30 02:40:13,020 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2025-10-30 02:40:13,331 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2025-10-30 02:40:13,395 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095?flat'} 2025-10-30 02:40:13,395 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is found in opserver 2025-10-30 02:40:13,420 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 02:40:13,432 - DEBUG - VRF ids for VN ctest-VN1-73262095: {} 2025-10-30 02:40:13,433 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:13,442 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:13,456 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:13,552 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:13,565 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:13,576 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/37c4c8e6-55b2-467b-9739-463b2857d674 2025-10-30 02:40:13,586 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/37c4c8e6-55b2-467b-9739-463b2857d674 2025-10-30 02:40:13,592 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/bd79564e-37ee-4a55-809b-75b60c292d95 2025-10-30 02:40:13,600 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-30 02:40:13,600 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:13,610 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/37c4c8e6-55b2-467b-9739-463b2857d674 2025-10-30 02:40:13,627 - INFO - Verified VN network id 14 for VN cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:13,627 - INFO - Verifications in API Server for VN ctest-VN2-45003015 passed 2025-10-30 02:40:13,627 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:13,638 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/37c4c8e6-55b2-467b-9739-463b2857d674 2025-10-30 02:40:13,646 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/37c4c8e6-55b2-467b-9739-463b2857d674 2025-10-30 02:40:13,653 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/bd79564e-37ee-4a55-809b-75b60c292d95 2025-10-30 02:40:13,666 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14632057681378298180', 'uuid-lslong': '13167514384249485491'}, 'enable': 'true', 'created': '2025-10-30T02:40:10', 'last-modified': '2025-10-30T02:40:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.593974'} 2025-10-30 02:40:13,673 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-30 02:40:13,679 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14632057681378298180', 'uuid-lslong': '13167514384249485491'}, 'enable': 'true', 'created': '2025-10-30T02:40:10', 'last-modified': '2025-10-30T02:40:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.607506'} 2025-10-30 02:40:13,686 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-30 02:40:13,691 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14632057681378298180', 'uuid-lslong': '13167514384249485491'}, 'enable': 'true', 'created': '2025-10-30T02:40:10', 'last-modified': '2025-10-30T02:40:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.617516'} 2025-10-30 02:40:13,697 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-30 02:40:13,697 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-45003015 passed 2025-10-30 02:40:13,697 - DEBUG - ====Verifying policy data for ctest-VN2-45003015 in API_Server ====== 2025-10-30 02:40:13,698 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:13,704 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:13,716 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:13,818 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:13,831 - DEBUG - =>VN ctest-VN2-45003015 has no policy to be verified 2025-10-30 02:40:13,831 - DEBUG - Verifying the vn in opserver 2025-10-30 02:40:13,831 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 virtual network link through opserver 10.0.0.242 2025-10-30 02:40:13,831 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2025-10-30 02:40:13,904 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015?flat'} 2025-10-30 02:40:13,904 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 virtual network link through opserver 10.0.0.254 2025-10-30 02:40:13,904 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 02:40:13,972 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015?flat'} 2025-10-30 02:40:13,972 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 virtual network link through opserver 10.0.0.240 2025-10-30 02:40:13,972 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2025-10-30 02:40:14,033 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015?flat'} 2025-10-30 02:40:14,033 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 is found in opserver 2025-10-30 02:40:14,060 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 02:40:14,073 - DEBUG - VRF ids for VN ctest-VN2-45003015: {} 2025-10-30 02:40:14,073 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:14,082 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:14,095 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:14,198 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:14,214 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:14,227 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/70f1c17c-355a-4138-a8df-4ff3e3b5015e 2025-10-30 02:40:14,236 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/70f1c17c-355a-4138-a8df-4ff3e3b5015e 2025-10-30 02:40:14,243 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/5f898d97-b923-44e2-abc2-2980d530f68f 2025-10-30 02:40:14,251 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 02:40:14,251 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:14,261 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/70f1c17c-355a-4138-a8df-4ff3e3b5015e 2025-10-30 02:40:14,278 - INFO - Verified VN network id 15 for VN 7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:14,278 - INFO - Verifications in API Server for VN ctest-VN3-07325992 passed 2025-10-30 02:40:14,278 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:14,289 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/70f1c17c-355a-4138-a8df-4ff3e3b5015e 2025-10-30 02:40:14,300 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/70f1c17c-355a-4138-a8df-4ff3e3b5015e 2025-10-30 02:40:14,310 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/5f898d97-b923-44e2-abc2-2980d530f68f 2025-10-30 02:40:14,324 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9148495050082831904', 'uuid-lslong': '11977251034141535136'}, 'enable': 'true', 'created': '2025-10-30T02:40:11', 'last-modified': '2025-10-30T02:40:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.596989'} 2025-10-30 02:40:14,330 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 02:40:14,338 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9148495050082831904', 'uuid-lslong': '11977251034141535136'}, 'enable': 'true', 'created': '2025-10-30T02:40:11', 'last-modified': '2025-10-30T02:40:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.609886'} 2025-10-30 02:40:14,347 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 02:40:14,353 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-89578501', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9148495050082831904', 'uuid-lslong': '11977251034141535136'}, 'enable': 'true', 'created': '2025-10-30T02:40:11', 'last-modified': '2025-10-30T02:40:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.626170'} 2025-10-30 02:40:14,361 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 02:40:14,361 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-07325992 passed 2025-10-30 02:40:14,361 - DEBUG - ====Verifying policy data for ctest-VN3-07325992 in API_Server ====== 2025-10-30 02:40:14,361 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:14,367 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:14,381 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:14,477 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7ef5fbc6-f99b-4e20-a637-be5b7bafaba0 2025-10-30 02:40:14,488 - DEBUG - =>VN ctest-VN3-07325992 has no policy to be verified 2025-10-30 02:40:14,488 - DEBUG - Verifying the vn in opserver 2025-10-30 02:40:14,488 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 virtual network link through opserver 10.0.0.242 2025-10-30 02:40:14,488 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2025-10-30 02:40:14,550 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992?flat'} 2025-10-30 02:40:14,550 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 virtual network link through opserver 10.0.0.254 2025-10-30 02:40:14,550 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-30 02:40:14,610 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992?flat'} 2025-10-30 02:40:14,610 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 virtual network link through opserver 10.0.0.240 2025-10-30 02:40:14,611 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2025-10-30 02:40:14,666 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992?flat'} 2025-10-30 02:40:14,666 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 is found in opserver 2025-10-30 02:40:14,691 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 02:40:14,702 - DEBUG - VRF ids for VN ctest-VN3-07325992: {} 2025-10-30 02:40:14,708 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-30 02:40:15,024 - DEBUG - No destination network defined 2025-10-30 02:40:15,025 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAcl-89578501:ctest-policy13-66044040, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-30 02:40:15,297 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-30 02:40:15,517 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:15,523 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:15,541 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:15,657 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:40:15,666 - DEBUG - Setup step: Associating the policy to VN' 2025-10-30 02:40:15,892 - INFO - Associated Policy to ctest-VN1-73262095 2025-10-30 02:40:15,893 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:40:15,899 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:40:15,914 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:40:16,020 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:40:16,033 - DEBUG - Setup step: Associating the policy to VN' 2025-10-30 02:40:16,191 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'cb0f82ef-ef94-4944-b6bc-6891680978b3', 'name': 'ctest-VN2-45003015', 'tenant_id': 'e5762e07d0514deb8071c031e34ad976', 'project_id': 'e5762e07d0514deb8071c031e34ad976', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['23c3a833-4eca-4045-bd43-9ef74cb13633'], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-VN2-45003015'], 'policys': [['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-policy21-95937417']], 'subnet_ipam': [{'subnet_cidr': '34.162.8.64/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAcl-89578501', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-10-30 02:40:16,309 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-policy21-95937417']] to ctest-VN2-45003015 2025-10-30 02:40:16,440 - DEBUG - Services list from nova: [, , , ] 2025-10-30 02:40:17,548 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-2) 2025-10-30 02:40:19,121 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-1) 2025-10-30 02:40:20,690 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4535-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4535-2) 2025-10-30 02:40:20,811 - DEBUG - VM is in ACTIVE state now 2025-10-30 02:40:20,811 - INFO - VM name : ctest-VM11-64157801 2025-10-30 02:40:20,898 - DEBUG - VM ctest-VM11-64157801 ID is e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:40:20,983 - DEBUG - VM is in ACTIVE state now 2025-10-30 02:40:21,035 - DEBUG - VM ctest-VM11-64157801 launched on Node an-jenkins-deploy-platform-ansible-os-4535-2 2025-10-30 02:40:21,163 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:40:21,616 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:40:21,657 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:40:21,674 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9f94fc03-f848-41fd-8a4d-72bd0f975b3e 2025-10-30 02:40:21,686 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:40:21,694 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9f94fc03-f848-41fd-8a4d-72bd0f975b3e 2025-10-30 02:40:21,705 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/49e79486-75cc-468b-b0f6-c6f41a93a755 2025-10-30 02:40:21,716 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:40:21,716 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:40:21,724 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9f94fc03-f848-41fd-8a4d-72bd0f975b3e 2025-10-30 02:40:21,736 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/49e79486-75cc-468b-b0f6-c6f41a93a755 2025-10-30 02:40:21,746 - INFO - VM ctest-VM11-64157801 verfication in all API Servers passed 2025-10-30 02:40:21,766 - DEBUG - VM ctest-VM11-64157801 Tap interface: {'index': '3', 'name': 'tap9f94fc03-f8', 'uuid': '9f94fc03-f848-41fd-8a4d-72bd0f975b3e', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095:ctest-VN1-73262095', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'vm_uuid': 'e59197d3-704c-402a-bda7-561537ddd019', 'vm_name': 'ctest-VM11-64157801', 'ip_addr': '38.182.138.131', 'mac_addr': '02:9f:94:fc:03:f8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '46', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e', 'sg_uuid_list': ['ec3f8f07-d7c7-46ac-abbd-91c5f043cba7'], 'static_route_list': None, 'vm_project_uuid': 'e5762e07-d051-4deb-8071-c031e34ad976', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 02:40:21,766 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095:ctest-VN1-73262095 2025-10-30 02:40:21,772 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095:ctest-VN1-73262095', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.241:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-30 02:40:21,862 - DEBUG - VM ctest-VM11-64157801 : Tap interface tap9f94fc03-f8 is set to Active 2025-10-30 02:40:21,862 - DEBUG - Tap interface tap9f94fc03-f8 detail : {'index': '3', 'name': 'tap9f94fc03-f8', 'uuid': '9f94fc03-f848-41fd-8a4d-72bd0f975b3e', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095:ctest-VN1-73262095', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'vm_uuid': 'e59197d3-704c-402a-bda7-561537ddd019', 'vm_name': 'ctest-VM11-64157801', 'ip_addr': '38.182.138.131', 'mac_addr': '02:9f:94:fc:03:f8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '46', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e', 'sg_uuid_list': ['ec3f8f07-d7c7-46ac-abbd-91c5f043cba7'], 'static_route_list': None, 'vm_project_uuid': 'e5762e07-d051-4deb-8071-c031e34ad976', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 02:40:22,111 - DEBUG - Starting Layer 2 verification in Agent 2025-10-30 02:40:22,123 - DEBUG - Layer 2 path is seen for VM MAC 02:9f:94:fc:03:f8 in agent 10.0.0.65 2025-10-30 02:40:22,123 - DEBUG - Active layer 2 route in agent is present for VMI tap9f94fc03-f8 2025-10-30 02:40:22,123 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-30 02:40:22,139 - DEBUG - VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is found in Agent of node 10.0.0.65 2025-10-30 02:40:22,282 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is consistent in agent 10.0.0.65 2025-10-30 02:40:22,282 - DEBUG - Route for VM IP ['38.182.138.131'] is consistent in agent 10.0.0.65 2025-10-30 02:40:22,282 - DEBUG - VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 verification for VM ctest-VM11-64157801 in Agent 10.0.0.65 passed 2025-10-30 02:40:22,401 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-10-30 02:40:22,412 - DEBUG - Route for VM MAC 02:9f:94:fc:03:f8 is consistent in agent 10.0.0.65 2025-10-30 02:40:25,608 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-30 02:40:25,609 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:25,626 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:29,696 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-30 02:40:29,696 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:29,714 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:33,796 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-30 02:40:33,796 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:33,814 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:37,895 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-30 02:40:37,895 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:37,912 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:41,985 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-30 02:40:41,986 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:42,001 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:46,082 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-30 02:40:46,082 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:46,097 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:50,184 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-30 02:40:50,184 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:50,200 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:54,279 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-30 02:40:54,279 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:54,294 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:40:58,368 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-30 02:40:58,368 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 failed! 2025-10-30 02:40:58,382 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 is 38.182.138.129 and allocation pool is NOT set 2025-10-30 02:41:02,471 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.81 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1017ms\r\nrtt min/avg/max/mdev = 5.814/5.814/5.814/0.000 ms') 2025-10-30 02:41:02,471 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 passed 2025-10-30 02:41:02,471 - INFO - VM ctest-VM11-64157801 verifications in Compute nodes passed 2025-10-30 02:41:02,737 - DEBUG - Validated VM route 38.182.138.131 in vrouter of 10.0.0.65 2025-10-30 02:41:02,747 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-30 02:41:02,747 - INFO - Validated routes of VM ctest-VM11-64157801 in all vrouters 2025-10-30 02:41:03,169 - DEBUG - Starting all layer2 verification in 10.0.0.242 Control Node 2025-10-30 02:41:03,294 - DEBUG - Layer2 route found for VM MAC 02:9f:94:fc:03:f8 in Control-node 10.0.0.242 2025-10-30 02:41:03,294 - DEBUG - L2 Label for VM ctest-VM11-64157801 same between Control-node 10.0.0.242 and Agent, Expected: 29, Seen: 29 2025-10-30 02:41:03,294 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-30 02:41:03,410 - DEBUG - Layer2 route found for VM MAC 02:9f:94:fc:03:f8 in Control-node 10.0.0.254 2025-10-30 02:41:03,410 - DEBUG - L2 Label for VM ctest-VM11-64157801 same between Control-node 10.0.0.254 and Agent, Expected: 29, Seen: 29 2025-10-30 02:41:03,410 - INFO - Verification in Control-nodes for VM ctest-VM11-64157801 passed 2025-10-30 02:41:03,410 - DEBUG - Verifying the vm in opserver 2025-10-30 02:41:03,410 - DEBUG - Verifying in collector 10.0.0.240 ... 2025-10-30 02:41:03,410 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019?flat 2025-10-30 02:41:03,427 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e?flat 2025-10-30 02:41:03,452 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e?flat 2025-10-30 02:41:03,478 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019?flat 2025-10-30 02:41:03,496 - DEBUG - Verifying vm in vn uve 2025-10-30 02:41:03,496 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e?flat 2025-10-30 02:41:03,517 - DEBUG - VM uve shows interface as {'l2_active': True, 'active': True, 'label': 25, '__T': 1761792042271959, 'is_health_check_active': True, 'vn_uuid': '7d55fb1f-0003-4d3d-ab43-68109ea6ad62', 'virtual_network': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095', 'ip6_active': False, 'uuid': '9f94fc03-f848-41fd-8a4d-72bd0f975b3e', 'vm_name': 'ctest-VM11-64157801', 'gateway': '38.182.138.129', 'fixed_ip4_list': ['38.182.138.131'], 'mac_address': '02:9f:94:fc:03:f8', 'port_mirror_enabled': False, 'ip6_address': '::', 'ip_address': '38.182.138.131', 'rx_vlan': 65535, 'tx_vlan': 65535, 'admin_state': True, 'vhostuser_mode': 0, 'vm_uuid': 'e59197d3-704c-402a-bda7-561537ddd019', 'ip4_active': True} 2025-10-30 02:41:03,517 - DEBUG - VM uve shows ip address as ['38.182.138.131', '::'] 2025-10-30 02:41:03,517 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 2025-10-30 02:41:03,517 - INFO - Verifying through opserver in 10.0.0.242 2025-10-30 02:41:03,517 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095?flat 2025-10-30 02:41:03,544 - DEBUG - expected vm list e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:41:03,544 - DEBUG - Extracted vm list ['e59197d3-704c-402a-bda7-561537ddd019'] 2025-10-30 02:41:03,544 - INFO - VM e59197d3-704c-402a-bda7-561537ddd019 is present in default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 2025-10-30 02:41:03,544 - DEBUG - Verifying vm in vrouter uve 2025-10-30 02:41:03,544 - DEBUG - Getting info from collector 10.0.0.240.. 2025-10-30 02:41:03,544 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019?flat 2025-10-30 02:41:03,563 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4535-2'] 2025-10-30 02:41:03,563 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:41:03,601 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:41:03,639 - DEBUG - VM e59197d3-704c-402a-bda7-561537ddd019 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:03,639 - DEBUG - Validated that VM ctest-VM11-64157801 is in Vrouter an-jenkins-deploy-platform-ansible-os-4535-2 UVE 2025-10-30 02:41:03,639 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-30 02:41:03,649 - DEBUG - Expected tap interface of VM uuid e59197d3-704c-402a-bda7-561537ddd019 is default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e 2025-10-30 02:41:03,649 - DEBUG - Expected VN of VM uuid e59197d3-704c-402a-bda7-561537ddd019 is default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 2025-10-30 02:41:03,649 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:41:03,683 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:41:03,713 - DEBUG - VM e59197d3-704c-402a-bda7-561537ddd019 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:03,713 - INFO - tap interface default-domain:ctest-TestPolicyAcl-89578501:9f94fc03-f848-41fd-8a4d-72bd0f975b3e of vm e59197d3-704c-402a-bda7-561537ddd019 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:03,713 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 of vm e59197d3-704c-402a-bda7-561537ddd019 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:03,713 - DEBUG - Verifying the e59197d3-704c-402a-bda7-561537ddd019 virtual network link through opserver 10.0.0.242 2025-10-30 02:41:03,713 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machines 2025-10-30 02:41:03,727 - DEBUG - VM link and name as {'name': 'e59197d3-704c-402a-bda7-561537ddd019', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019?flat'} 2025-10-30 02:41:03,727 - DEBUG - Verifying the e59197d3-704c-402a-bda7-561537ddd019 virtual network link through opserver 10.0.0.254 2025-10-30 02:41:03,727 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-30 02:41:03,740 - DEBUG - VM link and name as {'name': 'e59197d3-704c-402a-bda7-561537ddd019', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019?flat'} 2025-10-30 02:41:03,740 - DEBUG - Verifying the e59197d3-704c-402a-bda7-561537ddd019 virtual network link through opserver 10.0.0.240 2025-10-30 02:41:03,740 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machines 2025-10-30 02:41:03,753 - DEBUG - VM link and name as {'name': 'e59197d3-704c-402a-bda7-561537ddd019', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019?flat'} 2025-10-30 02:41:03,753 - INFO - VM ctest-VM11-64157801 validations in Opserver passed 2025-10-30 02:41:03,846 - DEBUG - VM is in ACTIVE state now 2025-10-30 02:41:03,846 - INFO - VM name : ctest-VM21-81017595 2025-10-30 02:41:03,931 - DEBUG - VM ctest-VM21-81017595 ID is 739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:04,011 - DEBUG - VM is in ACTIVE state now 2025-10-30 02:41:04,011 - DEBUG - VM ctest-VM21-81017595 launched on Node an-jenkins-deploy-platform-ansible-os-4535-1 2025-10-30 02:41:04,100 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:04,112 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:04,121 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/444e5fe4-5461-402c-9de7-a445117ef0a0 2025-10-30 02:41:04,136 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:04,145 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/444e5fe4-5461-402c-9de7-a445117ef0a0 2025-10-30 02:41:04,156 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/83377205-9d06-4d2e-a390-818cb83f81f0 2025-10-30 02:41:04,166 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:41:04,166 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:04,174 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/444e5fe4-5461-402c-9de7-a445117ef0a0 2025-10-30 02:41:04,186 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/83377205-9d06-4d2e-a390-818cb83f81f0 2025-10-30 02:41:04,195 - INFO - VM ctest-VM21-81017595 verfication in all API Servers passed 2025-10-30 02:41:04,218 - DEBUG - VM ctest-VM21-81017595 Tap interface: {'index': '3', 'name': 'tap444e5fe4-54', 'uuid': '444e5fe4-5461-402c-9de7-a445117ef0a0', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015:ctest-VN2-45003015', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'vm_uuid': '739cbc9c-da10-47ed-b511-f568202b97f4', 'vm_name': 'ctest-VM21-81017595', 'ip_addr': '34.162.8.67', 'mac_addr': '02:44:4e:5f:e4:54', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0', 'sg_uuid_list': ['ec3f8f07-d7c7-46ac-abbd-91c5f043cba7'], 'static_route_list': None, 'vm_project_uuid': 'e5762e07-d051-4deb-8071-c031e34ad976', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 02:41:04,218 - DEBUG - Agent 10.0.0.129 vrf name: default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015:ctest-VN2-45003015 2025-10-30 02:41:04,230 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015:ctest-VN2-45003015', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.17:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-30 02:41:04,314 - DEBUG - VM ctest-VM21-81017595 : Tap interface tap444e5fe4-54 is set to Active 2025-10-30 02:41:04,314 - DEBUG - Tap interface tap444e5fe4-54 detail : {'index': '3', 'name': 'tap444e5fe4-54', 'uuid': '444e5fe4-5461-402c-9de7-a445117ef0a0', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015:ctest-VN2-45003015', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'vm_uuid': '739cbc9c-da10-47ed-b511-f568202b97f4', 'vm_name': 'ctest-VM21-81017595', 'ip_addr': '34.162.8.67', 'mac_addr': '02:44:4e:5f:e4:54', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0', 'sg_uuid_list': ['ec3f8f07-d7c7-46ac-abbd-91c5f043cba7'], 'static_route_list': None, 'vm_project_uuid': 'e5762e07-d051-4deb-8071-c031e34ad976', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 02:41:04,431 - DEBUG - Starting Layer 2 verification in Agent 2025-10-30 02:41:04,442 - DEBUG - Layer 2 path is seen for VM MAC 02:44:4e:5f:e4:54 in agent 10.0.0.129 2025-10-30 02:41:04,442 - DEBUG - Active layer 2 route in agent is present for VMI tap444e5fe4-54 2025-10-30 02:41:04,442 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-30 02:41:04,448 - DEBUG - VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 is found in Agent of node 10.0.0.129 2025-10-30 02:41:04,580 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 is consistent in agent 10.0.0.129 2025-10-30 02:41:04,581 - DEBUG - Route for VM IP ['34.162.8.67'] is consistent in agent 10.0.0.129 2025-10-30 02:41:04,581 - DEBUG - VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 verification for VM ctest-VM21-81017595 in Agent 10.0.0.129 passed 2025-10-30 02:41:04,694 - DEBUG - Starting all layer 2 verification in agent 10.0.0.129 2025-10-30 02:41:04,705 - DEBUG - Route for VM MAC 02:44:4e:5f:e4:54 is consistent in agent 10.0.0.129 2025-10-30 02:41:05,894 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.40 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.90 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 4.900/6.150/7.401/1.250 ms') 2025-10-30 02:41:05,895 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-81017595 passed 2025-10-30 02:41:05,895 - INFO - VM ctest-VM21-81017595 verifications in Compute nodes passed 2025-10-30 02:41:06,152 - DEBUG - Validated VM route 34.162.8.67 in vrouter of 10.0.0.129 2025-10-30 02:41:06,161 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-30 02:41:06,161 - INFO - Validated routes of VM ctest-VM21-81017595 in all vrouters 2025-10-30 02:41:06,573 - DEBUG - Starting all layer2 verification in 10.0.0.242 Control Node 2025-10-30 02:41:06,700 - DEBUG - Layer2 route found for VM MAC 02:44:4e:5f:e4:54 in Control-node 10.0.0.242 2025-10-30 02:41:06,700 - DEBUG - L2 Label for VM ctest-VM21-81017595 same between Control-node 10.0.0.242 and Agent, Expected: 29, Seen: 29 2025-10-30 02:41:06,700 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-30 02:41:06,832 - DEBUG - Layer2 route found for VM MAC 02:44:4e:5f:e4:54 in Control-node 10.0.0.254 2025-10-30 02:41:06,832 - DEBUG - L2 Label for VM ctest-VM21-81017595 same between Control-node 10.0.0.254 and Agent, Expected: 29, Seen: 29 2025-10-30 02:41:06,832 - INFO - Verification in Control-nodes for VM ctest-VM21-81017595 passed 2025-10-30 02:41:06,832 - DEBUG - Verifying the vm in opserver 2025-10-30 02:41:06,832 - DEBUG - Verifying in collector 10.0.0.240 ... 2025-10-30 02:41:06,832 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4?flat 2025-10-30 02:41:06,850 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0?flat 2025-10-30 02:41:06,877 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0?flat 2025-10-30 02:41:06,898 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4?flat 2025-10-30 02:41:06,918 - DEBUG - Verifying vm in vn uve 2025-10-30 02:41:06,918 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0?flat 2025-10-30 02:41:06,945 - DEBUG - VM uve shows interface as {'mac_address': '02:44:4e:5f:e4:54', 'label': 25, 'l2_active': True, 'vhostuser_mode': 0, 'active': True, 'ip6_address': '::', 'vn_uuid': 'cb0f82ef-ef94-4944-b6bc-6891680978b3', 'gateway': '34.162.8.65', 'ip_address': '34.162.8.67', 'rx_vlan': 65535, '__T': 1761792034708193, 'uuid': '444e5fe4-5461-402c-9de7-a445117ef0a0', 'vm_uuid': '739cbc9c-da10-47ed-b511-f568202b97f4', 'fixed_ip4_list': ['34.162.8.67'], 'admin_state': True, 'vm_name': 'ctest-VM21-81017595', 'ip6_active': False, 'tx_vlan': 65535, 'ip4_active': True, 'port_mirror_enabled': False, 'virtual_network': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015', 'is_health_check_active': True} 2025-10-30 02:41:06,945 - DEBUG - VM uve shows ip address as ['34.162.8.67', '::'] 2025-10-30 02:41:06,945 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 2025-10-30 02:41:06,945 - INFO - Verifying through opserver in 10.0.0.242 2025-10-30 02:41:06,945 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015?flat 2025-10-30 02:41:06,971 - DEBUG - expected vm list 739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:06,971 - DEBUG - Extracted vm list ['739cbc9c-da10-47ed-b511-f568202b97f4'] 2025-10-30 02:41:06,971 - INFO - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is present in default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 2025-10-30 02:41:06,972 - DEBUG - Verifying vm in vrouter uve 2025-10-30 02:41:06,972 - DEBUG - Getting info from collector 10.0.0.240.. 2025-10-30 02:41:06,972 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4?flat 2025-10-30 02:41:06,993 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4535-1'] 2025-10-30 02:41:06,993 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:41:07,033 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:41:07,065 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:41:07,065 - DEBUG - Validated that VM ctest-VM21-81017595 is in Vrouter an-jenkins-deploy-platform-ansible-os-4535-1 UVE 2025-10-30 02:41:07,065 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-30 02:41:07,075 - DEBUG - Expected tap interface of VM uuid 739cbc9c-da10-47ed-b511-f568202b97f4 is default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0 2025-10-30 02:41:07,075 - DEBUG - Expected VN of VM uuid 739cbc9c-da10-47ed-b511-f568202b97f4 is default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 2025-10-30 02:41:07,075 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:41:07,116 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:41:07,146 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:41:07,146 - INFO - tap interface default-domain:ctest-TestPolicyAcl-89578501:444e5fe4-5461-402c-9de7-a445117ef0a0 of vm 739cbc9c-da10-47ed-b511-f568202b97f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:41:07,146 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 of vm 739cbc9c-da10-47ed-b511-f568202b97f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:41:07,146 - DEBUG - Verifying the 739cbc9c-da10-47ed-b511-f568202b97f4 virtual network link through opserver 10.0.0.242 2025-10-30 02:41:07,146 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machines 2025-10-30 02:41:07,163 - DEBUG - VM link and name as {'name': '739cbc9c-da10-47ed-b511-f568202b97f4', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4?flat'} 2025-10-30 02:41:07,163 - DEBUG - Verifying the 739cbc9c-da10-47ed-b511-f568202b97f4 virtual network link through opserver 10.0.0.254 2025-10-30 02:41:07,163 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-30 02:41:07,181 - DEBUG - VM link and name as {'name': '739cbc9c-da10-47ed-b511-f568202b97f4', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4?flat'} 2025-10-30 02:41:07,181 - DEBUG - Verifying the 739cbc9c-da10-47ed-b511-f568202b97f4 virtual network link through opserver 10.0.0.240 2025-10-30 02:41:07,181 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machines 2025-10-30 02:41:07,197 - DEBUG - VM link and name as {'name': '739cbc9c-da10-47ed-b511-f568202b97f4', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4?flat'} 2025-10-30 02:41:07,197 - INFO - VM ctest-VM21-81017595 validations in Opserver passed 2025-10-30 02:41:07,297 - DEBUG - VM is in ACTIVE state now 2025-10-30 02:41:07,297 - INFO - VM name : ctest-VM31-37880665 2025-10-30 02:41:07,388 - DEBUG - VM ctest-VM31-37880665 ID is 78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:07,500 - DEBUG - VM is in ACTIVE state now 2025-10-30 02:41:07,500 - DEBUG - VM ctest-VM31-37880665 launched on Node an-jenkins-deploy-platform-ansible-os-4535-2 2025-10-30 02:41:07,594 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:07,605 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:07,617 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c8f58b61-4ede-4600-a846-d426a1a0aa2f 2025-10-30 02:41:07,636 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:07,644 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c8f58b61-4ede-4600-a846-d426a1a0aa2f 2025-10-30 02:41:07,654 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/2008225c-d3d6-4e4c-85d1-b58d864e42ec 2025-10-30 02:41:07,665 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:41:07,665 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:07,673 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c8f58b61-4ede-4600-a846-d426a1a0aa2f 2025-10-30 02:41:07,683 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/2008225c-d3d6-4e4c-85d1-b58d864e42ec 2025-10-30 02:41:07,692 - INFO - VM ctest-VM31-37880665 verfication in all API Servers passed 2025-10-30 02:41:07,709 - DEBUG - VM ctest-VM31-37880665 Tap interface: {'index': '4', 'name': 'tapc8f58b61-4e', 'uuid': 'c8f58b61-4ede-4600-a846-d426a1a0aa2f', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992:ctest-VN3-07325992', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '31', 'l2_label': '35', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'vm_uuid': '78a130c4-924c-40d7-8756-0b7375d2684e', 'vm_name': 'ctest-VM31-37880665', 'ip_addr': '220.187.136.67', 'mac_addr': '02:c8:f5:8b:61:4e', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f', 'sg_uuid_list': ['ec3f8f07-d7c7-46ac-abbd-91c5f043cba7'], 'static_route_list': None, 'vm_project_uuid': 'e5762e07-d051-4deb-8071-c031e34ad976', 'admin_state': 'Enabled', 'flow_key_idx': '37', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 02:41:07,709 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992:ctest-VN3-07325992 2025-10-30 02:41:07,714 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992:ctest-VN3-07325992', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'table_label': '-1', 'vxlan_id': '15', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.241:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-30 02:41:07,790 - DEBUG - VM ctest-VM31-37880665 : Tap interface tapc8f58b61-4e is set to Active 2025-10-30 02:41:07,790 - DEBUG - Tap interface tapc8f58b61-4e detail : {'index': '4', 'name': 'tapc8f58b61-4e', 'uuid': 'c8f58b61-4ede-4600-a846-d426a1a0aa2f', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992:ctest-VN3-07325992', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '31', 'l2_label': '35', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'vm_uuid': '78a130c4-924c-40d7-8756-0b7375d2684e', 'vm_name': 'ctest-VM31-37880665', 'ip_addr': '220.187.136.67', 'mac_addr': '02:c8:f5:8b:61:4e', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f', 'sg_uuid_list': ['ec3f8f07-d7c7-46ac-abbd-91c5f043cba7'], 'static_route_list': None, 'vm_project_uuid': 'e5762e07-d051-4deb-8071-c031e34ad976', 'admin_state': 'Enabled', 'flow_key_idx': '37', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 02:41:07,907 - DEBUG - Starting Layer 2 verification in Agent 2025-10-30 02:41:07,916 - DEBUG - Layer 2 path is seen for VM MAC 02:c8:f5:8b:61:4e in agent 10.0.0.65 2025-10-30 02:41:07,916 - DEBUG - Active layer 2 route in agent is present for VMI tapc8f58b61-4e 2025-10-30 02:41:07,916 - DEBUG - L2 label(35) matches bw route table and interface table 2025-10-30 02:41:07,928 - DEBUG - VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 is found in Agent of node 10.0.0.65 2025-10-30 02:41:08,061 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 is consistent in agent 10.0.0.65 2025-10-30 02:41:08,062 - DEBUG - Route for VM IP ['220.187.136.67'] is consistent in agent 10.0.0.65 2025-10-30 02:41:08,062 - DEBUG - VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 verification for VM ctest-VM31-37880665 in Agent 10.0.0.65 passed 2025-10-30 02:41:08,188 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-10-30 02:41:08,204 - DEBUG - Route for VM MAC 02:c8:f5:8b:61:4e is consistent in agent 10.0.0.65 2025-10-30 02:41:09,386 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=9.58 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.808 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.808/5.195/9.583/4.387 ms') 2025-10-30 02:41:09,386 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-37880665 passed 2025-10-30 02:41:09,386 - INFO - VM ctest-VM31-37880665 verifications in Compute nodes passed 2025-10-30 02:41:09,598 - DEBUG - Validated VM route 220.187.136.67 in vrouter of 10.0.0.65 2025-10-30 02:41:09,603 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-30 02:41:09,603 - INFO - Validated routes of VM ctest-VM31-37880665 in all vrouters 2025-10-30 02:41:10,148 - DEBUG - Starting all layer2 verification in 10.0.0.242 Control Node 2025-10-30 02:41:10,275 - DEBUG - Layer2 route found for VM MAC 02:c8:f5:8b:61:4e in Control-node 10.0.0.242 2025-10-30 02:41:10,275 - DEBUG - L2 Label for VM ctest-VM31-37880665 same between Control-node 10.0.0.242 and Agent, Expected: 35, Seen: 35 2025-10-30 02:41:10,275 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-30 02:41:10,401 - DEBUG - Layer2 route found for VM MAC 02:c8:f5:8b:61:4e in Control-node 10.0.0.254 2025-10-30 02:41:10,401 - DEBUG - L2 Label for VM ctest-VM31-37880665 same between Control-node 10.0.0.254 and Agent, Expected: 35, Seen: 35 2025-10-30 02:41:10,401 - INFO - Verification in Control-nodes for VM ctest-VM31-37880665 passed 2025-10-30 02:41:10,401 - DEBUG - Verifying the vm in opserver 2025-10-30 02:41:10,401 - DEBUG - Verifying in collector 10.0.0.240 ... 2025-10-30 02:41:10,401 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e?flat 2025-10-30 02:41:10,417 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f?flat 2025-10-30 02:41:10,436 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f?flat 2025-10-30 02:41:10,458 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e?flat 2025-10-30 02:41:10,474 - DEBUG - Verifying vm in vn uve 2025-10-30 02:41:10,474 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f?flat 2025-10-30 02:41:10,498 - DEBUG - VM uve shows interface as {'l2_active': True, 'active': True, 'label': 31, '__T': 1761792042271997, 'is_health_check_active': True, 'vn_uuid': '7ef5fbc6-f99b-4e20-a637-be5b7bafaba0', 'virtual_network': 'default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992', 'ip6_active': False, 'uuid': 'c8f58b61-4ede-4600-a846-d426a1a0aa2f', 'vm_name': 'ctest-VM31-37880665', 'gateway': '220.187.136.65', 'fixed_ip4_list': ['220.187.136.67'], 'mac_address': '02:c8:f5:8b:61:4e', 'port_mirror_enabled': False, 'ip6_address': '::', 'ip_address': '220.187.136.67', 'rx_vlan': 65535, 'tx_vlan': 65535, 'admin_state': True, 'vhostuser_mode': 0, 'vm_uuid': '78a130c4-924c-40d7-8756-0b7375d2684e', 'ip4_active': True} 2025-10-30 02:41:10,498 - DEBUG - VM uve shows ip address as ['220.187.136.67', '::'] 2025-10-30 02:41:10,498 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 2025-10-30 02:41:10,498 - INFO - Verifying through opserver in 10.0.0.242 2025-10-30 02:41:10,498 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992?flat 2025-10-30 02:41:10,527 - DEBUG - expected vm list 78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:10,527 - DEBUG - Extracted vm list ['78a130c4-924c-40d7-8756-0b7375d2684e'] 2025-10-30 02:41:10,527 - INFO - VM 78a130c4-924c-40d7-8756-0b7375d2684e is present in default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 2025-10-30 02:41:10,527 - DEBUG - Verifying vm in vrouter uve 2025-10-30 02:41:10,527 - DEBUG - Getting info from collector 10.0.0.240.. 2025-10-30 02:41:10,527 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e?flat 2025-10-30 02:41:10,548 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4535-2'] 2025-10-30 02:41:10,548 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:41:10,590 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:41:10,621 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:10,621 - DEBUG - Validated that VM ctest-VM31-37880665 is in Vrouter an-jenkins-deploy-platform-ansible-os-4535-2 UVE 2025-10-30 02:41:10,621 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-30 02:41:10,629 - DEBUG - Expected tap interface of VM uuid 78a130c4-924c-40d7-8756-0b7375d2684e is default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f 2025-10-30 02:41:10,629 - DEBUG - Expected VN of VM uuid 78a130c4-924c-40d7-8756-0b7375d2684e is default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 2025-10-30 02:41:10,629 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:41:10,665 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:41:10,703 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:10,703 - INFO - tap interface default-domain:ctest-TestPolicyAcl-89578501:c8f58b61-4ede-4600-a846-d426a1a0aa2f of vm 78a130c4-924c-40d7-8756-0b7375d2684e is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:10,703 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 of vm 78a130c4-924c-40d7-8756-0b7375d2684e is present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:41:10,703 - DEBUG - Verifying the 78a130c4-924c-40d7-8756-0b7375d2684e virtual network link through opserver 10.0.0.242 2025-10-30 02:41:10,703 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machines 2025-10-30 02:41:10,717 - DEBUG - VM link and name as {'name': '78a130c4-924c-40d7-8756-0b7375d2684e', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e?flat'} 2025-10-30 02:41:10,717 - DEBUG - Verifying the 78a130c4-924c-40d7-8756-0b7375d2684e virtual network link through opserver 10.0.0.254 2025-10-30 02:41:10,717 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-30 02:41:10,729 - DEBUG - VM link and name as {'name': '78a130c4-924c-40d7-8756-0b7375d2684e', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e?flat'} 2025-10-30 02:41:10,729 - DEBUG - Verifying the 78a130c4-924c-40d7-8756-0b7375d2684e virtual network link through opserver 10.0.0.240 2025-10-30 02:41:10,729 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machines 2025-10-30 02:41:10,742 - DEBUG - VM link and name as {'name': '78a130c4-924c-40d7-8756-0b7375d2684e', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e?flat'} 2025-10-30 02:41:10,742 - INFO - VM ctest-VM31-37880665 validations in Opserver passed 2025-10-30 02:41:10,742 - INFO - Waiting for VM ctest-VM11-64157801 to be up.. 2025-10-30 02:41:10,742 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:10,742 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:41:10,750 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9f94fc03-f848-41fd-8a4d-72bd0f975b3e 2025-10-30 02:41:11,909 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.36 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.96 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.362/3.159/3.957/0.797 ms') 2025-10-30 02:41:11,910 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-64157801 passed 2025-10-30 02:41:11,986 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:11,986 - DEBUG - Waiting to SSH to VM ctest-VM11-64157801, IP 38.182.138.131, Port 22 2025-10-30 02:41:12,051 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 02:41:12,142 - DEBUG - VM ctest-VM11-64157801 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 02:41:17,144 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:17,144 - DEBUG - Waiting to SSH to VM ctest-VM11-64157801, IP 38.182.138.131, Port 22 2025-10-30 02:41:17,211 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 02:41:17,307 - DEBUG - VM ctest-VM11-64157801 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 02:41:22,307 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:22,308 - DEBUG - Waiting to SSH to VM ctest-VM11-64157801, IP 38.182.138.131, Port 22 2025-10-30 02:41:22,479 - DEBUG - VM ctest-VM11-64157801 is ready for SSH connections 2025-10-30 02:41:22,479 - INFO - Waiting for VM ctest-VM21-81017595 to be up.. 2025-10-30 02:41:22,479 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:22,479 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:41:22,489 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/444e5fe4-5461-402c-9de7-a445117ef0a0 2025-10-30 02:41:23,654 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.38 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.64 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.639/2.508/3.377/0.869 ms') 2025-10-30 02:41:23,654 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-81017595 passed 2025-10-30 02:41:23,726 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:23,726 - DEBUG - Waiting to SSH to VM ctest-VM21-81017595, IP 34.162.8.67, Port 22 2025-10-30 02:41:23,785 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 02:41:23,873 - DEBUG - VM ctest-VM21-81017595 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 02:41:28,874 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:28,874 - DEBUG - Waiting to SSH to VM ctest-VM21-81017595, IP 34.162.8.67, Port 22 2025-10-30 02:41:29,042 - DEBUG - VM ctest-VM21-81017595 is ready for SSH connections 2025-10-30 02:41:29,042 - INFO - Waiting for VM ctest-VM31-37880665 to be up.. 2025-10-30 02:41:29,042 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:29,042 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:41:29,052 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c8f58b61-4ede-4600-a846-d426a1a0aa2f 2025-10-30 02:41:30,227 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.96 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.859 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.859/1.910/2.961/1.051 ms') 2025-10-30 02:41:30,227 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-37880665 passed 2025-10-30 02:41:30,299 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 02:41:30,299 - DEBUG - Waiting to SSH to VM ctest-VM31-37880665, IP 220.187.136.67, Port 22 2025-10-30 02:41:30,469 - DEBUG - VM ctest-VM31-37880665 is ready for SSH connections 2025-10-30 02:41:30,469 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 34.162.8.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-10-30 02:41:30,469 - DEBUG - ping -s 56 -c 3 -W 1 34.162.8.67 2025-10-30 02:42:18,447 - DEBUG - PING 34.162.8.67 (34.162.8.67) 56(84) bytes of data. 64 bytes from 34.162.8.67: icmp_req=1 ttl=63 time=7.90 ms 64 bytes from 34.162.8.67: icmp_req=2 ttl=63 time=1.29 ms 64 bytes from 34.162.8.67: icmp_req=3 ttl=63 time=1.05 ms --- 34.162.8.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.053/3.419/7.908/3.175 ms 2025-10-30 02:42:18,447 - INFO - Ping to IP 34.162.8.67 from VM ctest-VM11-64157801 passed 2025-10-30 02:42:18,447 - INFO - Test with src as VN and dst as policy PASSED 2025-10-30 02:42:18,447 - INFO - Deleting VM ctest-VM31-37880665 2025-10-30 02:42:18,526 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:42:18,526 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:42:18,535 - DEBUG - VM ID 78a130c4-924c-40d7-8756-0b7375d2684e of VM ctest-VM31-37880665 is still found in API Server 2025-10-30 02:42:20,536 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:42:20,536 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:42:20,543 - DEBUG - Response Code: 404 2025-10-30 02:42:20,544 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:42:20,550 - DEBUG - Response Code: 404 2025-10-30 02:42:20,551 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/78a130c4-924c-40d7-8756-0b7375d2684e 2025-10-30 02:42:20,556 - DEBUG - Response Code: 404 2025-10-30 02:42:20,556 - INFO - VM ctest-VM31-37880665 is fully removed in API-Server 2025-10-30 02:42:20,710 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-30 02:42:20,753 - DEBUG - Validated that vrouter 10.0.0.129 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 2025-10-30 02:42:20,762 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 2025-10-30 02:42:20,763 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 2025-10-30 02:42:20,763 - INFO - VM ctest-VM31-37880665 is removed in Compute, and routes are removed in all compute nodes 2025-10-30 02:42:21,002 - INFO - Routes for VM ctest-VM31-37880665 is removed in all control-nodes 2025-10-30 02:42:21,002 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:21,038 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:21,071 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:21,071 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:21,071 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:21,071 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:24,072 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:24,117 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:24,153 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:24,154 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:24,154 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:24,154 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:27,154 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:27,190 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:27,223 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:27,223 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:27,224 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:27,224 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:30,225 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:30,260 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:30,292 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:30,292 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:30,292 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:30,292 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:33,292 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:33,328 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:33,362 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:33,362 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:33,362 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:33,362 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:36,363 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:36,408 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:36,441 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:36,441 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:36,441 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:36,441 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:39,442 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:39,480 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:39,515 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:39,515 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:39,515 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:39,515 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:42,515 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:42,550 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:42:42,587 - DEBUG - VM 78a130c4-924c-40d7-8756-0b7375d2684e is not present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:42:42,587 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:42,587 - DEBUG - interface for vm 78a130c4-924c-40d7-8756-0b7375d2684e deleted from vrouter uve ... 2025-10-30 02:42:42,587 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:42,587 - DEBUG - Validated that VM 78a130c4-924c-40d7-8756-0b7375d2684e is removed in Vrouter UVE 2025-10-30 02:42:42,587 - DEBUG - Verifying through opserver in 10.0.0.242 2025-10-30 02:42:42,587 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992?flat 2025-10-30 02:42:42,608 - DEBUG - 78a130c4-924c-40d7-8756-0b7375d2684e BM not in default-domain:ctest-TestPolicyAcl-89578501:ctest-VN3-07325992 uve 2025-10-30 02:42:42,609 - DEBUG - Validated that VM 78a130c4-924c-40d7-8756-0b7375d2684e is not present in the VN UVE 2025-10-30 02:42:42,609 - DEBUG - Verifying the 78a130c4-924c-40d7-8756-0b7375d2684e virtual network link through opserver 10.0.0.242 2025-10-30 02:42:42,609 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machines 2025-10-30 02:42:42,621 - INFO - 78a130c4-924c-40d7-8756-0b7375d2684e vm uve deleted from opserver 2025-10-30 02:42:42,621 - DEBUG - Verifying the 78a130c4-924c-40d7-8756-0b7375d2684e virtual network link through opserver 10.0.0.254 2025-10-30 02:42:42,622 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-30 02:42:42,636 - INFO - 78a130c4-924c-40d7-8756-0b7375d2684e vm uve deleted from opserver 2025-10-30 02:42:42,636 - DEBUG - Verifying the 78a130c4-924c-40d7-8756-0b7375d2684e virtual network link through opserver 10.0.0.240 2025-10-30 02:42:42,636 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machines 2025-10-30 02:42:42,652 - INFO - 78a130c4-924c-40d7-8756-0b7375d2684e vm uve deleted from opserver 2025-10-30 02:42:42,652 - INFO - Validated that VM 78a130c4-924c-40d7-8756-0b7375d2684e is removed from Opserver 2025-10-30 02:42:42,652 - INFO - Deleting VM ctest-VM21-81017595 2025-10-30 02:42:42,733 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:42:42,733 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:42:42,742 - DEBUG - VM ID 739cbc9c-da10-47ed-b511-f568202b97f4 of VM ctest-VM21-81017595 is still found in API Server 2025-10-30 02:42:44,742 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:42:44,742 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:42:44,750 - DEBUG - Response Code: 404 2025-10-30 02:42:44,750 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:42:44,757 - DEBUG - Response Code: 404 2025-10-30 02:42:44,757 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/739cbc9c-da10-47ed-b511-f568202b97f4 2025-10-30 02:42:44,763 - DEBUG - Response Code: 404 2025-10-30 02:42:44,763 - INFO - VM ctest-VM21-81017595 is fully removed in API-Server 2025-10-30 02:42:44,927 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-30 02:42:44,974 - DEBUG - Validated that vrouter 10.0.0.129 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 2025-10-30 02:42:44,986 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 2025-10-30 02:42:44,986 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 2025-10-30 02:42:44,987 - INFO - VM ctest-VM21-81017595 is removed in Compute, and routes are removed in all compute nodes 2025-10-30 02:42:45,198 - INFO - Routes for VM ctest-VM21-81017595 is removed in all control-nodes 2025-10-30 02:42:45,198 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:45,236 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:42:45,266 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:42:45,266 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:45,266 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:42:45,266 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:48,268 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:48,304 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:42:48,333 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:42:48,333 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:48,333 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:42:48,333 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:51,333 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:51,368 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:42:51,397 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:42:51,398 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:51,398 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:42:51,398 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:54,398 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:54,431 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:42:54,461 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:42:54,461 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:54,461 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:42:54,461 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:42:57,462 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:42:57,505 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:42:57,534 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:42:57,534 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:42:57,534 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:42:57,534 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:43:00,535 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:43:00,583 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:43:00,613 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:43:00,613 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:43:00,613 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:43:00,613 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:43:03,613 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:43:03,651 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:43:03,679 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:43:03,679 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:43:03,679 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:43:03,679 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:43:06,680 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-1:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:43:06,717 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-1?flat 2025-10-30 02:43:06,745 - DEBUG - VM 739cbc9c-da10-47ed-b511-f568202b97f4 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4535-1 uve 2025-10-30 02:43:06,745 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:43:06,745 - DEBUG - interface for vm 739cbc9c-da10-47ed-b511-f568202b97f4 deleted from vrouter uve ... 2025-10-30 02:43:06,745 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:43:06,745 - DEBUG - Validated that VM 739cbc9c-da10-47ed-b511-f568202b97f4 is removed in Vrouter UVE 2025-10-30 02:43:06,745 - DEBUG - Verifying through opserver in 10.0.0.242 2025-10-30 02:43:06,745 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015?flat 2025-10-30 02:43:06,765 - DEBUG - 739cbc9c-da10-47ed-b511-f568202b97f4 BM not in default-domain:ctest-TestPolicyAcl-89578501:ctest-VN2-45003015 uve 2025-10-30 02:43:06,765 - DEBUG - Validated that VM 739cbc9c-da10-47ed-b511-f568202b97f4 is not present in the VN UVE 2025-10-30 02:43:06,765 - DEBUG - Verifying the 739cbc9c-da10-47ed-b511-f568202b97f4 virtual network link through opserver 10.0.0.242 2025-10-30 02:43:06,765 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machines 2025-10-30 02:43:06,776 - INFO - 739cbc9c-da10-47ed-b511-f568202b97f4 vm uve deleted from opserver 2025-10-30 02:43:06,776 - DEBUG - Verifying the 739cbc9c-da10-47ed-b511-f568202b97f4 virtual network link through opserver 10.0.0.254 2025-10-30 02:43:06,776 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-30 02:43:06,790 - INFO - 739cbc9c-da10-47ed-b511-f568202b97f4 vm uve deleted from opserver 2025-10-30 02:43:06,790 - DEBUG - Verifying the 739cbc9c-da10-47ed-b511-f568202b97f4 virtual network link through opserver 10.0.0.240 2025-10-30 02:43:06,790 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machines 2025-10-30 02:43:06,804 - INFO - 739cbc9c-da10-47ed-b511-f568202b97f4 vm uve deleted from opserver 2025-10-30 02:43:06,804 - INFO - Validated that VM 739cbc9c-da10-47ed-b511-f568202b97f4 is removed from Opserver 2025-10-30 02:43:06,804 - INFO - Deleting VM ctest-VM11-64157801 2025-10-30 02:43:06,878 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:43:06,879 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:06,888 - DEBUG - VM ID e59197d3-704c-402a-bda7-561537ddd019 of VM ctest-VM11-64157801 is still found in API Server 2025-10-30 02:43:08,889 - DEBUG - Verifying in api server 10.0.0.240 2025-10-30 02:43:08,889 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:08,897 - DEBUG - Response Code: 404 2025-10-30 02:43:08,897 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:08,903 - DEBUG - Response Code: 404 2025-10-30 02:43:08,903 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:08,910 - DEBUG - Response Code: 404 2025-10-30 02:43:08,910 - INFO - VM ctest-VM11-64157801 is fully removed in API-Server 2025-10-30 02:43:09,064 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-30 02:43:09,100 - DEBUG - Validated that vrouter 10.0.0.129 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 2025-10-30 02:43:09,111 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 2025-10-30 02:43:09,111 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 2025-10-30 02:43:09,112 - INFO - VM ctest-VM11-64157801 is removed in Compute, and routes are removed in all compute nodes 2025-10-30 02:43:09,310 - INFO - Routes for VM ctest-VM11-64157801 is removed in all control-nodes 2025-10-30 02:43:09,311 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:43:09,348 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:43:09,381 - DEBUG - VM e59197d3-704c-402a-bda7-561537ddd019 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:43:09,381 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:43:09,381 - DEBUG - interface for vm e59197d3-704c-402a-bda7-561537ddd019 deleted from vrouter uve ... 2025-10-30 02:43:09,382 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:43:12,382 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4535-2:Compute:contrail-vrouter-agent:0?flat 2025-10-30 02:43:12,444 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4535-2?flat 2025-10-30 02:43:12,482 - DEBUG - VM e59197d3-704c-402a-bda7-561537ddd019 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4535-2 uve 2025-10-30 02:43:12,482 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-30 02:43:12,482 - DEBUG - interface for vm e59197d3-704c-402a-bda7-561537ddd019 deleted from vrouter uve ... 2025-10-30 02:43:12,482 - DEBUG - Deleted interface not in error interface list ... 2025-10-30 02:43:12,482 - DEBUG - Validated that VM e59197d3-704c-402a-bda7-561537ddd019 is removed in Vrouter UVE 2025-10-30 02:43:12,482 - DEBUG - Verifying through opserver in 10.0.0.242 2025-10-30 02:43:12,484 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095?flat 2025-10-30 02:43:12,505 - DEBUG - e59197d3-704c-402a-bda7-561537ddd019 BM not in default-domain:ctest-TestPolicyAcl-89578501:ctest-VN1-73262095 uve 2025-10-30 02:43:12,505 - DEBUG - Validated that VM e59197d3-704c-402a-bda7-561537ddd019 is not present in the VN UVE 2025-10-30 02:43:12,505 - DEBUG - Verifying the e59197d3-704c-402a-bda7-561537ddd019 virtual network link through opserver 10.0.0.242 2025-10-30 02:43:12,505 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-machines 2025-10-30 02:43:12,519 - DEBUG - No links retuned for e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:12,519 - INFO - e59197d3-704c-402a-bda7-561537ddd019 vm uve deleted from opserver 2025-10-30 02:43:12,519 - DEBUG - Verifying the e59197d3-704c-402a-bda7-561537ddd019 virtual network link through opserver 10.0.0.254 2025-10-30 02:43:12,519 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-30 02:43:12,534 - DEBUG - No links retuned for e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:12,534 - INFO - e59197d3-704c-402a-bda7-561537ddd019 vm uve deleted from opserver 2025-10-30 02:43:12,534 - DEBUG - Verifying the e59197d3-704c-402a-bda7-561537ddd019 virtual network link through opserver 10.0.0.240 2025-10-30 02:43:12,534 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-machines 2025-10-30 02:43:12,549 - DEBUG - No links retuned for e59197d3-704c-402a-bda7-561537ddd019 2025-10-30 02:43:12,549 - INFO - e59197d3-704c-402a-bda7-561537ddd019 vm uve deleted from opserver 2025-10-30 02:43:12,549 - INFO - Validated that VM e59197d3-704c-402a-bda7-561537ddd019 is removed from Opserver 2025-10-30 02:43:12,549 - DEBUG - Detaching the Policy for VN :ctest-VN2-45003015 2025-10-30 02:43:12,549 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:43:12,564 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:43:12,582 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:43:12,675 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/cb0f82ef-ef94-4944-b6bc-6891680978b3 2025-10-30 02:43:12,691 - DEBUG - Requesting: http://10.0.0.242:8082/network-policy/72d77d1e-9478-46d2-9d2b-2d86f8f9d90d 2025-10-30 02:43:12,877 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAcl-89578501', 'ctest-policy21-95937417']] from ctest-VN2-45003015 2025-10-30 02:43:12,877 - DEBUG - Detaching the Policy for VN :ctest-VN1-73262095 2025-10-30 02:43:12,878 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:43:12,885 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:43:12,899 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:43:13,015 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/7d55fb1f-0003-4d3d-ab43-68109ea6ad62 2025-10-30 02:43:13,232 - INFO - Detached Policy from ctest-VN1-73262095 2025-10-30 02:43:13,311 - INFO - Deleted policy ctest-policy13-66044040 2025-10-30 02:43:13,358 - INFO - Deleted policy ctest-policy21-95937417 2025-10-30 02:43:13,444 - INFO - Deleted policy ctest-policy12-35263623 2025-10-30 02:43:13,444 - INFO - Deleting VN ctest-VN3-07325992 2025-10-30 02:43:13,649 - DEBUG - Response for deleting network () 2025-10-30 02:43:13,649 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/70f1c17c-355a-4138-a8df-4ff3e3b5015e 2025-10-30 02:43:13,655 - DEBUG - Response Code: 404 2025-10-30 02:43:13,655 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:43:13,661 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:43:13,673 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:43:13,773 - INFO - Validated that VN ctest-VN3-07325992 is not found in API Server 2025-10-30 02:43:13,783 - DEBUG - VN ctest-VN3-07325992 is not present in Agent 10.0.0.129 2025-10-30 02:43:13,793 - DEBUG - VN ctest-VN3-07325992 is not present in Agent 10.0.0.65 2025-10-30 02:43:13,793 - INFO - Validated that VN ctest-VN3-07325992 is not in any agent 2025-10-30 02:43:13,834 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-07325992 info 2025-10-30 02:43:13,834 - INFO - Deleting VN ctest-VN2-45003015 2025-10-30 02:43:14,011 - DEBUG - Response for deleting network () 2025-10-30 02:43:14,011 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/37c4c8e6-55b2-467b-9739-463b2857d674 2025-10-30 02:43:14,020 - DEBUG - Response Code: 404 2025-10-30 02:43:14,020 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:43:14,029 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:43:14,056 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:43:14,159 - INFO - Validated that VN ctest-VN2-45003015 is not found in API Server 2025-10-30 02:43:14,170 - DEBUG - VN ctest-VN2-45003015 is not present in Agent 10.0.0.129 2025-10-30 02:43:14,180 - DEBUG - VN ctest-VN2-45003015 is not present in Agent 10.0.0.65 2025-10-30 02:43:14,180 - INFO - Validated that VN ctest-VN2-45003015 is not in any agent 2025-10-30 02:43:14,213 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-45003015 info 2025-10-30 02:43:14,213 - INFO - Deleting VN ctest-VN1-73262095 2025-10-30 02:43:14,427 - DEBUG - Response for deleting network () 2025-10-30 02:43:14,428 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/7a7c2893-6b5a-4d3b-bb70-7d1955a4ca08 2025-10-30 02:43:14,438 - DEBUG - Response Code: 404 2025-10-30 02:43:14,438 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2025-10-30 02:43:14,449 - DEBUG - Requesting: http://10.0.0.242:8082/domain/2be6ea5e-665d-4a78-a8ec-f940f567f06f 2025-10-30 02:43:14,467 - DEBUG - Requesting: http://10.0.0.242:8082/project/e5762e07-d051-4deb-8071-c031e34ad976 2025-10-30 02:43:14,564 - INFO - Validated that VN ctest-VN1-73262095 is not found in API Server 2025-10-30 02:43:14,574 - DEBUG - VN ctest-VN1-73262095 is not present in Agent 10.0.0.129 2025-10-30 02:43:14,585 - DEBUG - VN ctest-VN1-73262095 is not present in Agent 10.0.0.65 2025-10-30 02:43:14,585 - INFO - Validated that VN ctest-VN1-73262095 is not in any agent 2025-10-30 02:43:14,618 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-73262095 info 2025-10-30 02:43:14,708 - INFO - IPAM: ipam3 is not found in API Server 2025-10-30 02:43:14,729 - INFO - IPAM:ipam3 is not found in control node 2025-10-30 02:43:14,888 - INFO - IPAM: ipam2 is not found in API Server 2025-10-30 02:43:14,920 - INFO - IPAM:ipam2 is not found in control node 2025-10-30 02:43:15,085 - INFO - IPAM: ipam1 is not found in API Server 2025-10-30 02:43:15,111 - INFO - IPAM:ipam1 is not found in control node 2025-10-30 02:43:16,374 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 02:43:16,374 - INFO - END TEST : test_policy_inheritance_src_vn_dst_pol : PASSED[0:03:10] 2025-10-30 02:43:16,374 - INFO - -------------------------------------------------------------------------------- 2025-10-30 02:43:17,255 - INFO - Deleted project: ctest-TestPolicyAcl-89578501, ID : e5762e07-d051-4deb-8071-c031e34ad976