2025-07-21 12:18:06,839 - INFO - Domain Default found not creating 2025-07-21 12:18:07,220 - INFO - Project ctest-TestIntfMirror-76319596 not found, creating it 2025-07-21 12:18:08,024 - INFO - Created Project:ctest-TestIntfMirror-76319596, ID : ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:10,153 - INFO - ================================================================================ 2025-07-21 12:18:10,153 - INFO - STARTING TEST : test_intf_mirror_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 2025-07-21 12:18:10,153 - INFO - TEST DESCRIPTION : Validate the interface mirroring src vm, dst vm and analyzer vm on different CNs, all in different VNs 2025-07-21 12:18:10,454 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-07-21 12:18:10,454 - INFO - Initial checks done. Running the testcase now 2025-07-21 12:18:10,454 - INFO - 2025-07-21 12:18:10,455 - INFO - src compute cn-jenkins-deploy-platform-ansible-os-3677-1 -> dst compute cn-jenkins-deploy-platform-ansible-os-3677-1 => analyzer compute cn-jenkins-deploy-platform-ansible-os-3677-1 2025-07-21 12:18:11,218 - DEBUG - Response for create_network : {'network': {'id': 'd50060f9-0d2d-4270-82b4-52684cafaee7', 'name': 'ctest-vn1-30204270', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn1-30204270'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:18:11,488 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a69fb1b1-abe1-43ac-82bc-e6979d479b61', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'd50060f9-0d2d-4270-82b4-52684cafaee7', 'ip_version': 4, 'cidr': '24.91.219.192/26', 'allocation_pools': [{'start': '24.91.219.194', 'end': '24.91.219.254'}], 'gateway_ip': '24.91.219.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '24.91.219.194', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:18:11,517 - INFO - Created VN ctest-vn1-30204270 2025-07-21 12:18:11,573 - DEBUG - VN ctest-vn1-30204270 UUID is d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:11,704 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:12,040 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:12,077 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:18:12,110 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:12,212 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:12,236 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:12,259 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1968c884-8853-43be-8c37-64ffd399118f 2025-07-21 12:18:12,276 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1968c884-8853-43be-8c37-64ffd399118f 2025-07-21 12:18:12,291 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/22ef09f0-11e0-4987-8c79-f10fde7c529a 2025-07-21 12:18:12,307 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:18:12,307 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:12,337 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1968c884-8853-43be-8c37-64ffd399118f 2025-07-21 12:18:12,379 - INFO - Verified VN network id 15 for VN d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:12,379 - INFO - Verifications in API Server for VN ctest-vn1-30204270 passed 2025-07-21 12:18:12,380 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:12,406 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1968c884-8853-43be-8c37-64ffd399118f 2025-07-21 12:18:12,423 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1968c884-8853-43be-8c37-64ffd399118f 2025-07-21 12:18:12,443 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/22ef09f0-11e0-4987-8c79-f10fde7c529a 2025-07-21 12:18:12,474 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15348374152862843504', 'uuid-lslong': '9418243328655208167'}, 'enable': 'true', 'created': '2025-07-21T12:18:11', 'last-modified': '2025-07-21T12:18:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.036140'} 2025-07-21 12:18:12,490 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:18:12,490 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-30204270 passed 2025-07-21 12:18:12,490 - DEBUG - ====Verifying policy data for ctest-vn1-30204270 in API_Server ====== 2025-07-21 12:18:12,491 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:12,503 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:18:12,525 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:12,649 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d50060f9-0d2d-4270-82b4-52684cafaee7 2025-07-21 12:18:12,675 - DEBUG - =>VN ctest-vn1-30204270 has no policy to be verified 2025-07-21 12:18:12,675 - DEBUG - Verifying the vn in opserver 2025-07-21 12:18:12,676 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 virtual network link through opserver 10.0.0.254 2025-07-21 12:18:12,676 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:18:13,022 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:18:13,124 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270?flat'} 2025-07-21 12:18:13,124 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 is found in opserver 2025-07-21 12:18:13,160 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:18:13,179 - DEBUG - VRF ids for VN ctest-vn1-30204270: {} 2025-07-21 12:18:13,537 - DEBUG - Response for create_network : {'network': {'id': 'c9083818-9aa6-4447-bd35-2a9049962258', 'name': 'ctest-vn2-42572030', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn2-42572030'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:18:13,739 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd1519446-ad80-418e-87f3-67eb1da5067e', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'c9083818-9aa6-4447-bd35-2a9049962258', 'ip_version': 4, 'cidr': '12.158.11.0/26', 'allocation_pools': [{'start': '12.158.11.2', 'end': '12.158.11.62'}], 'gateway_ip': '12.158.11.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.158.11.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:18:13,757 - INFO - Created VN ctest-vn2-42572030 2025-07-21 12:18:13,813 - DEBUG - VN ctest-vn2-42572030 UUID is c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:13,973 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:13,981 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:18:14,002 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:14,104 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:14,130 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:14,146 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9b2729b6-634a-48e9-8073-850ece5ff65a 2025-07-21 12:18:14,159 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9b2729b6-634a-48e9-8073-850ece5ff65a 2025-07-21 12:18:14,171 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/beef134a-c485-447f-9983-1715091ddfda 2025-07-21 12:18:14,184 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:18:14,184 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:14,203 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9b2729b6-634a-48e9-8073-850ece5ff65a 2025-07-21 12:18:14,235 - INFO - Verified VN network id 16 for VN c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:14,236 - INFO - Verifications in API Server for VN ctest-vn2-42572030 passed 2025-07-21 12:18:14,236 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:14,253 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9b2729b6-634a-48e9-8073-850ece5ff65a 2025-07-21 12:18:14,268 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9b2729b6-634a-48e9-8073-850ece5ff65a 2025-07-21 12:18:14,287 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/beef134a-c485-447f-9983-1715091ddfda 2025-07-21 12:18:14,315 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14485889879762158663', 'uuid-lslong': '13633850246132277848'}, 'enable': 'true', 'created': '2025-07-21T12:18:13', 'last-modified': '2025-07-21T12:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.613935'} 2025-07-21 12:18:14,331 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:18:14,331 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-42572030 passed 2025-07-21 12:18:14,332 - DEBUG - ====Verifying policy data for ctest-vn2-42572030 in API_Server ====== 2025-07-21 12:18:14,332 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:14,341 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:18:14,371 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:14,500 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/c9083818-9aa6-4447-bd35-2a9049962258 2025-07-21 12:18:14,521 - DEBUG - =>VN ctest-vn2-42572030 has no policy to be verified 2025-07-21 12:18:14,521 - DEBUG - Verifying the vn in opserver 2025-07-21 12:18:14,521 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 virtual network link through opserver 10.0.0.254 2025-07-21 12:18:14,521 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:18:14,546 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030?flat'} 2025-07-21 12:18:14,547 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 is found in opserver 2025-07-21 12:18:14,576 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:18:14,591 - DEBUG - VRF ids for VN ctest-vn2-42572030: {} 2025-07-21 12:18:14,936 - DEBUG - Response for create_network : {'network': {'id': '7159dd08-3e7f-40b3-99dc-383f22772e1e', 'name': 'ctest-vn3-51035932', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn3-51035932'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:18:15,140 - DEBUG - Response for create_subnet : {'subnet': {'id': '49f4ebc8-eeca-4c6b-b833-0f62c8b780b0', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '7159dd08-3e7f-40b3-99dc-383f22772e1e', 'ip_version': 4, 'cidr': '126.88.63.128/26', 'allocation_pools': [{'start': '126.88.63.130', 'end': '126.88.63.190'}], 'gateway_ip': '126.88.63.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.88.63.130', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:18:15,164 - INFO - Created VN ctest-vn3-51035932 2025-07-21 12:18:15,221 - DEBUG - VN ctest-vn3-51035932 UUID is 7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:15,395 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:15,415 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:18:15,456 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:15,583 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:15,618 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:15,650 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a95caf7b-43ed-4486-8545-dbdfbef608c3 2025-07-21 12:18:15,673 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a95caf7b-43ed-4486-8545-dbdfbef608c3 2025-07-21 12:18:15,699 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/2db2728d-3255-439e-aa03-81113fcc7ada 2025-07-21 12:18:15,721 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:18:15,721 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:15,752 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a95caf7b-43ed-4486-8545-dbdfbef608c3 2025-07-21 12:18:15,794 - INFO - Verified VN network id 17 for VN 7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:15,794 - INFO - Verifications in API Server for VN ctest-vn3-51035932 passed 2025-07-21 12:18:15,794 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:15,823 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a95caf7b-43ed-4486-8545-dbdfbef608c3 2025-07-21 12:18:15,843 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a95caf7b-43ed-4486-8545-dbdfbef608c3 2025-07-21 12:18:15,866 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/2db2728d-3255-439e-aa03-81113fcc7ada 2025-07-21 12:18:15,902 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8167802426691109043', 'uuid-lslong': '11086798226491649566'}, 'enable': 'true', 'created': '2025-07-21T12:18:14', 'last-modified': '2025-07-21T12:18:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.794098'} 2025-07-21 12:18:15,912 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:18:15,912 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-51035932 passed 2025-07-21 12:18:15,912 - DEBUG - ====Verifying policy data for ctest-vn3-51035932 in API_Server ====== 2025-07-21 12:18:15,912 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:18:15,925 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:18:15,940 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:18:16,065 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7159dd08-3e7f-40b3-99dc-383f22772e1e 2025-07-21 12:18:16,089 - DEBUG - =>VN ctest-vn3-51035932 has no policy to be verified 2025-07-21 12:18:16,089 - DEBUG - Verifying the vn in opserver 2025-07-21 12:18:16,089 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 virtual network link through opserver 10.0.0.254 2025-07-21 12:18:16,090 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:18:16,121 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932?flat'} 2025-07-21 12:18:16,121 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 is found in opserver 2025-07-21 12:18:16,149 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:18:16,163 - DEBUG - VRF ids for VN ctest-vn3-51035932: {} 2025-07-21 12:18:16,184 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:18:16,577 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:18:17,013 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:18:17,590 - INFO - Attaching policy ctest-vn1_vn2_pass-92653953 to vn ctest-vn1-30204270 2025-07-21 12:18:18,186 - INFO - Attaching policy ctest-vn1_vn2_pass-92653953 to vn ctest-vn2-42572030 2025-07-21 12:18:18,837 - INFO - Attaching policy ctest-vn1_vn3_pass-02731068 to vn ctest-vn1-30204270 2025-07-21 12:18:19,577 - INFO - Attaching policy ctest-vn1_vn3_pass-02731068 to vn ctest-vn3-51035932 2025-07-21 12:18:20,173 - INFO - Attaching policy ctest-vn2_vn3_pass-71406421 to vn ctest-vn2-42572030 2025-07-21 12:18:20,902 - INFO - Attaching policy ctest-vn2_vn3_pass-71406421 to vn ctest-vn3-51035932 2025-07-21 12:18:21,648 - DEBUG - Services list from nova: [, , ] 2025-07-21 12:18:23,854 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1) 2025-07-21 12:18:25,426 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1) 2025-07-21 12:18:26,874 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3677-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3677-1) 2025-07-21 12:18:26,958 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-21 12:18:32,089 - DEBUG - VM is in ACTIVE state now 2025-07-21 12:18:32,089 - INFO - VM name : ctest-src_vm-49170798 2025-07-21 12:18:32,218 - DEBUG - VM ctest-src_vm-49170798 ID is 80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:18:32,326 - DEBUG - VM is in ACTIVE state now 2025-07-21 12:18:32,354 - DEBUG - VM ctest-src_vm-49170798 launched on Node cn-jenkins-deploy-platform-ansible-os-3677-1. 2025-07-21 12:18:32,474 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:18:32,490 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:18:32,504 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/734ea1b1-d549-4ae9-9ab0-e7402de61941 2025-07-21 12:18:32,521 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:18:32,531 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/734ea1b1-d549-4ae9-9ab0-e7402de61941 2025-07-21 12:18:32,544 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/54ee460a-aae6-49d1-971e-8f6b89c9ed80 2025-07-21 12:18:32,558 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:18:32,558 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:18:32,569 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/734ea1b1-d549-4ae9-9ab0-e7402de61941 2025-07-21 12:18:32,584 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/54ee460a-aae6-49d1-971e-8f6b89c9ed80 2025-07-21 12:18:32,593 - INFO - VM ctest-src_vm-49170798 verfication in all API Servers passed 2025-07-21 12:18:32,619 - DEBUG - VM ctest-src_vm-49170798 Tap interface: {'index': '3', 'name': 'tap734ea1b1-d5', 'uuid': '734ea1b1-d549-4ae9-9ab0-e7402de61941', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270:ctest-vn1-30204270', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270', 'vm_uuid': '80b2143d-44a2-4a88-8093-807e805e2786', 'vm_name': 'ctest-src_vm-49170798', 'ip_addr': '24.91.219.195', 'mac_addr': '02:73:4e:a1:b1:d5', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '60', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '21', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-21 12:18:32,619 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270:ctest-vn1-30204270 2025-07-21 12:18:32,626 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270:ctest-vn1-30204270', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270', 'table_label': '-1', 'vxlan_id': '15', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.17:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-07-21 12:18:32,810 - DEBUG - VM ctest-src_vm-49170798 : Tap interface tap734ea1b1-d5 is set to Active 2025-07-21 12:18:32,811 - DEBUG - Tap interface tap734ea1b1-d5 detail : {'index': '3', 'name': 'tap734ea1b1-d5', 'uuid': '734ea1b1-d549-4ae9-9ab0-e7402de61941', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270:ctest-vn1-30204270', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270', 'vm_uuid': '80b2143d-44a2-4a88-8093-807e805e2786', 'vm_name': 'ctest-src_vm-49170798', 'ip_addr': '24.91.219.195', 'mac_addr': '02:73:4e:a1:b1:d5', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '60', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '21', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-21 12:18:33,041 - DEBUG - Starting Layer 2 verification in Agent 2025-07-21 12:18:33,064 - DEBUG - Layer 2 path is seen for VM MAC 02:73:4e:a1:b1:d5 in agent 10.0.0.254 2025-07-21 12:18:33,065 - DEBUG - Active layer 2 route in agent is present for VMI tap734ea1b1-d5 2025-07-21 12:18:33,065 - DEBUG - L2 label(29) matches bw route table and interface table 2025-07-21 12:18:33,079 - DEBUG - VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 is found in Agent of node 10.0.0.254 2025-07-21 12:18:33,294 - DEBUG - VRF IDs of VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 is consistent in agent 10.0.0.254 2025-07-21 12:18:33,294 - DEBUG - Route for VM IP ['24.91.219.195'] is consistent in agent 10.0.0.254 2025-07-21 12:18:33,294 - DEBUG - VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 verification for VM ctest-src_vm-49170798 in Agent 10.0.0.254 passed 2025-07-21 12:18:33,517 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-07-21 12:18:33,550 - DEBUG - Route for VM MAC 02:73:4e:a1:b1:d5 is consistent in agent 10.0.0.254 2025-07-21 12:18:36,890 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-07-21 12:18:36,890 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-src_vm-49170798 failed! 2025-07-21 12:18:36,953 - DEBUG - Gateway for vn default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 is 24.91.219.193 and allocation pool is NOT set 2025-07-21 12:18:39,021 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.00 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.632 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.632/2.814/4.997/2.182 ms') 2025-07-21 12:18:39,021 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-src_vm-49170798 passed 2025-07-21 12:18:39,021 - INFO - VM ctest-src_vm-49170798 verifications in Compute nodes passed 2025-07-21 12:18:39,512 - DEBUG - Validated VM route 24.91.219.195 in vrouter of 10.0.0.254 2025-07-21 12:18:39,521 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-07-21 12:18:39,521 - INFO - Validated routes of VM ctest-src_vm-49170798 in all vrouters 2025-07-21 12:18:40,293 - INFO - Verification in Control-nodes for VM ctest-src_vm-49170798 passed 2025-07-21 12:18:40,293 - DEBUG - Verifying the vm in opserver 2025-07-21 12:18:40,293 - DEBUG - Verifying in collector 10.0.0.254 ... 2025-07-21 12:18:40,294 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat 2025-07-21 12:18:40,337 - DEBUG - Failed to get VM ctest-src_vm-49170798, ID 80b2143d-44a2-4a88-8093-807e805e2786 info from Opserver 2025-07-21 12:18:42,338 - DEBUG - Verifying the vm in opserver 2025-07-21 12:18:42,339 - DEBUG - Verifying in collector 10.0.0.254 ... 2025-07-21 12:18:42,339 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat 2025-07-21 12:18:42,368 - DEBUG - Failed to get VM ctest-src_vm-49170798, ID 80b2143d-44a2-4a88-8093-807e805e2786 info from Opserver 2025-07-21 12:18:44,369 - DEBUG - Verifying the vm in opserver 2025-07-21 12:18:44,370 - DEBUG - Verifying in collector 10.0.0.254 ... 2025-07-21 12:18:44,370 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat 2025-07-21 12:18:44,415 - DEBUG - Failed to get VM ctest-src_vm-49170798, ID 80b2143d-44a2-4a88-8093-807e805e2786 info from Opserver 2025-07-21 12:18:46,416 - DEBUG - Verifying the vm in opserver 2025-07-21 12:18:46,416 - DEBUG - Verifying in collector 10.0.0.254 ... 2025-07-21 12:18:46,416 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat 2025-07-21 12:18:46,448 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941?flat 2025-07-21 12:18:46,543 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941?flat 2025-07-21 12:18:46,588 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat 2025-07-21 12:18:46,652 - DEBUG - Verifying vm in vn uve 2025-07-21 12:18:46,652 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941?flat 2025-07-21 12:18:46,726 - DEBUG - VM uve shows interface as {'virtual_network': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270', 'mac_address': '02:73:4e:a1:b1:d5', 'ip6_active': False, 'vhostuser_mode': 0, 'ip4_active': True, 'active': True, 'vn_uuid': 'd50060f9-0d2d-4270-82b4-52684cafaee7', 'vm_name': 'ctest-src_vm-49170798', 'tx_vlan': 65535, 'uuid': '734ea1b1-d549-4ae9-9ab0-e7402de61941', 'admin_state': True, 'rx_vlan': 65535, 'l2_active': True, 'is_health_check_active': True, 'fixed_ip4_list': ['24.91.219.195'], 'port_mirror_enabled': False, '__T': 1753100324685686, 'gateway': '24.91.219.193', 'ip_address': '24.91.219.195', 'ip6_address': '::', 'label': 25, 'vm_uuid': '80b2143d-44a2-4a88-8093-807e805e2786'} 2025-07-21 12:18:46,726 - DEBUG - VM uve shows ip address as ['24.91.219.195', '::'] 2025-07-21 12:18:46,726 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 2025-07-21 12:18:46,726 - INFO - Verifying through opserver in 10.0.0.254 2025-07-21 12:18:46,726 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270?flat 2025-07-21 12:18:46,797 - DEBUG - expected vm list 80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:18:46,797 - DEBUG - Extracted vm list ['80b2143d-44a2-4a88-8093-807e805e2786'] 2025-07-21 12:18:46,797 - INFO - VM 80b2143d-44a2-4a88-8093-807e805e2786 is present in default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 2025-07-21 12:18:46,797 - DEBUG - Verifying vm in vrouter uve 2025-07-21 12:18:46,797 - DEBUG - Getting info from collector 10.0.0.254.. 2025-07-21 12:18:46,797 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat 2025-07-21 12:18:46,854 - DEBUG - VM uve shows vrouter as ['cn-jenkins-deploy-platform-ansible-os-3677-1'] 2025-07-21 12:18:46,855 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:18:46,974 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/cn-jenkins-deploy-platform-ansible-os-3677-1?flat 2025-07-21 12:18:47,046 - DEBUG - VM 80b2143d-44a2-4a88-8093-807e805e2786 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:47,046 - DEBUG - Validated that VM ctest-src_vm-49170798 is in Vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 UVE 2025-07-21 12:18:47,046 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-07-21 12:18:47,058 - DEBUG - Expected tap interface of VM uuid 80b2143d-44a2-4a88-8093-807e805e2786 is default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941 2025-07-21 12:18:47,058 - DEBUG - Expected VN of VM uuid 80b2143d-44a2-4a88-8093-807e805e2786 is default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 2025-07-21 12:18:47,059 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:18:47,121 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/cn-jenkins-deploy-platform-ansible-os-3677-1?flat 2025-07-21 12:18:47,178 - DEBUG - VM 80b2143d-44a2-4a88-8093-807e805e2786 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:47,179 - INFO - tap interface default-domain:ctest-TestIntfMirror-76319596:734ea1b1-d549-4ae9-9ab0-e7402de61941 of vm 80b2143d-44a2-4a88-8093-807e805e2786 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:47,179 - DEBUG - Connected network default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 of vm 80b2143d-44a2-4a88-8093-807e805e2786 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:47,179 - DEBUG - Verifying the 80b2143d-44a2-4a88-8093-807e805e2786 virtual network link through opserver 10.0.0.254 2025-07-21 12:18:47,179 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-07-21 12:18:47,193 - DEBUG - VM link and name as {'name': '80b2143d-44a2-4a88-8093-807e805e2786', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786?flat'} 2025-07-21 12:18:47,193 - INFO - VM ctest-src_vm-49170798 validations in Opserver passed 2025-07-21 12:18:47,301 - DEBUG - VM is in ACTIVE state now 2025-07-21 12:18:47,301 - INFO - VM name : ctest-dst_vm-34145302 2025-07-21 12:18:47,418 - DEBUG - VM ctest-dst_vm-34145302 ID is 94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:18:47,544 - DEBUG - VM is in ACTIVE state now 2025-07-21 12:18:47,544 - DEBUG - VM ctest-dst_vm-34145302 launched on Node cn-jenkins-deploy-platform-ansible-os-3677-1. 2025-07-21 12:18:47,665 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:18:47,681 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:18:47,695 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/c47f0854-556c-40bd-9d06-0a6722fb00d2 2025-07-21 12:18:47,715 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:18:47,727 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/c47f0854-556c-40bd-9d06-0a6722fb00d2 2025-07-21 12:18:47,743 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/32df435b-b5a1-45a1-b404-d96b7eb90a1c 2025-07-21 12:18:47,756 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:18:47,757 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:18:47,771 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/c47f0854-556c-40bd-9d06-0a6722fb00d2 2025-07-21 12:18:47,790 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/32df435b-b5a1-45a1-b404-d96b7eb90a1c 2025-07-21 12:18:47,802 - INFO - VM ctest-dst_vm-34145302 verfication in all API Servers passed 2025-07-21 12:18:47,835 - DEBUG - VM ctest-dst_vm-34145302 Tap interface: {'index': '4', 'name': 'tapc47f0854-55', 'uuid': 'c47f0854-556c-40bd-9d06-0a6722fb00d2', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030:ctest-vn2-42572030', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030', 'vm_uuid': '94f6c261-f325-405c-8a0c-8f071f6a1f47', 'vm_name': 'ctest-dst_vm-34145302', 'ip_addr': '12.158.11.3', 'mac_addr': '02:c4:7f:08:54:55', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '61', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '33', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-21 12:18:47,835 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030:ctest-vn2-42572030 2025-07-21 12:18:47,846 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030:ctest-vn2-42572030', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030', 'table_label': '-1', 'vxlan_id': '16', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.17:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-07-21 12:18:48,023 - DEBUG - VM ctest-dst_vm-34145302 : Tap interface tapc47f0854-55 is set to Active 2025-07-21 12:18:48,024 - DEBUG - Tap interface tapc47f0854-55 detail : {'index': '4', 'name': 'tapc47f0854-55', 'uuid': 'c47f0854-556c-40bd-9d06-0a6722fb00d2', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030:ctest-vn2-42572030', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030', 'vm_uuid': '94f6c261-f325-405c-8a0c-8f071f6a1f47', 'vm_name': 'ctest-dst_vm-34145302', 'ip_addr': '12.158.11.3', 'mac_addr': '02:c4:7f:08:54:55', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '61', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '33', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-21 12:18:48,234 - DEBUG - Starting Layer 2 verification in Agent 2025-07-21 12:18:48,258 - DEBUG - Layer 2 path is seen for VM MAC 02:c4:7f:08:54:55 in agent 10.0.0.254 2025-07-21 12:18:48,258 - DEBUG - Active layer 2 route in agent is present for VMI tapc47f0854-55 2025-07-21 12:18:48,259 - DEBUG - L2 label(36) matches bw route table and interface table 2025-07-21 12:18:48,267 - DEBUG - VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 is found in Agent of node 10.0.0.254 2025-07-21 12:18:48,486 - DEBUG - VRF IDs of VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 is consistent in agent 10.0.0.254 2025-07-21 12:18:48,486 - DEBUG - Route for VM IP ['12.158.11.3'] is consistent in agent 10.0.0.254 2025-07-21 12:18:48,486 - DEBUG - VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 verification for VM ctest-dst_vm-34145302 in Agent 10.0.0.254 passed 2025-07-21 12:18:48,701 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-07-21 12:18:48,726 - DEBUG - Route for VM MAC 02:c4:7f:08:54:55 is consistent in agent 10.0.0.254 2025-07-21 12:18:50,007 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.39 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.635 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.635/2.512/4.390/1.877 ms') 2025-07-21 12:18:50,008 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-dst_vm-34145302 passed 2025-07-21 12:18:50,008 - INFO - VM ctest-dst_vm-34145302 verifications in Compute nodes passed 2025-07-21 12:18:50,651 - DEBUG - Validated VM route 12.158.11.3 in vrouter of 10.0.0.254 2025-07-21 12:18:50,660 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-07-21 12:18:50,660 - INFO - Validated routes of VM ctest-dst_vm-34145302 in all vrouters 2025-07-21 12:18:51,352 - INFO - Verification in Control-nodes for VM ctest-dst_vm-34145302 passed 2025-07-21 12:18:51,352 - DEBUG - Verifying the vm in opserver 2025-07-21 12:18:51,353 - DEBUG - Verifying in collector 10.0.0.254 ... 2025-07-21 12:18:51,353 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47?flat 2025-07-21 12:18:51,370 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2?flat 2025-07-21 12:18:51,442 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2?flat 2025-07-21 12:18:51,524 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47?flat 2025-07-21 12:18:51,591 - DEBUG - Verifying vm in vn uve 2025-07-21 12:18:51,591 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2?flat 2025-07-21 12:18:51,661 - DEBUG - VM uve shows interface as {'virtual_network': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030', 'mac_address': '02:c4:7f:08:54:55', 'ip6_active': False, 'vhostuser_mode': 0, 'ip4_active': True, 'active': True, 'vn_uuid': 'c9083818-9aa6-4447-bd35-2a9049962258', 'vm_name': 'ctest-dst_vm-34145302', 'tx_vlan': 65535, 'uuid': 'c47f0854-556c-40bd-9d06-0a6722fb00d2', 'admin_state': True, 'rx_vlan': 65535, 'l2_active': True, 'is_health_check_active': True, 'fixed_ip4_list': ['12.158.11.3'], 'port_mirror_enabled': False, '__T': 1753100324685738, 'gateway': '12.158.11.1', 'ip_address': '12.158.11.3', 'ip6_address': '::', 'label': 32, 'vm_uuid': '94f6c261-f325-405c-8a0c-8f071f6a1f47'} 2025-07-21 12:18:51,661 - DEBUG - VM uve shows ip address as ['12.158.11.3', '::'] 2025-07-21 12:18:51,661 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 2025-07-21 12:18:51,661 - INFO - Verifying through opserver in 10.0.0.254 2025-07-21 12:18:51,662 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030?flat 2025-07-21 12:18:51,742 - DEBUG - expected vm list 94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:18:51,742 - DEBUG - Extracted vm list ['94f6c261-f325-405c-8a0c-8f071f6a1f47'] 2025-07-21 12:18:51,743 - INFO - VM 94f6c261-f325-405c-8a0c-8f071f6a1f47 is present in default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 2025-07-21 12:18:51,743 - DEBUG - Verifying vm in vrouter uve 2025-07-21 12:18:51,743 - DEBUG - Getting info from collector 10.0.0.254.. 2025-07-21 12:18:51,743 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47?flat 2025-07-21 12:18:51,811 - DEBUG - VM uve shows vrouter as ['cn-jenkins-deploy-platform-ansible-os-3677-1'] 2025-07-21 12:18:51,812 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:18:51,966 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/cn-jenkins-deploy-platform-ansible-os-3677-1?flat 2025-07-21 12:18:52,040 - DEBUG - VM 94f6c261-f325-405c-8a0c-8f071f6a1f47 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:52,040 - DEBUG - Validated that VM ctest-dst_vm-34145302 is in Vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 UVE 2025-07-21 12:18:52,040 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-07-21 12:18:52,065 - DEBUG - Expected tap interface of VM uuid 94f6c261-f325-405c-8a0c-8f071f6a1f47 is default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2 2025-07-21 12:18:52,066 - DEBUG - Expected VN of VM uuid 94f6c261-f325-405c-8a0c-8f071f6a1f47 is default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 2025-07-21 12:18:52,066 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:18:52,163 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/cn-jenkins-deploy-platform-ansible-os-3677-1?flat 2025-07-21 12:18:52,243 - DEBUG - VM 94f6c261-f325-405c-8a0c-8f071f6a1f47 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:52,244 - INFO - tap interface default-domain:ctest-TestIntfMirror-76319596:c47f0854-556c-40bd-9d06-0a6722fb00d2 of vm 94f6c261-f325-405c-8a0c-8f071f6a1f47 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:52,244 - DEBUG - Connected network default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 of vm 94f6c261-f325-405c-8a0c-8f071f6a1f47 is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:52,244 - DEBUG - Verifying the 94f6c261-f325-405c-8a0c-8f071f6a1f47 virtual network link through opserver 10.0.0.254 2025-07-21 12:18:52,244 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-07-21 12:18:52,273 - DEBUG - VM link and name as {'name': '94f6c261-f325-405c-8a0c-8f071f6a1f47', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47?flat'} 2025-07-21 12:18:52,273 - INFO - VM ctest-dst_vm-34145302 validations in Opserver passed 2025-07-21 12:18:52,441 - DEBUG - VM is in ACTIVE state now 2025-07-21 12:18:52,441 - INFO - VM name : ctest-analyzer_vm-94189700 2025-07-21 12:18:52,728 - DEBUG - VM ctest-analyzer_vm-94189700 ID is 2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:18:52,859 - DEBUG - VM is in ACTIVE state now 2025-07-21 12:18:52,859 - DEBUG - VM ctest-analyzer_vm-94189700 launched on Node cn-jenkins-deploy-platform-ansible-os-3677-1. 2025-07-21 12:18:52,990 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:18:53,003 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:18:53,018 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/8342d54d-7f18-427d-b959-25f7d485e5d9 2025-07-21 12:18:53,036 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:18:53,047 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/8342d54d-7f18-427d-b959-25f7d485e5d9 2025-07-21 12:18:53,073 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/acae803f-2713-4fd7-bfda-7d8824add7a1 2025-07-21 12:18:53,098 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:18:53,098 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:18:53,110 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine-interface/8342d54d-7f18-427d-b959-25f7d485e5d9 2025-07-21 12:18:53,123 - DEBUG - Requesting: http://10.0.0.254:8082/instance-ip/acae803f-2713-4fd7-bfda-7d8824add7a1 2025-07-21 12:18:53,136 - INFO - VM ctest-analyzer_vm-94189700 verfication in all API Servers passed 2025-07-21 12:18:53,174 - DEBUG - VM ctest-analyzer_vm-94189700 Tap interface: {'index': '5', 'name': 'tap8342d54d-7f', 'uuid': '8342d54d-7f18-427d-b959-25f7d485e5d9', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932:ctest-vn3-51035932', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'vm_uuid': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e', 'vm_name': 'ctest-analyzer_vm-94189700', 'ip_addr': '126.88.63.131', 'mac_addr': '02:83:42:d5:4d:7f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '62', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-21 12:18:53,174 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932:ctest-vn3-51035932 2025-07-21 12:18:53,185 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932:ctest-vn3-51035932', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'table_label': '-1', 'vxlan_id': '17', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.17:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-07-21 12:18:53,362 - DEBUG - VM ctest-analyzer_vm-94189700 : Tap interface tap8342d54d-7f is set to Active 2025-07-21 12:18:53,362 - DEBUG - Tap interface tap8342d54d-7f detail : {'index': '5', 'name': 'tap8342d54d-7f', 'uuid': '8342d54d-7f18-427d-b959-25f7d485e5d9', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932:ctest-vn3-51035932', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'vm_uuid': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e', 'vm_name': 'ctest-analyzer_vm-94189700', 'ip_addr': '126.88.63.131', 'mac_addr': '02:83:42:d5:4d:7f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '62', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-21 12:18:53,589 - DEBUG - Starting Layer 2 verification in Agent 2025-07-21 12:18:53,626 - DEBUG - Layer 2 path is seen for VM MAC 02:83:42:d5:4d:7f in agent 10.0.0.254 2025-07-21 12:18:53,627 - DEBUG - Active layer 2 route in agent is present for VMI tap8342d54d-7f 2025-07-21 12:18:53,627 - DEBUG - L2 label(43) matches bw route table and interface table 2025-07-21 12:18:53,649 - DEBUG - VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 is found in Agent of node 10.0.0.254 2025-07-21 12:18:53,897 - DEBUG - VRF IDs of VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 is consistent in agent 10.0.0.254 2025-07-21 12:18:53,897 - DEBUG - Route for VM IP ['126.88.63.131'] is consistent in agent 10.0.0.254 2025-07-21 12:18:53,898 - DEBUG - VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 verification for VM ctest-analyzer_vm-94189700 in Agent 10.0.0.254 passed 2025-07-21 12:18:54,142 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-07-21 12:18:54,182 - DEBUG - Route for VM MAC 02:83:42:d5:4d:7f is consistent in agent 10.0.0.254 2025-07-21 12:18:55,461 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=10.6 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.621 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.621/5.605/10.589/4.984 ms') 2025-07-21 12:18:55,461 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-analyzer_vm-94189700 passed 2025-07-21 12:18:55,461 - INFO - VM ctest-analyzer_vm-94189700 verifications in Compute nodes passed 2025-07-21 12:18:56,050 - DEBUG - Validated VM route 126.88.63.131 in vrouter of 10.0.0.254 2025-07-21 12:18:56,058 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-07-21 12:18:56,058 - INFO - Validated routes of VM ctest-analyzer_vm-94189700 in all vrouters 2025-07-21 12:18:56,849 - INFO - Verification in Control-nodes for VM ctest-analyzer_vm-94189700 passed 2025-07-21 12:18:56,849 - DEBUG - Verifying the vm in opserver 2025-07-21 12:18:56,850 - DEBUG - Verifying in collector 10.0.0.254 ... 2025-07-21 12:18:56,850 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e?flat 2025-07-21 12:18:56,882 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9?flat 2025-07-21 12:18:56,963 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9?flat 2025-07-21 12:18:57,035 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e?flat 2025-07-21 12:18:57,097 - DEBUG - Verifying vm in vn uve 2025-07-21 12:18:57,097 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9?flat 2025-07-21 12:18:57,181 - DEBUG - VM uve shows interface as {'virtual_network': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'mac_address': '02:83:42:d5:4d:7f', 'ip6_active': False, 'vhostuser_mode': 0, 'ip4_active': True, 'active': True, 'vn_uuid': '7159dd08-3e7f-40b3-99dc-383f22772e1e', 'vm_name': 'ctest-analyzer_vm-94189700', 'tx_vlan': 65535, 'uuid': '8342d54d-7f18-427d-b959-25f7d485e5d9', 'admin_state': True, 'rx_vlan': 65535, 'l2_active': True, 'is_health_check_active': True, 'fixed_ip4_list': ['126.88.63.131'], 'port_mirror_enabled': False, '__T': 1753100324685718, 'gateway': '126.88.63.129', 'ip_address': '126.88.63.131', 'ip6_address': '::', 'label': 39, 'vm_uuid': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e'} 2025-07-21 12:18:57,181 - DEBUG - VM uve shows ip address as ['126.88.63.131', '::'] 2025-07-21 12:18:57,181 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 2025-07-21 12:18:57,181 - INFO - Verifying through opserver in 10.0.0.254 2025-07-21 12:18:57,182 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932?flat 2025-07-21 12:18:57,236 - DEBUG - expected vm list 2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:18:57,236 - DEBUG - Extracted vm list ['2ef0edc0-2c4a-426a-b031-7abbd3a6005e'] 2025-07-21 12:18:57,236 - INFO - VM 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is present in default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 2025-07-21 12:18:57,237 - DEBUG - Verifying vm in vrouter uve 2025-07-21 12:18:57,237 - DEBUG - Getting info from collector 10.0.0.254.. 2025-07-21 12:18:57,237 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e?flat 2025-07-21 12:18:57,258 - DEBUG - VM uve shows vrouter as ['cn-jenkins-deploy-platform-ansible-os-3677-1'] 2025-07-21 12:18:57,258 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:18:57,372 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/cn-jenkins-deploy-platform-ansible-os-3677-1?flat 2025-07-21 12:18:57,419 - DEBUG - VM 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:57,419 - DEBUG - Validated that VM ctest-analyzer_vm-94189700 is in Vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 UVE 2025-07-21 12:18:57,419 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-07-21 12:18:57,434 - DEBUG - Expected tap interface of VM uuid 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9 2025-07-21 12:18:57,434 - DEBUG - Expected VN of VM uuid 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 2025-07-21 12:18:57,434 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:18:57,507 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/vrouter/cn-jenkins-deploy-platform-ansible-os-3677-1?flat 2025-07-21 12:18:57,569 - DEBUG - VM 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:57,569 - INFO - tap interface default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9 of vm 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:57,569 - DEBUG - Connected network default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 of vm 2ef0edc0-2c4a-426a-b031-7abbd3a6005e is present in vrouter cn-jenkins-deploy-platform-ansible-os-3677-1 uve 2025-07-21 12:18:57,569 - DEBUG - Verifying the 2ef0edc0-2c4a-426a-b031-7abbd3a6005e virtual network link through opserver 10.0.0.254 2025-07-21 12:18:57,569 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-07-21 12:18:57,595 - DEBUG - VM link and name as {'name': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e?flat'} 2025-07-21 12:18:57,595 - INFO - VM ctest-analyzer_vm-94189700 validations in Opserver passed 2025-07-21 12:18:58,154 - DEBUG - VM has booted up.. 2025-07-21 12:18:58,412 - DEBUG - VM has booted up.. 2025-07-21 12:18:58,633 - DEBUG - VM has booted up.. 2025-07-21 12:18:58,749 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 2025-07-21 12:18:58,905 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 2025-07-21 12:18:59,064 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 2025-07-21 12:18:59,065 - INFO - Compute/VM: SRC: cn-jenkins-deploy-platform-ansible-os-3677-1 / 24.91.219.195, -> DST: cn-jenkins-deploy-platform-ansible-os-3677-1 / 12.158.11.3 => ANALYZER: cn-jenkins-deploy-platform-ansible-os-3677-1 / 126.88.63.131 2025-07-21 12:18:59,719 - DEBUG - SVM state is active 2025-07-21 12:18:59,984 - DEBUG - svm_obj:'{'manager': , '_info': {'id': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e', 'name': 'ctest-analyzer_vm-94189700', 'status': 'ACTIVE', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'user_id': 'fe0a3eb692e4486483a23f4157170cfc', 'metadata': {}, 'hostId': '45f5b02b2e750fb40684600f8ded711b73fca7d54c0f892afaee35b5', 'image': {'id': '98e62e7d-734d-4b4d-8699-24579a1f651a', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.254:8774/images/98e62e7d-734d-4b4d-8699-24579a1f651a'}]}, 'flavor': {'id': '194a3dfa-896d-4e01-b1f9-908d7ca136ce', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.254:8774/flavors/194a3dfa-896d-4e01-b1f9-908d7ca136ce'}]}, 'created': '2025-07-21T12:18:26Z', 'updated': '2025-07-21T12:18:29Z', 'addresses': {'ctest-vn3-51035932': [{'version': 4, 'addr': '126.88.63.131', 'OS-EXT-IPS:type': 'fixed', 'OS-EXT-IPS-MAC:mac_addr': '02:83:42:d5:4d:7f'}]}, 'accessIPv4': '', 'accessIPv6': '', 'links': [{'rel': 'self', 'href': 'http://10.0.0.254:8774/v2.1/servers/2ef0edc0-2c4a-426a-b031-7abbd3a6005e'}, {'rel': 'bookmark', 'href': 'http://10.0.0.254:8774/servers/2ef0edc0-2c4a-426a-b031-7abbd3a6005e'}], 'OS-DCF:diskConfig': 'MANUAL', 'progress': 0, 'OS-EXT-AZ:availability_zone': 'nova', 'config_drive': '', 'key_name': 'ctest_ctest-TestIntfMirror-76319596ctest-TestIntfMirror-76319596key1', 'OS-SRV-USG:launched_at': '2025-07-21T12:18:29.000000', 'OS-SRV-USG:terminated_at': None, 'OS-EXT-SRV-ATTR:host': 'cn-jenkins-deploy-platform-ansible-os-3677-1', 'OS-EXT-SRV-ATTR:instance_name': 'instance-0000001a', 'OS-EXT-SRV-ATTR:hypervisor_hostname': 'cn-jenkins-deploy-platform-ansible-os-3677-1.', 'OS-EXT-STS:task_state': None, 'OS-EXT-STS:vm_state': 'active', 'OS-EXT-STS:power_state': 1, 'os-extended-volumes:volumes_attached': [], 'security_groups': [{'name': 'default'}]}, 'id': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e', 'name': 'ctest-analyzer_vm-94189700', 'status': 'ACTIVE', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'user_id': 'fe0a3eb692e4486483a23f4157170cfc', 'metadata': {}, 'hostId': '45f5b02b2e750fb40684600f8ded711b73fca7d54c0f892afaee35b5', 'image': {'id': '98e62e7d-734d-4b4d-8699-24579a1f651a', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.254:8774/images/98e62e7d-734d-4b4d-8699-24579a1f651a'}]}, 'flavor': {'id': '194a3dfa-896d-4e01-b1f9-908d7ca136ce', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.254:8774/flavors/194a3dfa-896d-4e01-b1f9-908d7ca136ce'}]}, 'created': '2025-07-21T12:18:26Z', 'updated': '2025-07-21T12:18:29Z', 'addresses': {'ctest-vn3-51035932': [{'version': 4, 'addr': '126.88.63.131', 'OS-EXT-IPS:type': 'fixed', 'OS-EXT-IPS-MAC:mac_addr': '02:83:42:d5:4d:7f'}]}, 'accessIPv4': '', 'accessIPv6': '', 'links': [{'rel': 'self', 'href': 'http://10.0.0.254:8774/v2.1/servers/2ef0edc0-2c4a-426a-b031-7abbd3a6005e'}, {'rel': 'bookmark', 'href': 'http://10.0.0.254:8774/servers/2ef0edc0-2c4a-426a-b031-7abbd3a6005e'}], 'OS-DCF:diskConfig': 'MANUAL', 'progress': 0, 'OS-EXT-AZ:availability_zone': 'nova', 'config_drive': '', 'key_name': 'ctest_ctest-TestIntfMirror-76319596ctest-TestIntfMirror-76319596key1', 'OS-SRV-USG:launched_at': '2025-07-21T12:18:29.000000', 'OS-SRV-USG:terminated_at': None, 'OS-EXT-SRV-ATTR:host': 'cn-jenkins-deploy-platform-ansible-os-3677-1', 'OS-EXT-SRV-ATTR:instance_name': 'instance-0000001a', 'OS-EXT-SRV-ATTR:hypervisor_hostname': 'cn-jenkins-deploy-platform-ansible-os-3677-1.', 'OS-EXT-STS:task_state': None, 'OS-EXT-STS:vm_state': 'active', 'OS-EXT-STS:power_state': 1, 'os-extended-volumes:volumes_attached': [], 'security_groups': [{'name': 'default'}], '_loaded': True, 'x_openstack_request_ids': []}' compute_ip:'10.0.0.254' agent_inspect:'[{'index': '5', 'name': 'tap8342d54d-7f', 'uuid': '8342d54d-7f18-427d-b959-25f7d485e5d9', 'vrf_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932:ctest-vn3-51035932', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932', 'vm_uuid': '2ef0edc0-2c4a-426a-b031-7abbd3a6005e', 'vm_name': 'ctest-analyzer_vm-94189700', 'ip_addr': '126.88.63.131', 'mac_addr': '02:83:42:d5:4d:7f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '62', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-76319596:8342d54d-7f18-427d-b959-25f7d485e5d9', 'sg_uuid_list': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'static_route_list': None, 'vm_project_uuid': 'ba0fe256-f9a1-4918-8a73-2b4f0e159b11', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}]' 2025-07-21 12:19:00,103 - DEBUG - Executing command: rm -f /tmp/mirror-tap8342d54d-7f_ctest-random-14120295.pcap 2025-07-21 12:19:10,694 - INFO - Starting tcpdump to capture the mirrored packets. 2025-07-21 12:19:10,695 - DEBUG - Executing command: sudo tcpdump -ni tap8342d54d-7f -U udp port 8099 -w /tmp/mirror-tap8342d54d-7f_ctest-random-14120295.pcap 2025-07-21 12:19:20,731 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-21 12:19:20,731 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-21 12:19:20,732 - DEBUG - Running remote_cmd, Cmd : ping -s 1200 -c 5 -W 1 12.158.11.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.254, gateway password: c0ntrail123 2025-07-21 12:19:20,733 - DEBUG - ping -s 1200 -c 5 -W 1 12.158.11.3 2025-07-21 12:19:25,751 - DEBUG - PING 12.158.11.3 (12.158.11.3): 1200 data bytes 1208 bytes from 12.158.11.3: seq=0 ttl=63 time=6.769 ms 1208 bytes from 12.158.11.3: seq=1 ttl=63 time=1.771 ms 1208 bytes from 12.158.11.3: seq=2 ttl=63 time=2.672 ms 1208 bytes from 12.158.11.3: seq=3 ttl=63 time=2.362 ms 1208 bytes from 12.158.11.3: seq=4 ttl=63 time=2.290 ms --- 12.158.11.3 ping statistics --- 5 packets transmitted, 5 packets received, 0% packet loss round-trip min/avg/max = 1.771/3.172/6.769 ms 2025-07-21 12:19:25,752 - INFO - Ping to IP 12.158.11.3 from VM ctest-src_vm-49170798 passed 2025-07-21 12:19:35,753 - INFO - Ping from 24.91.219.195 to 12.158.11.3 executed with c=5, expected mirrored packets 5 Ingress,5 Egress count = 10 2025-07-21 12:19:35,753 - DEBUG - Waiting for the tcpdump write to complete. 2025-07-21 12:19:37,755 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap8342d54d-7f_ctest-random-14120295.pcap| awk '{print $2}') 2025-07-21 12:19:37,760 - DEBUG - Executing command: sync 2025-07-21 12:19:40,809 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap8342d54d-7f_ctest-random-14120295.pcap | grep "length [1-9][2-9][0-9][0-9][0-9]*" | wc -l 2025-07-21 12:19:40,857 - DEBUG - STDOUT: 10 2025-07-21 12:19:40,857 - DEBUG - STDERR: reading from file /tmp/mirror-tap8342d54d-7f_ctest-random-14120295.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-07-21 12:19:40,857 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap8342d54d-7f_ctest-random-14120295.pcap 2025-07-21 12:19:40,904 - INFO - 10 ICMP packets are mirrored to the analyzer service VM 'ctest-analyzer_vm-94189700' 2025-07-21 12:19:40,905 - INFO - Disabling intf mirroring on sub intf port 2025-07-21 12:19:40,905 - INFO - interface_mirror enabled..disabling it.. 2025-07-21 12:19:40,942 - INFO - Deleting VM ctest-analyzer_vm-94189700 2025-07-21 12:19:41,059 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:19:41,059 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:19:41,075 - DEBUG - VM ID 2ef0edc0-2c4a-426a-b031-7abbd3a6005e of VM ctest-analyzer_vm-94189700 is still found in API Server 2025-07-21 12:19:43,076 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:19:43,076 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:19:43,086 - DEBUG - Response Code: 404 2025-07-21 12:19:43,086 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:19:43,095 - DEBUG - Response Code: 404 2025-07-21 12:19:43,095 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/2ef0edc0-2c4a-426a-b031-7abbd3a6005e 2025-07-21 12:19:43,106 - DEBUG - Response Code: 404 2025-07-21 12:19:43,107 - INFO - VM ctest-analyzer_vm-94189700 is fully removed in API-Server 2025-07-21 12:19:43,298 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-07-21 12:19:43,361 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 2025-07-21 12:19:43,361 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-51035932 2025-07-21 12:19:43,361 - INFO - VM ctest-analyzer_vm-94189700 is removed in Compute, and routes are removed in all compute nodes 2025-07-21 12:19:43,709 - INFO - Routes for VM ctest-analyzer_vm-94189700 is removed in all control-nodes 2025-07-21 12:19:43,710 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:19:43,721 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:19:43,721 - ERROR - query returned none 2025-07-21 12:19:43,721 - DEBUG - can't get collector's generator 2025-07-21 12:19:46,723 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:19:46,760 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:19:46,760 - ERROR - query returned none 2025-07-21 12:19:46,761 - DEBUG - can't get collector's generator 2025-07-21 12:19:49,761 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:19:49,795 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:19:49,795 - ERROR - query returned none 2025-07-21 12:19:49,796 - DEBUG - can't get collector's generator 2025-07-21 12:19:52,797 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:19:52,812 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:19:52,815 - ERROR - query returned none 2025-07-21 12:19:52,815 - DEBUG - can't get collector's generator 2025-07-21 12:19:55,816 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:19:55,849 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:19:55,850 - ERROR - query returned none 2025-07-21 12:19:55,850 - DEBUG - can't get collector's generator 2025-07-21 12:19:58,852 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:19:58,873 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:19:58,873 - ERROR - query returned none 2025-07-21 12:19:58,873 - DEBUG - can't get collector's generator 2025-07-21 12:20:01,874 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:01,904 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:01,904 - ERROR - query returned none 2025-07-21 12:20:01,905 - DEBUG - can't get collector's generator 2025-07-21 12:20:04,906 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:04,934 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:04,934 - ERROR - query returned none 2025-07-21 12:20:04,934 - DEBUG - can't get collector's generator 2025-07-21 12:20:07,935 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:07,961 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:07,961 - ERROR - query returned none 2025-07-21 12:20:07,961 - DEBUG - can't get collector's generator 2025-07-21 12:20:10,962 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:10,995 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:10,996 - ERROR - query returned none 2025-07-21 12:20:10,996 - DEBUG - can't get collector's generator 2025-07-21 12:20:13,998 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:14,031 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:14,031 - ERROR - query returned none 2025-07-21 12:20:14,031 - DEBUG - can't get collector's generator 2025-07-21 12:20:17,032 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:17,069 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:17,070 - ERROR - query returned none 2025-07-21 12:20:17,070 - DEBUG - can't get collector's generator 2025-07-21 12:20:20,071 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:20,098 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:20,098 - ERROR - query returned none 2025-07-21 12:20:20,098 - DEBUG - can't get collector's generator 2025-07-21 12:20:23,099 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:23,131 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:23,132 - ERROR - query returned none 2025-07-21 12:20:23,132 - DEBUG - can't get collector's generator 2025-07-21 12:20:26,133 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:26,163 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:26,163 - ERROR - query returned none 2025-07-21 12:20:26,163 - DEBUG - can't get collector's generator 2025-07-21 12:20:29,164 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:29,192 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:29,192 - ERROR - query returned none 2025-07-21 12:20:29,192 - DEBUG - can't get collector's generator 2025-07-21 12:20:29,193 - INFO - Deleting VM ctest-dst_vm-34145302 2025-07-21 12:20:29,339 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:20:29,340 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:20:29,355 - DEBUG - VM ID 94f6c261-f325-405c-8a0c-8f071f6a1f47 of VM ctest-dst_vm-34145302 is still found in API Server 2025-07-21 12:20:31,356 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:20:31,356 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:20:31,371 - DEBUG - Response Code: 404 2025-07-21 12:20:31,371 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:20:31,383 - DEBUG - Response Code: 404 2025-07-21 12:20:31,384 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/94f6c261-f325-405c-8a0c-8f071f6a1f47 2025-07-21 12:20:31,393 - DEBUG - Response Code: 404 2025-07-21 12:20:31,393 - INFO - VM ctest-dst_vm-34145302 is fully removed in API-Server 2025-07-21 12:20:31,587 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-07-21 12:20:31,682 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 2025-07-21 12:20:31,682 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42572030 2025-07-21 12:20:31,683 - INFO - VM ctest-dst_vm-34145302 is removed in Compute, and routes are removed in all compute nodes 2025-07-21 12:20:32,059 - INFO - Routes for VM ctest-dst_vm-34145302 is removed in all control-nodes 2025-07-21 12:20:32,059 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:32,099 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:32,099 - ERROR - query returned none 2025-07-21 12:20:32,100 - DEBUG - can't get collector's generator 2025-07-21 12:20:35,102 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:35,128 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:35,129 - ERROR - query returned none 2025-07-21 12:20:35,129 - DEBUG - can't get collector's generator 2025-07-21 12:20:38,131 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:38,165 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:38,166 - ERROR - query returned none 2025-07-21 12:20:38,166 - DEBUG - can't get collector's generator 2025-07-21 12:20:41,167 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:41,202 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:41,202 - ERROR - query returned none 2025-07-21 12:20:41,216 - DEBUG - can't get collector's generator 2025-07-21 12:20:44,217 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:44,238 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:44,238 - ERROR - query returned none 2025-07-21 12:20:44,238 - DEBUG - can't get collector's generator 2025-07-21 12:20:47,239 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:47,257 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:47,257 - ERROR - query returned none 2025-07-21 12:20:47,257 - DEBUG - can't get collector's generator 2025-07-21 12:20:50,259 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:50,283 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:50,283 - ERROR - query returned none 2025-07-21 12:20:50,283 - DEBUG - can't get collector's generator 2025-07-21 12:20:53,284 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:53,314 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:53,314 - ERROR - query returned none 2025-07-21 12:20:53,314 - DEBUG - can't get collector's generator 2025-07-21 12:20:56,315 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:56,346 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:56,346 - ERROR - query returned none 2025-07-21 12:20:56,346 - DEBUG - can't get collector's generator 2025-07-21 12:20:59,347 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:20:59,377 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:20:59,377 - ERROR - query returned none 2025-07-21 12:20:59,377 - DEBUG - can't get collector's generator 2025-07-21 12:21:02,378 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:02,407 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:02,408 - ERROR - query returned none 2025-07-21 12:21:02,408 - DEBUG - can't get collector's generator 2025-07-21 12:21:05,409 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:05,441 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:05,441 - ERROR - query returned none 2025-07-21 12:21:05,441 - DEBUG - can't get collector's generator 2025-07-21 12:21:08,442 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:08,475 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:08,476 - ERROR - query returned none 2025-07-21 12:21:08,477 - DEBUG - can't get collector's generator 2025-07-21 12:21:11,478 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:11,512 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:11,512 - ERROR - query returned none 2025-07-21 12:21:11,512 - DEBUG - can't get collector's generator 2025-07-21 12:21:14,514 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:14,543 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:14,544 - ERROR - query returned none 2025-07-21 12:21:14,544 - DEBUG - can't get collector's generator 2025-07-21 12:21:17,545 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:17,576 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:17,576 - ERROR - query returned none 2025-07-21 12:21:17,577 - DEBUG - can't get collector's generator 2025-07-21 12:21:17,577 - INFO - Deleting VM ctest-src_vm-49170798 2025-07-21 12:21:17,747 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:21:17,748 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:21:17,773 - DEBUG - VM ID 80b2143d-44a2-4a88-8093-807e805e2786 of VM ctest-src_vm-49170798 is still found in API Server 2025-07-21 12:21:19,774 - DEBUG - Verifying in api server 10.0.0.254 2025-07-21 12:21:19,775 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:21:19,786 - DEBUG - Response Code: 404 2025-07-21 12:21:19,787 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:21:19,797 - DEBUG - Response Code: 404 2025-07-21 12:21:19,797 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-machine/80b2143d-44a2-4a88-8093-807e805e2786 2025-07-21 12:21:19,807 - DEBUG - Response Code: 404 2025-07-21 12:21:19,807 - INFO - VM ctest-src_vm-49170798 is fully removed in API-Server 2025-07-21 12:21:20,002 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-07-21 12:21:20,093 - DEBUG - Validated that vrouter 10.0.0.254 does not have VMs route for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 2025-07-21 12:21:20,093 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-30204270 2025-07-21 12:21:20,093 - INFO - VM ctest-src_vm-49170798 is removed in Compute, and routes are removed in all compute nodes 2025-07-21 12:21:20,465 - INFO - Routes for VM ctest-src_vm-49170798 is removed in all control-nodes 2025-07-21 12:21:20,465 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:20,482 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:20,482 - ERROR - query returned none 2025-07-21 12:21:20,482 - DEBUG - can't get collector's generator 2025-07-21 12:21:23,483 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:23,505 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:23,505 - ERROR - query returned none 2025-07-21 12:21:23,506 - DEBUG - can't get collector's generator 2025-07-21 12:21:26,506 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:26,524 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:26,524 - ERROR - query returned none 2025-07-21 12:21:26,524 - DEBUG - can't get collector's generator 2025-07-21 12:21:29,525 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:29,563 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:29,563 - ERROR - query returned none 2025-07-21 12:21:29,563 - DEBUG - can't get collector's generator 2025-07-21 12:21:32,563 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:32,586 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:32,586 - ERROR - query returned none 2025-07-21 12:21:32,586 - DEBUG - can't get collector's generator 2025-07-21 12:21:35,587 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:35,611 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:35,611 - ERROR - query returned none 2025-07-21 12:21:35,612 - DEBUG - can't get collector's generator 2025-07-21 12:21:38,612 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:38,635 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:38,635 - ERROR - query returned none 2025-07-21 12:21:38,635 - DEBUG - can't get collector's generator 2025-07-21 12:21:41,636 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:41,656 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:41,656 - ERROR - query returned none 2025-07-21 12:21:41,656 - DEBUG - can't get collector's generator 2025-07-21 12:21:44,657 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:44,690 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:44,690 - ERROR - query returned none 2025-07-21 12:21:44,690 - DEBUG - can't get collector's generator 2025-07-21 12:21:47,692 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:47,719 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:47,720 - ERROR - query returned none 2025-07-21 12:21:47,720 - DEBUG - can't get collector's generator 2025-07-21 12:21:50,721 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:50,749 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:50,749 - ERROR - query returned none 2025-07-21 12:21:50,749 - DEBUG - can't get collector's generator 2025-07-21 12:21:53,750 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:53,777 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:53,777 - ERROR - query returned none 2025-07-21 12:21:53,778 - DEBUG - can't get collector's generator 2025-07-21 12:21:56,778 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:56,808 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:56,808 - ERROR - query returned none 2025-07-21 12:21:56,808 - DEBUG - can't get collector's generator 2025-07-21 12:21:59,810 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:21:59,840 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:21:59,840 - ERROR - query returned none 2025-07-21 12:21:59,840 - DEBUG - can't get collector's generator 2025-07-21 12:22:02,842 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:22:02,872 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:22:02,872 - ERROR - query returned none 2025-07-21 12:22:02,873 - DEBUG - can't get collector's generator 2025-07-21 12:22:05,874 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent:0?flat 2025-07-21 12:22:05,902 - WARNING - ops generator uve analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3677-1.:Compute:contrail-vrouter-agent?flat not returned 2025-07-21 12:22:05,902 - ERROR - query returned none 2025-07-21 12:22:05,903 - DEBUG - can't get collector's generator 2025-07-21 12:22:05,903 - INFO - Dettaching policy ctest-vn2_vn3_pass-71406421 from vn ctest-vn3-51035932 2025-07-21 12:22:06,281 - INFO - Dettaching policy ctest-vn2_vn3_pass-71406421 from vn ctest-vn2-42572030 2025-07-21 12:22:06,685 - INFO - Dettaching policy ctest-vn1_vn3_pass-02731068 from vn ctest-vn3-51035932 2025-07-21 12:22:06,941 - INFO - Dettaching policy ctest-vn1_vn3_pass-02731068 from vn ctest-vn1-30204270 2025-07-21 12:22:07,342 - INFO - Dettaching policy ctest-vn1_vn2_pass-92653953 from vn ctest-vn2-42572030 2025-07-21 12:22:07,658 - INFO - Dettaching policy ctest-vn1_vn2_pass-92653953 from vn ctest-vn1-30204270 2025-07-21 12:22:08,020 - INFO - Deleted policy ctest-vn2_vn3_pass-71406421 2025-07-21 12:22:08,071 - INFO - Deleted policy ctest-vn1_vn3_pass-02731068 2025-07-21 12:22:08,116 - INFO - Deleted policy ctest-vn1_vn2_pass-92653953 2025-07-21 12:22:08,116 - INFO - Deleting VN ctest-vn3-51035932 2025-07-21 12:22:08,298 - DEBUG - Response for deleting network () 2025-07-21 12:22:08,298 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a95caf7b-43ed-4486-8545-dbdfbef608c3 2025-07-21 12:22:08,311 - DEBUG - Response Code: 404 2025-07-21 12:22:08,312 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:08,321 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:08,341 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:08,433 - INFO - Validated that VN ctest-vn3-51035932 is not found in API Server 2025-07-21 12:22:08,452 - DEBUG - VN ctest-vn3-51035932 is not present in Agent 10.0.0.254 2025-07-21 12:22:08,452 - INFO - Validated that VN ctest-vn3-51035932 is not in any agent 2025-07-21 12:22:08,485 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-51035932 info 2025-07-21 12:22:08,485 - INFO - Deleting VN ctest-vn2-42572030 2025-07-21 12:22:08,671 - DEBUG - Response for deleting network () 2025-07-21 12:22:08,671 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/9b2729b6-634a-48e9-8073-850ece5ff65a 2025-07-21 12:22:08,681 - DEBUG - Response Code: 404 2025-07-21 12:22:08,681 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:08,690 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:08,750 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:08,861 - INFO - Validated that VN ctest-vn2-42572030 is not found in API Server 2025-07-21 12:22:08,886 - DEBUG - VN ctest-vn2-42572030 is not present in Agent 10.0.0.254 2025-07-21 12:22:08,886 - INFO - Validated that VN ctest-vn2-42572030 is not in any agent 2025-07-21 12:22:08,921 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-42572030 info 2025-07-21 12:22:08,922 - INFO - Deleting VN ctest-vn1-30204270 2025-07-21 12:22:09,064 - DEBUG - Response for deleting network () 2025-07-21 12:22:09,064 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1968c884-8853-43be-8c37-64ffd399118f 2025-07-21 12:22:09,075 - DEBUG - Response Code: 404 2025-07-21 12:22:09,075 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:09,084 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:09,146 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:09,245 - INFO - Validated that VN ctest-vn1-30204270 is not found in API Server 2025-07-21 12:22:09,268 - DEBUG - VN ctest-vn1-30204270 is not present in Agent 10.0.0.254 2025-07-21 12:22:09,268 - INFO - Validated that VN ctest-vn1-30204270 is not in any agent 2025-07-21 12:22:09,298 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-30204270 info 2025-07-21 12:22:09,619 - DEBUG - No XMPP flaps were noticed during the test 2025-07-21 12:22:09,619 - INFO - END TEST : test_intf_mirror_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 : PASSED[0:03:59] 2025-07-21 12:22:09,619 - INFO - -------------------------------------------------------------------------------- 2025-07-21 12:22:09,623 - INFO - ================================================================================ 2025-07-21 12:22:09,623 - INFO - STARTING TEST : test_intf_mirror_with_subintf_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 2025-07-21 12:22:09,623 - INFO - TEST DESCRIPTION : Validate the interface mirroring src vm, dst vm and analyzer vm on different CNs, all in different VNs when src vmi, dst vmi and analyzer vmi are sub interfaces 2025-07-21 12:22:09,954 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-07-21 12:22:09,954 - INFO - Initial checks done. Running the testcase now 2025-07-21 12:22:09,955 - INFO - 2025-07-21 12:22:09,955 - INFO - src compute cn-jenkins-deploy-platform-ansible-os-3677-1 -> dst compute cn-jenkins-deploy-platform-ansible-os-3677-1 => analyzer compute cn-jenkins-deploy-platform-ansible-os-3677-1 2025-07-21 12:22:10,281 - DEBUG - Response for create_network : {'network': {'id': '90b4dd36-4b1b-424c-92ea-12d7343361e8', 'name': 'ctest-vn1-22952389', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn1-22952389'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:22:10,544 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e8faadf5-eb20-48fe-9ce2-c798db780433', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '90b4dd36-4b1b-424c-92ea-12d7343361e8', 'ip_version': 4, 'cidr': '175.39.79.0/26', 'allocation_pools': [{'start': '175.39.79.2', 'end': '175.39.79.62'}], 'gateway_ip': '175.39.79.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.39.79.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:10,575 - INFO - Created VN ctest-vn1-22952389 2025-07-21 12:22:10,638 - DEBUG - VN ctest-vn1-22952389 UUID is 90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:10,793 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:10,809 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:10,844 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:11,001 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:11,033 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:11,062 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2780bddc-12ed-42fc-b088-9e4dec8bcc27 2025-07-21 12:22:11,090 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2780bddc-12ed-42fc-b088-9e4dec8bcc27 2025-07-21 12:22:11,118 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7cdd6688-75b9-4a6e-86b5-2b5cc73cb1b1 2025-07-21 12:22:11,142 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:22:11,142 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:11,179 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2780bddc-12ed-42fc-b088-9e4dec8bcc27 2025-07-21 12:22:11,231 - INFO - Verified VN network id 15 for VN 90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:11,232 - INFO - Verifications in API Server for VN ctest-vn1-22952389 passed 2025-07-21 12:22:11,232 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:11,276 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2780bddc-12ed-42fc-b088-9e4dec8bcc27 2025-07-21 12:22:11,315 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2780bddc-12ed-42fc-b088-9e4dec8bcc27 2025-07-21 12:22:11,338 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/7cdd6688-75b9-4a6e-86b5-2b5cc73cb1b1 2025-07-21 12:22:11,364 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10427202262527590988', 'uuid-lslong': '10586294589590823400'}, 'enable': 'true', 'created': '2025-07-21T12:22:10', 'last-modified': '2025-07-21T12:22:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.882701'} 2025-07-21 12:22:11,381 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:22:11,381 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-22952389 passed 2025-07-21 12:22:11,381 - DEBUG - ====Verifying policy data for ctest-vn1-22952389 in API_Server ====== 2025-07-21 12:22:11,381 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:11,397 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:11,421 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:11,522 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90b4dd36-4b1b-424c-92ea-12d7343361e8 2025-07-21 12:22:11,544 - DEBUG - =>VN ctest-vn1-22952389 has no policy to be verified 2025-07-21 12:22:11,545 - DEBUG - Verifying the vn in opserver 2025-07-21 12:22:11,545 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389 virtual network link through opserver 10.0.0.254 2025-07-21 12:22:11,545 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:22:11,560 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389?flat'} 2025-07-21 12:22:11,560 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389 is found in opserver 2025-07-21 12:22:11,574 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:22:11,580 - DEBUG - VRF ids for VN ctest-vn1-22952389: {} 2025-07-21 12:22:11,818 - DEBUG - Response for create_network : {'network': {'id': '863f34e1-bff9-4394-8742-6a1ca60de1e0', 'name': 'ctest-vn2-50821839', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn2-50821839'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:22:12,090 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e526570f-6c9d-43d2-b4bc-311985d73e18', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '863f34e1-bff9-4394-8742-6a1ca60de1e0', 'ip_version': 4, 'cidr': '186.238.53.0/26', 'allocation_pools': [{'start': '186.238.53.2', 'end': '186.238.53.62'}], 'gateway_ip': '186.238.53.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.238.53.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:12,126 - INFO - Created VN ctest-vn2-50821839 2025-07-21 12:22:12,185 - DEBUG - VN ctest-vn2-50821839 UUID is 863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,362 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:12,382 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:12,400 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:12,520 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,548 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,577 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6b62edc3-6211-4392-bd70-479c0879ba4c 2025-07-21 12:22:12,596 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6b62edc3-6211-4392-bd70-479c0879ba4c 2025-07-21 12:22:12,615 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/ed757295-ec0a-4d18-917b-3c3b9fd54486 2025-07-21 12:22:12,627 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:22:12,627 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,643 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6b62edc3-6211-4392-bd70-479c0879ba4c 2025-07-21 12:22:12,665 - INFO - Verified VN network id 16 for VN 863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,665 - INFO - Verifications in API Server for VN ctest-vn2-50821839 passed 2025-07-21 12:22:12,665 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,681 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6b62edc3-6211-4392-bd70-479c0879ba4c 2025-07-21 12:22:12,693 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6b62edc3-6211-4392-bd70-479c0879ba4c 2025-07-21 12:22:12,703 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/ed757295-ec0a-4d18-917b-3c3b9fd54486 2025-07-21 12:22:12,727 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9673508668808184724', 'uuid-lslong': '9746469214860730848'}, 'enable': 'true', 'created': '2025-07-21T12:22:11', 'last-modified': '2025-07-21T12:22:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.689707'} 2025-07-21 12:22:12,738 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:22:12,738 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-50821839 passed 2025-07-21 12:22:12,738 - DEBUG - ====Verifying policy data for ctest-vn2-50821839 in API_Server ====== 2025-07-21 12:22:12,738 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:12,748 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:12,769 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:12,869 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/863f34e1-bff9-4394-8742-6a1ca60de1e0 2025-07-21 12:22:12,887 - DEBUG - =>VN ctest-vn2-50821839 has no policy to be verified 2025-07-21 12:22:12,887 - DEBUG - Verifying the vn in opserver 2025-07-21 12:22:12,887 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839 virtual network link through opserver 10.0.0.254 2025-07-21 12:22:12,888 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:22:12,905 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839?flat'} 2025-07-21 12:22:12,905 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839 is found in opserver 2025-07-21 12:22:12,922 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:22:12,933 - DEBUG - VRF ids for VN ctest-vn2-50821839: {} 2025-07-21 12:22:13,269 - DEBUG - Response for create_network : {'network': {'id': '7e7b4f4b-a17d-411d-98ae-aac3c491ae92', 'name': 'ctest-vn3-44601164', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn3-44601164'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:22:13,476 - DEBUG - Response for create_subnet : {'subnet': {'id': '0ee0c15d-ed57-4433-ac2e-fb56ed3ecac9', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '7e7b4f4b-a17d-411d-98ae-aac3c491ae92', 'ip_version': 4, 'cidr': '185.243.193.0/26', 'allocation_pools': [{'start': '185.243.193.2', 'end': '185.243.193.62'}], 'gateway_ip': '185.243.193.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '185.243.193.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:13,503 - INFO - Created VN ctest-vn3-44601164 2025-07-21 12:22:13,561 - DEBUG - VN ctest-vn3-44601164 UUID is 7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:13,702 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:13,715 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:13,741 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:13,837 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:13,858 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:13,876 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f418f00f-2e26-4fdf-b9b9-9239627645dc 2025-07-21 12:22:13,891 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f418f00f-2e26-4fdf-b9b9-9239627645dc 2025-07-21 12:22:13,905 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/87f83b0f-6592-4e25-b34b-0ab62e18c9d4 2025-07-21 12:22:13,922 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:22:13,922 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:13,949 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f418f00f-2e26-4fdf-b9b9-9239627645dc 2025-07-21 12:22:13,988 - INFO - Verified VN network id 17 for VN 7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:13,989 - INFO - Verifications in API Server for VN ctest-vn3-44601164 passed 2025-07-21 12:22:13,989 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:14,017 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f418f00f-2e26-4fdf-b9b9-9239627645dc 2025-07-21 12:22:14,032 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f418f00f-2e26-4fdf-b9b9-9239627645dc 2025-07-21 12:22:14,052 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/87f83b0f-6592-4e25-b34b-0ab62e18c9d4 2025-07-21 12:22:14,087 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9113965457164812573', 'uuid-lslong': '11001918697505926802'}, 'enable': 'true', 'created': '2025-07-21T12:22:13', 'last-modified': '2025-07-21T12:22:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.656788'} 2025-07-21 12:22:14,103 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:22:14,103 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-44601164 passed 2025-07-21 12:22:14,103 - DEBUG - ====Verifying policy data for ctest-vn3-44601164 in API_Server ====== 2025-07-21 12:22:14,104 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:14,115 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:14,135 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:14,260 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7e7b4f4b-a17d-411d-98ae-aac3c491ae92 2025-07-21 12:22:14,283 - DEBUG - =>VN ctest-vn3-44601164 has no policy to be verified 2025-07-21 12:22:14,283 - DEBUG - Verifying the vn in opserver 2025-07-21 12:22:14,283 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164 virtual network link through opserver 10.0.0.254 2025-07-21 12:22:14,283 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:22:14,305 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164?flat'} 2025-07-21 12:22:14,305 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164 is found in opserver 2025-07-21 12:22:14,330 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:22:14,340 - DEBUG - VRF ids for VN ctest-vn3-44601164: {} 2025-07-21 12:22:14,351 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:22:14,746 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-22952389, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:22:15,129 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-50821839, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-44601164, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:22:15,685 - INFO - Attaching policy ctest-vn1_vn2_pass-20999590 to vn ctest-vn1-22952389 2025-07-21 12:22:16,337 - INFO - Attaching policy ctest-vn1_vn2_pass-20999590 to vn ctest-vn2-50821839 2025-07-21 12:22:16,989 - INFO - Attaching policy ctest-vn1_vn3_pass-29041030 to vn ctest-vn1-22952389 2025-07-21 12:22:17,717 - INFO - Attaching policy ctest-vn1_vn3_pass-29041030 to vn ctest-vn3-44601164 2025-07-21 12:22:18,321 - INFO - Attaching policy ctest-vn2_vn3_pass-73458091 to vn ctest-vn2-50821839 2025-07-21 12:22:19,021 - INFO - Attaching policy ctest-vn2_vn3_pass-73458091 to vn ctest-vn3-44601164 2025-07-21 12:22:19,881 - DEBUG - Response for create_network : {'network': {'id': '438646ff-2210-41c2-a042-14b567834e32', 'name': 'ctest-src_parent_port_vn-90477164', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-src_parent_port_vn-90477164'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:22:20,135 - DEBUG - Response for create_subnet : {'subnet': {'id': '4d309cef-1f94-4380-a0ea-944a73c624ba', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '438646ff-2210-41c2-a042-14b567834e32', 'ip_version': 4, 'cidr': '167.1.5.0/26', 'allocation_pools': [{'start': '167.1.5.2', 'end': '167.1.5.62'}], 'gateway_ip': '167.1.5.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '167.1.5.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:20,155 - INFO - Created VN ctest-src_parent_port_vn-90477164 2025-07-21 12:22:20,213 - DEBUG - VN ctest-src_parent_port_vn-90477164 UUID is 438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:20,378 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:20,393 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:20,437 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:20,537 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:20,572 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:20,603 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8ec66d8e-3dcb-48c9-9eb1-e77b5069235d 2025-07-21 12:22:20,626 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8ec66d8e-3dcb-48c9-9eb1-e77b5069235d 2025-07-21 12:22:20,639 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/5f5f439d-fe5e-4062-baad-a162da61f404 2025-07-21 12:22:20,651 - DEBUG - Route Targets: ['target:64512:8000014'] 2025-07-21 12:22:20,651 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:20,675 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8ec66d8e-3dcb-48c9-9eb1-e77b5069235d 2025-07-21 12:22:20,703 - INFO - Verified VN network id 18 for VN 438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:20,704 - INFO - Verifications in API Server for VN ctest-src_parent_port_vn-90477164 passed 2025-07-21 12:22:20,704 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:20,721 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8ec66d8e-3dcb-48c9-9eb1-e77b5069235d 2025-07-21 12:22:20,731 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8ec66d8e-3dcb-48c9-9eb1-e77b5069235d 2025-07-21 12:22:20,745 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/5f5f439d-fe5e-4062-baad-a162da61f404 2025-07-21 12:22:20,778 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-90477164', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4865654509022495170', 'uuid-lslong': '11547815163889667634'}, 'enable': 'true', 'created': '2025-07-21T12:22:19', 'last-modified': '2025-07-21T12:22:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.686055'} 2025-07-21 12:22:20,797 - DEBUG - Route Targets: ['target:64512:8000014'] 2025-07-21 12:22:20,797 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-src_parent_port_vn-90477164 passed 2025-07-21 12:22:20,798 - DEBUG - ====Verifying policy data for ctest-src_parent_port_vn-90477164 in API_Server ====== 2025-07-21 12:22:20,798 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:20,814 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:20,854 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:20,985 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/438646ff-2210-41c2-a042-14b567834e32 2025-07-21 12:22:21,014 - DEBUG - =>VN ctest-src_parent_port_vn-90477164 has no policy to be verified 2025-07-21 12:22:21,014 - DEBUG - Verifying the vn in opserver 2025-07-21 12:22:21,014 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-90477164 virtual network link through opserver 10.0.0.254 2025-07-21 12:22:21,014 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:22:21,046 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-90477164', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-90477164?flat'} 2025-07-21 12:22:21,046 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-90477164 is found in opserver 2025-07-21 12:22:21,075 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:22:21,092 - DEBUG - VRF ids for VN ctest-src_parent_port_vn-90477164: {} 2025-07-21 12:22:21,093 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-65931569']} 2025-07-21 12:22:21,430 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-65931569', 'id': 'bde1e5b0-9e5f-4bd9-b28f-ab30407b3b37', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '438646ff-2210-41c2-a042-14b567834e32', 'mac_address': '02:bd:e1:e5:b0:9e', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '167.1.5.3', 'subnet_id': '4d309cef-1f94-4380-a0ea-944a73c624ba'}], 'security_groups': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:21,430 - DEBUG - Created port bde1e5b0-9e5f-4bd9-b28f-ab30407b3b37 2025-07-21 12:22:21,545 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-89965788']} 2025-07-21 12:22:22,169 - DEBUG - Created port 9b24d3b3-cc9a-43aa-bf1c-1ce3f432909c 2025-07-21 12:22:22,752 - DEBUG - Response for create_network : {'network': {'id': '20393431-462b-4c70-a43c-854f4a095926', 'name': 'ctest-dst_parent_port_vn-29713908', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-dst_parent_port_vn-29713908'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:22:23,023 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c8954cc4-8910-4052-abc1-b725add06b53', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '20393431-462b-4c70-a43c-854f4a095926', 'ip_version': 4, 'cidr': '19.214.126.64/26', 'allocation_pools': [{'start': '19.214.126.66', 'end': '19.214.126.126'}], 'gateway_ip': '19.214.126.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '19.214.126.66', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:23,050 - INFO - Created VN ctest-dst_parent_port_vn-29713908 2025-07-21 12:22:23,121 - DEBUG - VN ctest-dst_parent_port_vn-29713908 UUID is 20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:23,288 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:23,310 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:23,337 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:23,462 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:23,492 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:23,523 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/30179f2c-a781-45c3-ba63-d98fdbc67341 2025-07-21 12:22:23,551 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/30179f2c-a781-45c3-ba63-d98fdbc67341 2025-07-21 12:22:23,578 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/9b6209f5-884e-482e-9d05-0880f45cc1c3 2025-07-21 12:22:23,601 - DEBUG - Route Targets: ['target:64512:8000015'] 2025-07-21 12:22:23,601 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:23,638 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/30179f2c-a781-45c3-ba63-d98fdbc67341 2025-07-21 12:22:23,687 - INFO - Verified VN network id 19 for VN 20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:23,688 - INFO - Verifications in API Server for VN ctest-dst_parent_port_vn-29713908 passed 2025-07-21 12:22:23,688 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:23,721 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/30179f2c-a781-45c3-ba63-d98fdbc67341 2025-07-21 12:22:23,747 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/30179f2c-a781-45c3-ba63-d98fdbc67341 2025-07-21 12:22:23,771 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/9b6209f5-884e-482e-9d05-0880f45cc1c3 2025-07-21 12:22:23,816 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-29713908', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2321944469121485936', 'uuid-lslong': '11834480496413858086'}, 'enable': 'true', 'created': '2025-07-21T12:22:22', 'last-modified': '2025-07-21T12:22:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.848204'} 2025-07-21 12:22:23,842 - DEBUG - Route Targets: ['target:64512:8000015'] 2025-07-21 12:22:23,842 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-dst_parent_port_vn-29713908 passed 2025-07-21 12:22:23,843 - DEBUG - ====Verifying policy data for ctest-dst_parent_port_vn-29713908 in API_Server ====== 2025-07-21 12:22:23,843 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:23,861 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:23,900 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:24,040 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/20393431-462b-4c70-a43c-854f4a095926 2025-07-21 12:22:24,067 - DEBUG - =>VN ctest-dst_parent_port_vn-29713908 has no policy to be verified 2025-07-21 12:22:24,067 - DEBUG - Verifying the vn in opserver 2025-07-21 12:22:24,068 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-29713908 virtual network link through opserver 10.0.0.254 2025-07-21 12:22:24,068 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:22:24,103 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-29713908', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-29713908?flat'} 2025-07-21 12:22:24,103 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-29713908 is found in opserver 2025-07-21 12:22:24,137 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:22:24,154 - DEBUG - VRF ids for VN ctest-dst_parent_port_vn-29713908: {} 2025-07-21 12:22:24,154 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-15188822']} 2025-07-21 12:22:24,616 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-15188822', 'id': '298a8710-116a-4185-87d5-c10be94a5f07', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '20393431-462b-4c70-a43c-854f4a095926', 'mac_address': '02:29:8a:87:10:11', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '19.214.126.67', 'subnet_id': 'c8954cc4-8910-4052-abc1-b725add06b53'}], 'security_groups': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:24,616 - DEBUG - Created port 298a8710-116a-4185-87d5-c10be94a5f07 2025-07-21 12:22:24,742 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-28932594']} 2025-07-21 12:22:25,349 - DEBUG - Created port 89d6000e-f1b9-4623-b823-fa4bb2097fb3 2025-07-21 12:22:25,877 - DEBUG - Response for create_network : {'network': {'id': 'd3e3fea1-47f9-47f0-b90b-8a7135ba365b', 'name': 'ctest-analyzer_parent_port_vn-38618675', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-analyzer_parent_port_vn-38618675'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:22:26,061 - DEBUG - Response for create_subnet : {'subnet': {'id': '822f4131-31ee-4bc1-818a-6b8480d3dad7', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'd3e3fea1-47f9-47f0-b90b-8a7135ba365b', 'ip_version': 4, 'cidr': '180.126.5.128/26', 'allocation_pools': [{'start': '180.126.5.130', 'end': '180.126.5.190'}], 'gateway_ip': '180.126.5.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '180.126.5.130', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:26,088 - INFO - Created VN ctest-analyzer_parent_port_vn-38618675 2025-07-21 12:22:26,145 - DEBUG - VN ctest-analyzer_parent_port_vn-38618675 UUID is d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,291 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:26,303 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:26,334 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:26,468 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,494 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,516 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/faeff001-75ff-449c-a9e7-1163b2c5b24a 2025-07-21 12:22:26,531 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/faeff001-75ff-449c-a9e7-1163b2c5b24a 2025-07-21 12:22:26,549 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/038751a0-c83b-4e66-8adf-e3b92a1767d8 2025-07-21 12:22:26,564 - DEBUG - Route Targets: ['target:64512:8000016'] 2025-07-21 12:22:26,564 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,585 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/faeff001-75ff-449c-a9e7-1163b2c5b24a 2025-07-21 12:22:26,625 - INFO - Verified VN network id 20 for VN d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,625 - INFO - Verifications in API Server for VN ctest-analyzer_parent_port_vn-38618675 passed 2025-07-21 12:22:26,625 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,656 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/faeff001-75ff-449c-a9e7-1163b2c5b24a 2025-07-21 12:22:26,680 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/faeff001-75ff-449c-a9e7-1163b2c5b24a 2025-07-21 12:22:26,703 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/038751a0-c83b-4e66-8adf-e3b92a1767d8 2025-07-21 12:22:26,762 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-38618675', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15268327130366822384', 'uuid-lslong': '13333903340597818971'}, 'enable': 'true', 'created': '2025-07-21T12:22:25', 'last-modified': '2025-07-21T12:22:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.739616'} 2025-07-21 12:22:26,780 - DEBUG - Route Targets: ['target:64512:8000016'] 2025-07-21 12:22:26,781 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-analyzer_parent_port_vn-38618675 passed 2025-07-21 12:22:26,781 - DEBUG - ====Verifying policy data for ctest-analyzer_parent_port_vn-38618675 in API_Server ====== 2025-07-21 12:22:26,781 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:22:26,796 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:22:26,819 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:22:26,919 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d3e3fea1-47f9-47f0-b90b-8a7135ba365b 2025-07-21 12:22:26,933 - DEBUG - =>VN ctest-analyzer_parent_port_vn-38618675 has no policy to be verified 2025-07-21 12:22:26,933 - DEBUG - Verifying the vn in opserver 2025-07-21 12:22:26,933 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-38618675 virtual network link through opserver 10.0.0.254 2025-07-21 12:22:26,933 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:22:26,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-38618675', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-38618675?flat'} 2025-07-21 12:22:26,947 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-38618675 is found in opserver 2025-07-21 12:22:26,962 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:22:26,969 - DEBUG - VRF ids for VN ctest-analyzer_parent_port_vn-38618675: {} 2025-07-21 12:22:26,969 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-93428356']} 2025-07-21 12:22:27,261 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-93428356', 'id': 'd98adae0-a297-48c2-9836-6cccf89db722', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'd3e3fea1-47f9-47f0-b90b-8a7135ba365b', 'mac_address': '02:d9:8a:da:e0:a2', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '180.126.5.131', 'subnet_id': '822f4131-31ee-4bc1-818a-6b8480d3dad7'}], 'security_groups': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:22:27,261 - DEBUG - Created port d98adae0-a297-48c2-9836-6cccf89db722 2025-07-21 12:22:27,370 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-91074895']} 2025-07-21 12:22:28,045 - DEBUG - Created port db963c51-a4df-4357-b511-17ce100ca6b8 2025-07-21 12:24:09,178 - DEBUG - Installing image ubuntu 2025-07-21 12:24:09,179 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-21 12:24:09,181 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:24:09,181 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:24:09,181 - DEBUG - Unzip image 2025-07-21 12:24:09,181 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:24:09,214 - DEBUG - Try to create image in user context 2025-07-21 12:24:09,609 - INFO - Deleted port db963c51-a4df-4357-b511-17ce100ca6b8 2025-07-21 12:24:09,757 - DEBUG - Response for delete_port : () 2025-07-21 12:24:09,757 - INFO - Deleted port d98adae0-a297-48c2-9836-6cccf89db722 2025-07-21 12:24:09,758 - INFO - Deleting VN ctest-analyzer_parent_port_vn-38618675 2025-07-21 12:24:09,916 - DEBUG - Response for deleting network () 2025-07-21 12:24:09,916 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/faeff001-75ff-449c-a9e7-1163b2c5b24a 2025-07-21 12:24:09,962 - DEBUG - Response Code: 404 2025-07-21 12:24:09,963 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:09,977 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:10,013 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:10,144 - INFO - Validated that VN ctest-analyzer_parent_port_vn-38618675 is not found in API Server 2025-07-21 12:24:10,176 - DEBUG - VN ctest-analyzer_parent_port_vn-38618675 is not present in Agent 10.0.0.254 2025-07-21 12:24:10,176 - INFO - Validated that VN ctest-analyzer_parent_port_vn-38618675 is not in any agent 2025-07-21 12:24:10,205 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-analyzer_parent_port_vn-38618675 info 2025-07-21 12:24:10,319 - INFO - Deleted port 89d6000e-f1b9-4623-b823-fa4bb2097fb3 2025-07-21 12:24:10,452 - DEBUG - Response for delete_port : () 2025-07-21 12:24:10,452 - INFO - Deleted port 298a8710-116a-4185-87d5-c10be94a5f07 2025-07-21 12:24:10,452 - INFO - Deleting VN ctest-dst_parent_port_vn-29713908 2025-07-21 12:24:10,577 - DEBUG - Response for deleting network () 2025-07-21 12:24:10,577 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/30179f2c-a781-45c3-ba63-d98fdbc67341 2025-07-21 12:24:10,586 - DEBUG - Response Code: 404 2025-07-21 12:24:10,586 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:10,593 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:10,655 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:10,763 - INFO - Validated that VN ctest-dst_parent_port_vn-29713908 is not found in API Server 2025-07-21 12:24:10,794 - DEBUG - VN ctest-dst_parent_port_vn-29713908 is not present in Agent 10.0.0.254 2025-07-21 12:24:10,794 - INFO - Validated that VN ctest-dst_parent_port_vn-29713908 is not in any agent 2025-07-21 12:24:10,825 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-dst_parent_port_vn-29713908 info 2025-07-21 12:24:10,946 - INFO - Deleted port 9b24d3b3-cc9a-43aa-bf1c-1ce3f432909c 2025-07-21 12:24:11,081 - DEBUG - Response for delete_port : () 2025-07-21 12:24:11,081 - INFO - Deleted port bde1e5b0-9e5f-4bd9-b28f-ab30407b3b37 2025-07-21 12:24:11,081 - INFO - Deleting VN ctest-src_parent_port_vn-90477164 2025-07-21 12:24:11,228 - DEBUG - Response for deleting network () 2025-07-21 12:24:11,228 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8ec66d8e-3dcb-48c9-9eb1-e77b5069235d 2025-07-21 12:24:11,235 - DEBUG - Response Code: 404 2025-07-21 12:24:11,236 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:11,247 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:11,273 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:11,376 - INFO - Validated that VN ctest-src_parent_port_vn-90477164 is not found in API Server 2025-07-21 12:24:11,405 - DEBUG - VN ctest-src_parent_port_vn-90477164 is not present in Agent 10.0.0.254 2025-07-21 12:24:11,405 - INFO - Validated that VN ctest-src_parent_port_vn-90477164 is not in any agent 2025-07-21 12:24:11,429 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-src_parent_port_vn-90477164 info 2025-07-21 12:24:11,429 - INFO - Dettaching policy ctest-vn2_vn3_pass-73458091 from vn ctest-vn3-44601164 2025-07-21 12:24:11,762 - INFO - Dettaching policy ctest-vn2_vn3_pass-73458091 from vn ctest-vn2-50821839 2025-07-21 12:24:12,170 - INFO - Dettaching policy ctest-vn1_vn3_pass-29041030 from vn ctest-vn3-44601164 2025-07-21 12:24:12,466 - INFO - Dettaching policy ctest-vn1_vn3_pass-29041030 from vn ctest-vn1-22952389 2025-07-21 12:24:12,938 - INFO - Dettaching policy ctest-vn1_vn2_pass-20999590 from vn ctest-vn2-50821839 2025-07-21 12:24:13,245 - INFO - Dettaching policy ctest-vn1_vn2_pass-20999590 from vn ctest-vn1-22952389 2025-07-21 12:24:13,646 - INFO - Deleted policy ctest-vn2_vn3_pass-73458091 2025-07-21 12:24:13,703 - INFO - Deleted policy ctest-vn1_vn3_pass-29041030 2025-07-21 12:24:13,771 - INFO - Deleted policy ctest-vn1_vn2_pass-20999590 2025-07-21 12:24:13,772 - INFO - Deleting VN ctest-vn3-44601164 2025-07-21 12:24:13,945 - DEBUG - Response for deleting network () 2025-07-21 12:24:13,945 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f418f00f-2e26-4fdf-b9b9-9239627645dc 2025-07-21 12:24:13,957 - DEBUG - Response Code: 404 2025-07-21 12:24:13,957 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:13,967 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:13,985 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:14,082 - INFO - Validated that VN ctest-vn3-44601164 is not found in API Server 2025-07-21 12:24:14,100 - DEBUG - VN ctest-vn3-44601164 is not present in Agent 10.0.0.254 2025-07-21 12:24:14,100 - INFO - Validated that VN ctest-vn3-44601164 is not in any agent 2025-07-21 12:24:14,130 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-44601164 info 2025-07-21 12:24:14,130 - INFO - Deleting VN ctest-vn2-50821839 2025-07-21 12:24:14,333 - DEBUG - Response for deleting network () 2025-07-21 12:24:14,333 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6b62edc3-6211-4392-bd70-479c0879ba4c 2025-07-21 12:24:14,341 - DEBUG - Response Code: 404 2025-07-21 12:24:14,342 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:14,349 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:14,419 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:14,554 - INFO - Validated that VN ctest-vn2-50821839 is not found in API Server 2025-07-21 12:24:14,583 - DEBUG - VN ctest-vn2-50821839 is not present in Agent 10.0.0.254 2025-07-21 12:24:14,583 - INFO - Validated that VN ctest-vn2-50821839 is not in any agent 2025-07-21 12:24:14,636 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-50821839 info 2025-07-21 12:24:14,637 - INFO - Deleting VN ctest-vn1-22952389 2025-07-21 12:24:14,921 - DEBUG - Response for deleting network () 2025-07-21 12:24:14,921 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2780bddc-12ed-42fc-b088-9e4dec8bcc27 2025-07-21 12:24:14,931 - DEBUG - Response Code: 404 2025-07-21 12:24:14,931 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:14,938 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:14,996 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:15,081 - INFO - Validated that VN ctest-vn1-22952389 is not found in API Server 2025-07-21 12:24:15,096 - DEBUG - VN ctest-vn1-22952389 is not present in Agent 10.0.0.254 2025-07-21 12:24:15,096 - INFO - Validated that VN ctest-vn1-22952389 is not in any agent 2025-07-21 12:24:15,137 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-22952389 info 2025-07-21 12:24:15,411 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 125, in test_intf_mirror_with_subintf_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3
    return self.verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3(sub_intf=True)
  File "/contrail-test/common/intf_mirroring/verify.py", line 85, in verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-21 12:24:15,423 - DEBUG - No XMPP flaps were noticed during the test 2025-07-21 12:24:15,424 - INFO - 2025-07-21 12:24:15,424 - INFO - END TEST : test_intf_mirror_with_subintf_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 : FAILED[0:02:06] 2025-07-21 12:24:15,424 - INFO - -------------------------------------------------------------------------------- 2025-07-21 12:24:15,431 - INFO - ================================================================================ 2025-07-21 12:24:15,432 - INFO - STARTING TEST : test_intf_mirroring_disable_enable_scenarios 2025-07-21 12:24:15,432 - INFO - TEST DESCRIPTION : Validate the interface mirroring Validate enable/disable combinations on parent/sub interface 1) Check pkts get mirrored from both sub intf and parent intf when enabled on both 2) Disable on sub intf and check pkts from parent still get mirrored 3) Enable on sub intf and verify step 1 4) Disable on parent and check pkts from sub intf still get mirrored 5) Enable on parent and verify step 1 2025-07-21 12:24:15,785 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-07-21 12:24:15,785 - INFO - Initial checks done. Running the testcase now 2025-07-21 12:24:15,786 - INFO - 2025-07-21 12:24:15,786 - INFO - src compute cn-jenkins-deploy-platform-ansible-os-3677-1 -> dst compute cn-jenkins-deploy-platform-ansible-os-3677-1 => analyzer compute cn-jenkins-deploy-platform-ansible-os-3677-1 2025-07-21 12:24:16,169 - DEBUG - Response for create_network : {'network': {'id': '0fd716ef-f126-4b12-a02a-1f15f7624f8a', 'name': 'ctest-vn1-19489453', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn1-19489453'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:24:16,433 - DEBUG - Response for create_subnet : {'subnet': {'id': '63e4f3d1-5048-423b-b9cc-8e167a2d2576', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '0fd716ef-f126-4b12-a02a-1f15f7624f8a', 'ip_version': 4, 'cidr': '7.172.151.64/26', 'allocation_pools': [{'start': '7.172.151.66', 'end': '7.172.151.126'}], 'gateway_ip': '7.172.151.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '7.172.151.66', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:16,465 - INFO - Created VN ctest-vn1-19489453 2025-07-21 12:24:16,529 - DEBUG - VN ctest-vn1-19489453 UUID is 0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:16,850 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:16,867 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:16,905 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:17,032 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:17,058 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:17,082 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eafeaa00-1910-4e16-8661-a359ed0a3b8f 2025-07-21 12:24:17,100 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eafeaa00-1910-4e16-8661-a359ed0a3b8f 2025-07-21 12:24:17,118 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/b3d9a9ae-df43-4e76-92d9-ad1ff373c02b 2025-07-21 12:24:17,135 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:24:17,135 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:17,164 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eafeaa00-1910-4e16-8661-a359ed0a3b8f 2025-07-21 12:24:17,212 - INFO - Verified VN network id 15 for VN 0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:17,212 - INFO - Verifications in API Server for VN ctest-vn1-19489453 passed 2025-07-21 12:24:17,213 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:17,246 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eafeaa00-1910-4e16-8661-a359ed0a3b8f 2025-07-21 12:24:17,270 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eafeaa00-1910-4e16-8661-a359ed0a3b8f 2025-07-21 12:24:17,294 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/b3d9a9ae-df43-4e76-92d9-ad1ff373c02b 2025-07-21 12:24:17,331 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1141406250360523538', 'uuid-lslong': '11541071174295506826'}, 'enable': 'true', 'created': '2025-07-21T12:24:16', 'last-modified': '2025-07-21T12:24:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.957103'} 2025-07-21 12:24:17,353 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:24:17,353 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-19489453 passed 2025-07-21 12:24:17,354 - DEBUG - ====Verifying policy data for ctest-vn1-19489453 in API_Server ====== 2025-07-21 12:24:17,354 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:17,372 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:17,414 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:17,555 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/0fd716ef-f126-4b12-a02a-1f15f7624f8a 2025-07-21 12:24:17,578 - DEBUG - =>VN ctest-vn1-19489453 has no policy to be verified 2025-07-21 12:24:17,578 - DEBUG - Verifying the vn in opserver 2025-07-21 12:24:17,578 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453 virtual network link through opserver 10.0.0.254 2025-07-21 12:24:17,578 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:24:17,714 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453?flat'} 2025-07-21 12:24:17,714 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453 is found in opserver 2025-07-21 12:24:17,749 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:24:17,766 - DEBUG - VRF ids for VN ctest-vn1-19489453: {} 2025-07-21 12:24:18,151 - DEBUG - Response for create_network : {'network': {'id': '14564a02-e876-4426-b4c4-0eb0a9ecb3f2', 'name': 'ctest-vn2-98696717', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn2-98696717'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:24:18,466 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fb7e212a-56c1-4cfb-9287-b02d3462efce', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '14564a02-e876-4426-b4c4-0eb0a9ecb3f2', 'ip_version': 4, 'cidr': '204.204.169.64/26', 'allocation_pools': [{'start': '204.204.169.66', 'end': '204.204.169.126'}], 'gateway_ip': '204.204.169.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '204.204.169.66', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:18,495 - INFO - Created VN ctest-vn2-98696717 2025-07-21 12:24:18,562 - DEBUG - VN ctest-vn2-98696717 UUID is 14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:18,713 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:18,730 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:18,763 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:18,887 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:18,909 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:18,934 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/187299fa-8313-461f-8d11-4c865aa3a4aa 2025-07-21 12:24:18,952 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/187299fa-8313-461f-8d11-4c865aa3a4aa 2025-07-21 12:24:18,970 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/430fa376-a4c7-45d7-88d4-07f214b81206 2025-07-21 12:24:18,986 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:24:18,986 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:19,013 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/187299fa-8313-461f-8d11-4c865aa3a4aa 2025-07-21 12:24:19,065 - INFO - Verified VN network id 16 for VN 14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:19,065 - INFO - Verifications in API Server for VN ctest-vn2-98696717 passed 2025-07-21 12:24:19,066 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:19,096 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/187299fa-8313-461f-8d11-4c865aa3a4aa 2025-07-21 12:24:19,117 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/187299fa-8313-461f-8d11-4c865aa3a4aa 2025-07-21 12:24:19,133 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/430fa376-a4c7-45d7-88d4-07f214b81206 2025-07-21 12:24:19,168 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1465440105106129958', 'uuid-lslong': '13025552174190212082'}, 'enable': 'true', 'created': '2025-07-21T12:24:18', 'last-modified': '2025-07-21T12:24:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.763175'} 2025-07-21 12:24:19,183 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:24:19,184 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-98696717 passed 2025-07-21 12:24:19,184 - DEBUG - ====Verifying policy data for ctest-vn2-98696717 in API_Server ====== 2025-07-21 12:24:19,184 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:19,195 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:19,217 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:19,339 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/14564a02-e876-4426-b4c4-0eb0a9ecb3f2 2025-07-21 12:24:19,368 - DEBUG - =>VN ctest-vn2-98696717 has no policy to be verified 2025-07-21 12:24:19,368 - DEBUG - Verifying the vn in opserver 2025-07-21 12:24:19,368 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717 virtual network link through opserver 10.0.0.254 2025-07-21 12:24:19,368 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:24:19,387 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717?flat'} 2025-07-21 12:24:19,388 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717 is found in opserver 2025-07-21 12:24:19,408 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:24:19,416 - DEBUG - VRF ids for VN ctest-vn2-98696717: {} 2025-07-21 12:24:19,677 - DEBUG - Response for create_network : {'network': {'id': 'd33610dc-ad28-4856-a773-0f68af4a7fe8', 'name': 'ctest-vn3-00724828', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn3-00724828'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:24:19,943 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a3a2392a-de94-4dac-868b-c86e0828d7fc', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'd33610dc-ad28-4856-a773-0f68af4a7fe8', 'ip_version': 4, 'cidr': '160.134.77.128/26', 'allocation_pools': [{'start': '160.134.77.130', 'end': '160.134.77.190'}], 'gateway_ip': '160.134.77.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '160.134.77.130', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:19,970 - INFO - Created VN ctest-vn3-00724828 2025-07-21 12:24:20,029 - DEBUG - VN ctest-vn3-00724828 UUID is d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,201 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:20,214 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:20,251 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:20,350 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,365 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,378 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b376243-b109-4a43-a394-e341bff894e2 2025-07-21 12:24:20,388 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b376243-b109-4a43-a394-e341bff894e2 2025-07-21 12:24:20,402 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/f8eb794e-019b-4f9b-83b9-f806c0276933 2025-07-21 12:24:20,412 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:24:20,412 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,428 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b376243-b109-4a43-a394-e341bff894e2 2025-07-21 12:24:20,450 - INFO - Verified VN network id 17 for VN d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,450 - INFO - Verifications in API Server for VN ctest-vn3-00724828 passed 2025-07-21 12:24:20,451 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,464 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b376243-b109-4a43-a394-e341bff894e2 2025-07-21 12:24:20,475 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b376243-b109-4a43-a394-e341bff894e2 2025-07-21 12:24:20,486 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/f8eb794e-019b-4f9b-83b9-f806c0276933 2025-07-21 12:24:20,508 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15219370530729117782', 'uuid-lslong': '12066004768947601384'}, 'enable': 'true', 'created': '2025-07-21T12:24:19', 'last-modified': '2025-07-21T12:24:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.617724'} 2025-07-21 12:24:20,522 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:24:20,522 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-00724828 passed 2025-07-21 12:24:20,522 - DEBUG - ====Verifying policy data for ctest-vn3-00724828 in API_Server ====== 2025-07-21 12:24:20,523 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:20,534 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:20,559 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:20,654 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/d33610dc-ad28-4856-a773-0f68af4a7fe8 2025-07-21 12:24:20,670 - DEBUG - =>VN ctest-vn3-00724828 has no policy to be verified 2025-07-21 12:24:20,670 - DEBUG - Verifying the vn in opserver 2025-07-21 12:24:20,670 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828 virtual network link through opserver 10.0.0.254 2025-07-21 12:24:20,670 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:24:20,686 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828?flat'} 2025-07-21 12:24:20,686 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828 is found in opserver 2025-07-21 12:24:20,702 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:24:20,710 - DEBUG - VRF ids for VN ctest-vn3-00724828: {} 2025-07-21 12:24:20,719 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:24:21,089 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-19489453, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:24:21,493 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-98696717, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:24:22,077 - INFO - Attaching policy ctest-vn1_vn2_pass-05397298 to vn ctest-vn1-19489453 2025-07-21 12:24:22,741 - INFO - Attaching policy ctest-vn1_vn2_pass-05397298 to vn ctest-vn2-98696717 2025-07-21 12:24:23,417 - INFO - Attaching policy ctest-vn1_vn3_pass-60765687 to vn ctest-vn1-19489453 2025-07-21 12:24:24,158 - INFO - Attaching policy ctest-vn1_vn3_pass-60765687 to vn ctest-vn3-00724828 2025-07-21 12:24:24,753 - INFO - Attaching policy ctest-vn2_vn3_pass-63114242 to vn ctest-vn2-98696717 2025-07-21 12:24:25,494 - INFO - Attaching policy ctest-vn2_vn3_pass-63114242 to vn ctest-vn3-00724828 2025-07-21 12:24:26,425 - DEBUG - Response for create_network : {'network': {'id': '30f637af-633e-4f6f-8111-1c86281dafaa', 'name': 'ctest-src_parent_port_vn-96009584', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-src_parent_port_vn-96009584'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:24:26,685 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e93b1f54-1c30-4089-a109-03958c7ab256', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '30f637af-633e-4f6f-8111-1c86281dafaa', 'ip_version': 4, 'cidr': '106.111.64.192/26', 'allocation_pools': [{'start': '106.111.64.194', 'end': '106.111.64.254'}], 'gateway_ip': '106.111.64.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '106.111.64.194', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:26,721 - INFO - Created VN ctest-src_parent_port_vn-96009584 2025-07-21 12:24:26,785 - DEBUG - VN ctest-src_parent_port_vn-96009584 UUID is 30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:26,929 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:26,942 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:26,977 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:27,102 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:27,123 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:27,157 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/13bfdae0-3650-4ecd-a644-d69247b9f462 2025-07-21 12:24:27,167 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/13bfdae0-3650-4ecd-a644-d69247b9f462 2025-07-21 12:24:27,175 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/03697068-ae49-44f6-ab4b-24b809c2b29b 2025-07-21 12:24:27,183 - DEBUG - Route Targets: ['target:64512:8000014'] 2025-07-21 12:24:27,184 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:27,195 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/13bfdae0-3650-4ecd-a644-d69247b9f462 2025-07-21 12:24:27,212 - INFO - Verified VN network id 18 for VN 30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:27,212 - INFO - Verifications in API Server for VN ctest-src_parent_port_vn-96009584 passed 2025-07-21 12:24:27,212 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:27,223 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/13bfdae0-3650-4ecd-a644-d69247b9f462 2025-07-21 12:24:27,233 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/13bfdae0-3650-4ecd-a644-d69247b9f462 2025-07-21 12:24:27,241 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/03697068-ae49-44f6-ab4b-24b809c2b29b 2025-07-21 12:24:27,259 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3528068584515194735', 'uuid-lslong': '9300246068021014442'}, 'enable': 'true', 'created': '2025-07-21T12:24:26', 'last-modified': '2025-07-21T12:24:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.621002'} 2025-07-21 12:24:27,269 - DEBUG - Route Targets: ['target:64512:8000014'] 2025-07-21 12:24:27,269 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-src_parent_port_vn-96009584 passed 2025-07-21 12:24:27,270 - DEBUG - ====Verifying policy data for ctest-src_parent_port_vn-96009584 in API_Server ====== 2025-07-21 12:24:27,270 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:27,278 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:27,298 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:27,417 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/30f637af-633e-4f6f-8111-1c86281dafaa 2025-07-21 12:24:27,447 - DEBUG - =>VN ctest-src_parent_port_vn-96009584 has no policy to be verified 2025-07-21 12:24:27,447 - DEBUG - Verifying the vn in opserver 2025-07-21 12:24:27,447 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584 virtual network link through opserver 10.0.0.254 2025-07-21 12:24:27,447 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:24:27,483 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584?flat'} 2025-07-21 12:24:27,483 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584 is found in opserver 2025-07-21 12:24:27,517 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:24:27,534 - DEBUG - VRF ids for VN ctest-src_parent_port_vn-96009584: {} 2025-07-21 12:24:27,535 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-65459157']} 2025-07-21 12:24:28,026 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-65459157', 'id': '017d69b3-e55d-4648-a3fe-d91f93b99beb', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '30f637af-633e-4f6f-8111-1c86281dafaa', 'mac_address': '02:01:7d:69:b3:e5', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '106.111.64.195', 'subnet_id': 'e93b1f54-1c30-4089-a109-03958c7ab256'}], 'security_groups': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:28,027 - DEBUG - Created port 017d69b3-e55d-4648-a3fe-d91f93b99beb 2025-07-21 12:24:28,162 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-24047610']} 2025-07-21 12:24:28,817 - DEBUG - Created port 3569abc4-4eab-4dda-9012-85ff80ad9e9a 2025-07-21 12:24:29,456 - DEBUG - Response for create_network : {'network': {'id': '2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4', 'name': 'ctest-dst_parent_port_vn-55306646', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-dst_parent_port_vn-55306646'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:24:29,753 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c230648e-582c-48fa-a789-1867cd39e855', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4', 'ip_version': 4, 'cidr': '218.85.236.192/26', 'allocation_pools': [{'start': '218.85.236.194', 'end': '218.85.236.254'}], 'gateway_ip': '218.85.236.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.85.236.194', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:29,787 - INFO - Created VN ctest-dst_parent_port_vn-55306646 2025-07-21 12:24:29,845 - DEBUG - VN ctest-dst_parent_port_vn-55306646 UUID is 2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,047 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:30,067 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:30,100 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:30,207 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,226 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,242 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f688cefa-eb1b-446b-986f-b4332f7c9a4e 2025-07-21 12:24:30,259 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f688cefa-eb1b-446b-986f-b4332f7c9a4e 2025-07-21 12:24:30,275 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/309dd0bc-ecf4-4241-bcf1-a5a395bca825 2025-07-21 12:24:30,286 - DEBUG - Route Targets: ['target:64512:8000015'] 2025-07-21 12:24:30,286 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,302 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f688cefa-eb1b-446b-986f-b4332f7c9a4e 2025-07-21 12:24:30,322 - INFO - Verified VN network id 19 for VN 2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,322 - INFO - Verifications in API Server for VN ctest-dst_parent_port_vn-55306646 passed 2025-07-21 12:24:30,323 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,337 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f688cefa-eb1b-446b-986f-b4332f7c9a4e 2025-07-21 12:24:30,345 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f688cefa-eb1b-446b-986f-b4332f7c9a4e 2025-07-21 12:24:30,354 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/309dd0bc-ecf4-4241-bcf1-a5a395bca825 2025-07-21 12:24:30,378 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3398458633265958387', 'uuid-lslong': '13806752408068029892'}, 'enable': 'true', 'created': '2025-07-21T12:24:29', 'last-modified': '2025-07-21T12:24:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.670437'} 2025-07-21 12:24:30,397 - DEBUG - Route Targets: ['target:64512:8000015'] 2025-07-21 12:24:30,397 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-dst_parent_port_vn-55306646 passed 2025-07-21 12:24:30,399 - DEBUG - ====Verifying policy data for ctest-dst_parent_port_vn-55306646 in API_Server ====== 2025-07-21 12:24:30,399 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:30,417 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:30,433 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:30,521 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4 2025-07-21 12:24:30,535 - DEBUG - =>VN ctest-dst_parent_port_vn-55306646 has no policy to be verified 2025-07-21 12:24:30,535 - DEBUG - Verifying the vn in opserver 2025-07-21 12:24:30,535 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646 virtual network link through opserver 10.0.0.254 2025-07-21 12:24:30,535 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:24:30,549 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646?flat'} 2025-07-21 12:24:30,549 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646 is found in opserver 2025-07-21 12:24:30,584 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:24:30,593 - DEBUG - VRF ids for VN ctest-dst_parent_port_vn-55306646: {} 2025-07-21 12:24:30,593 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-48627437']} 2025-07-21 12:24:30,902 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-48627437', 'id': 'adb72b88-9305-4165-bf1f-87535b21a5b5', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '2f29c01f-03ad-4df3-bf9b-7029f0a9fdc4', 'mac_address': '02:ad:b7:2b:88:93', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '218.85.236.195', 'subnet_id': 'c230648e-582c-48fa-a789-1867cd39e855'}], 'security_groups': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:30,903 - DEBUG - Created port adb72b88-9305-4165-bf1f-87535b21a5b5 2025-07-21 12:24:31,009 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-28488224']} 2025-07-21 12:24:31,661 - DEBUG - Created port 0e735320-d14e-4180-b21f-35730b160cde 2025-07-21 12:24:32,296 - DEBUG - Response for create_network : {'network': {'id': '4e39b8d1-1429-44de-b659-3b1c0928ce17', 'name': 'ctest-analyzer_parent_port_vn-87472981', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-analyzer_parent_port_vn-87472981'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:24:32,692 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e566f9ef-1e2d-4986-adcf-acae4733cae7', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '4e39b8d1-1429-44de-b659-3b1c0928ce17', 'ip_version': 4, 'cidr': '159.25.123.64/26', 'allocation_pools': [{'start': '159.25.123.66', 'end': '159.25.123.126'}], 'gateway_ip': '159.25.123.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '159.25.123.66', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:32,730 - INFO - Created VN ctest-analyzer_parent_port_vn-87472981 2025-07-21 12:24:32,802 - DEBUG - VN ctest-analyzer_parent_port_vn-87472981 UUID is 4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:32,992 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:33,008 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:33,034 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:33,143 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:33,174 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:33,199 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cc0f07e3-048c-44c3-bf18-a8894cc77a21 2025-07-21 12:24:33,218 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cc0f07e3-048c-44c3-bf18-a8894cc77a21 2025-07-21 12:24:33,243 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/efb2cdaf-49ed-4211-8102-da898cbd8d57 2025-07-21 12:24:33,266 - DEBUG - Route Targets: ['target:64512:8000016'] 2025-07-21 12:24:33,267 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:33,300 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cc0f07e3-048c-44c3-bf18-a8894cc77a21 2025-07-21 12:24:33,349 - INFO - Verified VN network id 20 for VN 4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:33,349 - INFO - Verifications in API Server for VN ctest-analyzer_parent_port_vn-87472981 passed 2025-07-21 12:24:33,350 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:33,375 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cc0f07e3-048c-44c3-bf18-a8894cc77a21 2025-07-21 12:24:33,397 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cc0f07e3-048c-44c3-bf18-a8894cc77a21 2025-07-21 12:24:33,408 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/efb2cdaf-49ed-4211-8102-da898cbd8d57 2025-07-21 12:24:33,438 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-87472981', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5636739616756810974', 'uuid-lslong': '13139598379428924951'}, 'enable': 'true', 'created': '2025-07-21T12:24:32', 'last-modified': '2025-07-21T12:24:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.896642'} 2025-07-21 12:24:33,461 - DEBUG - Route Targets: ['target:64512:8000016'] 2025-07-21 12:24:33,462 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-analyzer_parent_port_vn-87472981 passed 2025-07-21 12:24:33,462 - DEBUG - ====Verifying policy data for ctest-analyzer_parent_port_vn-87472981 in API_Server ====== 2025-07-21 12:24:33,463 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:24:33,479 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:24:33,512 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:24:33,657 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4e39b8d1-1429-44de-b659-3b1c0928ce17 2025-07-21 12:24:33,687 - DEBUG - =>VN ctest-analyzer_parent_port_vn-87472981 has no policy to be verified 2025-07-21 12:24:33,687 - DEBUG - Verifying the vn in opserver 2025-07-21 12:24:33,687 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-87472981 virtual network link through opserver 10.0.0.254 2025-07-21 12:24:33,688 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:24:33,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-87472981', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-87472981?flat'} 2025-07-21 12:24:33,722 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-analyzer_parent_port_vn-87472981 is found in opserver 2025-07-21 12:24:33,754 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:24:33,771 - DEBUG - VRF ids for VN ctest-analyzer_parent_port_vn-87472981: {} 2025-07-21 12:24:33,772 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-84806407']} 2025-07-21 12:24:34,195 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-84806407', 'id': 'ef70eaf5-dcd7-4df1-9234-0a40021423e4', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '4e39b8d1-1429-44de-b659-3b1c0928ce17', 'mac_address': '02:ef:70:ea:f5:dc', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '159.25.123.67', 'subnet_id': 'e566f9ef-1e2d-4986-adcf-acae4733cae7'}], 'security_groups': ['2f650583-f881-4dbe-946a-b1081b3d42e3'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:24:34,195 - DEBUG - Created port ef70eaf5-dcd7-4df1-9234-0a40021423e4 2025-07-21 12:24:34,325 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vmi-47362938']} 2025-07-21 12:24:34,976 - DEBUG - Created port 4d38ef3c-209e-4452-8360-9cac8d3ade98 2025-07-21 12:24:35,234 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:24:35,702 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-00724828, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:24:36,137 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-src_parent_port_vn-96009584, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-dst_parent_port_vn-55306646, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:24:36,717 - INFO - Attaching policy ctest-src_parent_to_analyzer_pass-42571221 to vn ctest-vn3-00724828 2025-07-21 12:24:37,585 - INFO - Attaching policy ctest-src_parent_to_analyzer_pass-42571221 to vn ctest-src_parent_port_vn-96009584 2025-07-21 12:24:38,221 - INFO - Attaching policy ctest-dst_parent_to_analyzer_pass-02833265 to vn ctest-vn3-00724828 2025-07-21 12:24:39,233 - INFO - Attaching policy ctest-dst_parent_to_analyzer_pass-02833265 to vn ctest-dst_parent_port_vn-55306646 2025-07-21 12:24:39,845 - INFO - Attaching policy ctest-src_parent_to_dst_parent_pass-81545015 to vn ctest-src_parent_port_vn-96009584 2025-07-21 12:24:40,597 - INFO - Attaching policy ctest-src_parent_to_dst_parent_pass-81545015 to vn ctest-dst_parent_port_vn-55306646 2025-07-21 12:26:22,032 - DEBUG - Installing image ubuntu 2025-07-21 12:26:22,033 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-21 12:26:22,034 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:26:22,035 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:26:22,035 - DEBUG - Unzip image 2025-07-21 12:26:22,035 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:26:22,069 - DEBUG - Try to create image in user context 2025-07-21 12:26:22,237 - INFO - Dettaching policy ctest-src_parent_to_dst_parent_pass-81545015 from vn ctest-dst_parent_port_vn-55306646 2025-07-21 12:26:22,582 - INFO - Dettaching policy ctest-src_parent_to_dst_parent_pass-81545015 from vn ctest-src_parent_port_vn-96009584 2025-07-21 12:26:23,013 - INFO - Dettaching policy ctest-dst_parent_to_analyzer_pass-02833265 from vn ctest-dst_parent_port_vn-55306646 2025-07-21 12:26:23,285 - INFO - Dettaching policy ctest-dst_parent_to_analyzer_pass-02833265 from vn ctest-vn3-00724828 2025-07-21 12:26:23,825 - INFO - Dettaching policy ctest-src_parent_to_analyzer_pass-42571221 from vn ctest-src_parent_port_vn-96009584 2025-07-21 12:26:24,129 - INFO - Dettaching policy ctest-src_parent_to_analyzer_pass-42571221 from vn ctest-vn3-00724828 2025-07-21 12:26:24,739 - INFO - Deleted policy ctest-src_parent_to_dst_parent_pass-81545015 2025-07-21 12:26:24,803 - INFO - Deleted policy ctest-dst_parent_to_analyzer_pass-02833265 2025-07-21 12:26:24,850 - INFO - Deleted policy ctest-src_parent_to_analyzer_pass-42571221 2025-07-21 12:26:24,950 - INFO - Deleted port 4d38ef3c-209e-4452-8360-9cac8d3ade98 2025-07-21 12:26:25,069 - DEBUG - Response for delete_port : () 2025-07-21 12:26:25,069 - INFO - Deleted port ef70eaf5-dcd7-4df1-9234-0a40021423e4 2025-07-21 12:26:25,070 - INFO - Deleting VN ctest-analyzer_parent_port_vn-87472981 2025-07-21 12:26:25,206 - DEBUG - Response for deleting network () 2025-07-21 12:26:25,207 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/cc0f07e3-048c-44c3-bf18-a8894cc77a21 2025-07-21 12:26:25,214 - DEBUG - Response Code: 404 2025-07-21 12:26:25,214 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:25,230 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:25,289 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:25,398 - INFO - Validated that VN ctest-analyzer_parent_port_vn-87472981 is not found in API Server 2025-07-21 12:26:25,412 - DEBUG - VN ctest-analyzer_parent_port_vn-87472981 is not present in Agent 10.0.0.254 2025-07-21 12:26:25,412 - INFO - Validated that VN ctest-analyzer_parent_port_vn-87472981 is not in any agent 2025-07-21 12:26:25,430 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-analyzer_parent_port_vn-87472981 info 2025-07-21 12:26:25,541 - INFO - Deleted port 0e735320-d14e-4180-b21f-35730b160cde 2025-07-21 12:26:25,659 - DEBUG - Response for delete_port : () 2025-07-21 12:26:25,659 - INFO - Deleted port adb72b88-9305-4165-bf1f-87535b21a5b5 2025-07-21 12:26:25,659 - INFO - Deleting VN ctest-dst_parent_port_vn-55306646 2025-07-21 12:26:25,796 - DEBUG - Response for deleting network () 2025-07-21 12:26:25,796 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/f688cefa-eb1b-446b-986f-b4332f7c9a4e 2025-07-21 12:26:25,806 - DEBUG - Response Code: 404 2025-07-21 12:26:25,806 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:25,812 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:25,868 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:25,979 - INFO - Validated that VN ctest-dst_parent_port_vn-55306646 is not found in API Server 2025-07-21 12:26:26,002 - DEBUG - VN ctest-dst_parent_port_vn-55306646 is not present in Agent 10.0.0.254 2025-07-21 12:26:26,002 - INFO - Validated that VN ctest-dst_parent_port_vn-55306646 is not in any agent 2025-07-21 12:26:26,034 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-dst_parent_port_vn-55306646 info 2025-07-21 12:26:26,155 - INFO - Deleted port 3569abc4-4eab-4dda-9012-85ff80ad9e9a 2025-07-21 12:26:26,265 - DEBUG - Response for delete_port : () 2025-07-21 12:26:26,265 - INFO - Deleted port 017d69b3-e55d-4648-a3fe-d91f93b99beb 2025-07-21 12:26:26,266 - INFO - Deleting VN ctest-src_parent_port_vn-96009584 2025-07-21 12:26:26,397 - DEBUG - Response for deleting network () 2025-07-21 12:26:26,397 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/13bfdae0-3650-4ecd-a644-d69247b9f462 2025-07-21 12:26:26,403 - DEBUG - Response Code: 404 2025-07-21 12:26:26,404 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:26,409 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:26,468 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:26,588 - INFO - Validated that VN ctest-src_parent_port_vn-96009584 is not found in API Server 2025-07-21 12:26:26,616 - DEBUG - VN ctest-src_parent_port_vn-96009584 is not present in Agent 10.0.0.254 2025-07-21 12:26:26,616 - INFO - Validated that VN ctest-src_parent_port_vn-96009584 is not in any agent 2025-07-21 12:26:26,669 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-src_parent_port_vn-96009584 info 2025-07-21 12:26:26,669 - INFO - Dettaching policy ctest-vn2_vn3_pass-63114242 from vn ctest-vn3-00724828 2025-07-21 12:26:27,117 - INFO - Dettaching policy ctest-vn2_vn3_pass-63114242 from vn ctest-vn2-98696717 2025-07-21 12:26:27,573 - INFO - Dettaching policy ctest-vn1_vn3_pass-60765687 from vn ctest-vn3-00724828 2025-07-21 12:26:27,885 - INFO - Dettaching policy ctest-vn1_vn3_pass-60765687 from vn ctest-vn1-19489453 2025-07-21 12:26:28,350 - INFO - Dettaching policy ctest-vn1_vn2_pass-05397298 from vn ctest-vn2-98696717 2025-07-21 12:26:28,625 - INFO - Dettaching policy ctest-vn1_vn2_pass-05397298 from vn ctest-vn1-19489453 2025-07-21 12:26:28,995 - INFO - Deleted policy ctest-vn2_vn3_pass-63114242 2025-07-21 12:26:29,047 - INFO - Deleted policy ctest-vn1_vn3_pass-60765687 2025-07-21 12:26:29,098 - INFO - Deleted policy ctest-vn1_vn2_pass-05397298 2025-07-21 12:26:29,099 - INFO - Deleting VN ctest-vn3-00724828 2025-07-21 12:26:29,267 - DEBUG - Response for deleting network () 2025-07-21 12:26:29,267 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8b376243-b109-4a43-a394-e341bff894e2 2025-07-21 12:26:29,277 - DEBUG - Response Code: 404 2025-07-21 12:26:29,277 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:29,285 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:29,351 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:29,475 - INFO - Validated that VN ctest-vn3-00724828 is not found in API Server 2025-07-21 12:26:29,496 - DEBUG - VN ctest-vn3-00724828 is not present in Agent 10.0.0.254 2025-07-21 12:26:29,496 - INFO - Validated that VN ctest-vn3-00724828 is not in any agent 2025-07-21 12:26:29,530 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-00724828 info 2025-07-21 12:26:29,531 - INFO - Deleting VN ctest-vn2-98696717 2025-07-21 12:26:29,768 - DEBUG - Response for deleting network () 2025-07-21 12:26:29,769 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/187299fa-8313-461f-8d11-4c865aa3a4aa 2025-07-21 12:26:29,779 - DEBUG - Response Code: 404 2025-07-21 12:26:29,780 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:29,791 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:29,851 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:29,976 - INFO - Validated that VN ctest-vn2-98696717 is not found in API Server 2025-07-21 12:26:29,999 - DEBUG - VN ctest-vn2-98696717 is not present in Agent 10.0.0.254 2025-07-21 12:26:30,000 - INFO - Validated that VN ctest-vn2-98696717 is not in any agent 2025-07-21 12:26:30,040 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-98696717 info 2025-07-21 12:26:30,040 - INFO - Deleting VN ctest-vn1-19489453 2025-07-21 12:26:30,272 - DEBUG - Response for deleting network () 2025-07-21 12:26:30,272 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/eafeaa00-1910-4e16-8661-a359ed0a3b8f 2025-07-21 12:26:30,280 - DEBUG - Response Code: 404 2025-07-21 12:26:30,281 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:30,296 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:30,309 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:30,413 - INFO - Validated that VN ctest-vn1-19489453 is not found in API Server 2025-07-21 12:26:30,432 - DEBUG - VN ctest-vn1-19489453 is not present in Agent 10.0.0.254 2025-07-21 12:26:30,432 - INFO - Validated that VN ctest-vn1-19489453 is not in any agent 2025-07-21 12:26:30,465 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-19489453 info 2025-07-21 12:26:30,767 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 31, in test_intf_mirroring_disable_enable_scenarios
    return self.verify_intf_mirroring_disable_enable_scenarios()
  File "/contrail-test/common/intf_mirroring/verify.py", line 61, in verify_intf_mirroring_disable_enable_scenarios
    return self.verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3(sub_intf=True, parent_intf=True)
  File "/contrail-test/common/intf_mirroring/verify.py", line 85, in verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-21 12:26:30,782 - DEBUG - No XMPP flaps were noticed during the test 2025-07-21 12:26:30,783 - INFO - 2025-07-21 12:26:30,783 - INFO - END TEST : test_intf_mirroring_disable_enable_scenarios : FAILED[0:02:15] 2025-07-21 12:26:30,783 - INFO - -------------------------------------------------------------------------------- 2025-07-21 12:26:30,797 - INFO - ================================================================================ 2025-07-21 12:26:30,798 - INFO - STARTING TEST : test_juniper_header 2025-07-21 12:26:30,798 - INFO - TEST DESCRIPTION : Validate the presence of juniper header 1) Check pkts get mirrored from both sub intf and parent intf when enabled on both 2) Verify if the juniper header is correct 3) Verify if the inner header is correct 2025-07-21 12:26:31,121 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-07-21 12:26:31,121 - INFO - Initial checks done. Running the testcase now 2025-07-21 12:26:31,121 - INFO - 2025-07-21 12:26:31,122 - INFO - src compute cn-jenkins-deploy-platform-ansible-os-3677-1 -> dst compute cn-jenkins-deploy-platform-ansible-os-3677-1 => analyzer compute cn-jenkins-deploy-platform-ansible-os-3677-1 2025-07-21 12:26:31,449 - DEBUG - Response for create_network : {'network': {'id': '64e7650a-98cb-4ea2-86a9-6d36301dae64', 'name': 'ctest-vn1-76860295', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn1-76860295'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:26:31,683 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b30853e4-cf4e-4cbc-9bb6-1f329cff50b0', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '64e7650a-98cb-4ea2-86a9-6d36301dae64', 'ip_version': 4, 'cidr': '160.112.247.64/26', 'allocation_pools': [{'start': '160.112.247.66', 'end': '160.112.247.126'}], 'gateway_ip': '160.112.247.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '160.112.247.66', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:26:31,708 - INFO - Created VN ctest-vn1-76860295 2025-07-21 12:26:31,765 - DEBUG - VN ctest-vn1-76860295 UUID is 64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:31,923 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:31,937 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:31,979 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:32,070 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:32,086 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:32,101 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c4b5bb3b-de17-42de-8a48-7b01bb18b4d3 2025-07-21 12:26:32,111 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c4b5bb3b-de17-42de-8a48-7b01bb18b4d3 2025-07-21 12:26:32,123 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/d2dd8b53-b068-44ab-a80b-99ff949ad436 2025-07-21 12:26:32,132 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:26:32,132 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:32,147 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c4b5bb3b-de17-42de-8a48-7b01bb18b4d3 2025-07-21 12:26:32,172 - INFO - Verified VN network id 15 for VN 64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:32,172 - INFO - Verifications in API Server for VN ctest-vn1-76860295 passed 2025-07-21 12:26:32,173 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:32,191 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c4b5bb3b-de17-42de-8a48-7b01bb18b4d3 2025-07-21 12:26:32,207 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c4b5bb3b-de17-42de-8a48-7b01bb18b4d3 2025-07-21 12:26:32,221 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/d2dd8b53-b068-44ab-a80b-99ff949ad436 2025-07-21 12:26:32,252 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7270891219600494242', 'uuid-lslong': '9703406951649357412'}, 'enable': 'true', 'created': '2025-07-21T12:26:31', 'last-modified': '2025-07-21T12:26:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.615840'} 2025-07-21 12:26:32,267 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:26:32,268 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-76860295 passed 2025-07-21 12:26:32,268 - DEBUG - ====Verifying policy data for ctest-vn1-76860295 in API_Server ====== 2025-07-21 12:26:32,268 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:32,279 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:32,307 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:32,447 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/64e7650a-98cb-4ea2-86a9-6d36301dae64 2025-07-21 12:26:32,470 - DEBUG - =>VN ctest-vn1-76860295 has no policy to be verified 2025-07-21 12:26:32,470 - DEBUG - Verifying the vn in opserver 2025-07-21 12:26:32,470 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295 virtual network link through opserver 10.0.0.254 2025-07-21 12:26:32,470 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:26:32,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295?flat'} 2025-07-21 12:26:32,497 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295 is found in opserver 2025-07-21 12:26:32,532 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:26:32,544 - DEBUG - VRF ids for VN ctest-vn1-76860295: {} 2025-07-21 12:26:32,864 - DEBUG - Response for create_network : {'network': {'id': 'ea2f80ae-57e2-4d52-accf-72ba3db00845', 'name': 'ctest-vn2-48375051', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn2-48375051'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:26:33,102 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f64e2198-02d8-4475-8701-717467983bc4', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'ea2f80ae-57e2-4d52-accf-72ba3db00845', 'ip_version': 4, 'cidr': '41.69.132.128/26', 'allocation_pools': [{'start': '41.69.132.130', 'end': '41.69.132.190'}], 'gateway_ip': '41.69.132.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.69.132.130', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:26:33,128 - INFO - Created VN ctest-vn2-48375051 2025-07-21 12:26:33,193 - DEBUG - VN ctest-vn2-48375051 UUID is ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,368 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:33,387 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:33,427 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:33,560 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,591 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,623 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/67d02c2a-14a0-4ee0-8b8f-6623d7cbe3af 2025-07-21 12:26:33,646 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/67d02c2a-14a0-4ee0-8b8f-6623d7cbe3af 2025-07-21 12:26:33,669 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/da947feb-7331-4180-8ea6-2d1575719da7 2025-07-21 12:26:33,691 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:26:33,692 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,726 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/67d02c2a-14a0-4ee0-8b8f-6623d7cbe3af 2025-07-21 12:26:33,767 - INFO - Verified VN network id 16 for VN ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,767 - INFO - Verifications in API Server for VN ctest-vn2-48375051 passed 2025-07-21 12:26:33,767 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,785 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/67d02c2a-14a0-4ee0-8b8f-6623d7cbe3af 2025-07-21 12:26:33,797 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/67d02c2a-14a0-4ee0-8b8f-6623d7cbe3af 2025-07-21 12:26:33,807 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/da947feb-7331-4180-8ea6-2d1575719da7 2025-07-21 12:26:33,825 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16874847815067651410', 'uuid-lslong': '12452297638927140933'}, 'enable': 'true', 'created': '2025-07-21T12:26:32', 'last-modified': '2025-07-21T12:26:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.786382'} 2025-07-21 12:26:33,836 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:26:33,837 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-48375051 passed 2025-07-21 12:26:33,837 - DEBUG - ====Verifying policy data for ctest-vn2-48375051 in API_Server ====== 2025-07-21 12:26:33,837 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:33,844 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:33,861 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:33,948 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/ea2f80ae-57e2-4d52-accf-72ba3db00845 2025-07-21 12:26:33,968 - DEBUG - =>VN ctest-vn2-48375051 has no policy to be verified 2025-07-21 12:26:33,968 - DEBUG - Verifying the vn in opserver 2025-07-21 12:26:33,968 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051 virtual network link through opserver 10.0.0.254 2025-07-21 12:26:33,968 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:26:33,988 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051?flat'} 2025-07-21 12:26:33,988 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051 is found in opserver 2025-07-21 12:26:34,008 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:26:34,016 - DEBUG - VRF ids for VN ctest-vn2-48375051: {} 2025-07-21 12:26:34,273 - DEBUG - Response for create_network : {'network': {'id': '5ac187dc-9474-4c01-97d4-a6fa99368c3a', 'name': 'ctest-vn3-96396511', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn3-96396511'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:26:34,546 - DEBUG - Response for create_subnet : {'subnet': {'id': 'da8f0ee4-5834-45c9-8e3b-0bf631a60951', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '5ac187dc-9474-4c01-97d4-a6fa99368c3a', 'ip_version': 4, 'cidr': '164.127.163.128/26', 'allocation_pools': [{'start': '164.127.163.130', 'end': '164.127.163.190'}], 'gateway_ip': '164.127.163.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '164.127.163.130', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:26:34,572 - INFO - Created VN ctest-vn3-96396511 2025-07-21 12:26:34,637 - DEBUG - VN ctest-vn3-96396511 UUID is 5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:34,791 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:34,809 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:34,845 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:34,978 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:35,004 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:35,038 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/09db0a8c-66ff-42ec-afff-d174e95b3c47 2025-07-21 12:26:35,061 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/09db0a8c-66ff-42ec-afff-d174e95b3c47 2025-07-21 12:26:35,081 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8287e9a0-bb40-4ad0-ab74-d447b5c67fee 2025-07-21 12:26:35,097 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:26:35,098 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:35,125 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/09db0a8c-66ff-42ec-afff-d174e95b3c47 2025-07-21 12:26:35,174 - INFO - Verified VN network id 17 for VN 5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:35,174 - INFO - Verifications in API Server for VN ctest-vn3-96396511 passed 2025-07-21 12:26:35,175 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:35,210 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/09db0a8c-66ff-42ec-afff-d174e95b3c47 2025-07-21 12:26:35,235 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/09db0a8c-66ff-42ec-afff-d174e95b3c47 2025-07-21 12:26:35,259 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8287e9a0-bb40-4ad0-ab74-d447b5c67fee 2025-07-21 12:26:35,304 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6539657515371875329', 'uuid-lslong': '10940552990032301114'}, 'enable': 'true', 'created': '2025-07-21T12:26:34', 'last-modified': '2025-07-21T12:26:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.813750'} 2025-07-21 12:26:35,327 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:26:35,327 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-96396511 passed 2025-07-21 12:26:35,328 - DEBUG - ====Verifying policy data for ctest-vn3-96396511 in API_Server ====== 2025-07-21 12:26:35,328 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:26:35,346 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:26:35,380 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:26:35,502 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/5ac187dc-9474-4c01-97d4-a6fa99368c3a 2025-07-21 12:26:35,523 - DEBUG - =>VN ctest-vn3-96396511 has no policy to be verified 2025-07-21 12:26:35,523 - DEBUG - Verifying the vn in opserver 2025-07-21 12:26:35,523 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511 virtual network link through opserver 10.0.0.254 2025-07-21 12:26:35,523 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:26:35,549 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511?flat'} 2025-07-21 12:26:35,549 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511 is found in opserver 2025-07-21 12:26:35,576 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:26:35,587 - DEBUG - VRF ids for VN ctest-vn3-96396511: {} 2025-07-21 12:26:35,602 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:26:36,017 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-76860295, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:26:36,457 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-48375051, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-96396511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:26:37,073 - INFO - Attaching policy ctest-vn1_vn2_pass-48832325 to vn ctest-vn1-76860295 2025-07-21 12:26:37,766 - INFO - Attaching policy ctest-vn1_vn2_pass-48832325 to vn ctest-vn2-48375051 2025-07-21 12:26:38,457 - INFO - Attaching policy ctest-vn1_vn3_pass-88732045 to vn ctest-vn1-76860295 2025-07-21 12:26:39,237 - INFO - Attaching policy ctest-vn1_vn3_pass-88732045 to vn ctest-vn3-96396511 2025-07-21 12:26:39,870 - INFO - Attaching policy ctest-vn2_vn3_pass-86641731 to vn ctest-vn2-48375051 2025-07-21 12:26:40,605 - INFO - Attaching policy ctest-vn2_vn3_pass-86641731 to vn ctest-vn3-96396511 2025-07-21 12:28:22,180 - DEBUG - Installing image ubuntu 2025-07-21 12:28:22,181 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-21 12:28:22,181 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:28:22,181 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:28:22,181 - DEBUG - Unzip image 2025-07-21 12:28:22,181 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:28:22,194 - DEBUG - Try to create image in user context 2025-07-21 12:28:22,258 - INFO - Dettaching policy ctest-vn2_vn3_pass-86641731 from vn ctest-vn3-96396511 2025-07-21 12:28:22,581 - INFO - Dettaching policy ctest-vn2_vn3_pass-86641731 from vn ctest-vn2-48375051 2025-07-21 12:28:23,038 - INFO - Dettaching policy ctest-vn1_vn3_pass-88732045 from vn ctest-vn3-96396511 2025-07-21 12:28:23,329 - INFO - Dettaching policy ctest-vn1_vn3_pass-88732045 from vn ctest-vn1-76860295 2025-07-21 12:28:23,722 - INFO - Dettaching policy ctest-vn1_vn2_pass-48832325 from vn ctest-vn2-48375051 2025-07-21 12:28:24,049 - INFO - Dettaching policy ctest-vn1_vn2_pass-48832325 from vn ctest-vn1-76860295 2025-07-21 12:28:24,387 - INFO - Deleted policy ctest-vn2_vn3_pass-86641731 2025-07-21 12:28:24,446 - INFO - Deleted policy ctest-vn1_vn3_pass-88732045 2025-07-21 12:28:24,487 - INFO - Deleted policy ctest-vn1_vn2_pass-48832325 2025-07-21 12:28:24,488 - INFO - Deleting VN ctest-vn3-96396511 2025-07-21 12:28:24,629 - DEBUG - Response for deleting network () 2025-07-21 12:28:24,629 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/09db0a8c-66ff-42ec-afff-d174e95b3c47 2025-07-21 12:28:24,638 - DEBUG - Response Code: 404 2025-07-21 12:28:24,639 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:24,646 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:24,706 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:24,833 - INFO - Validated that VN ctest-vn3-96396511 is not found in API Server 2025-07-21 12:28:24,871 - DEBUG - VN ctest-vn3-96396511 is not present in Agent 10.0.0.254 2025-07-21 12:28:24,871 - INFO - Validated that VN ctest-vn3-96396511 is not in any agent 2025-07-21 12:28:24,931 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-96396511 info 2025-07-21 12:28:24,931 - INFO - Deleting VN ctest-vn2-48375051 2025-07-21 12:28:25,168 - DEBUG - Response for deleting network () 2025-07-21 12:28:25,169 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/67d02c2a-14a0-4ee0-8b8f-6623d7cbe3af 2025-07-21 12:28:25,179 - DEBUG - Response Code: 404 2025-07-21 12:28:25,179 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:25,196 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:25,219 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:25,333 - INFO - Validated that VN ctest-vn2-48375051 is not found in API Server 2025-07-21 12:28:25,359 - DEBUG - VN ctest-vn2-48375051 is not present in Agent 10.0.0.254 2025-07-21 12:28:25,359 - INFO - Validated that VN ctest-vn2-48375051 is not in any agent 2025-07-21 12:28:25,406 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-48375051 info 2025-07-21 12:28:25,407 - INFO - Deleting VN ctest-vn1-76860295 2025-07-21 12:28:25,601 - DEBUG - Response for deleting network () 2025-07-21 12:28:25,601 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/c4b5bb3b-de17-42de-8a48-7b01bb18b4d3 2025-07-21 12:28:25,610 - DEBUG - Response Code: 404 2025-07-21 12:28:25,610 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:25,619 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:25,679 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:25,787 - INFO - Validated that VN ctest-vn1-76860295 is not found in API Server 2025-07-21 12:28:25,806 - DEBUG - VN ctest-vn1-76860295 is not present in Agent 10.0.0.254 2025-07-21 12:28:25,806 - INFO - Validated that VN ctest-vn1-76860295 is not in any agent 2025-07-21 12:28:25,842 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-76860295 info 2025-07-21 12:28:26,150 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/tcutils/util.py", line 1041, in wrapper
    return f(self, *func_args, **func_kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 42, in test_juniper_header
    return self.verify_juniper_header_testcase(header = 2)
  File "/contrail-test/common/intf_mirroring/verify.py", line 77, in verify_juniper_header_testcase
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, header = header, nh_mode=nh_mode, direction = direction, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-21 12:28:26,171 - DEBUG - No XMPP flaps were noticed during the test 2025-07-21 12:28:26,171 - INFO - 2025-07-21 12:28:26,171 - INFO - END TEST : test_juniper_header : FAILED[0:01:56] 2025-07-21 12:28:26,172 - INFO - -------------------------------------------------------------------------------- 2025-07-21 12:28:26,184 - INFO - ================================================================================ 2025-07-21 12:28:26,184 - INFO - STARTING TEST : test_juniper_header_without_header_ingress 2025-07-21 12:28:26,184 - INFO - TEST DESCRIPTION : Validate the presence of no juniper header 1) Check pkts get mirrored from both sub intf and parent intf when enabled on both 2) Verify if the juniper header is absent 3) Verify if the inner header is correct 2025-07-21 12:28:26,511 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.17': '0'}} with 2025-07-21 12:28:26,511 - INFO - Initial checks done. Running the testcase now 2025-07-21 12:28:26,511 - INFO - 2025-07-21 12:28:26,511 - INFO - src compute cn-jenkins-deploy-platform-ansible-os-3677-1 -> dst compute cn-jenkins-deploy-platform-ansible-os-3677-1 => analyzer compute cn-jenkins-deploy-platform-ansible-os-3677-1 2025-07-21 12:28:26,919 - DEBUG - Response for create_network : {'network': {'id': '6f69875f-9592-490c-8752-b225ad302955', 'name': 'ctest-vn1-39202939', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn1-39202939'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:28:27,200 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e353b537-b01e-42a5-a246-333ff2a4d1bd', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '6f69875f-9592-490c-8752-b225ad302955', 'ip_version': 4, 'cidr': '170.165.61.0/26', 'allocation_pools': [{'start': '170.165.61.2', 'end': '170.165.61.62'}], 'gateway_ip': '170.165.61.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '170.165.61.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:28:27,240 - INFO - Created VN ctest-vn1-39202939 2025-07-21 12:28:27,314 - DEBUG - VN ctest-vn1-39202939 UUID is 6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:27,464 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:27,478 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:27,512 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:27,648 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:27,678 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:27,706 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/19fafc81-d8af-4beb-9a78-b3cffda79339 2025-07-21 12:28:27,727 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/19fafc81-d8af-4beb-9a78-b3cffda79339 2025-07-21 12:28:27,747 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/05b2f746-2680-41ec-b824-cb5571b3d24b 2025-07-21 12:28:27,769 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:28:27,769 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:27,803 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/19fafc81-d8af-4beb-9a78-b3cffda79339 2025-07-21 12:28:27,850 - INFO - Verified VN network id 15 for VN 6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:27,850 - INFO - Verifications in API Server for VN ctest-vn1-39202939 passed 2025-07-21 12:28:27,851 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:27,889 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/19fafc81-d8af-4beb-9a78-b3cffda79339 2025-07-21 12:28:27,914 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/19fafc81-d8af-4beb-9a78-b3cffda79339 2025-07-21 12:28:27,944 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/05b2f746-2680-41ec-b824-cb5571b3d24b 2025-07-21 12:28:27,985 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8028096655365654796', 'uuid-lslong': '9751052018099693909'}, 'enable': 'true', 'created': '2025-07-21T12:28:26', 'last-modified': '2025-07-21T12:28:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.844774'} 2025-07-21 12:28:28,006 - DEBUG - Route Targets: ['target:64512:8000011'] 2025-07-21 12:28:28,006 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-39202939 passed 2025-07-21 12:28:28,007 - DEBUG - ====Verifying policy data for ctest-vn1-39202939 in API_Server ====== 2025-07-21 12:28:28,007 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:28,024 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:28,066 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:28,209 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6f69875f-9592-490c-8752-b225ad302955 2025-07-21 12:28:28,237 - DEBUG - =>VN ctest-vn1-39202939 has no policy to be verified 2025-07-21 12:28:28,237 - DEBUG - Verifying the vn in opserver 2025-07-21 12:28:28,238 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939 virtual network link through opserver 10.0.0.254 2025-07-21 12:28:28,238 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:28:28,277 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939?flat'} 2025-07-21 12:28:28,277 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939 is found in opserver 2025-07-21 12:28:28,322 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:28:28,342 - DEBUG - VRF ids for VN ctest-vn1-39202939: {} 2025-07-21 12:28:28,778 - DEBUG - Response for create_network : {'network': {'id': '6118233c-6a48-41e7-9b2a-de064d2863c8', 'name': 'ctest-vn2-42879136', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn2-42879136'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:28:29,038 - DEBUG - Response for create_subnet : {'subnet': {'id': '87f66ef2-d293-43cb-b39f-27d9914b4ead', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': '6118233c-6a48-41e7-9b2a-de064d2863c8', 'ip_version': 4, 'cidr': '50.206.88.0/26', 'allocation_pools': [{'start': '50.206.88.2', 'end': '50.206.88.62'}], 'gateway_ip': '50.206.88.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '50.206.88.2', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:28:29,064 - INFO - Created VN ctest-vn2-42879136 2025-07-21 12:28:29,121 - DEBUG - VN ctest-vn2-42879136 UUID is 6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,258 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:29,273 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:29,295 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:29,410 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,437 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,461 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/656979cb-83c3-43b9-adb9-34bbba73b8cf 2025-07-21 12:28:29,482 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/656979cb-83c3-43b9-adb9-34bbba73b8cf 2025-07-21 12:28:29,498 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/150711a3-c806-4b95-b280-e0473e5aa455 2025-07-21 12:28:29,514 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:28:29,514 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,535 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/656979cb-83c3-43b9-adb9-34bbba73b8cf 2025-07-21 12:28:29,561 - INFO - Verified VN network id 16 for VN 6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,562 - INFO - Verifications in API Server for VN ctest-vn2-42879136 passed 2025-07-21 12:28:29,562 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,576 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/656979cb-83c3-43b9-adb9-34bbba73b8cf 2025-07-21 12:28:29,587 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/656979cb-83c3-43b9-adb9-34bbba73b8cf 2025-07-21 12:28:29,597 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/150711a3-c806-4b95-b280-e0473e5aa455 2025-07-21 12:28:29,620 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6996380763508195815', 'uuid-lslong': '11180993143546340296'}, 'enable': 'true', 'created': '2025-07-21T12:28:28', 'last-modified': '2025-07-21T12:28:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.622750'} 2025-07-21 12:28:29,635 - DEBUG - Route Targets: ['target:64512:8000012'] 2025-07-21 12:28:29,636 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-42879136 passed 2025-07-21 12:28:29,636 - DEBUG - ====Verifying policy data for ctest-vn2-42879136 in API_Server ====== 2025-07-21 12:28:29,637 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:29,651 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:29,680 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:29,787 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6118233c-6a48-41e7-9b2a-de064d2863c8 2025-07-21 12:28:29,818 - DEBUG - =>VN ctest-vn2-42879136 has no policy to be verified 2025-07-21 12:28:29,818 - DEBUG - Verifying the vn in opserver 2025-07-21 12:28:29,818 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136 virtual network link through opserver 10.0.0.254 2025-07-21 12:28:29,818 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:28:29,842 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136?flat'} 2025-07-21 12:28:29,843 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136 is found in opserver 2025-07-21 12:28:29,864 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:28:29,878 - DEBUG - VRF ids for VN ctest-vn2-42879136: {} 2025-07-21 12:28:30,244 - DEBUG - Response for create_network : {'network': {'id': 'b95c13a5-1b84-4e36-9f2b-51c98a53a887', 'name': 'ctest-vn3-41325007', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'project_id': 'ba0fe256f9a149188a732b4f0e159b11', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-76319596', 'ctest-vn3-41325007'], 'port_security_enabled': True, 'description': ''}} 2025-07-21 12:28:30,483 - DEBUG - Response for create_subnet : {'subnet': {'id': '7d313c10-c30c-47f9-ada7-2c65d7a83d73', 'name': '', 'tenant_id': 'ba0fe256f9a149188a732b4f0e159b11', 'network_id': 'b95c13a5-1b84-4e36-9f2b-51c98a53a887', 'ip_version': 4, 'cidr': '209.253.117.192/26', 'allocation_pools': [{'start': '209.253.117.194', 'end': '209.253.117.254'}], 'gateway_ip': '209.253.117.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '209.253.117.194', 'tags': [], 'project_id': 'ba0fe256f9a149188a732b4f0e159b11'}} 2025-07-21 12:28:30,511 - INFO - Created VN ctest-vn3-41325007 2025-07-21 12:28:30,573 - DEBUG - VN ctest-vn3-41325007 UUID is b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:30,734 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:30,755 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:30,796 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:30,907 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:30,931 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:30,966 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b176c74d-7c73-4ce5-8e62-1e14e49edd60 2025-07-21 12:28:30,989 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b176c74d-7c73-4ce5-8e62-1e14e49edd60 2025-07-21 12:28:31,012 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/080025b6-e6b2-4ee5-abed-64e0a9389119 2025-07-21 12:28:31,032 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:28:31,033 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:31,061 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b176c74d-7c73-4ce5-8e62-1e14e49edd60 2025-07-21 12:28:31,107 - INFO - Verified VN network id 17 for VN b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:31,107 - INFO - Verifications in API Server for VN ctest-vn3-41325007 passed 2025-07-21 12:28:31,108 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:31,146 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b176c74d-7c73-4ce5-8e62-1e14e49edd60 2025-07-21 12:28:31,165 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b176c74d-7c73-4ce5-8e62-1e14e49edd60 2025-07-21 12:28:31,187 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/080025b6-e6b2-4ee5-abed-64e0a9389119 2025-07-21 12:28:31,218 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-76319596', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13356572194726235702', 'uuid-lslong': '11469350802080114823'}, 'enable': 'true', 'created': '2025-07-21T12:28:30', 'last-modified': '2025-07-21T12:28:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.781248'} 2025-07-21 12:28:31,232 - DEBUG - Route Targets: ['target:64512:8000013'] 2025-07-21 12:28:31,233 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-41325007 passed 2025-07-21 12:28:31,233 - DEBUG - ====Verifying policy data for ctest-vn3-41325007 in API_Server ====== 2025-07-21 12:28:31,233 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:28:31,248 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:28:31,271 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:28:31,392 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b95c13a5-1b84-4e36-9f2b-51c98a53a887 2025-07-21 12:28:31,413 - DEBUG - =>VN ctest-vn3-41325007 has no policy to be verified 2025-07-21 12:28:31,413 - DEBUG - Verifying the vn in opserver 2025-07-21 12:28:31,414 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007 virtual network link through opserver 10.0.0.254 2025-07-21 12:28:31,414 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-21 12:28:31,436 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007?flat'} 2025-07-21 12:28:31,436 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007 is found in opserver 2025-07-21 12:28:31,452 - DEBUG - Do not have enough data to verify VN in agent 2025-07-21 12:28:31,466 - DEBUG - VRF ids for VN ctest-vn3-41325007: {} 2025-07-21 12:28:31,474 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:28:31,837 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn1-39202939, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:28:32,234 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn2-42879136, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-76319596:ctest-vn3-41325007, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-21 12:28:32,818 - INFO - Attaching policy ctest-vn1_vn2_pass-40107970 to vn ctest-vn1-39202939 2025-07-21 12:28:33,429 - INFO - Attaching policy ctest-vn1_vn2_pass-40107970 to vn ctest-vn2-42879136 2025-07-21 12:28:34,114 - INFO - Attaching policy ctest-vn1_vn3_pass-10911741 to vn ctest-vn1-39202939 2025-07-21 12:28:34,882 - INFO - Attaching policy ctest-vn1_vn3_pass-10911741 to vn ctest-vn3-41325007 2025-07-21 12:28:35,530 - INFO - Attaching policy ctest-vn2_vn3_pass-82599140 to vn ctest-vn2-42879136 2025-07-21 12:28:36,277 - INFO - Attaching policy ctest-vn2_vn3_pass-82599140 to vn ctest-vn3-41325007 2025-07-21 12:30:17,785 - DEBUG - Installing image ubuntu 2025-07-21 12:30:17,785 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-21 12:30:17,787 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:30:17,787 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:30:17,787 - DEBUG - Unzip image 2025-07-21 12:30:17,787 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-21 12:30:17,827 - DEBUG - Try to create image in user context 2025-07-21 12:30:18,005 - INFO - Dettaching policy ctest-vn2_vn3_pass-82599140 from vn ctest-vn3-41325007 2025-07-21 12:30:18,494 - INFO - Dettaching policy ctest-vn2_vn3_pass-82599140 from vn ctest-vn2-42879136 2025-07-21 12:30:18,910 - INFO - Dettaching policy ctest-vn1_vn3_pass-10911741 from vn ctest-vn3-41325007 2025-07-21 12:30:19,265 - INFO - Dettaching policy ctest-vn1_vn3_pass-10911741 from vn ctest-vn1-39202939 2025-07-21 12:30:19,634 - INFO - Dettaching policy ctest-vn1_vn2_pass-40107970 from vn ctest-vn2-42879136 2025-07-21 12:30:19,958 - INFO - Dettaching policy ctest-vn1_vn2_pass-40107970 from vn ctest-vn1-39202939 2025-07-21 12:30:20,317 - INFO - Deleted policy ctest-vn2_vn3_pass-82599140 2025-07-21 12:30:20,383 - INFO - Deleted policy ctest-vn1_vn3_pass-10911741 2025-07-21 12:30:20,434 - INFO - Deleted policy ctest-vn1_vn2_pass-40107970 2025-07-21 12:30:20,434 - INFO - Deleting VN ctest-vn3-41325007 2025-07-21 12:30:20,602 - DEBUG - Response for deleting network () 2025-07-21 12:30:20,602 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b176c74d-7c73-4ce5-8e62-1e14e49edd60 2025-07-21 12:30:20,637 - DEBUG - Response Code: 404 2025-07-21 12:30:20,637 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:30:20,646 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:30:20,663 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:30:20,774 - INFO - Validated that VN ctest-vn3-41325007 is not found in API Server 2025-07-21 12:30:20,792 - DEBUG - VN ctest-vn3-41325007 is not present in Agent 10.0.0.254 2025-07-21 12:30:20,792 - INFO - Validated that VN ctest-vn3-41325007 is not in any agent 2025-07-21 12:30:20,824 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-41325007 info 2025-07-21 12:30:20,825 - INFO - Deleting VN ctest-vn2-42879136 2025-07-21 12:30:21,044 - DEBUG - Response for deleting network () 2025-07-21 12:30:21,045 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/656979cb-83c3-43b9-adb9-34bbba73b8cf 2025-07-21 12:30:21,057 - DEBUG - Response Code: 404 2025-07-21 12:30:21,057 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:30:21,065 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:30:21,083 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:30:21,178 - INFO - Validated that VN ctest-vn2-42879136 is not found in API Server 2025-07-21 12:30:21,198 - DEBUG - VN ctest-vn2-42879136 is not present in Agent 10.0.0.254 2025-07-21 12:30:21,199 - INFO - Validated that VN ctest-vn2-42879136 is not in any agent 2025-07-21 12:30:21,232 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-42879136 info 2025-07-21 12:30:21,232 - INFO - Deleting VN ctest-vn1-39202939 2025-07-21 12:30:21,374 - DEBUG - Response for deleting network () 2025-07-21 12:30:21,374 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/19fafc81-d8af-4beb-9a78-b3cffda79339 2025-07-21 12:30:21,382 - DEBUG - Response Code: 404 2025-07-21 12:30:21,382 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-21 12:30:21,395 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6f2dbf83-3a1f-4a4f-8676-305ebe4efd33 2025-07-21 12:30:21,453 - DEBUG - Requesting: http://10.0.0.254:8082/project/ba0fe256-f9a1-4918-8a73-2b4f0e159b11 2025-07-21 12:30:21,552 - INFO - Validated that VN ctest-vn1-39202939 is not found in API Server 2025-07-21 12:30:21,569 - DEBUG - VN ctest-vn1-39202939 is not present in Agent 10.0.0.254 2025-07-21 12:30:21,569 - INFO - Validated that VN ctest-vn1-39202939 is not in any agent 2025-07-21 12:30:21,593 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-39202939 info 2025-07-21 12:30:21,892 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 71, in test_juniper_header_without_header_ingress
    return self.verify_juniper_header_testcase(header = 3, direction = direction)
  File "/contrail-test/common/intf_mirroring/verify.py", line 77, in verify_juniper_header_testcase
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, header = header, nh_mode=nh_mode, direction = direction, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-21 12:30:21,909 - DEBUG - No XMPP flaps were noticed during the test 2025-07-21 12:30:21,909 - INFO - 2025-07-21 12:30:21,909 - INFO - END TEST : test_juniper_header_without_header_ingress : FAILED[0:01:55] 2025-07-21 12:30:21,909 - INFO - -------------------------------------------------------------------------------- 2025-07-21 12:30:22,910 - INFO - Deleted project: ctest-TestIntfMirror-76319596, ID : ba0fe256-f9a1-4918-8a73-2b4f0e159b11