2026-02-02 03:10:58,041 - INFO - Domain Default found not creating 2026-02-02 03:10:58,231 - INFO - Project ctest-TestSVCV2Mirror-75479911 not found, creating it 2026-02-02 03:10:58,795 - INFO - Created Project:ctest-TestSVCV2Mirror-75479911, ID : b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:00,351 - INFO - ================================================================================ 2026-02-02 03:11:00,351 - INFO - STARTING TEST : test_svc_v2_mirroring 2026-02-02 03:11:00,351 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2026-02-02 03:11:01,649 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.17': '0', '10.20.0.193': '0'}, '10.0.0.65': {'10.20.0.193': '0', '10.20.0.129': '0'}} with 2026-02-02 03:11:01,649 - INFO - Initial checks done. Running the testcase now 2026-02-02 03:11:01,649 - INFO - 2026-02-02 03:11:02,323 - DEBUG - Response for create_network : {'network': {'id': '4f8fe1fc-5c9d-4524-b072-68a74adaa59c', 'name': 'ctest-left-71287863', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'project_id': 'b8b9cc5916744629a2fc3fff57dca310', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-left-71287863'], 'port_security_enabled': True, 'description': ''}} 2026-02-02 03:11:02,580 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a5308a3-ee83-4f1d-b3d1-a27ce89eab60', 'name': '', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'network_id': '4f8fe1fc-5c9d-4524-b072-68a74adaa59c', 'ip_version': 4, 'cidr': '54.230.232.0/26', 'allocation_pools': [{'start': '54.230.232.2', 'end': '54.230.232.62'}], 'gateway_ip': '54.230.232.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '54.230.232.2', 'tags': [], 'project_id': 'b8b9cc5916744629a2fc3fff57dca310'}} 2026-02-02 03:11:02,600 - INFO - Created VN ctest-left-71287863 2026-02-02 03:11:02,611 - DEBUG - VN ctest-left-71287863 UUID is 4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:02,678 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:02,976 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:03,009 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:03,027 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:03,126 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:03,140 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:03,153 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/a98b3cb7-bf2a-4e86-a44f-cbd1af17fcee 2026-02-02 03:11:03,163 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/a98b3cb7-bf2a-4e86-a44f-cbd1af17fcee 2026-02-02 03:11:03,171 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/022b6a06-c837-4a28-a73d-604296f3028f 2026-02-02 03:11:03,177 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-02-02 03:11:03,177 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:03,186 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/a98b3cb7-bf2a-4e86-a44f-cbd1af17fcee 2026-02-02 03:11:03,201 - INFO - Verified VN network id 10 for VN 4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:03,201 - INFO - Verifications in API Server for VN ctest-left-71287863 passed 2026-02-02 03:11:03,201 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:03,211 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/a98b3cb7-bf2a-4e86-a44f-cbd1af17fcee 2026-02-02 03:11:03,220 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/a98b3cb7-bf2a-4e86-a44f-cbd1af17fcee 2026-02-02 03:11:03,227 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/022b6a06-c837-4a28-a73d-604296f3028f 2026-02-02 03:11:03,240 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5733049324667749668', 'uuid-lslong': '12714339765745001884'}, 'enable': 'true', 'created': '2026-02-02T03:11:02', 'last-modified': '2026-02-02T03:11:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.707807'} 2026-02-02 03:11:03,245 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-02-02 03:11:03,250 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5733049324667749668', 'uuid-lslong': '12714339765745001884'}, 'enable': 'true', 'created': '2026-02-02T03:11:02', 'last-modified': '2026-02-02T03:11:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.716931'} 2026-02-02 03:11:03,256 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-02-02 03:11:03,261 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5733049324667749668', 'uuid-lslong': '12714339765745001884'}, 'enable': 'true', 'created': '2026-02-02T03:11:02', 'last-modified': '2026-02-02T03:11:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.723574'} 2026-02-02 03:11:03,270 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-02-02 03:11:03,270 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-71287863 passed 2026-02-02 03:11:03,270 - DEBUG - ====Verifying policy data for ctest-left-71287863 in API_Server ====== 2026-02-02 03:11:03,270 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:03,276 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:03,293 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:03,383 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/4f8fe1fc-5c9d-4524-b072-68a74adaa59c 2026-02-02 03:11:03,393 - DEBUG - =>VN ctest-left-71287863 has no policy to be verified 2026-02-02 03:11:03,393 - DEBUG - Verifying the vn in opserver 2026-02-02 03:11:03,393 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863 virtual network link through opserver 10.0.0.141 2026-02-02 03:11:03,393 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-02-02 03:11:03,693 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-02-02 03:11:03,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863?flat'} 2026-02-02 03:11:03,755 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863 virtual network link through opserver 10.0.0.22 2026-02-02 03:11:03,755 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-02-02 03:11:04,051 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-02-02 03:11:04,114 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863?flat'} 2026-02-02 03:11:04,114 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863 virtual network link through opserver 10.0.0.23 2026-02-02 03:11:04,114 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-02-02 03:11:04,413 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-02-02 03:11:04,484 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863?flat'} 2026-02-02 03:11:04,484 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863 is found in opserver 2026-02-02 03:11:04,506 - DEBUG - Do not have enough data to verify VN in agent 2026-02-02 03:11:04,516 - DEBUG - VRF ids for VN ctest-left-71287863: {} 2026-02-02 03:11:04,742 - DEBUG - Response for create_network : {'network': {'id': '5ef37c90-ac89-4fc6-ab08-b6dae72a475d', 'name': 'ctest-right-48584776', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'project_id': 'b8b9cc5916744629a2fc3fff57dca310', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-right-48584776'], 'port_security_enabled': True, 'description': ''}} 2026-02-02 03:11:04,979 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f077fcda-a79b-4214-8416-d2efcde035f3', 'name': '', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'network_id': '5ef37c90-ac89-4fc6-ab08-b6dae72a475d', 'ip_version': 4, 'cidr': '132.165.139.192/26', 'allocation_pools': [{'start': '132.165.139.194', 'end': '132.165.139.254'}], 'gateway_ip': '132.165.139.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '132.165.139.194', 'tags': [], 'project_id': 'b8b9cc5916744629a2fc3fff57dca310'}} 2026-02-02 03:11:05,008 - INFO - Created VN ctest-right-48584776 2026-02-02 03:11:05,023 - DEBUG - VN ctest-right-48584776 UUID is 5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,094 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:05,101 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:05,115 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:05,213 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,228 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,237 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72558ccc-fbed-4b89-895c-7d6732539951 2026-02-02 03:11:05,244 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72558ccc-fbed-4b89-895c-7d6732539951 2026-02-02 03:11:05,252 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/308edc8f-53f8-46ec-b346-21f215cf7bae 2026-02-02 03:11:05,259 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-02-02 03:11:05,259 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,268 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72558ccc-fbed-4b89-895c-7d6732539951 2026-02-02 03:11:05,285 - INFO - Verified VN network id 11 for VN 5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,286 - INFO - Verifications in API Server for VN ctest-right-48584776 passed 2026-02-02 03:11:05,286 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,299 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72558ccc-fbed-4b89-895c-7d6732539951 2026-02-02 03:11:05,307 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72558ccc-fbed-4b89-895c-7d6732539951 2026-02-02 03:11:05,320 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/308edc8f-53f8-46ec-b346-21f215cf7bae 2026-02-02 03:11:05,333 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6841949219717730246', 'uuid-lslong': '12324301431596795741'}, 'enable': 'true', 'created': '2026-02-02T03:11:04', 'last-modified': '2026-02-02T03:11:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410369'} 2026-02-02 03:11:05,340 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-02-02 03:11:05,348 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6841949219717730246', 'uuid-lslong': '12324301431596795741'}, 'enable': 'true', 'created': '2026-02-02T03:11:04', 'last-modified': '2026-02-02T03:11:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426933'} 2026-02-02 03:11:05,354 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-02-02 03:11:05,361 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6841949219717730246', 'uuid-lslong': '12324301431596795741'}, 'enable': 'true', 'created': '2026-02-02T03:11:04', 'last-modified': '2026-02-02T03:11:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440997'} 2026-02-02 03:11:05,367 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-02-02 03:11:05,367 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-48584776 passed 2026-02-02 03:11:05,367 - DEBUG - ====Verifying policy data for ctest-right-48584776 in API_Server ====== 2026-02-02 03:11:05,367 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:05,373 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:05,389 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:05,488 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/5ef37c90-ac89-4fc6-ab08-b6dae72a475d 2026-02-02 03:11:05,507 - DEBUG - =>VN ctest-right-48584776 has no policy to be verified 2026-02-02 03:11:05,507 - DEBUG - Verifying the vn in opserver 2026-02-02 03:11:05,507 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776 virtual network link through opserver 10.0.0.141 2026-02-02 03:11:05,507 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-02-02 03:11:05,578 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776?flat'} 2026-02-02 03:11:05,578 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776 virtual network link through opserver 10.0.0.22 2026-02-02 03:11:05,578 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-02-02 03:11:05,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776?flat'} 2026-02-02 03:11:05,643 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776 virtual network link through opserver 10.0.0.23 2026-02-02 03:11:05,644 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-02-02 03:11:05,702 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776?flat'} 2026-02-02 03:11:05,703 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776 is found in opserver 2026-02-02 03:11:05,723 - DEBUG - Do not have enough data to verify VN in agent 2026-02-02 03:11:05,733 - DEBUG - VRF ids for VN ctest-right-48584776: {} 2026-02-02 03:11:05,999 - DEBUG - Response for create_network : {'network': {'id': '22018273-a19a-496c-bb5c-65660f476827', 'name': 'ctest-mgmt_vn-20696628', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'project_id': 'b8b9cc5916744629a2fc3fff57dca310', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-mgmt_vn-20696628'], 'port_security_enabled': True, 'description': ''}} 2026-02-02 03:11:06,236 - DEBUG - Response for create_subnet : {'subnet': {'id': 'be44399c-0013-4d79-b332-8d5607d19c23', 'name': '', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'network_id': '22018273-a19a-496c-bb5c-65660f476827', 'ip_version': 4, 'cidr': '162.61.219.192/26', 'allocation_pools': [{'start': '162.61.219.194', 'end': '162.61.219.254'}], 'gateway_ip': '162.61.219.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '162.61.219.194', 'tags': [], 'project_id': 'b8b9cc5916744629a2fc3fff57dca310'}} 2026-02-02 03:11:06,260 - INFO - Created VN ctest-mgmt_vn-20696628 2026-02-02 03:11:06,274 - DEBUG - VN ctest-mgmt_vn-20696628 UUID is 22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,346 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:06,351 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:06,364 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:06,476 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,490 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,502 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/5ecac73e-99f4-49b2-9938-c6594d5b990a 2026-02-02 03:11:06,511 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/5ecac73e-99f4-49b2-9938-c6594d5b990a 2026-02-02 03:11:06,518 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8514a003-2e82-4948-a6be-02e6655a8224 2026-02-02 03:11:06,527 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-02-02 03:11:06,527 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,537 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/5ecac73e-99f4-49b2-9938-c6594d5b990a 2026-02-02 03:11:06,560 - INFO - Verified VN network id 12 for VN 22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,560 - INFO - Verifications in API Server for VN ctest-mgmt_vn-20696628 passed 2026-02-02 03:11:06,561 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,571 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/5ecac73e-99f4-49b2-9938-c6594d5b990a 2026-02-02 03:11:06,579 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/5ecac73e-99f4-49b2-9938-c6594d5b990a 2026-02-02 03:11:06,586 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8514a003-2e82-4948-a6be-02e6655a8224 2026-02-02 03:11:06,599 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2450383105410353516', 'uuid-lslong': '13500777271967311911'}, 'enable': 'true', 'created': '2026-02-02T03:11:05', 'last-modified': '2026-02-02T03:11:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426918'} 2026-02-02 03:11:06,604 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-02-02 03:11:06,610 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2450383105410353516', 'uuid-lslong': '13500777271967311911'}, 'enable': 'true', 'created': '2026-02-02T03:11:05', 'last-modified': '2026-02-02T03:11:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440555'} 2026-02-02 03:11:06,617 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-02-02 03:11:06,622 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2450383105410353516', 'uuid-lslong': '13500777271967311911'}, 'enable': 'true', 'created': '2026-02-02T03:11:05', 'last-modified': '2026-02-02T03:11:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.456974'} 2026-02-02 03:11:06,629 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-02-02 03:11:06,629 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-20696628 passed 2026-02-02 03:11:06,629 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-20696628 in API_Server ====== 2026-02-02 03:11:06,629 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:06,635 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:06,647 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:06,735 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/22018273-a19a-496c-bb5c-65660f476827 2026-02-02 03:11:06,745 - DEBUG - =>VN ctest-mgmt_vn-20696628 has no policy to be verified 2026-02-02 03:11:06,745 - DEBUG - Verifying the vn in opserver 2026-02-02 03:11:06,745 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628 virtual network link through opserver 10.0.0.141 2026-02-02 03:11:06,745 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-02-02 03:11:06,807 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628?flat'} 2026-02-02 03:11:06,807 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628 virtual network link through opserver 10.0.0.22 2026-02-02 03:11:06,807 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-02-02 03:11:06,866 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628?flat'} 2026-02-02 03:11:06,866 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628 virtual network link through opserver 10.0.0.23 2026-02-02 03:11:06,866 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-02-02 03:11:06,923 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628?flat'} 2026-02-02 03:11:06,923 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-mgmt_vn-20696628 is found in opserver 2026-02-02 03:11:06,948 - DEBUG - Do not have enough data to verify VN in agent 2026-02-02 03:11:06,961 - DEBUG - VRF ids for VN ctest-mgmt_vn-20696628: {} 2026-02-02 03:11:07,251 - DEBUG - Response for create_network : {'network': {'id': '368c057b-064b-4de8-a49e-a8f97aba7fd0', 'name': 'ctest-trans_left_vn-38432636', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'project_id': 'b8b9cc5916744629a2fc3fff57dca310', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-trans_left_vn-38432636'], 'port_security_enabled': True, 'description': ''}} 2026-02-02 03:11:07,470 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd071b9fd-eb47-4426-9596-0469d682c4b8', 'name': '', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'network_id': '368c057b-064b-4de8-a49e-a8f97aba7fd0', 'ip_version': 4, 'cidr': '61.38.9.128/26', 'allocation_pools': [{'start': '61.38.9.130', 'end': '61.38.9.190'}], 'gateway_ip': '61.38.9.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '61.38.9.130', 'tags': [], 'project_id': 'b8b9cc5916744629a2fc3fff57dca310'}} 2026-02-02 03:11:07,497 - INFO - Created VN ctest-trans_left_vn-38432636 2026-02-02 03:11:07,510 - DEBUG - VN ctest-trans_left_vn-38432636 UUID is 368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:07,607 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:07,619 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:07,635 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:07,731 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:07,747 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:07,770 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c52387eb-3019-4b0a-8353-dc9e6cb4044e 2026-02-02 03:11:07,794 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c52387eb-3019-4b0a-8353-dc9e6cb4044e 2026-02-02 03:11:07,809 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/718d8f4c-3613-46ff-a688-a85559716b72 2026-02-02 03:11:07,822 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-02-02 03:11:07,822 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:07,834 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c52387eb-3019-4b0a-8353-dc9e6cb4044e 2026-02-02 03:11:07,852 - INFO - Verified VN network id 13 for VN 368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:07,852 - INFO - Verifications in API Server for VN ctest-trans_left_vn-38432636 passed 2026-02-02 03:11:07,852 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:07,888 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c52387eb-3019-4b0a-8353-dc9e6cb4044e 2026-02-02 03:11:07,900 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c52387eb-3019-4b0a-8353-dc9e6cb4044e 2026-02-02 03:11:07,913 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/718d8f4c-3613-46ff-a688-a85559716b72 2026-02-02 03:11:07,936 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3930522600732315112', 'uuid-lslong': '11862104257999830992'}, 'enable': 'true', 'created': '2026-02-02T03:11:07', 'last-modified': '2026-02-02T03:11:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.522434'} 2026-02-02 03:11:07,951 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-02-02 03:11:07,961 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3930522600732315112', 'uuid-lslong': '11862104257999830992'}, 'enable': 'true', 'created': '2026-02-02T03:11:07', 'last-modified': '2026-02-02T03:11:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.552518'} 2026-02-02 03:11:07,970 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-02-02 03:11:07,976 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3930522600732315112', 'uuid-lslong': '11862104257999830992'}, 'enable': 'true', 'created': '2026-02-02T03:11:07', 'last-modified': '2026-02-02T03:11:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.556844'} 2026-02-02 03:11:07,983 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-02-02 03:11:07,983 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-38432636 passed 2026-02-02 03:11:07,984 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-38432636 in API_Server ====== 2026-02-02 03:11:07,984 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:07,991 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:08,006 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:08,092 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/368c057b-064b-4de8-a49e-a8f97aba7fd0 2026-02-02 03:11:08,105 - DEBUG - =>VN ctest-trans_left_vn-38432636 has no policy to be verified 2026-02-02 03:11:08,105 - DEBUG - Verifying the vn in opserver 2026-02-02 03:11:08,105 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 virtual network link through opserver 10.0.0.141 2026-02-02 03:11:08,105 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-02-02 03:11:08,117 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636?flat'} 2026-02-02 03:11:08,117 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 virtual network link through opserver 10.0.0.22 2026-02-02 03:11:08,117 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-02-02 03:11:08,130 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636?flat'} 2026-02-02 03:11:08,130 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 virtual network link through opserver 10.0.0.23 2026-02-02 03:11:08,130 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-02-02 03:11:08,143 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636?flat'} 2026-02-02 03:11:08,143 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is found in opserver 2026-02-02 03:11:08,164 - DEBUG - Do not have enough data to verify VN in agent 2026-02-02 03:11:08,174 - DEBUG - VRF ids for VN ctest-trans_left_vn-38432636: {} 2026-02-02 03:11:08,438 - DEBUG - Response for create_network : {'network': {'id': 'a248041d-ad84-49b8-8f35-4d2ecbf26938', 'name': 'ctest-trans_right_vn-07404491', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'project_id': 'b8b9cc5916744629a2fc3fff57dca310', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-trans_right_vn-07404491'], 'port_security_enabled': True, 'description': ''}} 2026-02-02 03:11:08,641 - DEBUG - Response for create_subnet : {'subnet': {'id': '7452942a-67d6-43b0-81f0-dcec0a9a47d4', 'name': '', 'tenant_id': 'b8b9cc5916744629a2fc3fff57dca310', 'network_id': 'a248041d-ad84-49b8-8f35-4d2ecbf26938', 'ip_version': 4, 'cidr': '1.17.29.0/26', 'allocation_pools': [{'start': '1.17.29.2', 'end': '1.17.29.62'}], 'gateway_ip': '1.17.29.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '1.17.29.2', 'tags': [], 'project_id': 'b8b9cc5916744629a2fc3fff57dca310'}} 2026-02-02 03:11:08,662 - INFO - Created VN ctest-trans_right_vn-07404491 2026-02-02 03:11:08,672 - DEBUG - VN ctest-trans_right_vn-07404491 UUID is a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:08,754 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:08,760 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:08,770 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:08,859 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:08,870 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:08,878 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/df76d606-482a-4050-a26e-d64596e38b56 2026-02-02 03:11:08,887 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/df76d606-482a-4050-a26e-d64596e38b56 2026-02-02 03:11:08,895 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b8e36bb-29c4-43c3-a84e-8b07da8412fc 2026-02-02 03:11:08,901 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-02-02 03:11:08,901 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:08,910 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/df76d606-482a-4050-a26e-d64596e38b56 2026-02-02 03:11:08,926 - INFO - Verified VN network id 14 for VN a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:08,926 - INFO - Verifications in API Server for VN ctest-trans_right_vn-07404491 passed 2026-02-02 03:11:08,926 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:08,936 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/df76d606-482a-4050-a26e-d64596e38b56 2026-02-02 03:11:08,942 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/df76d606-482a-4050-a26e-d64596e38b56 2026-02-02 03:11:08,948 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b8e36bb-29c4-43c3-a84e-8b07da8412fc 2026-02-02 03:11:08,960 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11693600957979183544', 'uuid-lslong': '10319238984574855480'}, 'enable': 'true', 'created': '2026-02-02T03:11:08', 'last-modified': '2026-02-02T03:11:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.361304'} 2026-02-02 03:11:08,965 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-02-02 03:11:08,970 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11693600957979183544', 'uuid-lslong': '10319238984574855480'}, 'enable': 'true', 'created': '2026-02-02T03:11:08', 'last-modified': '2026-02-02T03:11:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.380249'} 2026-02-02 03:11:08,976 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-02-02 03:11:08,981 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-75479911', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11693600957979183544', 'uuid-lslong': '10319238984574855480'}, 'enable': 'true', 'created': '2026-02-02T03:11:08', 'last-modified': '2026-02-02T03:11:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391052'} 2026-02-02 03:11:08,987 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-02-02 03:11:08,987 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-07404491 passed 2026-02-02 03:11:08,987 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-07404491 in API_Server ====== 2026-02-02 03:11:08,988 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:11:08,993 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:11:09,003 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:11:09,097 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a248041d-ad84-49b8-8f35-4d2ecbf26938 2026-02-02 03:11:09,107 - DEBUG - =>VN ctest-trans_right_vn-07404491 has no policy to be verified 2026-02-02 03:11:09,107 - DEBUG - Verifying the vn in opserver 2026-02-02 03:11:09,107 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491 virtual network link through opserver 10.0.0.141 2026-02-02 03:11:09,107 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-02-02 03:11:09,121 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491?flat'} 2026-02-02 03:11:09,121 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491 virtual network link through opserver 10.0.0.22 2026-02-02 03:11:09,121 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-02-02 03:11:09,131 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491?flat'} 2026-02-02 03:11:09,131 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491 virtual network link through opserver 10.0.0.23 2026-02-02 03:11:09,131 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-02-02 03:11:09,144 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491?flat'} 2026-02-02 03:11:09,144 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_right_vn-07404491 is found in opserver 2026-02-02 03:11:09,166 - DEBUG - Do not have enough data to verify VN in agent 2026-02-02 03:11:09,175 - DEBUG - VRF ids for VN ctest-trans_right_vn-07404491: {} 2026-02-02 03:11:09,237 - DEBUG - Services list from nova: [, , , ] 2026-02-02 03:11:10,305 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5167-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5167-1) 2026-02-02 03:11:11,600 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5167-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5167-2) 2026-02-02 03:11:11,600 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-76463308'] 2026-02-02 03:11:11,907 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-76463308'] created succesfully 2026-02-02 03:11:13,287 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5167-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5167-1) 2026-02-02 03:11:13,287 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:11:13,618 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:11:13,648 - DEBUG - Response Code: 404 2026-02-02 03:11:15,649 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:11:15,662 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:11:15,745 - INFO - Waiting for VM ctest-pt_svm0-54666348 to be up.. 2026-02-02 03:11:15,831 - DEBUG - VM is in ACTIVE state now 2026-02-02 03:11:15,831 - INFO - VM name : ctest-pt_svm0-54666348 2026-02-02 03:11:15,917 - DEBUG - VM ctest-pt_svm0-54666348 ID is 677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:11:15,946 - DEBUG - VM ctest-pt_svm0-54666348 launched on Node an-jenkins-deploy-platform-ansible-os-5167-1 2026-02-02 03:11:16,039 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:11:16,046 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:11:19,218 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2026-02-02 03:11:19,218 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:19,232 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:23,321 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2026-02-02 03:11:23,322 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:23,335 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:27,412 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-02-02 03:11:27,412 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:27,425 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:31,515 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-02-02 03:11:31,515 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:31,533 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:35,606 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-02-02 03:11:35,606 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:35,619 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:39,704 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2026-02-02 03:11:39,704 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:39,721 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:43,801 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-02-02 03:11:43,802 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:43,815 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:47,896 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-02-02 03:11:47,897 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:47,910 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:51,990 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2026-02-02 03:11:51,991 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:52,004 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:11:56,085 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-02-02 03:11:56,085 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 failed! 2026-02-02 03:11:56,097 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is 61.38.9.129 and allocation pool is NOT set 2026-02-02 03:12:00,181 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=6.88 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1022ms\r\nrtt min/avg/max/mdev = 6.881/6.881/6.881/0.000 ms') 2026-02-02 03:12:00,181 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 passed 2026-02-02 03:12:00,254 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:00,254 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54666348, IP 61.38.9.131, Port 22 2026-02-02 03:12:00,326 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:00,421 - DEBUG - VM ctest-pt_svm0-54666348 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:05,421 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:05,421 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54666348, IP 61.38.9.131, Port 22 2026-02-02 03:12:05,490 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:05,575 - DEBUG - VM ctest-pt_svm0-54666348 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:10,575 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:10,576 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54666348, IP 61.38.9.131, Port 22 2026-02-02 03:12:10,643 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:10,728 - DEBUG - VM ctest-pt_svm0-54666348 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:15,730 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:15,730 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54666348, IP 61.38.9.131, Port 22 2026-02-02 03:12:15,797 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:15,879 - DEBUG - VM ctest-pt_svm0-54666348 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:20,880 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:20,880 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54666348, IP 61.38.9.131, Port 22 2026-02-02 03:12:21,055 - DEBUG - VM ctest-pt_svm0-54666348 is ready for SSH connections 2026-02-02 03:12:21,061 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-si-06037216'] 2026-02-02 03:12:21,553 - INFO - Waiting for VM ctest-left_vm-38191228 to be up.. 2026-02-02 03:12:21,693 - DEBUG - VM is in ACTIVE state now 2026-02-02 03:12:21,694 - INFO - VM name : ctest-left_vm-38191228 2026-02-02 03:12:21,834 - DEBUG - VM ctest-left_vm-38191228 ID is 7b8651e8-6845-45aa-a5e6-8bbb03fba1b8 2026-02-02 03:12:21,834 - DEBUG - VM ctest-left_vm-38191228 launched on Node an-jenkins-deploy-platform-ansible-os-5167-1 2026-02-02 03:12:21,957 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/7b8651e8-6845-45aa-a5e6-8bbb03fba1b8 2026-02-02 03:12:21,971 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/47553e3f-d657-43d5-848b-203baf3d85b8 2026-02-02 03:12:23,152 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=23.1 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=13.7 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 13.692/18.386/23.081/4.694 ms') 2026-02-02 03:12:23,152 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-38191228 passed 2026-02-02 03:12:23,218 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:23,219 - DEBUG - Waiting to SSH to VM ctest-left_vm-38191228, IP 54.230.232.3, Port 22 2026-02-02 03:12:23,286 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:23,371 - DEBUG - VM ctest-left_vm-38191228 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:28,371 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:28,371 - DEBUG - Waiting to SSH to VM ctest-left_vm-38191228, IP 54.230.232.3, Port 22 2026-02-02 03:12:28,439 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:28,515 - DEBUG - VM ctest-left_vm-38191228 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:33,520 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:33,521 - DEBUG - Waiting to SSH to VM ctest-left_vm-38191228, IP 54.230.232.3, Port 22 2026-02-02 03:12:33,591 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:33,674 - DEBUG - VM ctest-left_vm-38191228 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:38,675 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:38,675 - DEBUG - Waiting to SSH to VM ctest-left_vm-38191228, IP 54.230.232.3, Port 22 2026-02-02 03:12:38,742 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:38,824 - DEBUG - VM ctest-left_vm-38191228 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:43,824 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:43,825 - DEBUG - Waiting to SSH to VM ctest-left_vm-38191228, IP 54.230.232.3, Port 22 2026-02-02 03:12:43,890 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-02-02 03:12:43,971 - DEBUG - VM ctest-left_vm-38191228 is NOT ready for SSH connections, VM status: ACTIVE 2026-02-02 03:12:48,972 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:48,972 - DEBUG - Waiting to SSH to VM ctest-left_vm-38191228, IP 54.230.232.3, Port 22 2026-02-02 03:12:49,138 - DEBUG - VM ctest-left_vm-38191228 is ready for SSH connections 2026-02-02 03:12:49,138 - INFO - Waiting for VM ctest-right_vm-10023963 to be up.. 2026-02-02 03:12:49,214 - DEBUG - VM is in ACTIVE state now 2026-02-02 03:12:49,214 - INFO - VM name : ctest-right_vm-10023963 2026-02-02 03:12:49,302 - DEBUG - VM ctest-right_vm-10023963 ID is 2b95e970-4ca6-47b7-86a8-f7b728f13fa9 2026-02-02 03:12:49,302 - DEBUG - VM ctest-right_vm-10023963 launched on Node an-jenkins-deploy-platform-ansible-os-5167-2 2026-02-02 03:12:49,385 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/2b95e970-4ca6-47b7-86a8-f7b728f13fa9 2026-02-02 03:12:49,397 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/6af10971-235c-441a-ae80-3b47f19f1d4d 2026-02-02 03:12:50,560 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.546 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.546/2.707/4.868/2.161 ms') 2026-02-02 03:12:50,560 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-10023963 passed 2026-02-02 03:12:50,629 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:50,629 - DEBUG - Waiting to SSH to VM ctest-right_vm-10023963, IP 132.165.139.195, Port 22 2026-02-02 03:12:50,797 - DEBUG - VM ctest-right_vm-10023963 is ready for SSH connections 2026-02-02 03:12:50,803 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-si-06037216, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-02-02 03:12:51,124 - INFO - Attaching policy ctest-policy-66267941 to vn ctest-left-71287863 2026-02-02 03:12:51,492 - INFO - Attaching policy ctest-policy-66267941 to vn ctest-right-48584776 2026-02-02 03:12:51,799 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-76463308'] created succesfully 2026-02-02 03:12:51,974 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-si-06037216'] created succesfully 2026-02-02 03:12:51,974 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:12:51,980 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:12:51,992 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:12:52,073 - DEBUG - Requesting: http://10.0.0.141:8082/service-instance/7cf0cba5-a9d4-4379-a8bb-eeb493bf1571 2026-02-02 03:12:52,082 - DEBUG - SI 'ctest-si-06037216' has service template ref to ctest-service_template_1-76463308 2026-02-02 03:12:52,082 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:12:52,087 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:12:52,097 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:12:52,219 - DEBUG - Requesting: http://10.0.0.141:8082/service-instance/7cf0cba5-a9d4-4379-a8bb-eeb493bf1571 2026-02-02 03:12:52,227 - DEBUG - Requesting: http://10.0.0.141:8082/port-tuple/ed2bac0a-f142-44e2-a8c1-912300394614 2026-02-02 03:12:52,235 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:12:52,428 - DEBUG - VM is in ACTIVE state now 2026-02-02 03:12:52,645 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:12:52,653 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:12:52,664 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/13d55ab3-d3a3-4dc3-9b3e-06c9193d9508 2026-02-02 03:12:52,671 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/88d8cb1b-a2fd-424a-83f2-1feea8372a3f 2026-02-02 03:12:52,678 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/ae83b6f7-2867-4ffc-9804-29c1df1d8a9b 2026-02-02 03:12:52,859 - DEBUG - VM is in ACTIVE state now 2026-02-02 03:12:52,859 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:12:52,868 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:12:54,011 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=4.02 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=0.930 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.930/2.473/4.017/1.543 ms') 2026-02-02 03:12:54,011 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-54666348 passed 2026-02-02 03:12:54,045 - DEBUG - VM ctest-pt_svm0-54666348 Tap interface: {'index': '4', 'name': 'tap9f911d5f-cf', 'uuid': '9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636:ctest-trans_left_vn-38432636', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'vm_uuid': '677817d0-d3e8-460d-992a-60a2a700c662', 'vm_name': 'ctest-pt_svm0-54666348', 'ip_addr': '61.38.9.131', 'mac_addr': '02:9f:91:1d:5f:cf', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-75479911:9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd', 'sg_uuid_list': ['2e78a98e-3157-487f-96c2-e41af8c1adb0'], 'static_route_list': None, 'vm_project_uuid': 'b8b9cc59-1674-4629-a2fc-3fff57dca310', 'admin_state': 'Enabled', 'flow_key_idx': '40', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-02-02 03:12:54,045 - DEBUG - Agent 10.0.0.50 vrf name: default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636:ctest-trans_left_vn-38432636 2026-02-02 03:12:54,051 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636:ctest-trans_left_vn-38432636', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.192:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-02-02 03:12:54,131 - DEBUG - VM ctest-pt_svm0-54666348 : Tap interface tap9f911d5f-cf is set to Active 2026-02-02 03:12:54,131 - DEBUG - Tap interface tap9f911d5f-cf detail : {'index': '4', 'name': 'tap9f911d5f-cf', 'uuid': '9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636:ctest-trans_left_vn-38432636', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636', 'vm_uuid': '677817d0-d3e8-460d-992a-60a2a700c662', 'vm_name': 'ctest-pt_svm0-54666348', 'ip_addr': '61.38.9.131', 'mac_addr': '02:9f:91:1d:5f:cf', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-75479911:9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd', 'sg_uuid_list': ['2e78a98e-3157-487f-96c2-e41af8c1adb0'], 'static_route_list': None, 'vm_project_uuid': 'b8b9cc59-1674-4629-a2fc-3fff57dca310', 'admin_state': 'Enabled', 'flow_key_idx': '40', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-02-02 03:12:54,248 - DEBUG - Starting Layer 2 verification in Agent 2026-02-02 03:12:54,262 - DEBUG - Layer 2 path is seen for VM MAC 02:9f:91:1d:5f:cf in agent 10.0.0.50 2026-02-02 03:12:54,262 - DEBUG - Active layer 2 route in agent is present for VMI tap9f911d5f-cf 2026-02-02 03:12:54,262 - DEBUG - L2 label(35) matches bw route table and interface table 2026-02-02 03:12:54,272 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is found in Agent of node 10.0.0.50 2026-02-02 03:12:54,406 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 is consistent in agent 10.0.0.50 2026-02-02 03:12:54,406 - DEBUG - Route for VM IP ['61.38.9.131'] is consistent in agent 10.0.0.50 2026-02-02 03:12:54,406 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-trans_left_vn-38432636 verification for VM ctest-pt_svm0-54666348 in Agent 10.0.0.50 passed 2026-02-02 03:12:54,517 - DEBUG - Starting all layer 2 verification in agent 10.0.0.50 2026-02-02 03:12:54,532 - DEBUG - Route for VM MAC 02:9f:91:1d:5f:cf is consistent in agent 10.0.0.50 2026-02-02 03:12:54,537 - INFO - VM ctest-pt_svm0-54666348 verifications in Compute nodes passed 2026-02-02 03:12:54,537 - DEBUG - The SVMs in the SI are : [] 2026-02-02 03:12:54,537 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:12:54,546 - DEBUG - Service VM for SI 'ctest-si-06037216' is launched 2026-02-02 03:12:54,546 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:12:54,551 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:12:54,561 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:12:54,651 - DEBUG - Requesting: http://10.0.0.141:8082/service-instance/7cf0cba5-a9d4-4379-a8bb-eeb493bf1571 2026-02-02 03:12:54,660 - DEBUG - SI ctest-si-06037216 has Port Tuple: ['ctest-port_tuple-19998461'] 2026-02-02 03:12:54,721 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863 2026-02-02 03:12:54,825 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776 2026-02-02 03:12:54,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:54,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:12:54,825 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 132.165.139.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-02 03:12:54,825 - DEBUG - ping -s 56 -c 3 -W 1 132.165.139.195 2026-02-02 03:13:13,068 - DEBUG - PING 132.165.139.195 (132.165.139.195) 56(84) bytes of data. 64 bytes from 132.165.139.195: icmp_req=1 ttl=63 time=7.20 ms 64 bytes from 132.165.139.195: icmp_req=2 ttl=63 time=1.73 ms 64 bytes from 132.165.139.195: icmp_req=3 ttl=63 time=1.36 ms --- 132.165.139.195 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.365/3.432/7.200/2.668 ms 2026-02-02 03:13:13,068 - INFO - Ping to IP 132.165.139.195 from VM ctest-left_vm-38191228 passed 2026-02-02 03:13:13,075 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-si-06037216, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-left-71287863, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-right-48584776, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-75479911:ctest-si-06037216, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-02-02 03:13:13,140 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-02-02 03:13:13,140 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:13,149 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:13,169 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:13,255 - DEBUG - Requesting: http://10.0.0.141:8082/service-instance/7cf0cba5-a9d4-4379-a8bb-eeb493bf1571 2026-02-02 03:13:13,266 - DEBUG - Requesting: http://10.0.0.141:8082/port-tuple/ed2bac0a-f142-44e2-a8c1-912300394614 2026-02-02 03:13:13,273 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:13:13,449 - DEBUG - Executing command: rm -f /tmp/mirror-tap9f911d5f-cf_ctest-random-86477064.pcap 2026-02-02 03:13:23,860 - INFO - Starting tcpdump to capture the mirrored packets. 2026-02-02 03:13:23,861 - DEBUG - Executing command: sudo tcpdump -ni tap9f911d5f-cf -U udp port 8099 -w /tmp/mirror-tap9f911d5f-cf_ctest-random-86477064.pcap 2026-02-02 03:13:33,892 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 132.165.139.195, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2026-02-02 03:13:33,893 - DEBUG - ping -s 56 -c 3 -W 1 132.165.139.195 2026-02-02 03:13:36,352 - DEBUG - PING 132.165.139.195 (132.165.139.195) 56(84) bytes of data. 64 bytes from 132.165.139.195: icmp_req=1 ttl=63 time=6.60 ms 64 bytes from 132.165.139.195: icmp_req=2 ttl=63 time=1.23 ms 64 bytes from 132.165.139.195: icmp_req=3 ttl=63 time=1.39 ms --- 132.165.139.195 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.237/3.078/6.603/2.493 ms 2026-02-02 03:13:36,352 - INFO - Ping to IP 132.165.139.195 from VM ctest-left_vm-38191228 passed 2026-02-02 03:13:36,352 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:36,360 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:36,371 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:36,459 - DEBUG - Requesting: http://10.0.0.141:8082/service-instance/7cf0cba5-a9d4-4379-a8bb-eeb493bf1571 2026-02-02 03:13:36,466 - DEBUG - Requesting: http://10.0.0.141:8082/port-tuple/ed2bac0a-f142-44e2-a8c1-912300394614 2026-02-02 03:13:36,473 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/9f911d5f-cfb3-4fa5-b5c7-fcddba8162bd 2026-02-02 03:13:36,565 - DEBUG - Waiting for the tcpdump write to complete. 2026-02-02 03:13:38,566 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap9f911d5f-cf_ctest-random-86477064.pcap| awk '{print $2}') 2026-02-02 03:13:38,569 - DEBUG - Executing command: sync 2026-02-02 03:13:41,590 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap9f911d5f-cf_ctest-random-86477064.pcap | wc -l 2026-02-02 03:13:41,604 - DEBUG - STDOUT: 12 2026-02-02 03:13:41,604 - DEBUG - STDERR: reading from file /tmp/mirror-tap9f911d5f-cf_ctest-random-86477064.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-02-02 03:13:41,604 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap9f911d5f-cf_ctest-random-86477064.pcap 2026-02-02 03:13:41,650 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-54666348' 2026-02-02 03:13:41,650 - INFO - Dettaching policy ctest-policy-66267941 from vn ctest-right-48584776 2026-02-02 03:13:41,847 - INFO - Dettaching policy ctest-policy-66267941 from vn ctest-left-71287863 2026-02-02 03:13:42,069 - INFO - Deleted policy ctest-policy-66267941 2026-02-02 03:13:42,069 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-si-06037216'] 2026-02-02 03:13:42,168 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-75479911', 'ctest-si-06037216'] 2026-02-02 03:13:42,168 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:42,176 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:42,190 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:42,293 - DEBUG - Service instance ctest-si-06037216 removed from api server 2026-02-02 03:13:42,293 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/677817d0-d3e8-460d-992a-60a2a700c662 2026-02-02 03:13:42,303 - DEBUG - All Service VMs unlinked from SI ctest-si-06037216 2026-02-02 03:13:42,313 - DEBUG - 0 svc intances found in all projects. They are [] 2026-02-02 03:13:42,313 - DEBUG - 0 svc intances found in current project. They are [] 2026-02-02 03:13:42,365 - DEBUG - 0 svc intances found in all projects. They are [] 2026-02-02 03:13:42,365 - DEBUG - 0 svc intances found in current project. They are [] 2026-02-02 03:13:42,365 - INFO - Deleting VM ctest-pt_svm0-54666348 2026-02-02 03:13:42,441 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-76463308'] 2026-02-02 03:13:42,533 - INFO - Service template: ['default-domain', 'ctest-service_template_1-76463308'] deleted successfully. 2026-02-02 03:13:42,533 - INFO - Deleting VM ctest-right_vm-10023963 2026-02-02 03:13:42,675 - INFO - Deleting VM ctest-left_vm-38191228 2026-02-02 03:13:42,762 - INFO - Deleting VN ctest-trans_right_vn-07404491 2026-02-02 03:13:42,890 - DEBUG - Response for deleting network () 2026-02-02 03:13:42,890 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/df76d606-482a-4050-a26e-d64596e38b56 2026-02-02 03:13:42,895 - DEBUG - Response Code: 404 2026-02-02 03:13:42,896 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:42,901 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:42,923 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:43,004 - INFO - Validated that VN ctest-trans_right_vn-07404491 is not found in API Server 2026-02-02 03:13:43,017 - DEBUG - VN ctest-trans_right_vn-07404491 is not present in Agent 10.0.0.50 2026-02-02 03:13:43,029 - DEBUG - VN ctest-trans_right_vn-07404491 is not present in Agent 10.0.0.65 2026-02-02 03:13:43,029 - INFO - Validated that VN ctest-trans_right_vn-07404491 is not in any agent 2026-02-02 03:13:43,066 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-07404491 info 2026-02-02 03:13:43,067 - INFO - Deleting VN ctest-trans_left_vn-38432636 2026-02-02 03:13:43,117 - DEBUG - VN 368c057b-064b-4de8-a49e-a8f97aba7fd0 still in use: Unable to complete operation on network 368c057b-064b-4de8-a49e-a8f97aba7fd0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-588e4143-6c83-4815-81c2-9f1c5b79058d'] 2026-02-02 03:13:43,117 - WARNING - Deleting VN ctest-trans_left_vn-38432636 failed..Will retry 2026-02-02 03:13:45,268 - DEBUG - Response for deleting network () 2026-02-02 03:13:45,268 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/c52387eb-3019-4b0a-8353-dc9e6cb4044e 2026-02-02 03:13:45,280 - DEBUG - Response Code: 404 2026-02-02 03:13:45,280 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:45,287 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:45,342 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:45,422 - INFO - Validated that VN ctest-trans_left_vn-38432636 is not found in API Server 2026-02-02 03:13:45,435 - DEBUG - VN ctest-trans_left_vn-38432636 is not present in Agent 10.0.0.50 2026-02-02 03:13:45,448 - DEBUG - VN ctest-trans_left_vn-38432636 is not present in Agent 10.0.0.65 2026-02-02 03:13:45,448 - INFO - Validated that VN ctest-trans_left_vn-38432636 is not in any agent 2026-02-02 03:13:45,477 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-38432636 info 2026-02-02 03:13:45,477 - INFO - Deleting VN ctest-mgmt_vn-20696628 2026-02-02 03:13:45,623 - DEBUG - Response for deleting network () 2026-02-02 03:13:45,623 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/5ecac73e-99f4-49b2-9938-c6594d5b990a 2026-02-02 03:13:45,629 - DEBUG - Response Code: 404 2026-02-02 03:13:45,629 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:45,647 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:45,660 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:45,747 - INFO - Validated that VN ctest-mgmt_vn-20696628 is not found in API Server 2026-02-02 03:13:45,758 - DEBUG - VN ctest-mgmt_vn-20696628 is not present in Agent 10.0.0.50 2026-02-02 03:13:45,769 - DEBUG - VN ctest-mgmt_vn-20696628 is not present in Agent 10.0.0.65 2026-02-02 03:13:45,769 - INFO - Validated that VN ctest-mgmt_vn-20696628 is not in any agent 2026-02-02 03:13:45,799 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-20696628 info 2026-02-02 03:13:45,799 - INFO - Deleting VN ctest-right-48584776 2026-02-02 03:13:45,960 - DEBUG - Response for deleting network () 2026-02-02 03:13:45,960 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/72558ccc-fbed-4b89-895c-7d6732539951 2026-02-02 03:13:45,971 - DEBUG - Response Code: 404 2026-02-02 03:13:45,971 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:45,979 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:45,990 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:46,089 - INFO - Validated that VN ctest-right-48584776 is not found in API Server 2026-02-02 03:13:46,102 - DEBUG - VN ctest-right-48584776 is not present in Agent 10.0.0.50 2026-02-02 03:13:46,113 - DEBUG - VN ctest-right-48584776 is not present in Agent 10.0.0.65 2026-02-02 03:13:46,113 - INFO - Validated that VN ctest-right-48584776 is not in any agent 2026-02-02 03:13:46,141 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-48584776 info 2026-02-02 03:13:46,142 - INFO - Deleting VN ctest-left-71287863 2026-02-02 03:13:46,294 - DEBUG - Response for deleting network () 2026-02-02 03:13:46,294 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/a98b3cb7-bf2a-4e86-a44f-cbd1af17fcee 2026-02-02 03:13:46,305 - DEBUG - Response Code: 404 2026-02-02 03:13:46,305 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-02-02 03:13:46,311 - DEBUG - Requesting: http://10.0.0.141:8082/domain/4480bafd-5776-4d34-b387-df5887123349 2026-02-02 03:13:46,370 - DEBUG - Requesting: http://10.0.0.141:8082/project/b8b9cc59-1674-4629-a2fc-3fff57dca310 2026-02-02 03:13:46,452 - INFO - Validated that VN ctest-left-71287863 is not found in API Server 2026-02-02 03:13:46,467 - DEBUG - VN ctest-left-71287863 is not present in Agent 10.0.0.50 2026-02-02 03:13:46,477 - DEBUG - VN ctest-left-71287863 is not present in Agent 10.0.0.65 2026-02-02 03:13:46,477 - INFO - Validated that VN ctest-left-71287863 is not in any agent 2026-02-02 03:13:46,516 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-71287863 info 2026-02-02 03:13:47,787 - DEBUG - No XMPP flaps were noticed during the test 2026-02-02 03:13:47,787 - INFO -
2026-02-02 03:13:47,787 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:47]
2026-02-02 03:13:47,787 - INFO - -------------------------------------------------------------------------------- 2026-02-02 03:13:48,490 - INFO - Deleted project: ctest-TestSVCV2Mirror-75479911, ID : b8b9cc59-1674-4629-a2fc-3fff57dca310