2025-08-15 10:33:13,182 - INFO - Domain Default found not creating 2025-08-15 10:33:13,326 - INFO - Project ctest-TestSVCV2Mirror-38669862 not found, creating it 2025-08-15 10:33:13,860 - INFO - Created Project:ctest-TestSVCV2Mirror-38669862, ID : 107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:15,165 - INFO - ================================================================================ 2025-08-15 10:33:15,165 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-08-15 10:33:15,165 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-08-15 10:33:16,424 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.14': '1', '10.20.0.254': '1'}, '10.0.0.242': {'10.20.0.254': '0', '10.20.0.25': '1'}} with 2025-08-15 10:33:16,424 - INFO - Initial checks done. Running the testcase now 2025-08-15 10:33:16,424 - INFO - 2025-08-15 10:33:17,091 - DEBUG - Response for create_network : {'network': {'id': '3d91ac50-bd18-4181-acc7-4e188b88f567', 'name': 'ctest-left-75479507', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-left-75479507'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:33:17,423 - DEBUG - Response for create_subnet : {'subnet': {'id': '0b8b865d-d763-4ed0-8cd8-0a4aa8cbdf83', 'name': '', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'network_id': '3d91ac50-bd18-4181-acc7-4e188b88f567', 'ip_version': 4, 'cidr': '67.110.81.192/26', 'allocation_pools': [{'start': '67.110.81.194', 'end': '67.110.81.254'}], 'gateway_ip': '67.110.81.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.110.81.194', 'tags': [], 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a'}} 2025-08-15 10:33:17,442 - INFO - Created VN ctest-left-75479507 2025-08-15 10:33:17,452 - DEBUG - VN ctest-left-75479507 UUID is 3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:17,517 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:17,805 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:17,844 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:17,861 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:17,967 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:17,979 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:17,989 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/4d1896d8-9f80-43e2-b5f6-7bb540560d70 2025-08-15 10:33:17,996 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/4d1896d8-9f80-43e2-b5f6-7bb540560d70 2025-08-15 10:33:18,003 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/bfa43049-16d9-4f28-b700-5d4613f92a58 2025-08-15 10:33:18,009 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:33:18,009 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:18,017 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/4d1896d8-9f80-43e2-b5f6-7bb540560d70 2025-08-15 10:33:18,032 - INFO - Verified VN network id 15 for VN 3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:18,032 - INFO - Verifications in API Server for VN ctest-left-75479507 passed 2025-08-15 10:33:18,032 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:18,044 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/4d1896d8-9f80-43e2-b5f6-7bb540560d70 2025-08-15 10:33:18,052 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/4d1896d8-9f80-43e2-b5f6-7bb540560d70 2025-08-15 10:33:18,060 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/bfa43049-16d9-4f28-b700-5d4613f92a58 2025-08-15 10:33:18,077 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4436516570706493825', 'uuid-lslong': '12450005562216215911'}, 'enable': 'true', 'created': '2025-08-15T10:33:17', 'last-modified': '2025-08-15T10:33:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.717726'} 2025-08-15 10:33:18,084 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:33:18,090 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4436516570706493825', 'uuid-lslong': '12450005562216215911'}, 'enable': 'true', 'created': '2025-08-15T10:33:17', 'last-modified': '2025-08-15T10:33:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.722771'} 2025-08-15 10:33:18,097 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:33:18,102 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4436516570706493825', 'uuid-lslong': '12450005562216215911'}, 'enable': 'true', 'created': '2025-08-15T10:33:17', 'last-modified': '2025-08-15T10:33:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.748812'} 2025-08-15 10:33:18,108 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-15 10:33:18,108 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-75479507 passed 2025-08-15 10:33:18,109 - DEBUG - ====Verifying policy data for ctest-left-75479507 in API_Server ====== 2025-08-15 10:33:18,109 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:18,115 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:18,128 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:18,241 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d91ac50-bd18-4181-acc7-4e188b88f567 2025-08-15 10:33:18,253 - DEBUG - =>VN ctest-left-75479507 has no policy to be verified 2025-08-15 10:33:18,253 - DEBUG - Verifying the vn in opserver 2025-08-15 10:33:18,254 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507 virtual network link through opserver 10.0.0.50 2025-08-15 10:33:18,254 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:33:18,544 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:33:18,599 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507?flat'} 2025-08-15 10:33:18,599 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507 virtual network link through opserver 10.0.0.22 2025-08-15 10:33:18,600 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:33:18,890 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:33:18,996 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507?flat'} 2025-08-15 10:33:18,996 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507 virtual network link through opserver 10.0.0.19 2025-08-15 10:33:18,996 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:33:19,293 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:33:19,368 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507?flat'} 2025-08-15 10:33:19,369 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507 is found in opserver 2025-08-15 10:33:19,389 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:33:19,400 - DEBUG - VRF ids for VN ctest-left-75479507: {} 2025-08-15 10:33:19,699 - DEBUG - Response for create_network : {'network': {'id': 'ec9f10ff-c3f7-4ba7-8c92-26707d504635', 'name': 'ctest-right-02492291', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-right-02492291'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:33:19,980 - DEBUG - Response for create_subnet : {'subnet': {'id': '9e1cf89d-57c5-42ad-8c67-18fdc606539e', 'name': '', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'network_id': 'ec9f10ff-c3f7-4ba7-8c92-26707d504635', 'ip_version': 4, 'cidr': '68.106.187.64/26', 'allocation_pools': [{'start': '68.106.187.66', 'end': '68.106.187.126'}], 'gateway_ip': '68.106.187.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '68.106.187.66', 'tags': [], 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a'}} 2025-08-15 10:33:20,006 - INFO - Created VN ctest-right-02492291 2025-08-15 10:33:20,018 - DEBUG - VN ctest-right-02492291 UUID is ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,092 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:20,100 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:20,114 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:20,213 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,228 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,239 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/a5c6d786-2fef-4913-a230-9d364332c668 2025-08-15 10:33:20,248 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/a5c6d786-2fef-4913-a230-9d364332c668 2025-08-15 10:33:20,258 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/79a0be36-dff8-45fb-bcb6-1f086c5baf89 2025-08-15 10:33:20,265 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:33:20,265 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,274 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/a5c6d786-2fef-4913-a230-9d364332c668 2025-08-15 10:33:20,289 - INFO - Verified VN network id 16 for VN ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,289 - INFO - Verifications in API Server for VN ctest-right-02492291 passed 2025-08-15 10:33:20,290 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,301 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/a5c6d786-2fef-4913-a230-9d364332c668 2025-08-15 10:33:20,309 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/a5c6d786-2fef-4913-a230-9d364332c668 2025-08-15 10:33:20,315 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/79a0be36-dff8-45fb-bcb6-1f086c5baf89 2025-08-15 10:33:20,327 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17050365404938455975', 'uuid-lslong': '10129200776490272309'}, 'enable': 'true', 'created': '2025-08-15T10:33:19', 'last-modified': '2025-08-15T10:33:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407978'} 2025-08-15 10:33:20,333 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:33:20,339 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17050365404938455975', 'uuid-lslong': '10129200776490272309'}, 'enable': 'true', 'created': '2025-08-15T10:33:19', 'last-modified': '2025-08-15T10:33:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415597'} 2025-08-15 10:33:20,345 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:33:20,350 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17050365404938455975', 'uuid-lslong': '10129200776490272309'}, 'enable': 'true', 'created': '2025-08-15T10:33:19', 'last-modified': '2025-08-15T10:33:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433067'} 2025-08-15 10:33:20,356 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-15 10:33:20,356 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-02492291 passed 2025-08-15 10:33:20,357 - DEBUG - ====Verifying policy data for ctest-right-02492291 in API_Server ====== 2025-08-15 10:33:20,357 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:20,363 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:20,375 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:20,472 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/ec9f10ff-c3f7-4ba7-8c92-26707d504635 2025-08-15 10:33:20,492 - DEBUG - =>VN ctest-right-02492291 has no policy to be verified 2025-08-15 10:33:20,493 - DEBUG - Verifying the vn in opserver 2025-08-15 10:33:20,493 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291 virtual network link through opserver 10.0.0.50 2025-08-15 10:33:20,493 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:33:20,550 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291?flat'} 2025-08-15 10:33:20,550 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291 virtual network link through opserver 10.0.0.22 2025-08-15 10:33:20,550 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:33:20,605 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291?flat'} 2025-08-15 10:33:20,605 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291 virtual network link through opserver 10.0.0.19 2025-08-15 10:33:20,605 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:33:20,665 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291?flat'} 2025-08-15 10:33:20,665 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291 is found in opserver 2025-08-15 10:33:20,686 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:33:20,696 - DEBUG - VRF ids for VN ctest-right-02492291: {} 2025-08-15 10:33:20,961 - DEBUG - Response for create_network : {'network': {'id': '2d4a3b07-369b-463c-ba67-bcdd63bde8ef', 'name': 'ctest-mgmt_vn-73174779', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-mgmt_vn-73174779'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:33:21,232 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a26cd207-1d0f-48d6-ae58-96002f4177d5', 'name': '', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'network_id': '2d4a3b07-369b-463c-ba67-bcdd63bde8ef', 'ip_version': 4, 'cidr': '20.231.33.64/26', 'allocation_pools': [{'start': '20.231.33.66', 'end': '20.231.33.126'}], 'gateway_ip': '20.231.33.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.231.33.66', 'tags': [], 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a'}} 2025-08-15 10:33:21,258 - INFO - Created VN ctest-mgmt_vn-73174779 2025-08-15 10:33:21,273 - DEBUG - VN ctest-mgmt_vn-73174779 UUID is 2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,353 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:21,360 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:21,372 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:21,464 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,477 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,487 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/be16b8dd-dab4-4cb1-98a1-98dad669861f 2025-08-15 10:33:21,496 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/be16b8dd-dab4-4cb1-98a1-98dad669861f 2025-08-15 10:33:21,504 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/68a46fce-d4ae-4a8c-b6e0-ac5d2f05ea4b 2025-08-15 10:33:21,510 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-15 10:33:21,510 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,518 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/be16b8dd-dab4-4cb1-98a1-98dad669861f 2025-08-15 10:33:21,532 - INFO - Verified VN network id 17 for VN 2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,533 - INFO - Verifications in API Server for VN ctest-mgmt_vn-73174779 passed 2025-08-15 10:33:21,533 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,542 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/be16b8dd-dab4-4cb1-98a1-98dad669861f 2025-08-15 10:33:21,549 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/be16b8dd-dab4-4cb1-98a1-98dad669861f 2025-08-15 10:33:21,556 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/68a46fce-d4ae-4a8c-b6e0-ac5d2f05ea4b 2025-08-15 10:33:21,574 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3263485782150301244', 'uuid-lslong': '13431912072702978287'}, 'enable': 'true', 'created': '2025-08-15T10:33:20', 'last-modified': '2025-08-15T10:33:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401964'} 2025-08-15 10:33:21,580 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-15 10:33:21,586 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3263485782150301244', 'uuid-lslong': '13431912072702978287'}, 'enable': 'true', 'created': '2025-08-15T10:33:20', 'last-modified': '2025-08-15T10:33:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419106'} 2025-08-15 10:33:21,592 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-15 10:33:21,597 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3263485782150301244', 'uuid-lslong': '13431912072702978287'}, 'enable': 'true', 'created': '2025-08-15T10:33:20', 'last-modified': '2025-08-15T10:33:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425091'} 2025-08-15 10:33:21,603 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-15 10:33:21,603 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-73174779 passed 2025-08-15 10:33:21,603 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-73174779 in API_Server ====== 2025-08-15 10:33:21,603 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:21,610 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:21,638 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:21,745 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/2d4a3b07-369b-463c-ba67-bcdd63bde8ef 2025-08-15 10:33:21,754 - DEBUG - =>VN ctest-mgmt_vn-73174779 has no policy to be verified 2025-08-15 10:33:21,754 - DEBUG - Verifying the vn in opserver 2025-08-15 10:33:21,754 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779 virtual network link through opserver 10.0.0.50 2025-08-15 10:33:21,754 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:33:21,827 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779?flat'} 2025-08-15 10:33:21,827 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779 virtual network link through opserver 10.0.0.22 2025-08-15 10:33:21,827 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:33:21,897 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779?flat'} 2025-08-15 10:33:21,897 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779 virtual network link through opserver 10.0.0.19 2025-08-15 10:33:21,897 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:33:21,948 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779?flat'} 2025-08-15 10:33:21,949 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-mgmt_vn-73174779 is found in opserver 2025-08-15 10:33:21,969 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:33:21,980 - DEBUG - VRF ids for VN ctest-mgmt_vn-73174779: {} 2025-08-15 10:33:22,236 - DEBUG - Response for create_network : {'network': {'id': '3d5bf005-7975-4011-8d17-ba6391c95aad', 'name': 'ctest-trans_left_vn-82976241', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-trans_left_vn-82976241'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:33:22,483 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c999ff9e-4ec5-4aff-8a85-ae33189113c3', 'name': '', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'network_id': '3d5bf005-7975-4011-8d17-ba6391c95aad', 'ip_version': 4, 'cidr': '31.196.147.128/26', 'allocation_pools': [{'start': '31.196.147.130', 'end': '31.196.147.190'}], 'gateway_ip': '31.196.147.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.196.147.130', 'tags': [], 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a'}} 2025-08-15 10:33:22,504 - INFO - Created VN ctest-trans_left_vn-82976241 2025-08-15 10:33:22,514 - DEBUG - VN ctest-trans_left_vn-82976241 UUID is 3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,585 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:22,591 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:22,602 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:22,708 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,718 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,726 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3a7bc2d4-07c8-474f-addd-00da0cec2137 2025-08-15 10:33:22,732 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3a7bc2d4-07c8-474f-addd-00da0cec2137 2025-08-15 10:33:22,737 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/7e357b38-0b72-47f4-8e3d-8e360ee11452 2025-08-15 10:33:22,743 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-15 10:33:22,743 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,750 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3a7bc2d4-07c8-474f-addd-00da0cec2137 2025-08-15 10:33:22,763 - INFO - Verified VN network id 18 for VN 3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,764 - INFO - Verifications in API Server for VN ctest-trans_left_vn-82976241 passed 2025-08-15 10:33:22,764 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,772 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3a7bc2d4-07c8-474f-addd-00da0cec2137 2025-08-15 10:33:22,777 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3a7bc2d4-07c8-474f-addd-00da0cec2137 2025-08-15 10:33:22,784 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/7e357b38-0b72-47f4-8e3d-8e360ee11452 2025-08-15 10:33:22,795 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4421391365497503761', 'uuid-lslong': '10166799620622604973'}, 'enable': 'true', 'created': '2025-08-15T10:33:22', 'last-modified': '2025-08-15T10:33:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.371440'} 2025-08-15 10:33:22,802 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-15 10:33:22,807 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4421391365497503761', 'uuid-lslong': '10166799620622604973'}, 'enable': 'true', 'created': '2025-08-15T10:33:22', 'last-modified': '2025-08-15T10:33:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.375490'} 2025-08-15 10:33:22,813 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-15 10:33:22,817 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4421391365497503761', 'uuid-lslong': '10166799620622604973'}, 'enable': 'true', 'created': '2025-08-15T10:33:22', 'last-modified': '2025-08-15T10:33:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392388'} 2025-08-15 10:33:22,823 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-15 10:33:22,823 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-82976241 passed 2025-08-15 10:33:22,823 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-82976241 in API_Server ====== 2025-08-15 10:33:22,823 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:22,829 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:22,839 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:22,931 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/3d5bf005-7975-4011-8d17-ba6391c95aad 2025-08-15 10:33:22,943 - DEBUG - =>VN ctest-trans_left_vn-82976241 has no policy to be verified 2025-08-15 10:33:22,943 - DEBUG - Verifying the vn in opserver 2025-08-15 10:33:22,943 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 virtual network link through opserver 10.0.0.50 2025-08-15 10:33:22,943 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:33:22,979 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241?flat'} 2025-08-15 10:33:22,979 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 virtual network link through opserver 10.0.0.22 2025-08-15 10:33:22,979 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:33:22,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241?flat'} 2025-08-15 10:33:22,997 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 virtual network link through opserver 10.0.0.19 2025-08-15 10:33:22,997 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:33:23,010 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241?flat'} 2025-08-15 10:33:23,010 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is found in opserver 2025-08-15 10:33:23,030 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:33:23,039 - DEBUG - VRF ids for VN ctest-trans_left_vn-82976241: {} 2025-08-15 10:33:23,308 - DEBUG - Response for create_network : {'network': {'id': 'cb0d68f6-c335-4697-94bf-1262c7c7796f', 'name': 'ctest-trans_right_vn-21317944', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-trans_right_vn-21317944'], 'port_security_enabled': True, 'description': ''}} 2025-08-15 10:33:23,495 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c696ee68-f14e-4fe7-8fd0-362b7403b284', 'name': '', 'tenant_id': '107c13064d44428b8be3aa6ed8ef6b8a', 'network_id': 'cb0d68f6-c335-4697-94bf-1262c7c7796f', 'ip_version': 4, 'cidr': '64.91.127.64/26', 'allocation_pools': [{'start': '64.91.127.66', 'end': '64.91.127.126'}], 'gateway_ip': '64.91.127.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '64.91.127.66', 'tags': [], 'project_id': '107c13064d44428b8be3aa6ed8ef6b8a'}} 2025-08-15 10:33:23,527 - INFO - Created VN ctest-trans_right_vn-21317944 2025-08-15 10:33:23,538 - DEBUG - VN ctest-trans_right_vn-21317944 UUID is cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,609 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:23,615 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:23,626 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:23,725 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,737 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,746 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81c82218-0577-4ba8-98fd-cee11221b020 2025-08-15 10:33:23,754 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81c82218-0577-4ba8-98fd-cee11221b020 2025-08-15 10:33:23,761 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/888f0b42-918e-41d2-bc8a-e3ee0bcf550e 2025-08-15 10:33:23,767 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-15 10:33:23,767 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,776 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81c82218-0577-4ba8-98fd-cee11221b020 2025-08-15 10:33:23,790 - INFO - Verified VN network id 19 for VN cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,790 - INFO - Verifications in API Server for VN ctest-trans_right_vn-21317944 passed 2025-08-15 10:33:23,790 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,801 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81c82218-0577-4ba8-98fd-cee11221b020 2025-08-15 10:33:23,808 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81c82218-0577-4ba8-98fd-cee11221b020 2025-08-15 10:33:23,815 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/888f0b42-918e-41d2-bc8a-e3ee0bcf550e 2025-08-15 10:33:23,829 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14631466173442901655', 'uuid-lslong': '10718305853632903535'}, 'enable': 'true', 'created': '2025-08-15T10:33:23', 'last-modified': '2025-08-15T10:33:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376109'} 2025-08-15 10:33:23,840 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-15 10:33:23,845 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14631466173442901655', 'uuid-lslong': '10718305853632903535'}, 'enable': 'true', 'created': '2025-08-15T10:33:23', 'last-modified': '2025-08-15T10:33:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401312'} 2025-08-15 10:33:23,851 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-15 10:33:23,858 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-38669862', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14631466173442901655', 'uuid-lslong': '10718305853632903535'}, 'enable': 'true', 'created': '2025-08-15T10:33:23', 'last-modified': '2025-08-15T10:33:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.409469'} 2025-08-15 10:33:23,866 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-15 10:33:23,866 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-21317944 passed 2025-08-15 10:33:23,866 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-21317944 in API_Server ====== 2025-08-15 10:33:23,866 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:33:23,873 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:33:23,884 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:33:23,974 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/cb0d68f6-c335-4697-94bf-1262c7c7796f 2025-08-15 10:33:23,984 - DEBUG - =>VN ctest-trans_right_vn-21317944 has no policy to be verified 2025-08-15 10:33:23,984 - DEBUG - Verifying the vn in opserver 2025-08-15 10:33:23,984 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944 virtual network link through opserver 10.0.0.50 2025-08-15 10:33:23,984 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-15 10:33:24,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944?flat'} 2025-08-15 10:33:24,001 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944 virtual network link through opserver 10.0.0.22 2025-08-15 10:33:24,001 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-15 10:33:24,015 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944?flat'} 2025-08-15 10:33:24,015 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944 virtual network link through opserver 10.0.0.19 2025-08-15 10:33:24,015 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-15 10:33:24,028 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944?flat'} 2025-08-15 10:33:24,028 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_right_vn-21317944 is found in opserver 2025-08-15 10:33:24,052 - DEBUG - Do not have enough data to verify VN in agent 2025-08-15 10:33:24,061 - DEBUG - VRF ids for VN ctest-trans_right_vn-21317944: {} 2025-08-15 10:33:24,114 - DEBUG - Services list from nova: [, , , ] 2025-08-15 10:33:25,115 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3861-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3861-2) 2025-08-15 10:33:26,449 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3861-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3861-1) 2025-08-15 10:33:26,449 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-03439603'] 2025-08-15 10:33:26,804 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-03439603'] created succesfully 2025-08-15 10:33:28,340 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3861-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3861-2) 2025-08-15 10:33:28,340 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:33:28,660 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:33:28,692 - DEBUG - Response Code: 404 2025-08-15 10:33:30,693 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:33:30,704 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:33:30,783 - INFO - Waiting for VM ctest-pt_svm0-06621074 to be up.. 2025-08-15 10:33:30,864 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:33:30,864 - INFO - VM name : ctest-pt_svm0-06621074 2025-08-15 10:33:30,939 - DEBUG - VM ctest-pt_svm0-06621074 ID is 3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:33:30,965 - DEBUG - VM ctest-pt_svm0-06621074 launched on Node an-jenkins-deploy-platform-ansible-os-3861-2 2025-08-15 10:33:31,043 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:33:31,050 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:33:34,225 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-15 10:33:34,226 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:34,240 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:33:38,322 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-15 10:33:38,322 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:38,336 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:33:42,420 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-15 10:33:42,420 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:42,444 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:33:46,514 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-08-15 10:33:46,514 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:46,528 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:33:50,612 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-15 10:33:50,612 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:50,627 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:33:54,706 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-15 10:33:54,706 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:54,720 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:33:58,802 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-15 10:33:58,802 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:33:58,815 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:34:02,897 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-15 10:34:02,897 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:34:02,912 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:34:06,991 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-15 10:34:06,992 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:34:07,004 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:34:11,091 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-15 10:34:11,091 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 failed! 2025-08-15 10:34:11,105 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is 31.196.147.129 and allocation pool is NOT set 2025-08-15 10:34:13,169 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=8.01 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=5.59 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 5.586/6.796/8.007/1.210 ms') 2025-08-15 10:34:13,169 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 passed 2025-08-15 10:34:13,235 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:13,235 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-06621074, IP 31.196.147.131, Port 22 2025-08-15 10:34:13,290 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:34:13,363 - DEBUG - VM ctest-pt_svm0-06621074 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:34:18,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:18,364 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-06621074, IP 31.196.147.131, Port 22 2025-08-15 10:34:18,428 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:34:18,504 - DEBUG - VM ctest-pt_svm0-06621074 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:34:23,505 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:23,505 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-06621074, IP 31.196.147.131, Port 22 2025-08-15 10:34:23,572 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:34:23,647 - DEBUG - VM ctest-pt_svm0-06621074 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:34:28,648 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:28,648 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-06621074, IP 31.196.147.131, Port 22 2025-08-15 10:34:28,716 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-15 10:34:28,782 - DEBUG - VM ctest-pt_svm0-06621074 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-15 10:34:33,782 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:33,783 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-06621074, IP 31.196.147.131, Port 22 2025-08-15 10:34:33,952 - DEBUG - VM ctest-pt_svm0-06621074 is ready for SSH connections 2025-08-15 10:34:33,959 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-si-62618101'] 2025-08-15 10:34:34,443 - INFO - Waiting for VM ctest-left_vm-87097096 to be up.. 2025-08-15 10:34:34,544 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:34:34,544 - INFO - VM name : ctest-left_vm-87097096 2025-08-15 10:34:34,631 - DEBUG - VM ctest-left_vm-87097096 ID is c2a79934-96c8-47a2-89c9-d019377b3e24 2025-08-15 10:34:34,632 - DEBUG - VM ctest-left_vm-87097096 launched on Node an-jenkins-deploy-platform-ansible-os-3861-2 2025-08-15 10:34:34,749 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/c2a79934-96c8-47a2-89c9-d019377b3e24 2025-08-15 10:34:34,758 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/242bda89-c2a7-4498-9c23-c6ee05aacf20 2025-08-15 10:34:35,913 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.69 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.88 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.691/1.783/1.876/0.092 ms') 2025-08-15 10:34:35,913 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-87097096 passed 2025-08-15 10:34:35,980 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:35,980 - DEBUG - Waiting to SSH to VM ctest-left_vm-87097096, IP 67.110.81.195, Port 22 2025-08-15 10:34:36,143 - DEBUG - VM ctest-left_vm-87097096 is ready for SSH connections 2025-08-15 10:34:36,143 - INFO - Waiting for VM ctest-right_vm-44124882 to be up.. 2025-08-15 10:34:36,237 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:34:36,237 - INFO - VM name : ctest-right_vm-44124882 2025-08-15 10:34:36,311 - DEBUG - VM ctest-right_vm-44124882 ID is c385100d-17d0-4f88-92bd-160cdf070a0d 2025-08-15 10:34:36,311 - DEBUG - VM ctest-right_vm-44124882 launched on Node an-jenkins-deploy-platform-ansible-os-3861-1 2025-08-15 10:34:36,380 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/c385100d-17d0-4f88-92bd-160cdf070a0d 2025-08-15 10:34:36,388 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/0c8a2a34-7d7e-462f-83e0-39a525396987 2025-08-15 10:34:37,545 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.50 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.30 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.301/4.400/6.500/2.099 ms') 2025-08-15 10:34:37,546 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-44124882 passed 2025-08-15 10:34:37,611 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:37,611 - DEBUG - Waiting to SSH to VM ctest-right_vm-44124882, IP 68.106.187.67, Port 22 2025-08-15 10:34:37,778 - DEBUG - VM ctest-right_vm-44124882 is ready for SSH connections 2025-08-15 10:34:37,783 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-si-62618101, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-15 10:34:38,102 - INFO - Attaching policy ctest-policy-03385632 to vn ctest-left-75479507 2025-08-15 10:34:38,466 - INFO - Attaching policy ctest-policy-03385632 to vn ctest-right-02492291 2025-08-15 10:34:38,797 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-03439603'] created succesfully 2025-08-15 10:34:39,004 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-si-62618101'] created succesfully 2025-08-15 10:34:39,004 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:34:39,010 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:34:39,023 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:34:39,115 - DEBUG - Requesting: http://10.0.0.50:8082/service-instance/bd9c6930-4c1f-47ce-a7ef-4c08b5d29b3f 2025-08-15 10:34:39,123 - DEBUG - SI 'ctest-si-62618101' has service template ref to ctest-service_template_1-03439603 2025-08-15 10:34:39,123 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:34:39,128 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:34:39,138 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:34:39,228 - DEBUG - Requesting: http://10.0.0.50:8082/service-instance/bd9c6930-4c1f-47ce-a7ef-4c08b5d29b3f 2025-08-15 10:34:39,235 - DEBUG - Requesting: http://10.0.0.50:8082/port-tuple/4fcaef47-0db6-4167-ad56-ed68feab21a1 2025-08-15 10:34:39,241 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:34:39,402 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:34:39,594 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:34:39,600 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:34:39,608 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/3d056caa-7f7a-4e6b-af76-dd1a28aa06e6 2025-08-15 10:34:39,616 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/576adffa-caf1-4336-babf-5a16113dc0e5 2025-08-15 10:34:39,622 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/88421e70-0162-42d8-ae24-85a29746a34c 2025-08-15 10:34:39,765 - DEBUG - VM is in ACTIVE state now 2025-08-15 10:34:39,765 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:34:39,772 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:34:40,909 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=3.10 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=3.25 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.100/3.176/3.252/0.076 ms') 2025-08-15 10:34:40,909 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-06621074 passed 2025-08-15 10:34:40,938 - DEBUG - VM ctest-pt_svm0-06621074 Tap interface: {'index': '4', 'name': 'tap9cbdc776-21', 'uuid': '9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241:ctest-trans_left_vn-82976241', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'vm_uuid': '3ee29fae-f01f-43c5-83eb-7b6573f6eb3d', 'vm_name': 'ctest-pt_svm0-06621074', 'ip_addr': '31.196.147.131', 'mac_addr': '02:9c:bd:c7:76:21', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '95', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-38669862:9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3', 'sg_uuid_list': ['0054e983-1d30-44f8-9d0b-6307b4376686'], 'static_route_list': None, 'vm_project_uuid': '107c1306-4d44-428b-8be3-aa6ed8ef6b8a', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-15 10:34:40,938 - DEBUG - Agent 10.0.0.242 vrf name: default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241:ctest-trans_left_vn-82976241 2025-08-15 10:34:40,944 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241:ctest-trans_left_vn-82976241', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'table_label': '-1', 'vxlan_id': '18', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.18:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-15 10:34:41,028 - DEBUG - VM ctest-pt_svm0-06621074 : Tap interface tap9cbdc776-21 is set to Active 2025-08-15 10:34:41,029 - DEBUG - Tap interface tap9cbdc776-21 detail : {'index': '4', 'name': 'tap9cbdc776-21', 'uuid': '9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241:ctest-trans_left_vn-82976241', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241', 'vm_uuid': '3ee29fae-f01f-43c5-83eb-7b6573f6eb3d', 'vm_name': 'ctest-pt_svm0-06621074', 'ip_addr': '31.196.147.131', 'mac_addr': '02:9c:bd:c7:76:21', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '95', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-38669862:9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3', 'sg_uuid_list': ['0054e983-1d30-44f8-9d0b-6307b4376686'], 'static_route_list': None, 'vm_project_uuid': '107c1306-4d44-428b-8be3-aa6ed8ef6b8a', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-15 10:34:41,136 - DEBUG - Starting Layer 2 verification in Agent 2025-08-15 10:34:41,146 - DEBUG - Layer 2 path is seen for VM MAC 02:9c:bd:c7:76:21 in agent 10.0.0.242 2025-08-15 10:34:41,146 - DEBUG - Active layer 2 route in agent is present for VMI tap9cbdc776-21 2025-08-15 10:34:41,146 - DEBUG - L2 label(35) matches bw route table and interface table 2025-08-15 10:34:41,157 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is found in Agent of node 10.0.0.242 2025-08-15 10:34:41,285 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 is consistent in agent 10.0.0.242 2025-08-15 10:34:41,285 - DEBUG - Route for VM IP ['31.196.147.131'] is consistent in agent 10.0.0.242 2025-08-15 10:34:41,285 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-trans_left_vn-82976241 verification for VM ctest-pt_svm0-06621074 in Agent 10.0.0.242 passed 2025-08-15 10:34:41,392 - DEBUG - Starting all layer 2 verification in agent 10.0.0.242 2025-08-15 10:34:41,401 - DEBUG - Route for VM MAC 02:9c:bd:c7:76:21 is consistent in agent 10.0.0.242 2025-08-15 10:34:41,401 - INFO - VM ctest-pt_svm0-06621074 verifications in Compute nodes passed 2025-08-15 10:34:41,402 - DEBUG - The SVMs in the SI are : [] 2025-08-15 10:34:41,402 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:34:41,410 - DEBUG - Service VM for SI 'ctest-si-62618101' is launched 2025-08-15 10:34:41,410 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:34:41,415 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:34:41,426 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:34:41,513 - DEBUG - Requesting: http://10.0.0.50:8082/service-instance/bd9c6930-4c1f-47ce-a7ef-4c08b5d29b3f 2025-08-15 10:34:41,520 - DEBUG - SI ctest-si-62618101 has Port Tuple: ['ctest-port_tuple-76909092'] 2025-08-15 10:34:41,580 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507 2025-08-15 10:34:41,687 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291 2025-08-15 10:34:41,688 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:41,688 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:34:41,688 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.106.187.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-15 10:34:41,688 - DEBUG - ping -s 56 -c 3 -W 1 68.106.187.67 2025-08-15 10:35:24,296 - DEBUG - PING 68.106.187.67 (68.106.187.67) 56(84) bytes of data. 64 bytes from 68.106.187.67: icmp_req=1 ttl=63 time=10.6 ms 64 bytes from 68.106.187.67: icmp_req=2 ttl=63 time=1.37 ms 64 bytes from 68.106.187.67: icmp_req=3 ttl=63 time=1.16 ms --- 68.106.187.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.167/4.409/10.683/4.437 ms 2025-08-15 10:35:24,296 - INFO - Ping to IP 68.106.187.67 from VM ctest-left_vm-87097096 passed 2025-08-15 10:35:24,303 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-si-62618101, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-left-75479507, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-right-02492291, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-38669862:ctest-si-62618101, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-15 10:35:24,370 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-15 10:35:24,370 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:24,388 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:24,410 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:24,495 - DEBUG - Requesting: http://10.0.0.50:8082/service-instance/bd9c6930-4c1f-47ce-a7ef-4c08b5d29b3f 2025-08-15 10:35:24,503 - DEBUG - Requesting: http://10.0.0.50:8082/port-tuple/4fcaef47-0db6-4167-ad56-ed68feab21a1 2025-08-15 10:35:24,510 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:35:24,666 - DEBUG - Executing command: rm -f /tmp/mirror-tap9cbdc776-21_ctest-random-27787814.pcap 2025-08-15 10:35:35,048 - INFO - Starting tcpdump to capture the mirrored packets. 2025-08-15 10:35:35,048 - DEBUG - Executing command: sudo tcpdump -ni tap9cbdc776-21 -U udp port 8099 -w /tmp/mirror-tap9cbdc776-21_ctest-random-27787814.pcap 2025-08-15 10:35:45,078 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 68.106.187.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123 2025-08-15 10:35:45,078 - DEBUG - ping -s 56 -c 3 -W 1 68.106.187.67 2025-08-15 10:35:47,524 - DEBUG - PING 68.106.187.67 (68.106.187.67) 56(84) bytes of data. 64 bytes from 68.106.187.67: icmp_req=1 ttl=63 time=3.67 ms 64 bytes from 68.106.187.67: icmp_req=2 ttl=63 time=1.09 ms 64 bytes from 68.106.187.67: icmp_req=3 ttl=63 time=1.14 ms --- 68.106.187.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.094/1.970/3.670/1.202 ms 2025-08-15 10:35:47,524 - INFO - Ping to IP 68.106.187.67 from VM ctest-left_vm-87097096 passed 2025-08-15 10:35:47,524 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:47,532 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:47,542 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:47,633 - DEBUG - Requesting: http://10.0.0.50:8082/service-instance/bd9c6930-4c1f-47ce-a7ef-4c08b5d29b3f 2025-08-15 10:35:47,647 - DEBUG - Requesting: http://10.0.0.50:8082/port-tuple/4fcaef47-0db6-4167-ad56-ed68feab21a1 2025-08-15 10:35:47,655 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/9cbdc776-21c8-42ad-a5b8-66bb3a67c2a3 2025-08-15 10:35:47,746 - DEBUG - Waiting for the tcpdump write to complete. 2025-08-15 10:35:49,747 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap9cbdc776-21_ctest-random-27787814.pcap| awk '{print $2}') 2025-08-15 10:35:49,749 - DEBUG - Executing command: sync 2025-08-15 10:35:52,770 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap9cbdc776-21_ctest-random-27787814.pcap | wc -l 2025-08-15 10:35:52,785 - DEBUG - STDOUT: 12 2025-08-15 10:35:52,785 - DEBUG - STDERR: reading from file /tmp/mirror-tap9cbdc776-21_ctest-random-27787814.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-08-15 10:35:52,785 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap9cbdc776-21_ctest-random-27787814.pcap 2025-08-15 10:35:52,828 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-06621074' 2025-08-15 10:35:52,828 - INFO - Dettaching policy ctest-policy-03385632 from vn ctest-right-02492291 2025-08-15 10:35:52,978 - INFO - Dettaching policy ctest-policy-03385632 from vn ctest-left-75479507 2025-08-15 10:35:53,193 - INFO - Deleted policy ctest-policy-03385632 2025-08-15 10:35:53,193 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-si-62618101'] 2025-08-15 10:35:53,284 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-38669862', 'ctest-si-62618101'] 2025-08-15 10:35:53,285 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:53,294 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:53,309 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:53,416 - DEBUG - Service instance ctest-si-62618101 removed from api server 2025-08-15 10:35:53,416 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/3ee29fae-f01f-43c5-83eb-7b6573f6eb3d 2025-08-15 10:35:53,426 - DEBUG - All Service VMs unlinked from SI ctest-si-62618101 2025-08-15 10:35:53,450 - DEBUG - 0 svc intances found in all projects. They are [] 2025-08-15 10:35:53,450 - DEBUG - 0 svc intances found in current project. They are [] 2025-08-15 10:35:53,499 - DEBUG - 0 svc intances found in all projects. They are [] 2025-08-15 10:35:53,500 - DEBUG - 0 svc intances found in current project. They are [] 2025-08-15 10:35:53,500 - INFO - Deleting VM ctest-pt_svm0-06621074 2025-08-15 10:35:53,647 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-03439603'] 2025-08-15 10:35:53,747 - INFO - Service template: ['default-domain', 'ctest-service_template_1-03439603'] deleted successfully. 2025-08-15 10:35:53,748 - INFO - Deleting VM ctest-right_vm-44124882 2025-08-15 10:35:53,852 - INFO - Deleting VM ctest-left_vm-87097096 2025-08-15 10:35:53,919 - INFO - Deleting VN ctest-trans_right_vn-21317944 2025-08-15 10:35:54,073 - DEBUG - Response for deleting network () 2025-08-15 10:35:54,073 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/81c82218-0577-4ba8-98fd-cee11221b020 2025-08-15 10:35:54,078 - DEBUG - Response Code: 404 2025-08-15 10:35:54,079 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:54,084 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:54,111 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:54,224 - INFO - Validated that VN ctest-trans_right_vn-21317944 is not found in API Server 2025-08-15 10:35:54,236 - DEBUG - VN ctest-trans_right_vn-21317944 is not present in Agent 10.0.0.241 2025-08-15 10:35:54,245 - DEBUG - VN ctest-trans_right_vn-21317944 is not present in Agent 10.0.0.242 2025-08-15 10:35:54,245 - INFO - Validated that VN ctest-trans_right_vn-21317944 is not in any agent 2025-08-15 10:35:54,292 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-21317944 info 2025-08-15 10:35:54,292 - INFO - Deleting VN ctest-trans_left_vn-82976241 2025-08-15 10:35:54,341 - DEBUG - VN 3d5bf005-7975-4011-8d17-ba6391c95aad still in use: Unable to complete operation on network 3d5bf005-7975-4011-8d17-ba6391c95aad. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2b85d071-c83f-42fb-a0d5-f7c7c17f4a6d'] 2025-08-15 10:35:54,342 - WARNING - Deleting VN ctest-trans_left_vn-82976241 failed..Will retry 2025-08-15 10:35:56,466 - DEBUG - Response for deleting network () 2025-08-15 10:35:56,466 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/3a7bc2d4-07c8-474f-addd-00da0cec2137 2025-08-15 10:35:56,472 - DEBUG - Response Code: 404 2025-08-15 10:35:56,472 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:56,477 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:56,544 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:56,629 - INFO - Validated that VN ctest-trans_left_vn-82976241 is not found in API Server 2025-08-15 10:35:56,640 - DEBUG - VN ctest-trans_left_vn-82976241 is not present in Agent 10.0.0.241 2025-08-15 10:35:56,649 - DEBUG - VN ctest-trans_left_vn-82976241 is not present in Agent 10.0.0.242 2025-08-15 10:35:56,649 - INFO - Validated that VN ctest-trans_left_vn-82976241 is not in any agent 2025-08-15 10:35:56,677 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-82976241 info 2025-08-15 10:35:56,677 - INFO - Deleting VN ctest-mgmt_vn-73174779 2025-08-15 10:35:56,817 - DEBUG - Response for deleting network () 2025-08-15 10:35:56,817 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/be16b8dd-dab4-4cb1-98a1-98dad669861f 2025-08-15 10:35:56,826 - DEBUG - Response Code: 404 2025-08-15 10:35:56,826 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:56,837 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:56,850 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:56,945 - INFO - Validated that VN ctest-mgmt_vn-73174779 is not found in API Server 2025-08-15 10:35:56,955 - DEBUG - VN ctest-mgmt_vn-73174779 is not present in Agent 10.0.0.241 2025-08-15 10:35:56,964 - DEBUG - VN ctest-mgmt_vn-73174779 is not present in Agent 10.0.0.242 2025-08-15 10:35:56,964 - INFO - Validated that VN ctest-mgmt_vn-73174779 is not in any agent 2025-08-15 10:35:56,992 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-73174779 info 2025-08-15 10:35:56,992 - INFO - Deleting VN ctest-right-02492291 2025-08-15 10:35:57,182 - DEBUG - Response for deleting network () 2025-08-15 10:35:57,182 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/a5c6d786-2fef-4913-a230-9d364332c668 2025-08-15 10:35:57,188 - DEBUG - Response Code: 404 2025-08-15 10:35:57,188 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:57,193 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:57,203 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:57,296 - INFO - Validated that VN ctest-right-02492291 is not found in API Server 2025-08-15 10:35:57,307 - DEBUG - VN ctest-right-02492291 is not present in Agent 10.0.0.241 2025-08-15 10:35:57,317 - DEBUG - VN ctest-right-02492291 is not present in Agent 10.0.0.242 2025-08-15 10:35:57,317 - INFO - Validated that VN ctest-right-02492291 is not in any agent 2025-08-15 10:35:57,346 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-02492291 info 2025-08-15 10:35:57,347 - INFO - Deleting VN ctest-left-75479507 2025-08-15 10:35:57,498 - DEBUG - Response for deleting network () 2025-08-15 10:35:57,498 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/4d1896d8-9f80-43e2-b5f6-7bb540560d70 2025-08-15 10:35:57,502 - DEBUG - Response Code: 404 2025-08-15 10:35:57,503 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-08-15 10:35:57,511 - DEBUG - Requesting: http://10.0.0.50:8082/domain/4d954f05-13b9-4014-b839-289a92604c21 2025-08-15 10:35:57,564 - DEBUG - Requesting: http://10.0.0.50:8082/project/107c1306-4d44-428b-8be3-aa6ed8ef6b8a 2025-08-15 10:35:57,653 - INFO - Validated that VN ctest-left-75479507 is not found in API Server 2025-08-15 10:35:57,663 - DEBUG - VN ctest-left-75479507 is not present in Agent 10.0.0.241 2025-08-15 10:35:57,673 - DEBUG - VN ctest-left-75479507 is not present in Agent 10.0.0.242 2025-08-15 10:35:57,673 - INFO - Validated that VN ctest-left-75479507 is not in any agent 2025-08-15 10:35:57,702 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-75479507 info 2025-08-15 10:35:58,967 - DEBUG - No XMPP flaps were noticed during the test 2025-08-15 10:35:58,967 - INFO -

2025-08-15 10:35:58,967 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:43]

2025-08-15 10:35:58,967 - INFO - -------------------------------------------------------------------------------- 2025-08-15 10:35:59,635 - INFO - Deleted project: ctest-TestSVCV2Mirror-38669862, ID : 107c1306-4d44-428b-8be3-aa6ed8ef6b8a